Image capturing method and terminal device

Abstract

An image capturing method and a terminal device, which are used for increasing the definition of a wide-angle image. For example, the terminal device comprises a wide-angle camera and a telephoto camera. The method comprises: after a terminal device starts a camera application, displaying a first capturing interface, wherein the first capturing interface comprises a first preview image collected by means of a wide-angle camera; in response to a capturing instruction, capturing a first image by means of the wide-angle camera; displaying a second capturing interface, wherein the second capturing interface comprises a main preview area and an auxiliary preview area, a second preview image collected by means of a telephoto camera is displayed in the main preview area, the second preview image corresponds to a first area in the first image, the first image is displayed in the auxiliary preview area, and the first area on the first image is highlighted; in response to a scanning start instruction, by means of the telephoto camera, capturing a second image corresponding to the first area; and in response to a scanning end instruction, displaying a third image obtained by means of fusing the second image and the first image.

Description

An image capturing method and terminal device

[0001] Cross-references to related applications

[0002] This application claims priority to Chinese Patent Application No. 202410578734.1, filed on May 10, 2024, entitled "An Image Capture Method and Terminal Device", the entire contents of which are incorporated herein by reference. Technical Field

[0003] This application relates to the field of terminal technology, and in particular to an image capturing method and terminal device. Background Technology

[0004] With technological advancements, mobile phone camera capabilities have continuously improved. For example, mobile phones are equipped with wide-angle cameras, which can be used to capture large scenes (such as group photos). However, while wide-angle cameras capture images with a wide field of view, their clarity is low, making it difficult for users to clearly see details in the image, thus affecting the shooting experience. Summary of the Invention

[0005] This application provides an image capturing method and terminal device that can improve the clarity of wide-angle images and enhance image capturing quality.

[0006] Firstly, an image capturing method is provided, applied to a terminal device, which includes a wide-angle camera and a telephoto camera. In this method: the terminal device launches a camera application and displays a first capturing interface, which includes a first preview image, which is an image captured by the wide-angle camera; in response to a capturing command, the wide-angle camera captures the first image; a second capturing interface is displayed, wherein the second capturing interface includes a main preview area and an auxiliary preview area, the main preview area displays a second preview image, which is an image captured by the telephoto camera, and the second preview image corresponds to a first region in the first image; the auxiliary preview area displays the first image, and the first region is highlighted on the first image; in response to a start scanning command, the telephoto camera captures a second image, which corresponds to the first region; in response to a stop scanning command, a third image is displayed, wherein the third image is obtained by fusing the second image and the first image.

[0007] In this embodiment, the terminal device can capture a first image using a wide-angle camera and a second image using a telephoto camera. The second image is then used to compensate for the details of the first image, improving its clarity. Furthermore, after capturing the first image, the terminal device can display it in a picture-in-picture format (i.e., a main preview area and an auxiliary preview area) on the telephoto camera's preview image, highlighting the area currently being scanned by the telephoto camera (or the current shooting area). This prompts the user to identify which area of ​​the wide-angle image (i.e., the first image) the telephoto camera is currently scanning, enhancing the user's shooting experience.

[0008] In one possible design, before displaying the first shooting interface, the method further includes: receiving a first input operation and entering a first mode.

[0009] In this embodiment, if a user wants to use the camera application to capture a high-resolution wide-angle image, they can trigger the camera application to enter the first mode, so that the camera application uses the image capturing method provided in this embodiment to capture a high-resolution wide-angle image. Of course, if the user does not want to use the first mode, they can exit the first mode, resulting in a better user experience.

[0010] In one possible design, before displaying the first shooting interface, the method further includes: displaying a third shooting interface, wherein the third shooting interface includes a third preview image, the third preview image being an image captured by a camera other than the wide-angle camera; and when it is determined that the third preview image contains preset objects and the number of preset objects reaches a preset number, entering the first mode.

[0011] In this embodiment, after the camera application on the terminal device is launched, other cameras may be launched first. If the third preview image captured by the other cameras contains a large number of preset objects, it can automatically enter the first mode, so that the camera application can use the image shooting method provided in this embodiment to take pictures and obtain a wide-angle image with high clarity. This automatic entry into the first mode is convenient and efficient.

[0012] In one possible design, before entering the first mode, the method further includes: outputting a first prompt message, wherein the first prompt message is used to prompt entry into the first mode.

[0013] In this embodiment, the terminal device can prompt the user to use the first mode for shooting, which provides some guidance to the user because the user may not be aware that the camera application has a first mode, resulting in a better user experience.

[0014] In one possible design, after entering the first mode, the method further includes: outputting a second prompt message, wherein the second prompt message is used to indicate that the first mode has been entered.

[0015] In this embodiment of the application, after entering the first mode, the terminal device can provide feedback to the user that the first mode has been successfully entered, thereby improving the user experience.

[0016] In one possible design, after capturing a first image using the wide-angle camera in response to a shooting command, the method further includes: receiving a return operation to return to the first shooting interface; and re-capturing the first image using the wide-angle camera in response to a shooting command.

[0017] In this embodiment of the application, if the user is not satisfied with the first image captured by the wide-angle camera, they can go back and retake the image to ensure that the user captures a satisfactory image.

[0018] In one possible design, the method further includes: the position and / or area of ​​the first region on the first image varies with the shooting range of the telephoto camera.

[0019] In this embodiment of the application, after the terminal device captures the first image through the wide-angle camera, it displays the first image in a picture-in-picture manner on the preview image of the telephoto camera, and highlights the current scanning area of ​​the telephoto camera on the first image. Moreover, as the shooting range of the telephoto camera changes, the current scanning area of ​​the telephoto camera in the picture-in-picture changes accordingly, so as to prompt the user which area of ​​the first image the telephoto camera is currently scanning.

[0020] In one possible design, the step of capturing a second image via the telephoto camera in response to a start scanning command includes: capturing the second image via the telephoto camera when the stability duration of the terminal device reaches a preset duration or a shooting command is received in response to the start scanning command.

[0021] In this embodiment of the application, when the terminal device uses a telephoto camera to scan, if it is determined that the stable duration of the terminal device is greater than the preset duration or a shooting command is received, an image is captured by the telephoto camera to avoid blurry images caused by the instability of the terminal device.

[0022] In one possible design, highlighting the first area includes: displaying the first area in a first display mode, the first display mode including: outlining it with a dashed box, and / or filling it with a first color.

[0023] In this embodiment of the application, after the terminal device captures the first image through the wide-angle camera, it displays the first image in a picture-in-picture manner on the preview image of the telephoto camera, and highlights the current scanning area of ​​the telephoto camera on the first image. For example, the telephoto camera can be circled with a dashed frame and / or filled with a first color on the first image to prompt the user about the current scanning area of ​​the telephoto camera.

[0024] In one possible design, after capturing a second image via the telephoto camera in response to a start scanning command, the method further includes: changing the first region on the first image within the auxiliary preview area from the first display mode to the second display mode.

[0025] In this embodiment, when the terminal device finishes scanning a certain area using a telephoto camera, the display method of that area on the first image within the picture-in-picture changes to indicate to the user that the area has been scanned, resulting in a better interactive experience.

[0026] In one possible design, the second display method includes: using a solid line frame and / or filling with a second color.

[0027] In this embodiment of the application, when the terminal device scans a certain area using a telephoto camera, the display method of that area on the first image in the picture-in-picture changes. For example, the area is changed from being outlined with a dashed frame to being outlined with a solid frame, or the area is changed from being filled with a first color to being filled with a second color, so as to prompt the user that the area has been scanned, resulting in a better interactive experience.

[0028] In one possible design, after capturing the second image using the telephoto camera, the method further includes: moving the terminal device to capture a fourth image using the telephoto camera, wherein the fourth image corresponds to a second region within the first image; and displaying a fifth image in response to an end-scan command, wherein the fifth image is a fusion of the first image, the second image, and the fourth image.

[0029] In this embodiment of the application, after the terminal device captures the first image with a wide-angle camera, it can scan different areas on the first image with a telephoto camera, for example, scanning both the first and second areas to capture a second and a fourth image. The second and fourth images are then used to perform detail compensation on the first image to improve the clarity of the first image.

[0030] In one possible design, before capturing the fourth image using the telephoto camera, the method further includes: displaying a fourth preview image in the main preview area, the fourth preview image being an image captured by the telephoto camera, the fourth preview image corresponding to the second area, and highlighting the second area in the auxiliary preview area using a third display mode; after capturing the fourth image using the telephoto camera, the method further includes: changing the second area in the auxiliary preview area from the third display mode to the fourth display mode.

[0031] In this embodiment, after the terminal device captures a first image using a wide-angle camera, it can scan a first region on the first image using a telephoto camera and highlight the first region in the first image using a picture-in-picture method. If a second region is scanned using the telephoto camera, the second region is highlighted in the picture-in-picture mode. Moreover, after the second region is scanned, the display mode of the second region changes to prompt the user that the scan of the region is complete, thereby improving the user experience.

[0032] In one possible design, before displaying the third image, the method further includes: outputting a third prompt message, wherein the third prompt message is used to indicate that image fusion is in progress.

[0033] In this embodiment, the terminal device can display a fusion prompt message in response to the end scanning command, prompting the user to wait, which provides a better user experience.

[0034] In one possible design, before displaying the second shooting interface, the method further includes: determining a region to be scanned within the first image, wherein the region to be scanned is a default region, a user-specified region, or a region containing a preset object on the first image; displaying the first image within the auxiliary preview area, and highlighting the region to be scanned within the first image using a fifth display mode, wherein the first region is located within the region to be scanned.

[0035] In this embodiment, after the terminal device captures a first image using a wide-angle camera, it can determine the area to be scanned on the first image and highlight the area to be scanned in a picture-in-picture format to prompt the user to scan the area to be scanned using a telephoto camera. This eliminates the need to scan the entire first image and reduces shooting latency.

[0036] In one possible design, the third image is obtained by fusing the second image and the first image, including: determining the first RGB information of a first pixel on the first image; determining the second RGB information of a second pixel on the second image, wherein the second pixel corresponds to the first pixel; determining third RGB information based on the first RGB information and the second RGB information; and replacing the first RGB information of the first pixel on the first image with the third RGB information.

[0037] In this embodiment of the application, when the second image is used to perform detail compensation on the first image, pixel-level detail compensation can be performed. If the first image is a human image, this compensation method will not change the posture, action, expression, etc. of the human in the first image, thus improving the image quality.

[0038] In one possible design, before displaying the third image, the method further includes: sending the first image and the second image to a server, the server being used to fuse the first image and the second image to obtain a third image; and receiving the third image from the server.

[0039] In this embodiment, the terminal device can upload images captured by a wide-angle camera and a telephoto camera to a server. The server then performs image fusion and returns the fused image to the terminal device for storage and / or display. This saves the terminal device's computing power and avoids lag caused by excessive computing power.

[0040] Secondly, an image processing method is also provided, applied to a server. The method includes: receiving a first image and a second image from a terminal device, the second image corresponding to a first region on the first image; determining first RGB information of a first pixel point within the first region; determining second RGB information of a second pixel point on the second image, the second pixel point corresponding to the first pixel point; determining third RGB information based on the first RGB information and the second RGB information; replacing the first RGB information of the first pixel point on the first image with the third RGB information to obtain a third image; and sending the third image to the terminal device.

[0041] In this embodiment of the application, the server can help the terminal device perform image fusion. Moreover, when performing image fusion, the second image is used to compensate for the details of the first image, which can achieve pixel-level detail compensation. If the first image is a human image, this compensation method will not change the posture, action, expression, etc. of the human in the first image, thus improving the image quality.

[0042] In one possible design, the second image includes a person object. Before replacing the first RGB information of the first pixel in the first image with the third RGB information to obtain the third image, the method further includes: extracting first feature information from the second image; extracting second feature information from a first region in the first image; and performing person identity matching based on the first feature information and the second feature information.

[0043] In one possible design, before replacing the first RGB information of the first pixel in the first image with the third RGB information to obtain the third image, the method further includes: performing image registration between the first image and the second image.

[0044] Thirdly, a terminal device is also provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the method described in the first aspect above.

[0045] Fourthly, a terminal device is also provided, including a module / unit for executing the method corresponding to any of the designs in the first aspect above. These modules / units can be implemented in hardware or by hardware executing corresponding software.

[0046] Fifthly, a server is also provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor, when executing the computer program, implements the method described in the second aspect above.

[0047] Sixthly, a server is also provided, including modules / units for executing the methods corresponding to any of the designs in the second aspect above. These modules / units can be implemented in hardware or by executing corresponding software in hardware.

[0048] In a seventh aspect, a chip is also provided, including a processor and an interface; the processor is configured to read instructions via the interface to execute the method described in the first or second aspect above.

[0049] Eighthly, a chip system is also provided, the chip system including a processing circuit and a storage medium, the storage medium storing instructions; when the instructions are executed by the processing circuit, they implement the method as described in the first or second aspect above.

[0050] Ninthly, a communication system is also provided, comprising:

[0051] A terminal device for performing the method as described in the first aspect above;

[0052] A server for performing the method described in the second aspect above.

[0053] In a tenth aspect, a computer-readable storage medium is also provided, the computer-readable storage medium storing a computer program that, when executed by at least one processor, implements the method as described in the first or second aspect above.

[0054] Eleventhly, a computer program product is also provided, comprising a computer program that, when run on a computer, enables the computer to perform the methods described in the first or second aspect above.

[0055] The beneficial effects of the design in any of the second to eleventh aspects mentioned above can be referred to the beneficial effects of the corresponding design in the first aspect mentioned above, and this application will not elaborate on them one by one. Attached Figure Description

[0056] Figure 1 is a schematic diagram of an electronic device provided in an embodiment of this application;

[0057] Figure 2 is another schematic diagram of an electronic device provided in an embodiment of this application;

[0058] Figure 3A is a schematic diagram of a group photo taken using a wide-angle camera according to an embodiment of this application;

[0059] Figure 3B is a schematic diagram of a group photo taken using a telephoto camera according to an embodiment of this application;

[0060] Figure 3C is a comparative schematic diagram of a group photo provided in an embodiment of this application;

[0061] Figure 4 is a schematic diagram of a mobile phone camera interface provided in an embodiment of this application;

[0062] Figure 5 is a schematic diagram of a mobile phone suggesting entering the group photo mode according to an embodiment of this application;

[0063] Figure 6 is a schematic diagram of entering the group photo mode according to an embodiment of this application;

[0064] Figure 7 is a schematic diagram of the interface after entering the group photo mode according to an embodiment of this application;

[0065] Figure 8 is a schematic flowchart of an image capturing method provided in an embodiment of this application;

[0066] Figures 9 to 12 are schematic diagrams of taking pictures using the group photo mode according to an embodiment of this application;

[0067] Figures 13A to 13C are another schematic diagram of taking pictures using the group photo mode according to an embodiment of this application;

[0068] Figure 14 is a schematic diagram of an image fusion process provided in an embodiment of this application;

[0069] Figure 15 is a schematic diagram of edge-cloud collaborative shooting provided in an embodiment of this application;

[0070] Figure 16 is a schematic flowchart of an image capturing method provided in an embodiment of this application;

[0071] Figure 17 is another schematic diagram of an electronic device provided in an embodiment of this application. Detailed Implementation

[0072] The following explanations of some terms used in the embodiments of this application are provided to facilitate understanding by those skilled in the art.

[0073] The embodiments of this application involve at least one, including one or more; where "multiple" means two or more. Furthermore, it should be understood that in the description of this specification, terms such as "first" and "second" are used only for descriptive purposes and should not be construed as indicating or implying relative importance or order. For example, the first image and the second image do not represent their relative importance or order, but are merely for descriptive distinction. In the embodiments of this application, "and / or" merely describes an association relationship, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone. Additionally, the character " / " in this document generally indicates that the preceding and following related objects have an "or" relationship.

[0074] The directional terms mentioned in the embodiments of this application, such as "up", "down", "left", "right", "inner", and "outer", are only for reference to the directions in the accompanying drawings. Therefore, the directional terms used are for better and clearer explanation and understanding of the embodiments of this application, and are not intended to indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on the embodiments of this application.

[0075] References to "one embodiment," "in some examples," or "some embodiments" as described in this specification mean that one or more embodiments of this specification include a particular feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in some examples," "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0076] Field of view (FOV) can be understood as the range of a camera's field of view. The larger the FOV, the wider the field of view and the larger the shooting range. The size of the FOV can be described by angles. For example, the FOV can be 30°, 60°, 90°, 120°, etc., which will not be listed in this article. In the embodiments of this application, a camera whose FOV is greater than or equal to a preset FOV can be called a wide-angle camera. The specific value of the preset FOV is not limited in the embodiments of this application. For example, the preset FOV can be 90°, 120°, etc. Optionally, wide-angle cameras can be divided into two or more categories according to the size of the FOV. Taking two categories as an example, such as ordinary wide-angle cameras and super wide-angle cameras, the FOV of a super wide-angle camera is larger than that of an ordinary wide-angle camera. For example, a wide-angle camera with a FOV greater than or equal to a threshold of 1 is a super wide-angle camera, and a wide-angle camera with a FOV less than the threshold of 1 is an ordinary wide-angle camera.

[0077] Focal length, or the focal length of a camera, can be understood as the distance from the optical center of the lens to the focal point where light rays converge when incident. A larger focal length allows distant objects to be brought closer for shooting, and the longer the focal length, the clearer the distant objects are captured. The size of the focal length can be expressed as distance, and the unit of distance can be, for example, mm. In the embodiments of this application, a camera whose focal length is greater than or equal to a preset focal length can be called a telephoto camera. The specific value of the preset focal length is not limited in the embodiments of this application; for example, the preset focal length can be 150mm, 200mm, etc. Optionally, the aforementioned focal length can also be replaced with an equivalent focal length, which will not be elaborated on in the embodiments of this application. Optionally, telephoto cameras can be divided into two or more categories according to their focal length. Taking two categories as an example, there are ordinary telephoto cameras and super telephoto cameras. The focal length of a super telephoto camera is greater than that of an ordinary telephoto camera. For example, a telephoto camera with a focal length greater than or equal to a threshold of 2 is a super telephoto camera, and a telephoto camera with a focal length less than the threshold of 2 is an ordinary telephoto camera.

[0078] There is a certain correlation between focal length and field of view. This correlation can be, for example, inversely proportional. For instance, the shorter the focal length, the larger the field of view and the wider the shooting range; conversely, the longer the focal length, the smaller the field of view and the narrower the shooting range. For example, a wide-angle camera has an equivalent focal length of 26mm and a field of view of 80°, or an equivalent focal length of 16mm and a field of view of 120°. A telephoto camera has an equivalent focal length of 240mm and a field of view of 10°; or an equivalent focal length of 125mm and a field of view of 20°.

[0079] The definitions of wide-angle and telephoto cameras were explained above. It should be understood that other types of cameras exist besides wide-angle and telephoto cameras, such as ordinary cameras that fall between the two. Taking a wide-angle camera with a field of view of angle 'a' and a focal length of 'a' as an example, and a telephoto camera with a field of view of angle 'b' and a focal length of 'b' as another example, "between a wide-angle and telephoto cameras" can include: a field of view between the wide-angle camera's field of view 'a' and the telephoto camera's field of view 'b', and / or a focal length between the wide-angle camera's focal length 'a' and the telephoto camera's focal length 'b'.

[0080] The above explains some of the terms used in the embodiments of this application. The following describes the technical solutions provided by the embodiments of this application.

[0081] In some embodiments, the image capturing method provided in this application can be applied to a terminal device. Optionally, the terminal device can be a device specifically designed for photography, such as a DSLR camera. Alternatively, the terminal device can also be a device not specifically designed for photography. For example, the terminal device can be a mobile phone, tablet computer, laptop computer, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA) and other portable terminal devices; or it can be a wearable device such as a watch or bracelet; or it can be a means of transportation, such as various types of vehicles, trains, aircraft, mobile platforms, etc.; or it can be a virtual reality (VR) device, augmented reality (AR) device, mixed reality (MR) device, etc. In short, the embodiments of this application do not limit the specific type of terminal device.

[0082] In this embodiment, the terminal device may include multiple cameras, such as a first camera and a second camera. For example, the first camera may be a wide-angle camera, and the second camera may be a telephoto camera. For the definitions of wide-angle and telephoto cameras, please refer to the glossary section above. The terminal device can compensate for information from the image captured by the telephoto camera (referred to as the telephoto image) onto the image captured by the wide-angle camera (referred to as the wide-angle image) to improve the clarity of the wide-angle image.

[0083] In other embodiments, the image capturing method provided in this application can also be applied to a communication system. The communication system includes a terminal device and a server. The terminal device can be the terminal device described above. The terminal device includes multiple cameras, for example, a first camera and a second camera, as described above. The terminal device can send the image captured by the first camera (wide-angle image) and the image captured by the second camera (telephoto image) to the server for fusion processing. For example, the server can compensate for information from the telephoto image onto the wide-angle image to improve its clarity. The server can return the fused image to the terminal device, which then stores and / or displays it.

[0084] The following describes the electronic device according to the embodiments of this application. The electronic device may be the terminal device or server mentioned above.

[0085] For example, please refer to Figure 1, which is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. As shown in Figure 1, the electronic device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0086] Processor 110 may include one or more processing units, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors. The controller may serve as the nerve center and command center of the electronic device. The controller can generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution. Processor 110 may also include memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that processor 110 has just used or is repeatedly used. If processor 110 needs to reuse the instruction or data, it can directly retrieve it from the memory. This avoids repeated access, reduces the waiting time of processor 110, and thus improves system efficiency.

[0087] In some embodiments, the processor 110 can execute the image capture method provided in the embodiments of this application. For example, the processor 110 can compensate for information from the image captured by the telephoto camera onto the image captured by the wide-angle camera to improve the clarity of the wide-angle image. Alternatively, the processor 110 can also send the telephoto image and the wide-angle image to a server via the mobile communication module 150 or the wireless communication module 160, whereby the server performs image fusion. For example, the server can compensate for information from the telephoto image onto the wide-angle image. The processor 110 can also obtain the fused image from the server via the mobile communication module 150 or the wireless communication module 160, and store and / or display the image.

[0088] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0089] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C buses. The processor 110 can couple to the touch sensor 180K, charger, flash, camera 193, etc., through different I2C bus interfaces. For example, the processor 110 can couple to the touch sensor 180K through the I2C interface, enabling the processor 110 and the touch sensor 180K to communicate through the I2C bus interface, thereby realizing the touch function of the electronic device 100.

[0090] The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface to enable the function of answering phone calls through a Bluetooth headset.

[0091] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via the PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering phone calls through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0092] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface to enable music playback through Bluetooth headphones.

[0093] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to enable the electronic device 100 to capture images. The processor 110 and the display screen 194 communicate via the DSI interface to enable the electronic device 100 to display images.

[0094] The GPIO interface can be configured via software. It can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to a camera 193, a display screen 194, a wireless communication module 160, an audio module 170, a sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0095] USB port 130 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.

[0096] It is understood that the interface connection relationships between the modules illustrated in the embodiments of the present invention are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0097] The wireless communication function of the electronic device can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor, and baseband processor. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device can be used to cover one or more communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in conjunction with a tuning switch.

[0098] The mobile communication module 150 can provide solutions for wireless communication applications including 2G / 3G / 4G / 5G in electronic devices. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.

[0099] The wireless communication module 160 can provide solutions for wireless communication applications in electronic devices, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0100] In some embodiments, antenna 1 of the electronic device is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling the electronic device to communicate with networks and other devices via wireless communication technology.

[0101] The display screen 194 is used to display the application's interface, etc. The display screen 194 includes a display panel. In some embodiments, the electronic device may include one or N display screens 194, where N is a positive integer greater than 1.

[0102] The electronic device 100 can perform shooting functions through an ISP, a camera 193, a video codec, a GPU, a display 194, and an application processor. The ISP is used to process the data fed back by the camera 193.

[0103] In some embodiments, camera 193 may include multiple cameras. For example, two cameras, such as a first camera and a second camera. The first camera may be a wide-angle camera, and the second camera may be a telephoto camera. For definitions of wide-angle and telephoto cameras, please refer to the glossary section above. Processor 110 can compensate for information from the image captured by the telephoto camera onto the image captured by the wide-angle camera to improve the clarity of the wide-angle image. Alternatively, processor 110 can also send the telephoto and wide-angle images to a server via mobile communication module 150 or wireless communication module 160, where the server performs image fusion, for example, compensating for information from the telephoto image onto the wide-angle image. Processor 110 can also obtain the fused image from the server via mobile communication module 150 or wireless communication module 160, and store and / or display the image.

[0104] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of the electronic device by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system and software code for at least one application program. The data storage area may store data generated during the use of the electronic device (e.g., images, videos, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, general-purpose flash memory, etc.

[0105] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, images, videos, and other files can be saved on the external memory card.

[0106] Electronic devices can implement audio functions such as music playback and recording through audio modules 170, speakers 170A, receivers 170B, microphones 170C, headphone jacks 170D, and application processors.

[0107] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.

[0108] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or listen to hands-free calls and other external playback scenarios through one or more speakers 170A.

[0109] The receiver 170B, also known as a "handpiece," can be one or more, and is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a telephone call or voice message, the receiver 170B can be brought close to the ear to listen to the voice.

[0110] The microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals.

[0111] The 170D headphone jack is used to connect wired headphones.

[0112] The pressure sensor 180A is used to sense pressure signals and can convert the pressure signals into electrical signals. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194.

[0113] The gyroscope sensor 180B can be used to determine the motion attitude of an electronic device. In some embodiments, the gyroscope sensor 180B can determine the angular velocity of the electronic device about three axes (i.e., the x, y, and z axes). The gyroscope sensor 180B can be used for image stabilization.

[0114] The barometric pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device calculates altitude using the air pressure value measured by the barometric pressure sensor 180C to assist in positioning and navigation.

[0115] The magnetic sensor 180D includes a Hall effect sensor. Electronic devices can use the magnetic sensor 180D to detect the opening and closing of a flip cover.

[0116] The 180E accelerometer can detect the magnitude of acceleration in various directions (typically three axes) of electronic devices. When the electronic device is stationary, it can detect the magnitude and direction of gravity.

[0117] The 180F distance sensor is used to measure distance. Electronic devices can measure distance using infrared or laser.

[0118] The proximity sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The LED may be an infrared LED. The electronic device emits infrared light outward through the LED. The electronic device uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that an object is near the electronic device. When insufficient reflected light is detected, the electronic device can determine that no object is near the electronic device.

[0119] An ambient light sensor 180L is used to detect ambient light levels. Electronic devices can adaptively adjust the brightness of the display screen 194 based on the detected ambient light levels.

[0120] The fingerprint sensor 180H is used to collect fingerprints.

[0121] The 180J temperature sensor is used to detect temperature.

[0122] Touch sensor 180K, also known as a "touch panel," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touch screen." Touch sensor 180K is used to detect touch operations applied to or near it. The touch sensor can then transmit the detected touch operation to the application processor to determine the type of touch event.

[0123] The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire vibration signals from the vibrating bone segments of the human vocal cords.

[0124] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch buttons. The electronic device can receive button inputs and generate key signal inputs related to user settings and function control. Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. Indicator 192 can be an indicator light, used to indicate charging status, battery level changes, messages, missed calls, notifications, etc. SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation with the electronic device.

[0125] It is understood that the components shown in Figure 1 do not constitute a specific limitation on the electronic device. The electronic device in embodiments of the present invention may include more or fewer components than those shown in Figure 1. Furthermore, the combination / connection relationships between the components in Figure 1 can also be adjusted and modified.

[0126] For example, please refer to Figure 2, which is a schematic diagram of another structure of an electronic device provided in an embodiment of this application. The electronic device may be a terminal device or a server as described above. As shown in Figure 2, the software system of the electronic device may adopt a layered architecture. Of course, in addition to a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture may also be adopted, etc., which are not limited in this embodiment. As shown in Figure 2, the layered architecture divides the software into several layers, each with a clear role and division of labor. Layers communicate with each other through software interfaces. In some embodiments, the software system may be divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer. The application layer may include a series of application packages.

[0127] As shown in Figure 2, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.

[0128] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0129] As shown in Figure 2, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, and a notification manager. The window manager manages window programs. It can obtain the screen size, determine if a status bar is present, lock the screen, and capture the screen. The content provider stores and retrieves data, making this data accessible to the application. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, and a phone book. The view system includes visual controls, such as controls for displaying text and controls for displaying images. The view system can be used to build the application. The display interface can consist of one or more views. For example, a display interface including a text notification icon may include a view for displaying text and a view for displaying images. The phone manager provides communication functions for the electronic device 100, such as managing call status (including connection, hang-up, etc.). The resource manager provides the application with various resources, such as localized strings, icons, images, layout files, video files, etc. The notification manager allows the application to display notification information in the status bar, which can be used to convey informational messages and can disappear automatically after a short pause without user interaction. For example, the notification manager is used to notify users of download completions and message alerts. The notification manager can also display notifications as icons or scrolling text in the system's top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting alert sounds, causing electronic devices to vibrate, and flashing indicator lights.

[0130] The Android Runtime consists of core libraries and a virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.

[0131] The core library consists of two parts: one part is the functionalities that need to be called by the Java language, and the other part is the Android core library.

[0132] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0133] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), etc.

[0134] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.

[0135] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.

[0136] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0137] A 2D graphics engine is a graphics engine for 2D drawing.

[0138] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.

[0139] In this embodiment, the software system shown in Figure 2 may also include a camera service (not shown in Figure 2). The camera service can reside in any of the four layers of the architecture, such as in the system library. After starting the camera application, the camera application can acquire images captured by the telephoto camera and the wide-angle camera. The camera application can provide the telephoto and wide-angle images to the camera service. The camera service can call the Wi-Fi driver (not shown in Figure 2) in the kernel layer to send the telephoto and wide-angle images to the server via Wi-Fi, where the server performs image fusion. For example, the server can compensate for information from the telephoto image onto the wide-angle image to improve its clarity. Afterward, the electronic device can receive the fused image from the server via Wi-Fi and store and / or display the image. Alternatively, the aforementioned image fusion process can be executed automatically by the software system shown in Figure 2. For example, the camera service can perform image fusion. For example, the camera service may include an Artificial Intelligence (AI) service, which can perform image fusion. Of course, the AI ​​service can also be located outside the camera service, but independently of it. In this case, the camera service can send telephoto and wide-angle images to the AI ​​service for image fusion.

[0140] The following explanation uses the mobile phone shown in Figures 1 and 2 as an example.

[0141] To meet users' shooting needs, mobile phones can be equipped with various types of cameras, such as wide-angle cameras and telephoto cameras. The definitions of wide-angle and telephoto cameras can be found in the previous description. Wide-angle and telephoto cameras each have their own advantages and disadvantages. For example, a wide-angle camera has a large field of view, allowing more objects to be captured in the frame simultaneously, resulting in images with a wider field of view. However, images captured by a wide-angle camera tend to have lower sharpness and blurry details. A telephoto camera can capture details, such as bringing distant objects closer to the camera, resulting in images of distant objects with high sharpness and clear details. However, a telephoto camera has a narrow field of view, making it unable to capture a large amount of scenery in the frame at once.

[0142] In some situations, users may want to use their mobile phones to capture large scenes. A large scene can be understood as a scene with a large scope (or area) to be captured, such as a group photo, a city street scene, or a complete view of a building. In this embodiment, when capturing a large scene, either of the following two shooting methods can be used. It should be noted that the following explanation uses capturing a group photo as an example; the principle is the same for other scenes such as city street scenes.

[0143] The first shooting method is to use the wide-angle camera on the mobile phone. Because of the wide-angle camera's large field of view, it can include more people in the frame simultaneously, thus efficiently capturing group photos. For an example, see Figure 3A for the process of taking a group photo using a wide-angle camera.

[0144] As shown in Figure 3A(a), after the phone launches the camera application, it displays the shooting interface. The shooting interface includes a preview image. The preview image is captured by the wide-angle camera, with a large field of view, containing multiple people. When the phone receives an operation to press the shutter button, it captures a group photo image, which is a wide-angle image captured by the wide-angle camera. The phone can store this group photo image for the user to view. For example, in Figure 3A(a), after the phone receives an operation to press the shutter button, it displays a thumbnail 300 of the captured group photo image. When the phone receives an operation on the thumbnail 300, it displays the interface shown in Figure 3A(b), which includes the group photo image.

[0145] This shooting method utilizes the wide field of view of a wide-angle camera to efficiently capture group photos. However, it also suffers from the disadvantages of wide-angle cameras, namely, lower image clarity, making it difficult for users to see details. For example, as shown in Figure 3A(c), when users zoom in on the group photo to view faces, they will find the faces blurry, affecting the shooting experience.

[0146] The second shooting method involves using a non-wide-angle camera on the phone. This non-wide-angle camera can be, for example, a telephoto camera or a regular camera; for a description of regular cameras, please refer to the previous section. Because the field of view of a non-wide-angle camera is limited, it may not be possible to include all people in the frame simultaneously. Therefore, multiple frames can be captured, each containing different people, and then these frames can be stitched together to create the group photo. For example, using a telephoto camera as the non-wide-angle camera, the process of taking a group photo can be seen in Figure 3B.

[0147] As shown in Figure 3B(a), after the phone launches the camera application, the shooting interface is displayed. The shooting interface includes a preview image. The preview image is captured by the telephoto camera. Due to the small field of view of the telephoto camera, the preview image only contains a portion of the people; the figure shows three people as an example. To take a group photo of everyone, you can enter panorama mode, as shown in Figure 3B(b). It should be noted that there are multiple ways to enter panorama mode; Figure 3B(b) is just one example. Optionally, after entering panorama mode, the shooting interface displays a prompt: Please click the shutter button and pan in one direction. Optionally, the shooting interface also displays arrows to guide the user to move according to the arrows. In Figure 3B(b), when the phone receives the user's click of the shutter button, it begins shooting, and captures images in real time while the phone is moving, thus obtaining multiple frames. For example, in Figure 3B(c), after the phone moves to the right, a new image is captured, and this image contains new people. In Figure 3B(c), when the mobile phone receives the operation of the end shooting button, it stitches the captured multi-frame images together to obtain the final group photo image, as shown in Figure 3B(d).

[0148] This shooting method utilizes the advantage of telephoto cameras in capturing details, so the clarity of the resulting group photos will not be too low. However, during the shooting process, users need to move slowly and steadily. If the movement is unstable, the final stitched image will be misaligned and distorted, affecting the aesthetics of the image.

[0149] Therefore, neither of the above two shooting methods can produce high-quality group photos.

[0150] Therefore, this application provides an image capturing method that combines the advantages of both a telephoto camera and a wide-angle camera. For example, a wide-angle image is captured using a wide-angle camera, and a telephoto image is captured using a telephoto camera. Image details in the telephoto image can be transferred to the wide-angle image to improve its clarity. Furthermore, this method eliminates the need for image stitching, avoiding image misalignment and distortion, thus improving the image capturing experience. As an example, please refer to Figure 3C, which contains two images, image 310 and image 320. Image 310 is an image captured using the first capturing method described above; it has lower clarity, and the face is relatively blurry. Image 320 is an image captured using the image capturing method provided in this application; it has improved clarity, and the face is relatively clear.

[0151] The image capturing method provided in the embodiments of this application will be described in detail below with reference to the accompanying drawings.

[0152] Figure 4(a) shows a graphical user interface (GUI) of a mobile phone, which serves as the phone's desktop. The desktop includes icons for various applications (APPs). When the phone detects that the user has tapped the camera application icon 401, it can launch the camera application and display another GUI as shown in Figure 4(b), which can be called the shooting interface 402. The shooting interface 402 can display a preview image in real time. As shown in Figure 4(b), the preview image is an image captured by the wide-angle camera. For ease of understanding, taking a family photo as an example, the preview image shows four figures from left to right: a little girl, a father, a mother, and a little boy.

[0153] In some embodiments, when the camera application starts, the wide-angle camera can be activated immediately, and the preview image is the image captured by the wide-angle camera. In other embodiments, when the camera application starts, a non-wide-angle camera (e.g., a telephoto camera or a regular camera) can be activated first, and the preview image is the image captured by the non-wide-angle camera. When a switching condition is met, the camera switches from the non-wide-angle camera to the wide-angle camera, and the preview image is updated to the image captured by the wide-angle camera. Optionally, the switching condition may include, for example, that the current shooting scene is a preset scene, or that a user operation instructing the user to switch to the wide-angle camera has been received. Optionally, the preset scene may include a group photo scene, a street scene, an architectural scene, etc., and the preset scene may be stored in the phone beforehand. Taking a group photo scene as an example, one possible way for the phone to determine that the current shooting scene is a group photo scene is to use image recognition technology to identify whether the preview image captured by the non-wide-angle camera contains a preset object (e.g., a person). If it does, the number of preset objects is determined. If the number is greater than a threshold, the current shooting scene is determined to be a group photo scene, and the camera can be switched to the wide-angle camera. Optionally, after switching to the wide-angle camera, the group photo mode can be entered immediately, or it can be temporarily suspended. Figure 4 shows an example where the group photo mode is not yet entered; the group photo mode will be explained later. Optionally, the user operation used to indicate switching to the wide-angle camera can be an operation on an icon within the shooting interface. For example, the shooting interface displays an icon for the "w" mode (not shown in the figure) to indicate wide-angle mode. The user operation can be an operation on the "w" mode icon, or it can be other gesture operations; this embodiment of the application is not limited to these.

[0154] Continuing with Figure 4(b), the preview image is an image captured by a wide-angle camera. At this point, if the image capturing method provided in this embodiment is used, a relatively clear group photo image can be captured.

[0155] Optionally, the camera application includes a group photo mode, in which the image capturing method provided in the embodiments of this application can be used to take a picture. Therefore, in Figure 4(b), the mobile phone can control the camera application to enter the group photo mode. It should be understood that the group photo mode may also have other names, such as the first mode.

[0156] Optionally, before entering the group photo mode, the phone can output a prompt message to indicate that the group photo mode has been entered. Optionally, the prompt message can be in various forms such as text, icons, or voice, and this embodiment of the application is not limited to any particular form. For example, please refer to Figure 5, where a prompt message is displayed in the shooting interface 402: "It is recommended to use the group photo mode." Optionally, to avoid obscuring the preview image for an extended period, the prompt message can be canceled after being displayed for a certain time.

[0157] Optionally, there are several ways to enter the group photo mode, including but not limited to the following two methods.

[0158] Method 1: Automatically enter group photo mode. For example, when the phone determines that the current shooting scene is a group photo scene, it can automatically enter group photo mode. For example, the phone uses image recognition technology to identify whether the preview image captured by the wide-angle camera contains preset objects (such as people). If it does, it determines the number of preset objects. If the number is greater than the preset number, it automatically enters group photo mode.

[0159] Method 2: Manually enter group photo mode. For example, the mobile phone receives a first input operation and enters the first mode. For example, the mobile phone can provide a button for entering group photo mode. When the mobile phone receives an operation on the button, it enters group photo mode. For example, the button can be located within the shooting interface 402. For example, please refer to Figure 6(a), where the shooting interface 402 includes a group photo button 601. When the mobile phone receives an operation on the button 601, it enters group photo mode. As another example, please refer to Figure 6(b), where the shooting interface 402 includes a button 602. When the mobile phone receives an operation on the button 602, the interface shown in Figure 6(c) is displayed, which contains icons for various shooting modes. When the mobile phone receives an operation on icon 603, it enters group photo mode. It should be noted that Figure 6 illustrates two designs for the entry point of group photo mode. In practical applications, the entry point can also be other designs. For example, it can also be a button located in area 600 in Figure 6(a). This application embodiment does not limit this.

[0160] The above lists two ways to enter the group photo mode. It should be noted that in addition to the two methods mentioned above, there are other ways to enter the group photo mode, such as by voice command or specific gesture operation (e.g., double-tap the screen, tap the screen with your knuckle, etc.). This application embodiment will not list them all.

[0161] Optionally, the shooting interface can change after entering the group photo mode. For example, the shooting interface 402 in Figure 6(a) changes to the shooting interface 702 shown in Figure 7 after entering the group photo mode. Comparing shooting interface 402 and shooting interface 702, shooting interface 402 includes areas 600 and 610, and buttons are displayed in these two areas respectively. Areas 600 and 610 are removed in shooting interface 702. Optionally, the gallery button and the front / rear camera switching button are also removed from shooting interface 702, while the shooting button is retained.

[0162] As an example, after entering group photo mode, the phone can output a notification message to indicate that group photo mode has been entered. For example, see Figure 7, where the notification message "Group photo mode has been entered" is displayed on the shooting interface 702. Optionally, to avoid obscuring the preview image for an extended period, the notification message can be canceled after being displayed for a certain time.

[0163] After entering the group photo mode, the mobile phone can take a picture using the image shooting method provided in this application embodiment. For example, Figure 8 shows a flowchart of the image shooting method provided in this application embodiment. The process may include three steps: 1. Wide-angle shooting; 2. Telephoto scanning; 3. Image fusion. These three steps are described below.

[0164] I. Wide-angle shooting

[0165] Wide-angle shooting refers to capturing an image using a wide-angle camera, which can then be used as a reference for telephoto scanning. An example of the wide-angle shooting process can be seen in Figure 9.

[0166] As shown in Figure 9(a), after the phone enters the group photo mode, the preview interface 702 contains a preview image, which is an image captured by the wide-angle camera. Optionally, to prompt the user to take a wide-angle shot, the shooting interface 702 can display a prompt message: "Wide-angle shot." The display position of the prompt message is not limited in this embodiment. In Figure 9(a), the user can adjust the shooting angle, shooting magnification, etc. of the wide-angle camera to obtain a suitable wide-angle image. For example, when the phone receives an operation on the shooting button, it captures a wide-angle image through the wide-angle camera and stores the wide-angle image.

[0167] As an example, in Figure 9(a), after the mobile phone receives an operation on the shooting button, it can display the shooting interface 902 shown in Figure 9(b). The shooting interface 902 is used to perform the next process, namely telephoto scanning.

[0168] There is a possibility that after taking a wide-angle image, the user may feel that the image quality is not good enough, and in this case, they can retake the wide-angle image. One possible way is that, in Figure 9(b), the shooting interface 902 includes a back button 903. When the phone receives an operation on the back button 903, it returns to the shooting interface 702 shown in Figure 9(a) and retakes the wide-angle image.

[0169] II. Telephoto Scan

[0170] Telephoto scanning can be understood as, after obtaining a wide-angle image, using the wide-angle image as a reference, taking individual photos of each subject in the wide-angle image with a telephoto camera to achieve detail compensation for each subject in the wide-angle image.

[0171] As mentioned earlier, in Figure 9(a), after the mobile phone receives an operation on the shutter button, it can display the shooting interface 902 shown in Figure 9(b). The shooting interface 902 displays a preview image, which is the image captured by the telephoto camera. It is understood that the field of view of the telephoto camera is smaller than that of the wide-angle camera, so the field of view of the preview image in the shooting interface 902 is relatively small, for example, only including the little girl's face. Optionally, to provide a prompt to the user, the shooting interface 902 can also display the prompt message: "Telephoto Scan". Furthermore, the shooting interface 902 also includes a "Start Scan" button 904.

[0172] Since scanning is based on a wide-angle image, the wide-angle image can be displayed in the shooting interface 902 to help users determine which position in the wide-angle image is currently being scanned. For example, the phone can zoom out of the wide-angle image and display the zoomed-out wide-angle image in the shooting interface 902 via picture-in-picture. For example, as shown in Figure 9(b), the shooting interface 902 includes a main preview area and an auxiliary preview area. The main preview area displays the preview image captured by the telephoto camera, and the auxiliary preview area (i.e., picture-in-picture) displays the zoomed-out wide-angle image.

[0173] As an example, a prompt message can also be displayed in the auxiliary preview area to indicate the current scanning area of ​​the telephoto camera on the wide-angle image. The prompt message can be in any form. For example, in Figure 9(b), a scanning frame 905 is displayed in the auxiliary preview area to indicate to the user that the area enclosed by the scanning frame 905 is the current scanning area of ​​the telephoto camera. That is, the preview image in the main preview area corresponds to the portion within the scanning frame 905 in the auxiliary preview area. Optionally, the scanning frame 905 can adopt a first display method, which may include, for example, displaying it as a first graphic (e.g., a dashed frame), and / or filling it with a first color, which can be any color. It should be understood that before displaying the scanning frame 905, the mobile phone needs to determine the current scanning area of ​​the telephoto camera on the wide-angle image. For example, the mobile phone can perform image registration between the wide-angle image and the telephoto image, and determine the area of ​​the telephoto image corresponding to the wide-angle image through image registration; this area is the current scanning area of ​​the telephoto camera. There are various image registration methods, such as binocular registration, which are not limited in this embodiment.

[0174] It should be understood that the area and / or position of the scanning frame 905 can change with the shooting range of the telephoto camera. For example, the area of ​​the scanning frame 905 is inversely proportional to the magnification of the telephoto camera; that is, when the magnification of the telephoto camera increases, the area of ​​the scanning frame 905 decreases, and when the magnification of the telephoto camera decreases, the area of ​​the scanning frame 905 increases. Taking Figure 9(b) as an example, when the mobile phone receives an operation to reduce the magnification, it pushes the scene further away to shoot, as shown in Figure 10(a). The preview image in the main preview area can accommodate more people and objects, and correspondingly, the area of ​​the scanning frame 905 in the auxiliary preview area increases. Another example is that the position of the scanning frame 905 is in the same direction as the mobile phone's movement. For example, when the mobile phone moves in a first direction, the shooting range of the telephoto camera moves in the first direction, and correspondingly, the position of the scanning frame 905 also moves in the first direction. The first direction can be any direction such as up, down, left, or right. Continuing with Figure 9(b) as an example, when the user moves the phone to the right, the shooting range of the telephoto camera moves to the right, as shown in Figure 10(b). The preview image in the main preview area is updated, and correspondingly, the scanning frame 905 in the auxiliary preview area moves to the right.

[0175] Continuing with Figure 9(b) as an example, when the mobile phone receives an operation on the start scan button 904, it begins telephoto scanning and displays the interface shown in Figure 11(a). This interface displays the scan duration 906 and the end scan button 907. In Figure 11(a), the telephoto camera is aimed at the little girl's face. When the shooting conditions are met, the telephoto camera captures an image of the little girl's face. Optionally, the shooting conditions may include: the mobile phone stabilizing for a preset duration, receiving a shooting command (e.g., double-tap the screen, voice command, etc.). The preset duration may be 1 second, 2 seconds, etc., and the specific duration is not limited in this embodiment.

[0176] After capturing an image of the little girl's face, the mobile phone can output a prompt message to indicate the next object to be scanned. This prompt message can be in any form, such as text, icons, sound, or vibration. For example, as shown in Figure 11(b), after capturing the image of the little girl's face, the scanning frame 905 in the auxiliary preview area switches from a first display mode to a second display mode. Please refer to the previous description for the first display mode; the second display mode is different from the first. For example, the first display mode may be a first graphic (e.g., a dashed frame), and the second display mode may be a second graphic (e.g., a solid frame). Alternatively, if the first display mode uses a first color for filling, the second display mode uses a second color (e.g., gray) for filling, and the second color is different from the first color. For example, in Figure 11(b), the area enclosed by the scanning frame 905 is filled with gray, indicating that part of that area has been scanned.

[0177] There is a possibility that after taking an image of the little girl's face, the user might feel that the image is not well captured. In this case, a rescan can be performed. Optionally, rescanning can be done in the following two ways.

[0178] One possible approach is that, in Figure 11(b), the shooting interface 902 includes a return button 903. When the phone receives an operation on the return button 903, it returns to the previous step, that is, returns to the interface shown in Figure 11(a), where the user can re-scan the little girl with a telephoto lens. Optionally, when returning to the interface shown in Figure 11(a), the scanning duration 906 is increased and cannot be reversed.

[0179] Another possible approach is shown in Figure 11(b). When the phone receives an operation on the return button 903, it can return to the previous step, that is, return to the interface shown in Figure 9(b). The telephoto scan can then be restarted by pressing the start scan button 904 on that interface.

[0180] Continuing with Figure 11(b) as an example, after completing the scan of the little girl's face, you can either end the scan or continue scanning the next object.

[0181] Taking ending a scan as an example, the methods for ending a scan can include automatic and manual ending. Automatic ending a scan can occur, for example, when the conditions for ending a scan are met. Optionally, these conditions could include: all objects in the wide-angle image have been scanned, an incoming call has been received, or the phone has been rapidly shaken. Manual ending a scan, for example, is shown in Figure 11(b), where the telephoto scan ends when the phone receives an operation on the end-scan button 907. After ending the scan, the next process, image fusion, can begin. Since only the little girl was scanned using the telephoto lens (i.e., only her face was captured), the wide-angle image is fused with the little girl's face image during image fusion. Therefore, the clarity of the little girl's face area in the final group photo image is improved, while the clarity of other areas remains unchanged.

[0182] Taking the scanning of the next object as an example, in Figure 11(b), after scanning the little girl, the user can move the phone so that the telephoto camera is aimed at the next object. For example, in Figure 11(c), the user moves the phone to the right so that the telephoto camera is aimed at the next object, such as the father. Therefore, the preview image in the main preview area is updated to the image of the father's face captured by the telephoto camera. Correspondingly, the scanning frame 905 in the auxiliary preview area circles the father's face. The scanning frame 905 uses a third display method (which can be the same as the first display method, such as a dashed frame or filled with the first color) to indicate the current scanning area of ​​the telephoto camera. It should be noted that the area that has been scanned in the auxiliary preview area (the little girl's face area) continues to be filled with the second color (e.g., gray). In Figure 11(c), when the phone determines that the shooting conditions are met, it takes an image of the father's face through the telephoto camera. Optionally, the shooting conditions may include: the phone stabilizing for a preset duration, receiving a shooting command (e.g., double-tap the screen, voice command, etc.).

[0183] After capturing an image of the father's face, the phone can output a prompt message to indicate the next object to be scanned. For example, as shown in Figure 11(d), when the image of the father's face is captured, the scanning frame 905 in the auxiliary preview area switches from the third display mode to the fourth display mode (which can be the same as the second display mode, such as a solid line frame or a second color fill). For example, if the area enclosed by the scanning frame 905 is filled with a second color (e.g., gray), it indicates that the area has been scanned.

[0184] There is a possibility that after taking an image of the father's face, the user might feel the image wasn't captured well enough. In this case, a rescan can be performed. Optionally, rescanning can be done in two ways.

[0185] One possible approach is that, in Figure 11(d), when the phone receives an operation on the return button 903, it returns to the previous step, i.e., returns to the interface shown in Figure 11(c), where the user can re-scan the father using telephoto lenses. Optionally, when returning to the interface shown in Figure 11(c), the scanning duration 906 is increased and cannot be reversed.

[0186] Another possible approach is that, in Figure 11(d), when the phone receives an operation on the back button 903, it can return to the interface shown in Figure 9(b) and restart the telephoto scan via the start scan button 904 in that interface. Alternatively, in Figure 11(d), when the phone receives an operation on the back button 903, it can also return to the interface shown in Figure 11(a) or Figure 11(b) to rescan.

[0187] Continuing with Figure 11(d) as an example, after scanning the father's face, the scan can be stopped or the scan can continue to the next object. The principle is the same as before and will not be repeated. Taking the end of the scan as an example, for instance, in Figure 11(d), when the mobile phone receives the operation for the end scan button 907, it can enter the next process, namely image fusion, which is to fuse the wide-angle image, the little girl's face image, and the father's face image. Therefore, in the final group photo image, the clarity of the little girl's face and the father's face is improved, while the clarity of other areas is not improved. The image fusion process will be explained later. It is understood that image fusion requires a certain amount of time. In order to prompt the user, the mobile phone can display a prompt message to remind the user to wait. For example, in Figure 11(d), when the mobile phone receives the operation for the end scan button 907, it can display the interface shown in Figure 12, which displays the prompt message: "Synthesizing". It should be understood that the prompt message can also be other content, such as "Synthesizing" or "Please wait patiently", etc., which is not limited in this application embodiment.

[0188] It should be noted that there is a possibility that the subject scanned by the telephoto camera may not exist in the wide-angle image. In this case, the display position of the scanning frame 905 within the auxiliary preview area cannot be determined. One possible solution is for the phone to output a prompt message informing the user that the telephoto camera's shooting range exceeds the corresponding range of the wide-angle image, allowing the user to adjust the telephoto camera's shooting range so that it can scan for the subject in the wide-angle image.

[0189] In the above embodiments, telephoto scanning can be performed on all objects in the wide-angle image. In other embodiments, to improve efficiency and reduce the scanning time, the scanning range can be narrowed. For example, the mobile phone can determine the area to be scanned on the wide-angle image, scanning only objects within that area, while omitting objects outside that area. This improves the clarity within the scanned area, eliminating the need to improve clarity in other areas and avoiding excessive shooting delays. Optionally, there are various methods for determining the area to be scanned, including but not limited to at least one of the following.

[0190] Method A: The area to be scanned is the area containing a preset object in the wide-angle image. Preset objects include, for example, people and animals, and can be pre-stored in the phone. For instance, the phone can use image recognition technology to identify people in the wide-angle image and determine the area containing the person as the area to be scanned. Optionally, the area containing the person can be greater than or equal to the area enclosed by the person's edge contour. Optionally, the area containing the person can be the area containing the face or the entire body of the person. For example, as shown in Figure 13A(a), after entering the group photo mode, when the phone receives an operation on the shooting button, it captures a wide-angle image, determines the area containing the person in the wide-angle image, and displays the interface shown in Figure 13A(b). In this interface, the area 908 containing the person in the auxiliary preview area uses a fifth display method, such as being circled with a dashed frame and / or filled with a third color, to indicate that area 908 is the area to be scanned. The third color is different from the first and second colors mentioned earlier. A scanning frame 905 can also be displayed in the auxiliary preview area to indicate the current scanning area of ​​the telephoto camera.

[0191] Method B involves the user-specified area on the wide-angle image to be scanned. There are several ways for the user to specify the area, such as through gestures. For example, as shown in Figure 13B(a), after entering group photo mode, when the phone receives an operation to press the shutter button, it captures a wide-angle image and displays the interface shown in Figure 13B(b), which displays the prompt: "Please specify the scanning area." The user can circle the area to be scanned by drawing a circle. When the phone receives an operation to press the finish button, it determines the circled area as the area to be scanned and displays the interface shown in Figure 13B(c). In the auxiliary preview area of ​​this interface, the user-specified area 908 is displayed using the fifth display method to indicate that area 908 is the area to be scanned. A scanning frame 905 can also be displayed in the auxiliary preview area to indicate the current scanning area of ​​the telephoto camera.

[0192] The above lists two methods for determining the area to be scanned. It should be noted that the area to be scanned can also be determined using other methods, such as using the default area in a wide-angle image. The default area could be, for example, the center area.

[0193] Continuing with Figure 13B(c) as an example, since the area to be scanned is region 908, the user can use the telephoto camera to scan various objects within region 908. For example, in Figure 13B(c), when the phone receives an operation on the start scan button 904, it begins telephoto scanning and displays the interface shown in Figure 13C(a), which displays the scan duration 906 and the end scan button 907. In Figure 13C(a), the telephoto camera is aimed at the little girl's face, and when the shooting conditions are met (see above), an image of the little girl's face is captured by the telephoto camera. After capturing the image of the little girl's face, the interface shown in Figure 13C(b) is displayed. In this interface, the area enclosed by the scan frame 905 in the auxiliary preview area is filled with gray, indicating that part of this area has been scanned. After capturing the image of the little girl's face, the user can end the scan or continue scanning. The method for ending the scan is the same as described above and will not be repeated. Taking continuing the scan as an example, the user moves the phone so that the telephoto camera is aimed at the next subject, such as the father. The phone then displays the interface shown in Figure 13C(c). In this interface, the preview image is updated to the father's face image captured by the telephoto camera. Correspondingly, the father's face is enclosed in the scan box 905 within the auxiliary preview area, and the scanned area is still filled with gray. When the shooting conditions are met, the father's face image is captured using the telephoto camera. After capturing the father's face image, the interface shown in Figure 13C(d) is displayed. In this interface, the area enclosed by the scan box 905 in the auxiliary preview area is filled with gray, indicating that part of that area has been scanned. After capturing the father's face image, the user can end the scan or continue scanning, which will not be described again. After ending the scan, the phone can perform image fusion, for example, displaying the interface shown in Figure 12.

[0194] III. Image Fusion

[0195] Image fusion, also known as image blending, involves using a wide-angle image as a base and fusing images captured by a telephoto camera (e.g., the little girl's face image and the father's face image mentioned earlier) onto the wide-angle image. For example, Figure 14 is a flowchart illustrating the image fusion process provided in an embodiment of this application. It should be noted that Figure 14 uses the fusion of the little girl's face image onto the wide-angle image as an example; the fusion principle is the same for the father's face image and will not be repeated. As shown in Figure 14, the process includes:

[0196] S1401, perform image registration between the wide-angle image and the telephoto image. Image registration can be understood as determining the first region corresponding to the telephoto image on the wide-angle image. There are various methods of image registration, such as binocular registration, which are not limited in this embodiment. Optionally, S1401 may or may not be performed. For example, if image registration has already been performed during the telephoto scanning process, then S1401 does not need to be performed here. If image registration has not been performed during the telephoto scanning process, then S1401 needs to be performed here.

[0197] S1402, Extract first feature information from the telephoto image. The first feature information may be facial features, such as eyes, eyebrows, mouth, nasolabial folds, etc.

[0198] S1403, extract second feature information from the first region of the wide-angle image. The second feature information may be, for example, facial features. The first region is as described above.

[0199] S1404, perform identity matching based on the first feature information and the second feature information. For example, if the first feature information and the second feature information match, indicating that they belong to the same person, S1405 can be executed.

[0200] S1405 merges telephoto and wide-angle images.

[0201] Optionally, S1405 can be implemented in several ways, including but not limited to the following three.

[0202] Method 1 involves extracting the face region from the telephoto image and then using the extracted face region to replace the face region in the first region of the wide-angle image that matches the face region in the telephoto image. This method is relatively convenient and efficient.

[0203] Method 2 involves compensating for detail information from the telephoto image onto a first region in the wide-angle image. Please refer to the previous description for the first region. For example, the detail information may include RGB information. For instance, the first RGB information of a first pixel in the telephoto image and the second RGB information of a second pixel in the first region of the wide-angle image are determined, with the second pixel corresponding to the first pixel; compensation is then performed on the second RGB information based on the first RGB information. The compensation method may involve determining third RGB information based on the first and second RGB information, and determining the third RGB information as the final RGB information of the second pixel in the wide-angle image. Optionally, the third RGB information may be the second RGB information, or the average or weighted average of the first and second RGB information. The difference between Method 2 and Method 1 is that Method 1 involves replacing the face region, which may result in a mismatch between the face and body. Method 2, based on the RGB information of pixels, can compensate for the details of the face while maintaining the facial expression and posture in the wide-angle image, thus avoiding any mismatch between the face and body.

[0204] Method 3 involves inputting the face region from the telephoto image and the face region in the first region of the wide-angle image that matches the face region in the telephoto image into a pre-trained face enhancement AI model to obtain an image with enhanced face regions. The face enhancement AI model can be implemented using deep neural networks. Because the face enhancement AI model is trained on large datasets, the pose, expression, and other features of the face in the enhanced image are more stable, and the facial detail compensation is more realistic.

[0205] The phone can use any one of the methods described above, from Method 1 to Method 3. For example, if only the program code for Method 1 is configured in the phone, then Method 1 should be used; or if only the program code for Method 2 is configured, then Method 2 should be used; or if only the program code for Method 3 is configured, then Method 3 should be used. Alternatively, one method can be randomly selected or chosen based on the actual situation. For example, if the phone is determined to have a large memory footprint, Method 1 can be used to prevent lag; if the phone is determined to have a small memory footprint, Method 2 or Method 3 can be used to improve shooting quality.

[0206] Optionally, after S1405, the phone can store the fused image, for example, in the photo album. Optionally, the phone can also store the wide-angle image and / or, telephoto image (e.g., an image of a little girl's face and an image of her father's face) together.

[0207] In the foregoing embodiments, the image capturing method provided in this application is performed independently by a mobile phone. In other embodiments, the image capturing method provided in this application can be performed jointly by a mobile phone and a server. For example, please refer to Figure 15, which is another schematic flowchart of the image capturing method provided in this application. The left half of Figure 15 represents the terminal side, i.e., the terminal device side, and the right half represents the cloud side, i.e., the server side. As shown in Figure 15, the process includes:

[0208] S1501, enter group photo mode on the end.

[0209] S1502, wide-angle shooting from the end.

[0210] S1503, the edge sends the wide-angle image to the cloud.

[0211] S1504, long-focus scanning is performed at the end.

[0212] For the implementation principles of S1501 to S1504, please refer to the previous description, which will not be repeated here.

[0213] S1505: The end-side determines whether the telephoto scanning has ended. If it has ended, proceed to S1506; otherwise, continue with S1504.

[0214] S1506, the end side sends the telephoto image to the cloud side.

[0215] Optionally, S1506 can occur after S1505, that is, after determining that the telephoto scanning is finished, the telephoto image (possibly more than one telephoto image) is sent to the server; or, S1506 can also occur before or simultaneously with S1505. For example, each time a telephoto image is scanned, the image is sent to the server. If a rescan is needed, a withdrawal command can be sent to the server. In short, the execution order of S1506 and S1505 is not limited in this application embodiment.

[0216] S1507, the cloud side performs image registration between the wide-angle image and the telephoto image.

[0217] S1508, the cloud side extracts the first feature information from the telephoto image.

[0218] S1509, the cloud side extracts the second feature information from the first region of the wide-angle image.

[0219] S1510, the cloud side performs identity matching based on the first feature information and the second feature information.

[0220] S1511, the cloud side merges telephoto and wide-angle images.

[0221] For the implementation principles of S1507 to S1511, please refer to the previous description, which will not be repeated here.

[0222] S1512, the cloud side sends the fused image to the edge side.

[0223] S1513, the terminal side stores and / or displays the image.

[0224] The above embodiments use taking a group photo as an example. It should be noted that the technical solutions provided in this application embodiment can also be used for other shooting scenarios. For example, when a mobile phone is shooting a street scene, the technical solutions provided in this application embodiment can also be used. For example, the mobile phone provides a street scene mode. After entering the street scene mode, the final street scene image is obtained through three processes: wide-angle shooting, telephoto scanning, and image fusion. Optionally, the mobile phone may include both a group photo mode and a street scene mode; or, it may only include one mode, such as the first mode, in which the technical solutions provided in this application embodiment are used for shooting. Thus, the mobile phone can automatically or manually enter the first mode. Taking automatic entry as an example, when the mobile phone determines that the current shooting scene is a preset scene (e.g., a group photo scene or a street scene), it automatically enters the first mode. Taking manual entry as an example, regardless of whether it is a group photo, a street scene, or another scene, as long as a user operation instructing the user to enter the first mode is received, the mobile phone enters the first mode for shooting. The principle of the user operation for entering the first mode is the same as the principle of entering the group photo mode in Figure 6 above, and will not be repeated.

[0225] Figure 16 is a flowchart illustrating an image capture method according to an embodiment of this application. This method can be applied to terminal devices, such as the mobile phone mentioned earlier. Taking a mobile phone as an example, the mobile phone includes a wide-angle camera and a telephoto camera. As shown in Figure 16, the process includes:

[0226] S1601, launch the camera application.

[0227] For example, the way a mobile phone launches the camera application can be seen in Figure 4 above. For instance, in Figure 4(a), the mobile phone launches the camera application when it receives an operation on icon 401 for the camera application.

[0228] S1602, Display the first shooting interface, wherein the first shooting interface includes a first preview image, which is an image captured by a wide-angle camera.

[0229] For example, the first shooting interface may be the shooting interface 702 shown in FIG7, which includes a first preview image captured by a wide-angle camera, such as a family photo.

[0230] S1603, in response to the shooting command, captures the first image using a wide-angle camera.

[0231] For example, in Figure 9(a), when the mobile phone receives an operation on the shutter button, it captures the first image, namely a family photo, through the wide-angle camera.

[0232] S1604, a second shooting interface is displayed, wherein the second shooting interface includes a main preview area and an auxiliary preview area. The main preview area displays a second preview image, which is an image captured by the telephoto camera. The second preview image corresponds to a first area in the first image. The auxiliary preview area displays the first image, and the first area on the first image is highlighted.

[0233] For example, the second shooting interface can be the shooting interface 902 shown in Figure 9(b). The shooting interface 902 includes a main preview area and an auxiliary preview area. The main preview area displays the second preview image captured by the telephoto camera, and the auxiliary preview area displays the first image captured by the wide-angle camera. Moreover, a first area (i.e., area 905) on the first image in the auxiliary preview area corresponds to the second preview image of the telephoto camera in the main preview area. That is, the first area is the current scanning area of ​​the telephoto camera.

[0234] S1605, in response to the start scanning command, a second image is captured by the telephoto camera, wherein the second image corresponds to the first region.

[0235] For example, taking Figure 9(b) as an example, after the mobile phone receives the operation on the start scan button 904, it captures a second image, such as an image of a little girl's face, through the telephoto camera. Optionally, after the mobile phone receives the operation on the start scan button 904, it can also capture a second image through the telephoto camera when it determines that the mobile phone has stabilized for a preset time, so as to ensure that the captured image is not blurry.

[0236] S1606, in response to the end scan command, a third image is displayed, wherein the third image is obtained by fusing the second image and the first image.

[0237] For example, in Figure 9(b), after the mobile phone captures a second image, such as an image of a little girl's face, the first area in the auxiliary preview area can be adjusted from the original first display method to the second display method to indicate that the first area has been scanned. For example, in Figure 11(b), the first area (area 905) is filled with gray to indicate that the area has been scanned.

[0238] Taking Figure 11(b) as an example, when the mobile phone receives an operation on the end-scan button 907, it can fuse the second image captured by the telephoto camera (e.g., an image of a little girl's face) with the first image captured by the wide-angle camera. Optionally, the mobile phone can also display a fusion prompt as shown in Figure 12. After fusion, the mobile phone can display the fused third image.

[0239] Figure 17 is a schematic diagram of the structure of an electronic device 1700 provided in an embodiment of this application. The electronic device 1700 can be a terminal device (e.g., a mobile phone) or a server (e.g., a cloud device) as described above. As shown in Figure 17, the electronic device 1700 may include: one or more processors 1701; one or more memories 1702; a communication interface 1703; and one or more computer programs 1704. These devices can be connected via one or more communication buses 1705. The one or more computer programs 1704 are stored in the memory 1702 and configured to be executed by the one or more processors 1701. The one or more computer programs 1704 include instructions. For example, when the electronic device 1700 is a mobile phone as described above, the instructions can be used to perform the relevant steps of the mobile phone as described in any of the embodiments of Figures 1 to 15 above. For example, when the electronic device 1700 is a server as described above, the instructions can be used to perform the relevant steps of the server as described in any of the embodiments of Figures 1 to 15 above. The communication interface 1703 is used to enable communication between the electronic device 1700 and other devices; for example, the communication interface can be a transceiver.

[0240] In the embodiments provided above, the methods provided by the present application are described from the perspective of a terminal device (e.g., a mobile phone) as the executing entity. To implement the functions of the methods provided in the embodiments of the present application, the terminal device may include hardware structures and / or software modules, implementing the above functions in the form of hardware structures, software modules, or a combination of hardware structures and software modules. Whether a particular function is executed in the form of hardware structures, software modules, or a combination of hardware structures and software modules depends on the specific application and design constraints of the technical solution.

[0241] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present invention are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid state disk (SSD)). Where there is no conflict, the solutions in the above embodiments can be combined.

[0242] Based on the above embodiments, this application also provides a computer program product containing instructions, which, when run on a computer, causes the computer to execute the methods described in the embodiments of this application.

[0243] Based on the above embodiments, this application also provides a computer-readable storage medium storing a computer program, which, when executed by a computer, causes the computer to perform the methods described in the embodiments of this application.

[0244] Based on the above embodiments, this application also provides a chip for reading computer programs stored in a memory to implement the methods described in the embodiments of this application.

[0245] Based on the above embodiments, this application provides a chip system including a processor for supporting a computer device in implementing the methods described in the embodiments of this application. In one possible design, the chip system further includes a memory for storing necessary programs and data of the computer device. This chip system may be composed of chips or may include chips and other discrete devices.

[0246] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0247] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in one or more blocks of the flowchart illustrations and / or one or more blocks of the block diagrams.

[0248] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means that implement the functions specified in one or more flowcharts and / or one or more block diagrams.

[0249] These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process, such that the instructions, which execute on the computer or other programmable apparatus, provide steps for implementing the functions specified in one or more flowcharts and / or one or more block diagrams.

[0250] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the scope and intent of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application is also intended to include such modifications and variations.

Claims

1. An image capturing method, characterized in that, Applied to a terminal device, the terminal device including a wide-angle camera and a telephoto camera, the method includes: Launch the camera application on the terminal device; The first shooting interface is displayed, wherein the first shooting interface includes a first preview image, which is an image captured by the wide-angle camera; In response to a shooting command, a first image is captured using the wide-angle camera; The second shooting interface is displayed, which includes a main preview area and an auxiliary preview area. The main preview area displays a second preview image, which is an image captured by the telephoto camera. The second preview image corresponds to a first area in the first image. The auxiliary preview area displays the first image, and the first area on the first image is highlighted. In response to a start scanning command, a second image is captured using the telephoto camera, wherein the second image corresponds to the first region; In response to a scan end command, a third image is displayed, wherein the third image is obtained by fusing the second image and the first image.

2. The method according to claim 1, characterized in that, Before displaying the first shooting interface, the method further includes: Upon receiving the first input operation, enter the first mode.

3. The method according to claim 1, characterized in that, Before displaying the first shooting interface, the method further includes: The third shooting interface is displayed, which includes a third preview image, which is an image captured by a camera other than the wide-angle camera. When it is determined that the third preview image contains preset objects and the number of preset objects reaches a preset number, the first mode is entered.

4. The method according to claim 2 or 3, characterized in that, Prior to entering the first mode, the method further includes: Output a first prompt message, wherein the first prompt message is used to prompt entry into the first mode.

5. The method according to any one of claims 2-4, characterized in that, After entering the first mode, the method further includes: Output a second prompt message, wherein the second prompt message is used to indicate that the first mode has been entered.

6. The method according to any one of claims 1-5, characterized in that, After obtaining a first image by capturing it with the wide-angle camera in response to a shooting command, the method further includes: Receive the return request and return to the first shooting interface; In response to the shooting command, the first image is re-captured using the wide-angle camera.

7. The method according to any one of claims 1-6, characterized in that, The method further includes: The position and / or area of ​​the first region in the first image varies with the shooting range of the telephoto camera.

8. The method according to any one of claims 1-7, characterized in that, The step of capturing a second image via the telephoto camera in response to a start scanning command includes: In response to a start scanning command, when the stability duration of the terminal device reaches a preset duration or a shooting command is received, the second image is captured by the telephoto camera.

9. The method according to any one of claims 1-8, characterized in that, The first area is highlighted, including: The first area is displayed in a first display mode, wherein the first display mode includes: outlining with a dashed box, and / or filling with a first color.

10. The method according to any one of claims 1-9, characterized in that, After capturing a second image via the telephoto camera in response to a start scanning command, the method further includes: The first area on the first image within the auxiliary preview area changes from the first display mode to the second display mode.

11. The method according to claim 10, characterized in that, The second display method includes: using a solid line frame within the text, and / or using a second color for filling.

12. The method according to any one of claims 1-11, characterized in that, After capturing the second image using the telephoto camera, the method further includes: The terminal device is moved to capture a fourth image using the telephoto camera, wherein the fourth image corresponds to a second region within the first image; In response to a scan end command, a fifth image is displayed, wherein the fifth image is a fusion of the first image, the second image, and the fourth image.

13. The method according to claim 12, characterized in that, Before capturing the fourth image using the telephoto camera, the method further includes: displaying the fourth preview image in the main preview area, the fourth preview image being an image captured by the telephoto camera, the fourth preview image corresponding to the second area, and highlighting the second area in the auxiliary preview area using a third display method; After capturing the fourth image using the telephoto camera, the method further includes changing the second area within the auxiliary preview area from the third display mode to the fourth display mode.

14. The method according to any one of claims 1-13, characterized in that, Before displaying the second shooting interface, the method further includes: Determine the region to be scanned within the first image, wherein the region to be scanned is a default region, a user-specified region, or a region containing a preset object on the first image; The first image is displayed in the auxiliary preview area, and the area to be scanned in the first image is highlighted using a fifth display mode, wherein the first area is located within the area to be scanned.

15. The method according to any one of claims 1-14, characterized in that, The third image is obtained by fusing the second image and the first image, including: Determine the first RGB information of the first pixel in the first image; Determine the second RGB information of the second pixel point on the second image, wherein the second pixel point corresponds to the first pixel point; Based on the first RGB information and the second RGB information, determine the third RGB information; Replace the first RGB information of the first pixel in the first image with the third RGB information.

16. The method according to any one of claims 1-15, characterized in that, Before displaying the third image, the method further includes: The first image and the second image are sent to the server, which then merges the first image and the second image to obtain a third image. Receive the third image from the server.

17. A terminal device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the method as described in any one of claims 1 to 16.

18. A chip system, characterized in that, The chip system includes a processing circuit and a storage medium, wherein the storage medium stores instructions; when the instructions are executed by the processing circuit, they implement the method as described in any one of claims 1-16.

19. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it implements the method as described in any one of claims 1 to 16.

20. A computer program product, characterized in that, The computer program product includes a computer program that, when run on a computer, causes the computer to perform the method as described in any one of claims 1 to 16.

Images