Image shooting method and related equipment

By combining the parameter settings of the wide-angle camera and the telephoto camera and fusing their images, the problem of insufficient clarity of the wide-angle camera is solved, and high-definition and wide-angle image shooting effects are achieved.

CN116095516BActive Publication Date: 2025-09-23HUAWEI TECH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202111282790.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-11-01
Publication Date
2025-09-23
Estimated Expiration
2041-11-01

AI Technical Summary

Technical Problem

Although wide-angle cameras can capture images with a wide viewing angle, their image resolution capabilities are weak, resulting in insufficient clarity of panoramic images and affecting the user experience.

Method used

The first camera and the second camera are used to shoot together. The shooting parameters of the second camera are related to the first camera. The image quality is improved by fusing the two images.

Benefits of technology

It improves image clarity while maintaining a wide viewing angle, enhancing the user's shooting experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116095516B_ABST
    Figure CN116095516B_ABST
Patent Text Reader

Abstract

A method for capturing an image and related equipment. An electronic device includes a first camera and a second camera. In response to a first operation, the electronic device displays a capture interface, wherein a first image is displayed in the capture interface. The first image is an image captured by the first camera. In response to a second operation, a second image is captured. The second image is obtained based on the first image and a third image. The third image is captured by the second camera, and there is an overlapping area between the third image and the first image. The overlapping area includes at least one identical object. The second capture parameters used by the second camera when capturing the third image are related to the first capture parameters used by the first camera when capturing the first image. In this way, the electronic device can capture images with higher clarity, improving the shooting experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to an image capturing method and related equipment. Background Art

[0002] Users have increasingly sophisticated requirements for image capture. For example, when traveling, users often want to capture the entire scenery along the way. To meet these needs, some electronic devices (such as mobile phones) have panoramic shooting functions. These functions are used to capture images with a wide angle of view (FOV), meaning that more objects can be captured in a single image.

[0003] Generally, electronic devices are equipped with wide-angle cameras for capturing panoramic images. However, wide-angle cameras have relatively weak image resolution (i.e., camera resolution). Therefore, although panoramic images captured by wide-angle cameras include more scenery, the image details are not clear enough, affecting the shooting experience. Summary of the Invention

[0004] This application provides an image capture method and related equipment for improving the image capture experience.

[0005] In a first aspect, an image capture method is provided. The method is applicable to an electronic device. The electronic device includes a first camera and a second camera, and the method includes: in response to a first operation, displaying a capture interface, wherein a first image is displayed in the capture interface, where the first image is an image captured by the first camera; in response to a second operation, capturing a second image, where the second image is obtained based on the first image and a third image, where the third image is captured by the second camera, and where there is an overlapping area between the third image and the first image, where the overlapping area includes at least one identical object; wherein second capture parameters used by the second camera when capturing the third image are related to the first capture parameters used by the first camera when capturing the first image.

[0006] In other words, the first camera on the electronic device captures a first image, and the second camera captures a third image, and there is an overlapping area between the third image and the second image. The second image is obtained by combining the third image with the first image, for example, by fusing the third image with the first image to obtain the second image. This improves the image quality of the second image compared to the first image, thereby enhancing the shooting experience. Furthermore, because the second shooting parameters used by the second camera when capturing the third image are related to the first shooting parameters used by the first camera when capturing the first image, the third image and the first image can be more closely integrated, further improving the image quality of the second image.

[0007] In one possible design, the first camera is a wide-angle camera and the second camera is a telephoto camera.

[0008] Generally, a wide-angle camera has a weaker image resolution capability (i.e., camera resolution). Therefore, although a panoramic image captured by a wide-angle camera includes more scenery, the image clarity is lower. A telephoto camera, on the other hand, has a stronger image resolution capability (i.e., camera resolution). Therefore, the image captured by the telephoto camera has a higher clarity. In the embodiment of the present application, the electronic device obtains a second image based on the image captured by the telephoto camera (the third image) and the panoramic image captured by the wide-angle camera (i.e., the first image). In this way, the second image can have both a wide viewing angle and a higher clarity.

[0009] In one possible design, the first shooting parameters include: at least one of a first exposure time, a first aperture number, a first sensitivity, a first white balance, a first object distance, and a first focal length; and / or, the second shooting parameters include: at least one of a second exposure time, a second aperture number, a second sensitivity, a second white balance, a second object distance, and a second focal length. It should be noted that these are examples of shooting parameters and may include more or fewer parameters, such as saturation, color temperature, filters, etc., as long as the second shooting parameters are related to the first shooting parameters.

[0010] In one possible design, the second camera shooting is related to the first shooting parameter, including at least one of the following:

[0011] A difference between the second white balance degree and the first white balance degree is less than a first threshold;

[0012] The difference between the second focal length and the first focal length is less than a second threshold;

[0013] a difference between the second object distance and the first object distance is less than a third threshold;

[0014] The first exposure time, the first sensitivity, and the first aperture number satisfy a preset functional relationship with the second exposure time, the second sensitivity, and the second aperture number.

[0015] It should be noted that, since the second shooting parameters when the second camera shoots the third image are related to the first shooting parameters when the first camera shoots the first image, the third image and the first image can be more closely integrated, thereby improving the image quality of the second image.

[0016] In a possible design, the preset functional relationship includes:

[0017]

[0018] Among them, S1 is the first sensitivity, T1 is the first exposure time, A1 is the first aperture number, A2 is the second aperture number, S2 is the second sensitivity, and T2 is the second exposure time.

[0019] In one possible design, the electronic device captures a second image in response to a second operation, including: determining a first area on the first image in response to the second operation; adjusting the shooting angle of the second camera so that the object in the first area is within the field of view of the second camera, and capturing a third image; and obtaining the second image based on the first image and the third image. In other words, after obtaining the first image, the electronic device determines a first area on the first image, captures details of the first area to obtain a third image, and obtains the second image based on the third image and the first image. The second image obtained in this way supplements the details of the first area, improving the clarity of the first area.

[0020] Exemplarily, the first region satisfies at least one of the following conditions:

[0021] an area on the first image where the subject of interest to the user is located;

[0022] a central area of ​​the first image;

[0023] User-defined region;

[0024] An area on the first image whose clarity is lower than a preset clarity.

[0025] Therefore, in the embodiment of the present application, after the electronic device obtains the first image, it can take detailed photos of the area of ​​interest to the user or the area set by the user on the first image to improve the clarity of these areas. In this way, the clarity of the area of ​​interest to the user is improved, which helps to enhance the shooting experience.

[0026] In one possible design, the electronic device captures a second image in response to a second operation, including: displaying N shooting indicator points on the first image in response to the second operation, where N is a positive integer; adjusting the shooting angle of the second camera so that the subject within the area where the first shooting indicator point of the N shooting indicator points is located is within the field of view of the second camera, and capturing a third image; and upon detecting a third operation for indicating a capture, obtaining the second image based on the first image and the third image. In other words, the electronic device displays N shooting indicator points on the first image, and the user can capture the subject within the area where some of the shooting indicator points are located to improve the detail clarity of the area where these shooting indicator points are located.

[0027] In one possible design, the electronic device captures a second image in response to a second operation, including: displaying N shooting indicator points on the first image in response to the second operation, where N is a positive integer; sequentially adjusting the shooting angle of the second camera so that the second camera captures the subject within the area where each shooting indicator point is located, thereby obtaining N third images; and upon detecting that all shooting indicator points have been captured, obtaining the second image based on the N third images and the first image. In other words, the electronic device displays N shooting indicator points on the first image, and the electronic device can capture the subject within the area where each shooting indicator point is located, thereby obtaining N third images, and then obtain the second image based on the N third images and the first image.

[0028] In a possible design, the number of the shooting indication points is related to the first shooting parameter and / or the second shooting parameter; wherein the number of the shooting indication points includes the number in the horizontal direction and / or the number in the vertical direction.

[0029] For example, the number of shooting indication points is related to the first shooting parameter and / or the second shooting parameter, including: the number k1 of the shooting indication points in the horizontal direction is related to the ratio of the viewing angle range of the first camera in the horizontal direction to the viewing angle range of the second camera in the horizontal direction.

[0030] Exemplarily, the number k1 of the shooting indication points in the horizontal direction satisfies:

[0031]

[0032] Among them, W1 is the width of the imaging plane corresponding to the first camera, f1 is the focal length of the first camera, W2 is the width of the imaging plane corresponding to the second camera, and f2 is the focal length of the first camera.

[0033] For another example, the number of the shooting indication points is related to the first shooting parameter and / or the second shooting parameter, including: the number k2 of the shooting indication points in the vertical direction is related to the ratio of the viewing angle range of the first camera in the vertical direction to the viewing angle range of the second camera in the vertical direction.

[0034] Exemplarily, the number k2 of the shooting indication points in the vertical direction satisfies:

[0035]

[0036] Among them, h1 is the height of the imaging plane corresponding to the first camera, f1 is the focal length of the first camera, h2 is the height of the imaging plane corresponding to the second camera, and f2 is the focal length of the first camera.

[0037] It should be noted that, since the number k1 of horizontal shooting indicator points is related to the ratio of the horizontal viewing angle of the first camera to the horizontal viewing angle of the second camera, if each shooting indicator point corresponds to an area (the center point of the area is the shooting indicator point), then k1 areas correspond to the horizontal direction. These k1 areas can completely cover the width of the first image (i.e., the horizontal width). If detail supplementation is performed on each area, it is possible to ensure that all areas in the horizontal direction of the first image captured by the first camera are supplemented with details. Similarly, since the number k2 of vertical shooting indicator points is related to the ratio of the vertical viewing angle of the first camera to the vertical viewing angle of the second camera, if each shooting indicator point corresponds to an area (the center point of the area is the shooting indicator point), then k2 areas correspond to the vertical direction. These k2 areas can completely cover the height of the first image (i.e., the vertical height). If detail supplementation is performed on each area, it is possible to ensure that all areas in the vertical direction of the first image captured by the first camera are supplemented with details. In this way, it can be avoided that some areas on the first image are not supplemented with details, resulting in poor image integrity.

[0038] In a second aspect, an image shooting method is provided, which is applied to a system including a first electronic device and a second electronic device, the method including: the first electronic device displays a shooting interface in response to a first operation, and a first image is displayed in the shooting interface, where the first image is an image captured by the first camera on the second electronic device; the first electronic device obtains a third image in response to a second operation by shooting with the second camera on the first electronic device, and the third image has an overlapping area with the first image, and the overlapping area includes at least one identical object; wherein the second shooting parameters used by the second camera when shooting the third image are related to the first shooting parameters used by the first camera when shooting the first image; the first electronic device obtains a second image based on the third image and the first image; or, the first electronic device obtains the second image based on the third image and the first image and sends the second image to the second electronic device.

[0039] In a possible design, the first shooting parameter includes: at least one of a first exposure time, a first aperture number, a first sensitivity, a first white balance, a first object distance, and a first focal length; and / or,

[0040] The second shooting parameter includes at least one of a second exposure time, a second aperture number, a second sensitivity, a second white balance, a second object distance, and a second focal length.

[0041] In one possible design, the second camera shooting is related to the first shooting parameter, including at least one of the following:

[0042] A difference between the second white balance degree and the first white balance degree is less than a first threshold;

[0043] The difference between the second focal length and the first focal length is less than a second threshold;

[0044] a difference between the second object distance and the first object distance is less than a third threshold;

[0045] The first exposure time, the first sensitivity, and the first aperture number satisfy a preset functional relationship with the second exposure time, the second sensitivity, and the second aperture number.

[0046] In a possible design, the preset functional relationship includes:

[0047]

[0048] Among them, S1 is the first sensitivity, T1 is the first exposure time, A1 is the first aperture number, A2 is the second aperture number, S2 is the second sensitivity, and T2 is the second exposure time.

[0049] In one possible design, the first electronic device responds to the second operation and obtains a third image by capturing it through the second camera on the first electronic device, including: the first electronic device determines a first area on the first image in response to the second operation; the first electronic device adjusts the shooting angle of the second camera so that the object in the first area is within the field of view of the second camera, and captures the third image.

[0050] In one possible design, the first region satisfies at least one of the following conditions:

[0051] an area on the first image where the subject of interest to the user is located;

[0052] a central area of ​​the first image;

[0053] User-defined region;

[0054] An area on the first image whose clarity is lower than a preset clarity.

[0055] In one possible design, the first electronic device responds to the second operation and obtains a third image by capturing it through the second camera on the first electronic device, including: the first electronic device displays N shooting indication points on the first image in response to the second operation, where N is a positive integer; the first electronic device adjusts the shooting angle of the second camera so that the object within the area where the first shooting indication point among the N shooting indication points is located is within the field of view of the second camera, and captures the third image.

[0056] In one possible design, the first electronic device responds to the second operation and obtains a third image by capturing it through the second camera on the first electronic device, including: the first electronic device responds to the second operation and displays N shooting indication points on the first image; N is a positive integer; the first electronic device sequentially adjusts the shooting angle of the second camera so that the second camera captures the object within the area where each shooting indication point is located, and obtains N third images.

[0057] In a possible design, the number of the shooting indication points is related to the first shooting parameter and / or the second shooting parameter; wherein the number of the shooting indication points includes the number in the horizontal direction and / or the number in the vertical direction.

[0058] In a possible design, the number of the shooting indication points is related to the first shooting parameter and / or the second shooting parameter, including: the number k1 of the shooting indication points in the horizontal direction satisfies:

[0059]

[0060] Among them, W1 is the width of the imaging plane corresponding to the first camera, f1 is the focal length of the first camera, W2 is the width of the imaging plane corresponding to the second camera, and f2 is the focal length of the first camera.

[0061] In a possible design, the number of the shooting indication points is related to the first shooting parameter and / or the second shooting parameter, including: the number k2 of the shooting indication points in the vertical direction satisfies:

[0062]

[0063] Among them, h1 is the height of the imaging plane corresponding to the first camera, f1 is the focal length of the first camera, h2 is the height of the imaging plane corresponding to the second camera, and f2 is the focal length of the first camera.

[0064] In some possible designs, the first camera is a wide-angle camera and the second camera is a telephoto camera.

[0065] In a third aspect, a system is further provided, comprising: a first electronic device and a second electronic device;

[0066] The first electronic device comprises: a processor; a memory; wherein the memory stores one or more computer programs, and the one or more computer programs include instructions, and when the instructions are executed by the processor, the first electronic device performs the steps of the first electronic device in the method of the second aspect above;

[0067] The second electronic device includes: a processor; a memory; wherein the memory stores one or more computer programs, and the one or more computer programs include instructions, which, when executed by the processor, enable the second electronic device to perform the steps of the second electronic device in the method provided in the second aspect above.

[0068] In a fourth aspect, an electronic device is further provided, comprising:

[0069] a processor, a memory, and one or more programs;

[0070] The one or more programs are stored in the memory, and the one or more programs include instructions. When the instructions are executed by the processor, the electronic device executes the method steps provided in the first aspect above.

[0071] In a fifth aspect, a computer-readable storage medium is also provided, which is used to store a computer program. When the computer program is run on a computer, the computer executes the method provided in the first or second aspect above.

[0072] In a sixth aspect, a computer program product is also provided, comprising a computer program, which, when executed on a computer, enables the computer to execute the method described in the first or second aspect above.

[0073] In the seventh aspect, a graphical user interface on an electronic device is also provided, wherein the electronic device has a display screen, a memory, and a processor, the processor is used to execute one or more computer programs stored in the memory, and the graphical user interface includes a graphical user interface displayed when the electronic device executes the method described in the first aspect or the second aspect above.

[0074] In the eighth aspect, an embodiment of the present application also provides a chip, which is coupled to a memory in an electronic device, and is used to call a computer program stored in the memory and execute the technical solution of the first or second aspect of the embodiment of the present application. In the embodiment of the present application, "coupling" refers to the direct or indirect combination of two components with each other.

[0075] The beneficial effects of the second to eighth aspects mentioned above refer to the beneficial effects of the first aspect and will not be repeated. BRIEF DESCRIPTION OF THE DRAWINGS

[0076] Figure 1 A schematic diagram of the hardware structure of an electronic device provided in one embodiment of the present application;

[0077] Figure 2 A schematic diagram of the software structure of an electronic device provided in one embodiment of the present application;

[0078] Figure 3 A schematic diagram of a mobile phone GUI provided in one embodiment of the present application;

[0079] Figures 4 and 5 A schematic diagram of a mobile phone shooting interface provided in one embodiment of the present application;

[0080] Figure 6 A schematic diagram of a shooting progress indicator provided in an embodiment of the present application;

[0081] Figure 7 A schematic diagram of image fusion provided in one embodiment of the present application;

[0082] Figure 8 A schematic diagram of a camera on an electronic device provided in one embodiment of the present application;

[0083] Figure 9 Other schematic diagrams of a shooting interface of an electronic device provided in one embodiment of the present application;

[0084] FIG. 10A to FIG. 10B A schematic diagram of the imaging principle provided in one embodiment of the present application;

[0085] Figure 11 A schematic diagram of the distribution of shooting indication points provided in one embodiment of the present application;

[0086] Figure 12 A schematic diagram of a flow chart of an image capturing method provided in one embodiment of the present application;

[0087] Figures 13 and 14 Other schematic diagrams of the shooting interface on a mobile phone provided in one embodiment of the present application;

[0088] Figure 15 Another schematic diagram of a flow chart of an image capturing method provided in one embodiment of the present application;

[0089] Figure 16 A schematic diagram of a system provided in one embodiment of the present application;

[0090] Figure 17A schematic diagram of another flow chart of an image capturing method provided in an embodiment of the present application;

[0091] Figure 18 A schematic diagram of the structure of an electronic device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0092] The technical solutions in the embodiments of the present application will be described below in conjunction with the accompanying drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships can exist, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0093] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to indicate or imply relative importance or implicitly specify the number of the technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.

[0094] The image capture method provided in the embodiments of the present application can be applied to electronic devices. The electronic devices can be mobile phones, tablet computers, wearable devices, in-vehicle devices, augmented reality (AR) / virtual reality (VR) devices, laptop computers, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), and other electronic devices. The embodiments of the present application do not impose any restrictions on the specific type of electronic devices.

[0095] Figure 1 The electronic device may be a mobile phone, tablet computer, etc. Figure 1As shown, the electronic device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0096] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors. The controller may be the nerve center and command center of the electronic device. The controller may generate an operation control signal based on the instruction opcode and timing signal to complete the control of instruction fetching and execution. The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the processor may fuse images captured by multiple cameras on the electronic device to obtain a panoramic image. The processor for performing image fusion may be a CPU or a GPU.

[0097] The USB interface 130 is an interface that complies with USB standards, including but not limited to a Mini USB interface, a Micro USB interface, and a USB Type-C interface. The USB interface 130 can be used to connect a charger to charge the electronic device, and can also be used to transfer data between the electronic device and peripheral devices. The charging management module 140 is used to receive charging input from the charger. The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, and the wireless communication module 160.

[0098] The wireless communication function of the electronic device is implemented using antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, a modem processor, and a baseband processor. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.

[0099] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G / 6G applied to electronic devices. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0100] The wireless communication module 160 can provide wireless communication solutions for electronic devices, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0101] In some embodiments, antenna 1 of the electronic device is coupled to mobile communication module 150 , and antenna 2 is coupled to wireless communication module 160 , so that the electronic device can communicate with the network and other devices through wireless communication technology.

[0102] The display screen 194 is used to display a display interface of an application, etc. The electronic device may include one or N display screens 194 , where N is a positive integer greater than one.

[0103] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

[0104] The ISP processes data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can also perform algorithmic optimization on image noise, brightness, and skin tone. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 193.

[0105] Camera 193 is used to capture still images or video. The lens generates an optical image of an object and projects it onto a photosensitive element. The photosensitive element converts the optical signal into an electrical signal, which is then transmitted to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard format, such as RGB or YUV.

[0106] In some embodiments, the electronic device may include one or N cameras 193, where N is a positive integer greater than 1. For example, the electronic device may include N cameras, wherein the N cameras include at least one wide-angle camera. The wide-angle camera is used to capture a panoramic image (referred to as a main image), and the other cameras are used to capture auxiliary images. The auxiliary images are fused with the main image to produce a global image with clearer details. The specific implementation principles will be described later.

[0107] The internal memory 121 can be used to store computer executable program code, which includes instructions. The processor 110 executes various functional applications and data processing of the electronic device by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, and the software code of at least one application, etc. The data storage area can store data (such as images, videos, etc.) generated during the use of the electronic device. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash memory, etc.

[0108] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 110 through the external memory interface 120 to implement data storage.

[0109] The electronic device can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0110] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. Gyroscope sensor 180B can be used to determine the motion posture of the electronic device. In some embodiments, gyroscope sensor 180B can be used to determine the angular velocity of the electronic device around three axes (i.e., x, y, and z axes).

[0111] The gyroscope sensor 180B can be used for anti-shake shooting. The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist in positioning and navigation. The magnetic sensor 180D includes a Hall sensor. The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device in all directions (generally three axes). The distance sensor 180F is used to measure distance. The electronic device can measure the distance through infrared or laser. In some embodiments, when shooting a scene, the electronic device can use the distance sensor 180F to measure the distance to achieve fast focusing. The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The electronic device can use the proximity light sensor 180G to detect that the user is holding the electronic device close to the ear to talk, so as to automatically turn off the screen to save power.

[0112] The ambient light sensor 180L senses ambient light levels. The electronic device can adaptively adjust the brightness of the display 194 based on the perceived ambient light level. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking photos. The ambient light sensor 180L can also work in conjunction with the proximity sensor 180G to detect whether the electronic device is in a pocket to prevent accidental touches. The fingerprint sensor 180H collects fingerprints. The electronic device can use the collected fingerprint characteristics to unlock the device, access app locks, take photos, answer calls, and more.

[0113] The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy.

[0114] The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also known as a "touch screen." The touch sensor 180K is configured to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device, at a location different from that of the display screen 194.

[0115] Bone conduction sensor 180M can acquire vibration signals. In some embodiments, bone conduction sensor 180M can acquire vibration signals from vibrating bones in the human body. Bone conduction sensor 180M can also contact the human pulse to receive blood pressure signals.

[0116] The buttons 190 include a power button, a volume button, etc. The button 190 can be a mechanical button. It can also be a touch button. The electronic device can receive button input and generate key signal input related to the user settings and function control of the electronic device. The motor 191 can generate a vibration prompt. The motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. The indicator 192 can be an indicator light, which can be used to indicate the charging status, power changes, and can also be used to indicate messages, missed calls, notifications, etc. The SIM card interface 195 is used to connect the SIM card. The SIM card can be inserted into the SIM card interface 195 or pulled out from the SIM card interface 195 to achieve contact and separation with the electronic device.

[0117] It is understandable that Figure 1 The components shown do not constitute a specific limitation on the electronic device. The electronic device in the embodiment of the present invention may include Figure 1 More or fewer components in . In addition, Figure 1 The combination / connection relationship between the components can also be adjusted and modified.

[0118] Figure 2 A schematic diagram of the software structure of an electronic device provided in one embodiment of the present application.

[0119] like Figure 2 As shown, the software structure of the electronic device can be a layered structure, which divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. The layered architecture can be, for example, an event-driven architecture, a micro-kernel architecture, a microservice architecture, or a cloud architecture. The system is used as an example to illustrate the software structure of the electronic device 100. In some embodiments, The system is divided into five layers, from top to bottom: application layer, application framework layer, Android runtime (Android runtime) and system library, kernel layer and hardware layer.

[0120] like Figure 2 As shown in the figure, the application layer can include a series of application packages, such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video and other applications.

[0121] The application framework layer provides application programming interface (API) and programming framework for the applications in the application layer. The application framework layer includes some predefined functions. Figure 2As shown, the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like. The window manager is used to manage window programs. It can obtain the display screen size, determine whether a status bar is present, lock the screen, take screenshots, and more. The content provider is used to store and retrieve data and make it accessible to applications. This data may include video, images, audio, incoming and outgoing calls, browsing history and bookmarks, and a phone book. The view system includes visual controls, such as those for displaying text and images. The view system can be used to build applications. The display interface may consist of one or more views. For example, a display interface including a text notification icon may include a view for displaying text and a view for displaying images. The telephony manager is used to provide communication functions for electronic device 100, such as managing call status (including connected and ended calls). The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and more. The notification manager enables applications to display notification information in the status bar. This information can be used to convey notification messages and can be displayed for a short period of time, disappearing automatically without user interaction. For example, the notification manager is used to notify you of download completions, message reminders, and more. The notification manager can also appear as an icon or scrolling text bar in the system's top status bar, such as notifications from background applications. It can also appear as a dialog window on the screen. Examples include text messages in the status bar, beeping, vibrating electronic devices, or flashing indicator lights.

[0122] The Android Runtime consists of core libraries and a virtual machine (VM). The Android runtime is responsible for scheduling and management of the Android system. The core library consists of two parts: one for Java-based functions and the other for the Android core library. The application layer and application framework layer run in the VM. The VM executes Java files from the application layer and application framework layer as binary files. The VM is responsible for performing functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0123] The system library can include multiple functional modules. For example: surface manager, media library, 3D graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), etc. Among them, the surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing, etc. The 2D graphics engine is a drawing engine for 2D drawing.

[0124] The system library also includes a fusion management module and an imaging management module. Among them, the fusion management module is used to calculate the second shooting parameters of the second camera based on the first shooting parameters used when the first camera captures the first image, and is also used to provide the second shooting parameters to the imaging management module so that the shooting parameters of the second camera are set to the second shooting parameters through the imaging management module. When the second camera captures the second image (the second image can be a collection of multiple images) using the second shooting parameters, the imaging management module sends the second image to the fusion management module. The fusion management module fuses the first image captured by the first camera with the second image captured by the second camera. For example, the first camera is a wide-angle camera, then the first image is a panoramic image, the second camera is a telephoto camera, and the second image is a detail image (that is, the viewing angle is smaller than the first image), so the fusion of the first image and the second image can obtain a panoramic image with clear details.

[0125] Optionally, the system library may further include a transmission management module (not shown) for receiving or sending images with other electronic devices. Specifically, the transmission management module may call a transceiver in the hardware layer through the kernel layer to receive or send images.

[0126] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0127] The hardware layer includes multiple cameras, such as a first camera and a second camera, and may also include other hardware such as sensors and displays.

[0128] For ease of understanding, the following embodiments of the present application will take the electronic device being a mobile phone as an example, and will specifically illustrate the image capture method provided in the embodiments of the present application in conjunction with the accompanying drawings.

[0129] Figure 3(a) in the figure shows a graphical user interface (GUI) of a mobile phone, which is a desktop 201 of the mobile phone. The desktop 201 includes icons of various applications (APPs), including a camera application icon 202. When the mobile phone detects an operation (such as a click operation) on the camera application icon 202, the camera application can be started and the screen shown in FIG. Figure 3 Another GUI shown in (b) of FIG. 2 may be referred to as a shooting interface 203. In the preview state, the viewfinder interface 203 may display a preview image in real time. For example, Figure 3 In (b), the shooting interface 203 displays image A. Image A is a landscape image, for example, including objects such as ships.

[0130] Continue to see Figure 3 In (b), the viewfinder interface 203 includes a control 204 for indicating a photo mode, a control 205 for indicating a video mode, a control 206 for indicating a panoramic mode, and a shooting control 207. Figure 3 (b) Take the case where the mobile phone is currently in the photo mode. In the photo mode, when the mobile phone detects an operation on the shooting control 207, the mobile phone performs the photo operation. Assuming that the mobile phone detects an operation on the video control 206, it enters the video mode. In the video mode, when the mobile phone detects an operation on the shooting control 207, the mobile phone performs the video operation (this process is not shown in the figure). When the mobile phone detects an operation on the panorama control 206, it enters the panorama mode and displays the following: Figure 3 (c) shows the shooting interface, which displays image B. Image B has a larger angle of view (FOV) than image A. For example, in addition to the objects already in image A (such as a ship), image B also includes more objects such as trees and dogs. Figure 3 (b) and Figure 3 (c) As can be seen, when the phone switches from camera mode to panoramic mode, the preview image in the shooting interface switches from image A to image B, which is an image with a wider viewing angle. For the convenience of description, image B is referred to as the first image below.

[0131] In some embodiments, the first image is an image captured by a first camera. Exemplarily, the first camera may be a wide-angle camera.

[0132] In some embodiments, when the phone displays Figure 3In the interface shown in (c), if the phone detects an operation on the shooting control 207, it executes the photo action and obtains a panoramic image. This panoramic image is the image captured by the wide-angle camera. This method is relatively convenient, but because the image resolution capability of the wide-angle camera (i.e., the camera resolution) is relatively weak, the panoramic image captured by the wide-angle camera contains more scenery, but the image details are not clear enough.

[0133] To enhance the detail clarity of panoramic images captured by a wide-angle camera, embodiments of the present application provide an image capture method that can supplement details in a panoramic image captured by a wide-angle camera to enhance detail clarity in the panoramic image. For example, in addition to the panoramic image captured by the wide-angle camera, the electronic device also captures a detail image. By fusing the detail image with the panoramic image captured by the wide-angle camera, a panoramic image with enhanced detail clarity is obtained.

[0134] Exemplarily, the electronic device has at least two cameras, for example, a first camera and a second camera. The first camera is used to capture a first image (i.e., a panoramic image), and the second camera is used to capture a second image (a detail image used to supplement the panoramic image with details). The first camera can be a wide-angle camera. Considering that the second image is used to supplement details, the clarity of the details in the second image is ensured as much as possible. Therefore, the second camera can use a camera with a strong image resolution (i.e., camera resolution). For example, the resolution of the second camera is higher than that of the first camera. For example, the second camera can be a telephoto camera, or of course other types of cameras.

[0135] One possible implementation is that when the phone displays Figure 3 (c) If the mobile phone detects an operation on the shooting control 207, the following will be displayed: Figure 4 The interface 400 shown. The interface 400 displays a first image (i.e., image B), and four shooting indicator points: shooting indicator point 402, shooting indicator point 403, shooting indicator point 404, and shooting indicator point 405. Among them, the shooting indicator point is used to prompt the user to aim the second camera at the shooting indicator point to shoot the detail image. It should be noted that the aiming at the shooting indicator point to shoot mentioned here can be understood as adjusting the shooting angle of the second camera so that the object in the area where the shooting indicator point is located is within the field of view of the second camera. For example, taking the shooting indicator point 402 as an example, the area where the shooting indicator point 402 is located is area 1 with the shooting indicator point 402 as the center, a preset length, and a preset width (as shown in the following Figure 71), i.e., adjusting the second camera's shooting parameters so that the subject in area 1 is within the second camera's field of view. The specific values ​​of the preset length and width are not limited in this application. To facilitate user guidance, a prompt message may also be displayed in interface 400: "Aim at the shooting indicator point to shoot."

[0136] To facilitate user guidance regarding alignment with the shooting indicator, interface 400 also includes a reference point 401. The display position of reference point 401 changes as the shooting angle of the second camera changes. The user uses reference point 401 to determine whether alignment with the shooting indicator. For example, if reference point 401 overlaps with or overlays a certain shooting indicator, alignment with that shooting indicator is considered complete. For example, reference point 401 and the shooting indicator may have the same or different shapes and colors.

[0137] For example, Figure 5 (a), when the mobile phone detects that the reference point 401 is aligned with the shooting indicator point 402, the second camera captures the image 1. In some embodiments, when the mobile phone detects that the reference point 401 is aligned with the shooting indicator point 402 and maintains the alignment state for a preset period of time, the second camera captures the image 1; or, when the mobile phone detects that the reference point 401 is aligned with the shooting indicator point 402 and detects a user operation (such as a single click or double click on the reference point 401), the second camera captures the image 1. It should be noted that Figure 5 In (a), the mobile phone detects that the reference point 401 is aligned with the shooting indication point 402 and shoots the image 1. The mobile phone can shoot the image 1 in the background, and the shot image 1 is not displayed in the foreground, that is, the image 1 does not appear in the interface 400. Since the image 1 does not appear in the foreground, the user cannot know whether the shooting of the shooting indication point 402 is completed. In some embodiments, when the mobile phone finishes shooting the image 1, it can output a prompt to prompt the user that the shooting indication point 402 is completed. The prompt can be a sound or a vibration. Or, as Figure 6 As shown, when the mobile phone detects that the reference point 401 is aligned with the shooting indicator point 402 and takes a picture, a shooting progress indicator is displayed on the reference point 401. The shooting progress indicator can be an indicator needle 600. The indicator needle 600 rotates from 0 degrees to 360 degrees, indicating the shooting progress. When it rotates to 360 degrees, it means that the shooting is complete. In short, the mobile phone front desk may not display the detailed image of the shooting (i.e., image 1), but it can prompt the user through certain prompt information that the detailed image of the shooting indicator point 402 is completed.

[0138] After the shooting of the shooting indicator point 402 is completed, the mobile phone can automatically adjust the reference point 401 to align with the next shooting indicator point (such as the shooting indicator point 403) or the user can change the shooting angle of the second camera to make the reference point 401 align with the next shooting indicator point. Figure 5 (b), when the mobile phone detects that the reference point 401 is aligned with the shooting indicator point 403, the second camera captures the image 2. The shooting process of the mobile phone for the shooting indicator point 403 is the same as that for the shooting indicator point 402, and the details are not repeated. Similarly, the mobile phone can capture the remaining shooting indicator points. For example, Figure 5 (c) When the mobile phone detects that the reference point 401 is aligned with the shooting indication point 404, the second camera shoots the image 3. Figure 5 (d) When the mobile phone detects that the reference point 401 is aligned with the shooting indicator point 405, it shoots image 4. In other words, the second camera shoots corresponding detailed images of the four shooting indicator points, namely, images 1 to 4.

[0139] In some embodiments, after the mobile phone detects that the four shooting indication points have been traversed, the mobile phone fuses the four images (images 1 to 4) with the first image to obtain the second image. Specifically, the mobile phone fuses the four images into the corresponding areas on the first image. For example, see Figure 7 , the first image includes four areas, area 1 to area 4. The center point of area 1 is the location of the shooting indicator point 402, the center point of area 2 is the location of the shooting indicator point 403, the center point of area 3 is the location of the shooting indicator point 404, and the center point of area 4 is the location of the shooting indicator point 405. Since image 1 is a detailed image corresponding to area 1, the mobile phone fuses image 1 into area 1, that is, fuses image 1 with the image blocks in area 1. Similarly, image 2 is fused into area 2, image 3 is fused into area 3, and image 4 is fused into area 4. It should be noted that in Figure 3 In (c), the user clicks the capture button 207 once and then enters Figure 4 or Figure 5 The interface 400 shown is used to capture a detailed image. When the phone detects that all four capture indication points have been traversed, it can automatically fuse the four images (images 1 to 4) with the first image to generate a second image. In other words, the user only needs to click the capture button 207 once to capture a detailed panoramic image.

[0140] In other embodiments, Figure 3 In (c), the user clicks the capture button 207 once and then enters Figure 4 or Figure 5The interface 400 shown is used to shoot a detail image. After traversing the four shooting indication points, if the mobile phone detects that the user has triggered the shooting button 207 again, the four images (i.e., image 1 to image 4) are fused with the first image to obtain a second image. In this way, the user needs to click the shooting button 207 twice to complete the panoramic shooting. One possible scenario is that the mobile phone has traversed the four shooting indication points, but will not fuse the four images with the first image before detecting that the user has triggered the shooting button 207 again, allowing the user to reshoot one of the shooting indication points. For example, when the mobile phone detects that the reference point 401 is aligned with the shooting indication point 402 again, it shoots image 5 and replaces image 1 with image 5. When the mobile phone detects that the user has triggered the shooting button 207 again, the four images (image 2 to image 5) are fused with the first image to obtain the second image.

[0141] In some embodiments, it is not necessary to traverse all four shooting indication points. For example, only shooting indication point 402 and shooting indication point 403 are shot to obtain two detail images (i.e., image 1 and image 2), and these two images are fused with the first image to obtain the second image. One implementation method is to Figure 3 In (c), the user clicks the capture button 207 once and then enters Figure 4 In the interface 400, the user aligns the reference point 401 with the shooting indicator point 402 to obtain image 1, and aligns the reference point 401 with the shooting indicator point 403 to obtain image 2. At this time, the mobile phone detects that the user has triggered the shooting button 207 again, and then merges image 1 and image 2 with the first image to obtain the second image. In this process, the shooting indicator point 404 and the shooting indicator point 405 are not photographed. In this way, the user can only add details to the area of ​​interest. For example, Figure 5 (d) In the first image, the user only cares about the shooting quality of the area where the dog is located. In this case, only the shooting indicator point 404 can be photographed in detail. This not only reduces the workload but also does not affect the user's shooting experience because the detail clarity of the part that the user cares about has been improved.

[0142] In the above embodiment, the mobile phone uses the second camera to shoot four shooting indication points respectively. In other embodiments, the mobile phone can also use different cameras to shoot four shooting indication points respectively. For example, see Figure 8, five cameras are arranged on the back of the mobile phone (the side opposite to the mobile phone display screen), among which camera 1 is a wide-angle camera (i.e., the first camera) for capturing the first image. Cameras 2 to 5 can be telephoto cameras or other types of cameras. Cameras 2 to 5 are respectively used to shoot different shooting indication points. For example, image 1 can be taken by camera 2, image 2 can be taken by camera 3, image 3 can be taken by camera 4, and image 4 can be taken by camera 5. Alternatively, image 1 and image 2 are taken by camera 2, image 3 and image 4 are taken by camera 3, and so on, which is not limited in the embodiments of the present application.

[0143] In the above embodiment, the mobile phone displays the shooting prompt point, and instructs the user to shoot the detail image through the shooting prompt point. In other embodiments, the mobile phone may not display the shooting prompt point. For example, when the mobile phone displays Figure 3 In the interface shown in (c), if the mobile phone detects an operation on the shooting control 207, the mobile phone background determines a first area on the first image. The first area is the area on the first image to be supplemented with details. After determining the first area, the mobile phone adjusts the shooting angle of the second camera so that the subject in the first area is within the shooting range of the second camera, and uses the second camera to capture a third image. The third image is a detailed image used to supplement the details of the first area. The mobile phone integrates the third image into the first area on the first image to obtain a second image. The second image is a panoramic image but has higher detail clarity than the first image. In this method, after the user clicks the shooting control 207, the mobile phone does not display a shooting prompt point, but automatically identifies the first area and captures a detailed image (i.e., the third image) of the first area, and integrates the third image into the first area of ​​the first image to obtain the second image. In other words, the user automatically obtains a panoramic image with higher detail clarity by clicking the shooting control 207 once.

[0144] For example, the first area may be the area of ​​the first image where the user's subject of interest is located. For example, the phone may record which subjects the user has retouched and the number of times each subject has been retouched. In this case, the subject of interest to the user may be one that has been retouched more than a preset number of times. Alternatively, if the phone stores multiple images and the number of images containing a certain subject (e.g., a dog) exceeds a preset number, then that subject is the subject of interest to the user.

[0145] Alternatively, the first area is an area on the first image whose definition is lower than a preset definition.

[0146] Alternatively, the first area is a central area of ​​the first image.

[0147] Alternatively, the first area can also be an area set by the user. For example, the user can Figure 3In the interface shown in (c), the first area is selected by circling the area. In this way, the user can specify which area on the first image needs to be supplemented with details, thereby improving the clarity of the details in the area of ​​interest to the user.

[0148] In some embodiments, the first region may be one region or multiple regions. Taking two regions, namely the first region and the second region, as an example, the mobile phone adjusts the shooting angle of the second camera to capture the first region to obtain a third image, then adjusts the shooting angle of the second camera to capture the second region to obtain a fourth image, and then fuses the third image into the first region on the first image, and fuses the fourth image into the second region on the first image to obtain the second image.

[0149] As previously mentioned, the mobile phone captures detail images using the second camera. It is understood that the quality of the images captured by the second camera is related to the second camera's shooting parameters, which may include at least one of sensitivity, shutter speed, focal length, object distance, white balance, brightness, and color temperature. Embodiments of the present application provide at least one of the following methods for determining the second camera's shooting parameters.

[0150] In the first method, the shooting parameters of the second camera are set to the default settings (for example, the default settings are initial values), or they were set when the user last used the second camera. For example, if the shooting parameters set when the user last used the second camera include an ISO of 50 and a shutter speed of 1 / 250 second, then when the second camera shoots the shooting indicator point, it will use an ISO of 50 and a shutter speed of 1 / 250 second.

[0151] In a second embodiment, the second shooting parameters of the second camera are related to the first shooting parameters of the first camera. The first shooting parameters include at least one of a first exposure time, a first aperture number, a first sensitivity, a first white balance, a first object distance, and a first focal length. The second shooting parameters include at least one of a second exposure time, a second aperture number, a second sensitivity, a second white balance, a second object distance, and a second focal length.

[0152] Exemplarily, the second camera shooting is related to the first shooting parameter, including at least one of the following:

[0153] The difference between the second white balance and the first white balance is less than a first threshold. For example, if the first white balance of the first camera is 6000K, then the second white balance of the second camera is 6000K.

[0154] The difference between the second focal length and the first focal length is less than a second threshold. For example, if the first object distance of the first camera is 100 m, then the object distance of the second camera is also 100 m.

[0155] A difference between the second object distance and the first object distance is smaller than a third threshold.

[0156] The first exposure time, the first sensitivity, and the first aperture number satisfy a preset functional relationship with the second exposure time, the second sensitivity, and the second aperture number.

[0157] Exemplarily, the preset functional relationship includes:

[0158]

[0159] Among them, S1 is the first sensitivity, T1 is the first exposure time, A1 is the first aperture number, A2 is the second aperture number, S2 is the second sensitivity, and T2 is the second exposure time.

[0160] In general, the aperture of the camera is known, that is, the second aperture number A2 of the second camera and the first aperture number A1 of the first camera are known. When the first shutter time T1 and the first sensitivity S1 of the first camera are known, the product of the second sensitivity S2 of the second camera and the second shutter time T2 can be obtained by the above formula (1), and then the values ​​of the second sensitivity S2 and the second shutter time T2 can be obtained respectively. For example, assuming that the first shooting parameters of the first camera include: the first sensitivity is 100, the first shutter speed (i.e., the first exposure time) is 1 / 2000, and the first aperture number is 1.8, that is, A1=1.8, S1=100, T1=1 / 2000. Assume that the second aperture number of the second camera is 3.5. Then, according to the above formula (1), S2T2=0.189 can be calculated. For example, S2=50 and T2=1 / 250 can be taken, as long as the product of S2 and T2 is equal to 0.189.

[0161] It should be noted that the above formula (1) may be stored in the mobile phone, or may be obtained through the following steps 1 to 3.

[0162] Step 1: When capturing an image, the exposure time satisfies the following formula (2):

[0163]

[0164] Where A is the aperture number, T is the shutter speed, L is the brightness of the scene, S is the sensitivity, and K is the calibration constant for reflective light meters, which is a constant. The equation (2) satisfied by the above exposure time is known, such as that given in the ISO protocol (ISO2720:1974).

[0165] Step 2: Since L and K are fixed values ​​in formula (2), the above formula (2) can be simplified to the following formula (3):

[0166]

[0167] Step 3: For each lens, the above formula (3) is satisfied. Then, the following formula (1) is satisfied between different lenses:

[0168]

[0169] Therefore, the above formula (1) is obtained through the above steps 1 to 3.

[0170] In the second approach, because the second camera's second shooting parameters are related to the first camera's first shooting parameters when capturing the first image, the detail image captured by the second camera matches the first image. For example, differences in color and brightness are minimal. This allows the detail image (e.g., images 1 through 4) to be seamlessly integrated with the first image.

[0171] In the third method, the shooting parameters of the second camera can also be set by the user, in other words, the user can adjust them. For example, see Figure 9 (a), when the reference point 401 is aligned with the shooting indicator point 402, the shooting parameters 900 (for example, aperture 50, shutter speed 1 / 250 second) are displayed on the first image. The shooting parameters 900 are the current shooting parameters of the second camera. The user can increase or decrease the aperture or shutter speed, for example, by pressing the "+" button to increase or by pressing the "-" button to decrease. The second camera uses the adjusted shooting parameters to shoot the shooting indicator point 402. Similarly, if Figure 9 (b), when the reference point 401 is aligned with the shooting indicator point 403, the shooting parameters 901 are displayed, and the user can adjust the shooting parameters 901. The second camera uses the adjusted shooting parameters to shoot the shooting indicator point 403. Figure 9 (c) When the reference point 401 is aligned with the shooting indication point 404, the shooting parameters 902 are displayed and the user can adjust the shooting parameters. Figure 9 (d) When the reference point 401 is aligned with the shooting indication point 405, shooting parameters 903 are displayed and the user can adjust the shooting parameters.

[0172] It is worth noting that Figure 4 For example, if the second camera uses different shooting parameters when shooting at the four shooting indicator points, then there may be obvious differences in brightness, color, etc. between the images shot at the four shooting indicator points (i.e., images 1 to 4). Figure 7) fusion, the brightness and color of different areas in the fused image will vary significantly, affecting the overall aesthetics of the image. Therefore, in this embodiment of the present application, the second shooting parameters used by the second camera for each shooting indicator point can be the same. For example, the second shooting parameters are determined using any of the first to third methods described above.

[0173] In the above embodiment, four shooting indicator points are used as an example. It should be noted that the embodiment of the present application does not limit the number of shooting indicator points, and can be at least one. For example, the number of shooting indicator points can be set by the system default or by the user, or the number of shooting indicator points can be related to the first shooting parameter of the first camera and / or the second shooting parameter of the second camera. The number of shooting indicator points includes the number in the horizontal direction and / or the number in the vertical direction.

[0174] Exemplarily, the number of the shooting indication points in the horizontal direction satisfies:

[0175]

[0176] Where W1 is the width of the imaging plane corresponding to the first camera, f1 is the focal length of the first camera, W2 is the width of the imaging plane corresponding to the second camera, and f2 is the focal length of the first camera. For example, if the focal length of the first camera is 27mm, i.e., f1 = 27mm, and the focal length of the second camera is 95mm, i.e., f2 = 95mm, and the imaging planes of the two cameras are the same size, with a width w of 36mm and a height h of 24mm, then using formula (4) above, k1 = 3.33. By rounding up, it can be seen that four shooting prompt points are required in the horizontal direction.

[0177] Exemplarily, the number of the shooting indication points in the vertical direction satisfies:

[0178]

[0179] Where h1 is the height of the imaging plane corresponding to the first camera, f1 is the focal length of the first camera, h2 is the height of the imaging plane corresponding to the second camera, and f2 is the focal length of the second camera. For example, if the focal length of the first camera is 27 mm, i.e., f1 = 27 mm, and the focal length of the second camera is 95 mm, i.e., f2 = 95 mm, and the imaging planes of the two cameras are the same size, with a width w of 36 mm and a height h of 24 mm, then using the above formula (5), k2 = 3.33. By rounding up, we can see that four shooting cue points are required in the vertical direction.

[0180] That is, the shooting indication points include a 4*4 matrix with 4 points in the horizontal direction and 4 points in the vertical direction, such as Figure 4 shown.

[0181] In some embodiments, the above formulas (4) and (5) can be stored in the mobile phone in advance, or obtained by the following steps:

[0182] Step 1: Based on the imaging principle of the camera, the horizontal viewing angle α11 of the first camera satisfies the following formula (6):

[0183]

[0184] Wherein, f1 is the focal length of the first camera, and w1 is the size of the imaging plane of the first camera in the horizontal direction, that is, the width.

[0185] The vertical viewing angle α12 of the first camera satisfies the following formula (7):

[0186]

[0187] Wherein, f1 is the focal length of the first camera, and h1 is the size of the imaging plane of the first camera in the vertical direction, that is, the height.

[0188] For easier understanding, see Figure 10A , is a schematic diagram of the relationship between the first camera and the imaging plane. Light passing through the first camera forms an image on this plane. It can be understood that the viewing angle α1 of the first camera includes a viewing angle α11 in the horizontal direction and a viewing angle α12 in the vertical direction. α11 corresponds to the width w1 of the imaging plane, and α12 corresponds to the height h1 of the imaging plane. Here, α11, w1, and focal length f1 satisfy the above formula (6), and α12, h1, and focal length f1 satisfy the above formula (7).

[0189] Similarly, the horizontal viewing angle α21 of the second camera satisfies the following formula (6):

[0190]

[0191] Wherein, f2 is the focal length of the second camera, and w2 is the size of the imaging plane of the second camera in the horizontal direction, that is, the width.

[0192] The vertical viewing angle α22 of the second camera satisfies the following formula (7):

[0193]

[0194] Wherein, f2 is the focal length of the second camera, and h2 is the size of the imaging plane of the second camera in the vertical direction, that is, the height.

[0195] For easier understanding, see Figure 10B, which is a schematic diagram of the relationship between the second camera and the imaging plane. Light passing through the second camera forms an image on this plane. It can be understood that the viewing angle α2 of the first camera includes a viewing angle α21 in the horizontal direction and a viewing angle α22 in the vertical direction. α21 corresponds to the width w2 of the imaging plane, and α22 corresponds to the height h2 of the imaging plane. Here, α21, w2, and the focal length f2 satisfy the above formula (8), and α22, h2, and the focal length f2 satisfy the above formula (9).

[0196] Step 2: The number k1 of shooting indicator points in the horizontal direction is related to the ratio of the horizontal viewing angle α11 of the first camera to the horizontal viewing angle α21 of the second camera. For example, the number of shooting indicator points in the horizontal direction satisfies the following formula:

[0197]

[0198] Therefore, formula (4) is obtained in the above manner.

[0199] The number k2 of shooting indicator points in the vertical direction is related to the ratio of the vertical viewing angle α12 of the first camera and the vertical viewing angle α22 of the second camera. For example, the number of shooting indicator points in the vertical direction is:

[0200]

[0201] Therefore, formula (5) is obtained in the above manner.

[0202] In the above embodiment, the number of shooting indicator points in the horizontal direction is calculated by formula (4), and the number of shooting indicator points in the vertical direction is calculated by formula (5). In other embodiments, after the number of shooting indicator points in the horizontal direction is determined by formula (4), the number of shooting indicator points in the vertical direction can be equal to the number of shooting indicator points in the horizontal direction, or after the number of shooting indicator points in the vertical direction is determined by formula (5), the number of shooting indicator points in the horizontal direction can be equal to the number of shooting indicator points in the vertical direction.

[0203] In other embodiments, the number of shooting indication points may also be set by the user or by system default, etc., which is not limited in the embodiments of the present application.

[0204] After determining the number of shooting indicator points in the horizontal direction and the number in the vertical direction, the positions of the shooting indicator points can be determined, for example, evenly distributed on the first image. For example, the even distribution can be understood as the same distance between each shooting indicator point in the horizontal direction and the same distance between each shooting indicator point in the vertical direction. For example, see Figure 11In the horizontal direction, the distance between each shooting indication point is L1, and in the vertical direction, the distance between each shooting indication point is L2.

[0205] Figure 12 This is a flow chart of an image capturing method provided in one embodiment of the present application. As shown in the figure, the process of the method includes:

[0206] S1201: In response to a first operation, the electronic device displays a shooting interface, where a first image is displayed. The first image is an image captured by the first camera.

[0207] For example, the first operation may be for Figure 3 (b) Operation of the panorama button 206. The shooting interface can be Figure 3 (c) The first camera may be a wide-angle camera on an electronic device. The first image is image B.

[0208] S1201, the electronic device captures a second image in response to a second operation, where the second image is obtained based on the first image and a third image, the third image is captured by the second camera, and there is an overlapping area between the third image and the first image, and the overlapping area includes at least one identical object; wherein, the second shooting parameter used by the second camera when capturing the third image is related to the first shooting parameter used by the first camera when capturing the first image.

[0209] For example, the second operation may be Figure 3 In (c), the user clicks the capture button 207 .

[0210] The viewing angle of the second camera overlaps with the viewing angle of the first camera, so the second image captured by the second camera and the first image captured by the first camera have overlapping areas, and the overlapping areas include at least one identical object. For example, the overlapping area can be Figure 7 In this way, the overlapping area on the second image and the overlapping area on the first image can be fused to improve the clarity of the overlapping area on the first image.

[0211] One possible way to implement this is to Figure 3 In (c), the user clicks the capture button 207 once (i.e., the second operation), and then enters Figure 4 or Figure 5In the illustrated interface 400, four images (images 1 through 4) are captured by capturing detailed images at the capture indicator points. When the phone detects that all four capture indicator points have been traversed, it automatically merges the four images (images 1 through 4) with the first image to create a second image. In other words, the user only needs to click the capture button 207 once to capture a detailed panoramic image. The detailed implementation of this process can be found in the previous description.

[0212] Another possible implementation is to Figure 3 In (c), the user clicks the capture button 207 once (i.e., the second operation), and then enters Figure 4 or Figure 5 The interface 400 shown is used to capture a detailed image. After traversing the four capture indicator points, or capturing only some of the capture indicator points without traversing all of them, the mobile phone detects that the user has triggered the capture button 207 again, and the obtained detailed image is merged with the first image to generate a second image. The specific implementation process of this part is described above.

[0213] Another possible implementation is that the electronic device may not display the shooting indicator point. Figure 3 In the interface shown in (c), if an operation on the shooting control 207 (i.e., the second operation) is detected, the background determines a first area on the first image. The first area is the area on the first image to be supplemented with details. After determining the first area, the mobile phone adjusts the shooting angle of the second camera so that the subject in the first area is within the shooting range of the second camera, and uses the second camera to shoot a third image. The third image is a detailed image used to supplement the details of the first area. The mobile phone integrates the third image into the first area on the first image to obtain a second image. The second image is a panoramic image, but the detail clarity is higher than that of the first image. Please refer to the previous description for the specific implementation process of this part.

[0214] In this embodiment of the present application, the second shooting parameters used by the second camera when capturing the third image are related to the first shooting parameters used by the first camera when capturing the first image. The first shooting parameters include at least one of a first exposure time, a first aperture number, a first sensitivity, a first white balance, a first object distance, and a first focal length. The second shooting parameters include at least one of a second exposure time, a second aperture number, a second sensitivity, a second white balance, a second object distance, and a second focal length.

[0215] Exemplarily, the second camera shooting is related to the first shooting parameter, including at least one of the following:

[0216] The difference between the second white balance degree and the first white balance degree is less than a first threshold. For example, the second white balance degree is equal to the first white balance degree.

[0217] The difference between the second focal length and the first focal length is less than a second threshold. For example, the second focal length is equal to the first focal length.

[0218] The difference between the second object distance and the first object distance is less than a third threshold. For example, the second object distance is equal to the first object distance.

[0219] The first exposure time, the first sensitivity, and the first aperture number satisfy a preset functional relationship with the second exposure time, the second sensitivity, and the second aperture number. The preset functional relationship is Formula (1) mentioned above. For the derivation process of Formula (1), please refer to the above text and will not be repeated for the sake of space.

[0220] The image capture method provided in the embodiment of the present application can also be applied to a system. The system includes a first electronic device and a second electronic device. The first electronic device is used to capture a first image (i.e., a panoramic image), and the second electronic device is used to capture a second image, where the second image is a detail image used to supplement the first image with details, such as images 1 to 4 in the above embodiment. The second image captured by the second electronic device is fused with the first image captured by the first electronic device to obtain a panoramic image with clear details. Among them, the first camera can be a wide-angle camera. The resolution of the second camera is higher than that of the first camera, for example, the second camera can be a telephoto camera, or of course it can be other types of cameras.

[0221] The first electronic device and the second electronic device may be devices of the same type, such as both being mobile phones; or they may be devices of different types, such as one being a mobile phone and the other being a tablet computer, a drone, etc.

[0222] For ease of description, it is taken as an example that the first electronic device is a drone and the second electronic device is a mobile phone.

[0223] In some embodiments, a mobile phone establishes a connection with a drone, including a wireless connection. The specific connection process is not described in detail herein. After the mobile phone and drone are connected, the drone transmits images captured by a first camera on the drone to the mobile phone. For example, a button for transmitting images to the mobile phone is provided on the drone or on a remote control device connected to the drone. The user can use this button to control the drone to transmit the captured images to the mobile phone. The first camera can be a wide-angle camera.

[0224] See Figure 13(a) After the mobile phone enters the panoramic mode, it displays image C, which is an image captured by the wide-angle camera on the mobile phone, and also displays a mark 1300. In some embodiments, when the mobile phone is connected to the drone or when the mobile phone receives an image from the drone, the mark 1300 may appear. When the mobile phone detects the mark 1300, it displays the following: Figure 13 (b) The shooting interface includes image D, which is an image captured by the drone. In other words, the mobile phone displays the image captured by the drone in the shooting interface. For ease of description, image D is referred to as the first image.

[0225] When the mobile phone detects an operation on the shooting control 207, it displays the following Figure 14 Interface 1400 displays a first image (i.e., image D), a reference point 1401, and four shooting indicator points (shooting indicator points 1402 to 1405). The mobile phone uses the second camera to sequentially shoot the four shooting indicator points to obtain four images. The second shooting parameters of the second camera are related to the first shooting parameters of the first camera on the drone. The specific implementation process is the same as above and will not be repeated here.

[0226] After the mobile phone obtains the four detailed images, it can send them to the drone, which then fuses them with the first image captured by the drone itself to create a single, detailed panoramic image. Alternatively, the mobile phone can fuse the four images with the first image captured by the drone itself to create a single, detailed panoramic image, which is then sent to the drone.

[0227] Figure 15 This is a flow chart of the image capture method provided in an embodiment of the present application. The process of the method includes:

[0228] S1501: A first camera on a first electronic device captures a first image.

[0229] S1502: The first electronic device sends the first image and the first shooting parameters used by the first camera when shooting the first image to the second electronic device.

[0230] For example, taking the first electronic device as a drone, the first camera may be a wide-angle camera on the drone.

[0231] S1503: In response to the first operation, the second electronic device displays a shooting interface, in which the first image is displayed.

[0232] For example, taking the second electronic device as a mobile phone, the first operation may be for Figure 13 (a) The operation of the mark 1300. The shooting interface can be Figure 13In the interface shown in (b), the first image may be image D.

[0233] S1504: In response to the second operation, the second electronic device captures a third image using a second camera. The third image overlaps with the first image, and the overlapping area includes at least one identical object. The second shooting parameters used by the second camera to capture the third image are related to the first shooting parameters used by the first camera to capture the first image.

[0234] For example, the second operation may be Figure 13 In (b), the user clicks the capture button 207 .

[0235] One possible way to implement this is to Figure 13 In (b), the user clicks the capture button 207 once (i.e., the second operation), and then enters Figure 14 The interface 1400 shown in the figure obtains four third images (image 1 to image 4) by taking detailed pictures of the four shooting indication points. Figure 4 、 Figure 5 etc. Description.

[0236] Another possible implementation is to Figure 13 In (b), the user clicks the capture button 207 once (i.e., the second operation), and then enters Figure 14 The interface 1400 shown is used to capture a detailed image. After traversing all four capture indicator points, or capturing only some of the capture indicator points without traversing all of them, a third image (which can be one or more images) is obtained when the user triggers the capture button 207 again. Please refer to the previous description for the specific implementation process of this part.

[0237] Another possible implementation is that the mobile phone may not display the shooting indicator point. Figure 13 In the interface shown in (b), if an operation on the capture control 207 (i.e., the second operation) is detected, the background determines a first area on the first image. After determining the first area, the mobile phone adjusts the shooting angle of the second camera so that the subject in the first area is within the shooting range of the second camera, and captures a third image through the second camera. This third image is used to provide a detailed image that supplements the first area. Please refer to the previous description for the specific implementation process of this part.

[0238] In this embodiment of the present application, the second shooting parameters used by the second camera when capturing the third image are related to the first shooting parameters used by the first camera when capturing the first image. The first shooting parameters include at least one of a first exposure time, a first aperture number, a first sensitivity, a first white balance, a first object distance, and a first focal length. The second shooting parameters include at least one of a second exposure time, a second aperture number, a second sensitivity, a second white balance, a second object distance, and a second focal length.

[0239] Exemplarily, the second camera shooting is related to the first shooting parameter, including at least one of the following:

[0240] The difference between the second white balance degree and the first white balance degree is less than a first threshold. For example, the second white balance degree is equal to the first white balance degree.

[0241] The difference between the second focal length and the first focal length is less than a second threshold. For example, the second focal length is equal to the first focal length.

[0242] The difference between the second object distance and the first object distance is less than a third threshold. For example, the second object distance is equal to the first object distance.

[0243] The first exposure time, the first sensitivity, and the first aperture number satisfy a preset functional relationship with the second exposure time, the second sensitivity, and the second aperture number. The preset functional relationship is Formula (1) mentioned above. For the derivation process of Formula (1), please refer to the above text and will not be repeated for the sake of space.

[0244] S1505: The second electronic device sends a third image to the first electronic device.

[0245] S1506: The first electronic device obtains a second image based on the third image and the first image.

[0246] In some other embodiments, S1505 may be replaced by: the second electronic device obtains a second image based on the third image and the first image. S1506 may be replaced by: the second electronic device sends the second image to the first electronic device.

[0247] It should be noted that, in order to save space, the various implementations of this embodiment are not repeated, and the various implementations in the foregoing (such as determining the number and / or positions of shooting indication points) can all be applied to this embodiment.

[0248] Figure 16 A schematic diagram of the structure of a system provided in an embodiment of the present application.

[0249] Figure 16The left half of the diagram shows the software structure of the first electronic device, and the right half shows the software structure of the second electronic device. The first electronic device includes a first fusion management module, a first transmission management module, a first imaging management module, and a first camera. The second electronic device includes a second fusion management module, a second transmission management module, a second imaging management module, and a second camera.

[0250] Figure 17 This is a flow chart of the image capturing method provided in the embodiment of the present application. This flow chart can be understood as Figure 16 The information interaction diagram of the first electronic device and the second electronic device shown or Figure 15 A detailed flow chart of the process. The first electronic device may be, for example, a drone, and the second electronic device may be, for example, a mobile phone. Figure 17 , the process includes:

[0251] S1701: A first camera on a first electronic device captures a first image.

[0252] S1702: The first camera sends the first image and first shooting parameters to the first imaging management module, wherein the first shooting parameters are shooting parameters used by the first camera when capturing the first image.

[0253] S1703: The first imaging management module sends the first image and the first shooting parameters to the first transmission management module.

[0254] S1704: The first transmission management module sends the first image and the first shooting parameter to the second transmission management module in the second electronic device.

[0255] S1705: The second transmission management module sends the first image and the first shooting parameter to the second fusion management module.

[0256] S1706: The second fusion management module calculates the second shooting parameters of the second camera and the number and / or positions of the shooting indication points based on the first shooting parameters.

[0257] As described above, the second shooting parameter is related to the first shooting parameter, and the number of shooting indication points is related to the first shooting parameter and / or the second shooting parameter, so the implementation process of S1605 is described above.

[0258] It is understandable that after S1606 , a shooting indication point is displayed on the second electronic device.

[0259] S1707: The second fusion management module sends the second shooting parameters to the second imaging management module.

[0260] S1708: The second imaging management module sets the shooting parameters of the second camera to the second shooting parameters.

[0261] S1709: The second camera captures a second image using second shooting parameters.

[0262] S1710: The second imaging management module acquires a second image.

[0263] S1711: The second imaging management module sends the second image to the second transmission management module.

[0264] S1712: The second transmission management module sends the second image to the first transmission management module.

[0265] S1713: The first transmission management module sends the second image to the first fusion management module.

[0266] S1714: The first fusion management module fuses the second image with the first image to obtain a panoramic image.

[0267] Figure 18 This is a structural diagram of an electronic device 1800 provided in an embodiment of the present application. The electronic device 1800 may be the mobile phone mentioned above. Figure 18 As shown, the electronic device 1800 may include: one or more processors 1801; one or more memories 1802; a communication interface 1803, and one or more computer programs 1804. The above-mentioned components may be connected via one or more communication buses 1805. The one or more computer programs 1804 are stored in the above-mentioned memory 1802 and are configured to be executed by the one or more processors 1801. The one or more computer programs 1804 include instructions. For example, the above-mentioned instructions can be used to execute the relevant steps of the mobile phone in the corresponding embodiment above. The communication interface 1803 is used to realize communication between the mobile phone and other devices (such as drones). For example, the communication interface can be a transceiver.

[0268] The embodiment of the present application also provides a communication system. The communication system includes a first electronic device and a second electronic device. The first electronic device may be the drone mentioned above, and the second electronic device may be the mobile phone mentioned above. The structures of the first electronic device and the second electronic device can be referred to in the following example. Figure 18 For example, when Figure 18 When the electronic device 18 shown is a first electronic device, when the instructions of one or more computer programs 1804 are executed by the processor, the first electronic device performs the steps of the first electronic device (i.e., drone) as described above. Figure 18When the electronic device 1800 shown is a second electronic device, when the instructions of one or more computer programs 1804 are executed by the processor, the second electronic device executes the steps of the second electronic device (ie, mobile phone) described above.

[0269] In the embodiments provided in the present application above, the method provided in the embodiment of the present application is introduced from the perspective of an electronic device (such as a mobile phone) as the execution subject. In order to implement the various functions in the method provided in the embodiment of the present application above, the electronic device may include a hardware structure and / or a software module, and implement the above functions in the form of a hardware structure, a software module, or a hardware structure plus a software module. Whether a function of the above functions is executed in the form of a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraints of the technical solution.

[0270] As used in the above embodiments, the terms “when…” or “after…” may be interpreted to mean “if…” or “after…” or “in response to determining…” or “in response to detecting…”, depending on the context. Similarly, the phrases “upon determining…” or “if (the stated condition or event) is detected” may be interpreted to mean “if determining…” or “in response to determining…” or “upon detecting (the stated condition or event)” or “in response to detecting (the stated condition or event)”, depending on the context. In addition, in the above embodiments, relational terms such as first and second are used to distinguish one entity from another, without limiting any actual relationship or order between these entities.

[0271] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in yet other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0272] In the above embodiments, all or part of the embodiments can be implemented by software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present invention are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more available media. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)). In the absence of conflict, the solutions of the above embodiments can be used in combination.

[0273] Note: A portion of this patent application contains material which is subject to copyright protection. The copyright owner reserves all rights reserved except for copies of the materials in the patent file or patent record in the Patent Office.

Claims

1. An image capturing method, characterized in that: Applied to an electronic device, the electronic device includes a first camera and a second camera, and the method includes: In response to the first operation, displaying a shooting interface; In response to a second operation, displaying a first image and N shooting indication points, where the first image is an image captured by the first camera, and the N shooting indication points are used to indicate positions on the first image where additional details are required; sequentially adjusting the shooting angle of the second camera so that the second camera shoots the object within the area where each of the N shooting indicator points is located, to obtain N third images, where N is an integer not less than 1; detecting that all shooting indication points have been shot or detecting an operation for instructing shooting, and obtaining a second image based on the N third images and the first image; The second shooting parameters used by the second camera when shooting the N third images are related to the first shooting parameters used by the first camera when shooting the first image.

2. The method according to claim 1, characterized in that The first shooting parameter includes: at least one of a first exposure time, a first aperture number, a first sensitivity, a first white balance, a first object distance, and a first focal length; and / or, The second shooting parameter includes at least one of a second exposure time, a second aperture number, a second sensitivity, a second white balance, a second object distance, and a second focal length.

3. The method according to claim 2, characterized in that The second camera shooting is related to the first shooting parameter, including at least one of the following: A difference between the second white balance and the first white balance is less than a first threshold; The difference between the second focal length and the first focal length is less than a second threshold; a difference between the second object distance and the first object distance is less than a third threshold; The first exposure time, the first sensitivity, and the first aperture number satisfy a preset functional relationship with the second exposure time, the second sensitivity, and the second aperture number.

4. The method according to claim 3, characterized in that The preset functional relationship includes: Among them, S1 is the first sensitivity, T1 is the first exposure time, A1 is the first aperture number, A2 is the second aperture number, S2 is the second sensitivity, and T2 is the second exposure time.

5. The method according to any one of claims 1 to 4, characterized in that The number of the shooting indication points is related to the first shooting parameter and / or the second shooting parameter; The number of the shooting indication points includes the number in the horizontal direction and / or the number in the vertical direction.

6. The method according to claim 5, characterized in that The number of the shooting indication points is related to the first shooting parameter and / or the second shooting parameter, including: The number k1 of the shooting indication points in the horizontal direction satisfies: Among them, W1 is the width of the imaging plane corresponding to the first camera, f1 is the focal length of the first camera, W2 is the width of the imaging plane corresponding to the second camera, and f2 is the focal length of the first camera.

7. The method according to claim 5, characterized in that The number of the shooting indication points is related to the first shooting parameter and / or the second shooting parameter, including: The number k2 of the shooting indication points in the vertical direction satisfies: Among them, h1 is the height of the imaging plane corresponding to the first camera, f1 is the focal length of the first camera, h2 is the height of the imaging plane corresponding to the second camera, and f2 is the focal length of the first camera.

8. An image capturing method, characterized in that: Applied to a system including a first electronic device and a second electronic device, the method includes: The first electronic device displays a shooting interface in response to the first operation; In response to the second operation, the first electronic device displays a first image and N shooting indicator points, where the first image is an image captured by a first camera on the second electronic device, and the N shooting indicator points are used to indicate locations on the first image where additional details are required; sequentially adjusting the shooting angle of the second camera so that the second camera captures a subject within an area where each of the N shooting indicator points is located, to obtain N third images, where N is an integer not less than 1; The second shooting parameters used by the second camera when shooting the N third images are related to the first shooting parameters used by the first camera when shooting the first image; When the first electronic device detects that all shooting indication points have been shot or detects an operation for instructing shooting, it obtains a second image based on the N third images and the first image and sends the second image to the second electronic device.

9. The method according to claim 8, characterized in that The first shooting parameter includes: at least one of a first exposure time, a first aperture number, a first sensitivity, a first white balance, a first object distance, and a first focal length; and / or, The second shooting parameter includes at least one of a second exposure time, a second aperture number, a second sensitivity, a second white balance, a second object distance, and a second focal length.

10. The method according to claim 9, characterized in that The second camera shooting is related to the first shooting parameter, including at least one of the following: A difference between the second white balance and the first white balance is less than a first threshold; The difference between the second focal length and the first focal length is less than a second threshold; a difference between the second object distance and the first object distance is less than a third threshold; The first exposure time, the first sensitivity, and the first aperture number satisfy a preset functional relationship with the second exposure time, the second sensitivity, and the second aperture number.

11. The method according to claim 10, characterized in that The preset functional relationship includes: Among them, S1 is the first sensitivity, T1 is the first exposure time, A1 is the first aperture number, A2 is the second aperture number, S2 is the second sensitivity, and T2 is the second exposure time.

12. The method according to any one of claims 8 to 11, characterized in that The number of the shooting indication points is related to the first shooting parameter and / or the second shooting parameter; The number of the shooting indication points includes the number in the horizontal direction and / or the number in the vertical direction.

13. The method according to claim 12, characterized in that The number of the shooting indication points is related to the first shooting parameter and / or the second shooting parameter, including: The number k1 of the shooting indication points in the horizontal direction satisfies: Among them, W1 is the width of the imaging plane corresponding to the first camera, f1 is the focal length of the first camera, W2 is the width of the imaging plane corresponding to the second camera, and f2 is the focal length of the first camera.

14. The method according to claim 12, characterized in that The number of the shooting indication points is related to the first shooting parameter and / or the second shooting parameter, including: The number k2 of the shooting indication points in the vertical direction satisfies: Among them, h1 is the height of the imaging plane corresponding to the first camera, f1 is the focal length of the first camera, h2 is the height of the imaging plane corresponding to the second camera, and f2 is the focal length of the first camera.

15. An electronic device, characterized in that: include: a processor, a memory, and one or more programs; The one or more programs are stored in the memory, and the one or more programs include instructions. When the instructions are executed by the processor, the electronic device performs the method steps as described in any one of claims 1 to 7.

16. A communication system, characterized in that: include: a first electronic device and a second electronic device; The first electronic device comprises: a processor; a memory; wherein the memory stores one or more computer programs, and the one or more computer programs include instructions, and when the instructions are executed by the processor, the first electronic device performs the steps of the first electronic device in any one of the methods according to claims 8 to 14; The second electronic device includes: a processor; a memory; wherein the memory stores one or more computer programs, and the one or more computer programs include instructions, which, when executed by the processor, enable the second electronic device to perform the steps of the second electronic device in the method according to any one of claims 8 to 14.

17. A computer-readable storage medium, characterized in that The computer-readable storage medium is used to store a computer program, and when the computer program is run on a computer, the computer is caused to perform the method according to any one of claims 1 to 14.

Citation Information

Patent Citations

  • Image acquisition method and device, electronic equipment and computer readable storage medium

    CN112087571A