Ultra-wide-angle image acquisition methods, devices, storage media and electronic devices

Abstract

This application provides an ultra-wide-angle image acquisition method, apparatus, storage medium, and electronic device. The method is applied to a terminal device, which includes a first wide-angle module and a second wide-angle module. The method includes: acquiring a first original image and a second original image captured by the first wide-angle module and the second wide-angle module, respectively; performing image distortion correction on the first original image and the second original image to obtain a first corrected image and a second corrected image, respectively; cropping the edges of the first corrected image and the second corrected image, respectively; and combining the cropped first corrected image and the second corrected image to generate a target ultra-wide-angle image. This application not only obtains an ultra-wide-angle image, but also the obtained ultra-wide-angle image has small distortion and minimal edge pixel loss.

Description

Technical Field

[0001] This application relates to the field of image acquisition technology, and in particular to an ultra-wide-angle image acquisition method, apparatus, storage medium and electronic device. Background Technology

[0002] When users want to capture an image with an extremely wide field of view, they use the ultra-wide-angle function. Currently, the methods for obtaining ultra-wide-angle images on the market are either a single wide-angle lens plus distortion correction to output the ultra-wide-angle image, or a main camera plus a wide-angle lens to increase sharpness. However, ultra-wide-angle images obtained through these methods exhibit distortion at the edges, with the distortion becoming more pronounced closer to the edge. Even after distortion correction, some unnaturalness and loss of detail still appear at the edges.

[0003] Therefore, existing technologies have shortcomings and need to be improved and developed. Summary of the Invention

[0004] This application provides an ultra-wide-angle image acquisition method, apparatus, storage medium, and electronic device, which can not only obtain ultra-wide-angle images, but also obtain ultra-wide-angle images with small distortion and small edge pixel loss.

[0005] This application provides an ultra-wide-angle image acquisition method, applied to a terminal device, the terminal device including a first wide-angle module and a second wide-angle module, the method including:

[0006] The first and second original images captured by the first wide-angle module and the second wide-angle module are acquired respectively.

[0007] Image distortion correction is performed on the first original image and the second original image respectively to obtain the first corrected image and the second corrected image;

[0008] The edges of the first corrected image and the second corrected image are cropped respectively;

[0009] The cropped first corrected image and the second corrected image are combined to generate a target ultra-wide-angle image.

[0010] In the ultra-wide-angle image acquisition method described in this application embodiment, before performing image correction on the first original image and the second original image respectively to obtain the first corrected image and the second corrected image, the method further includes:

[0011] Obtain the distortion parameters of the first wide-angle module and the second wide-angle module respectively;

[0012] The step of performing image correction on the first original image and the second original image respectively to obtain a first corrected image and a second corrected image includes:

[0013] Based on the distortion parameters, the first original image and the second original image are respectively subjected to image distortion correction by distortion correction algorithm to obtain the first corrected image and the second corrected image.

[0014] In the ultra-wide-angle image acquisition method described in this application embodiment, the step of acquiring the distortion parameters of the first wide-angle module and the second wide-angle module respectively includes:

[0015] The first wide-angle module and the second wide-angle module are calibrated respectively to obtain the distortion parameters of the first wide-angle module and the second wide-angle module.

[0016] In the ultra-wide-angle image acquisition method described in this application embodiment, the step of cropping the edges of the first corrected image and the second corrected image respectively includes:

[0017] A first edge region in which the pixel loss of the first corrected image satisfies a preset pixel loss condition, and a second edge region in which the pixel loss of the second corrected image satisfies a preset pixel loss condition are identified.

[0018] Based on the first edge region and the second edge region, the edges of the first corrected image and the second corrected image are cropped respectively.

[0019] In the ultra-wide-angle image acquisition method described in this application embodiment, determining the first edge region where the pixel loss of the first corrected image satisfies a preset pixel loss condition, and the second edge region where the pixel loss of the second corrected image satisfies the preset pixel loss condition, includes:

[0020] The first corrected image is compared with the first original image to obtain the first comparison result;

[0021] The second corrected image is compared with the second original image to obtain a second comparison result;

[0022] Based on the first comparison result, a first edge region is determined to satisfy the preset pixel loss condition for the pixel loss of the first corrected image.

[0023] Based on the second comparison result, a second edge region is determined in which the pixel loss of the second corrected image satisfies the preset pixel loss condition.

[0024] In the ultra-wide-angle image acquisition method described in this application embodiment, the step of combining the cropped first corrected image and the second corrected image to generate a target ultra-wide-angle image includes:

[0025] The cropped first corrected image and the second corrected image are combined using an interpolation algorithm to generate the target ultra-wide-angle image.

[0026] In the ultra-wide-angle image acquisition method described in this application embodiment, before acquiring the first original image and the second original image captured by the first wide-angle module and the second wide-angle module respectively, the method further includes:

[0027] In response to a wide-angle image capture command, the first wide-angle module and the second wide-angle module are controlled to capture images to obtain the first original image and the second original image.

[0028] This application embodiment also provides an ultra-wide-angle image acquisition device, the device comprising:

[0029] The acquisition module is used to acquire the first original image and the second original image captured by the first wide-angle module and the second wide-angle module, respectively.

[0030] The correction module is used to correct image distortion in the first original image and the second original image respectively, to obtain a first corrected image and a second corrected image;

[0031] The cropping module is used to crop the edges of the first corrected image and the second corrected image, respectively.

[0032] The generation module is used to synthesize the cropped first corrected image and the second corrected image to generate a target ultra-wide-angle image.

[0033] This application also provides a storage medium storing a computer program that, when run on a computer, causes the computer to execute the ultra-wide-angle image acquisition method described in any embodiment.

[0034] This application also provides an electronic device, which includes a processor and a memory. The memory stores a computer program, and the processor executes the ultra-wide-angle image acquisition method described in any embodiment by calling the computer program stored in the memory.

[0035] This application embodiment uses two wide-angle modules to take pictures simultaneously, then performs image distortion correction on the images obtained by the two wide-angle modules respectively, then performs edge cropping on the two corrected images, and finally combines the two cropped images to obtain an ultra-wide-angle image. Thus, not only can an ultra-wide-angle image be obtained, but the obtained ultra-wide-angle image has small distortion and small edge pixel loss. Attached Figure Description

[0036] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0037] Figure 1 This is a flowchart illustrating the ultra-wide-angle image acquisition method provided in an embodiment of this application.

[0038] Figure 2 This is a schematic diagram of the structure of the ultra-wide-angle image acquisition device provided in the embodiments of this application.

[0039] Figure 3 This is another schematic diagram of the structure of the ultra-wide-angle image acquisition device provided in the embodiments of this application.

[0040] Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0041] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the protection scope of this application.

[0042] This application provides an ultra-wide-angle image acquisition method, which can be applied to a terminal device. The terminal device includes a first wide-angle module and a second wide-angle module, both of which include a wide-angle lens. The terminal device can be a smartphone or other similar device.

[0043] Please see Figure 1 , Figure 1 This is a flowchart illustrating an ultra-wide-angle image acquisition method provided in an embodiment of this application. The ultra-wide-angle image acquisition method is applied to a terminal device, which includes a first wide-angle module and a second wide-angle module. The method may include the following steps:

[0044] Step 101: Acquire the first original image and the second original image captured by the first wide-angle module and the second wide-angle module, respectively.

[0045] Both the first and second wide-angle modules include wide-angle lenses and have wide-angle shooting capabilities. The first and second wide-angle modules can be arranged horizontally or vertically on the terminal device. For example, the first and second wide-angle modules can be two rear-facing cameras arranged side-by-side on a mobile phone.

[0046] Step 102: Perform image distortion correction on the first original image and the second original image respectively to obtain the first corrected image and the second corrected image.

[0047] When capturing wide-angle images, distortion occurs at the edges, with the distortion becoming more pronounced closer to the edges. Therefore, image distortion correction is necessary for both the first and second original images.

[0048] In some embodiments, before performing image correction on the first original image and the second original image respectively to obtain the first corrected image and the second corrected image, the method further includes:

[0049] Obtain the distortion parameters of the first wide-angle module and the second wide-angle module respectively;

[0050] The step of performing image correction on the first original image and the second original image respectively to obtain a first corrected image and a second corrected image includes:

[0051] Based on the distortion parameters, the first original image and the second original image are respectively subjected to image distortion correction by distortion correction algorithm to obtain the first corrected image and the second corrected image.

[0052] For example, the distortion parameters of the first wide-angle module are obtained, and the first original image is corrected based on the distortion parameters of the first wide-angle module to obtain the first corrected image; the distortion parameters of the second wide-angle module are obtained, and the second original image is corrected based on the distortion parameters of the second wide-angle module to obtain the second corrected image.

[0053] In some embodiments, obtaining the distortion parameters of the first wide-angle module and the second wide-angle module respectively includes:

[0054] The first wide-angle module and the second wide-angle module are calibrated respectively to obtain the distortion parameters of the first wide-angle module and the second wide-angle module.

[0055] The purpose of calibrating the first wide-angle module is to obtain its distortion parameters, and the purpose of calibrating the second wide-angle module is to obtain its distortion parameters.

[0056] Step 103: Crop the edges of the first corrected image and the second corrected image respectively.

[0057] Since the image after image distortion correction has obvious edge distortion, the edges of the first and second corrected images need to be cropped.

[0058] In some embodiments, cropping the edges of the first corrected image and the second corrected image respectively includes:

[0059] A first edge region in which the pixel loss of the first corrected image satisfies a preset pixel loss condition, and a second edge region in which the pixel loss of the second corrected image satisfies a preset pixel loss condition are identified.

[0060] Based on the first edge region and the second edge region, the edges of the first corrected image and the second corrected image are cropped respectively.

[0061] Those skilled in the art can set preset pixel loss conditions according to actual needs, without specific limitations here. The first edge region is the edge region with severe pixel loss in the first corrected image, and the second edge region is the edge region with severe pixel loss in the second corrected image. After determining the first edge region and the second edge region, the first edge region and the second edge region are cropped out.

[0062] In some embodiments, determining the first edge region where the pixel loss of the first corrected image satisfies a preset pixel loss condition, and the second edge region where the pixel loss of the second corrected image satisfies the preset pixel loss condition, includes:

[0063] The first corrected image is compared with the first original image to obtain the first comparison result;

[0064] The second corrected image is compared with the second original image to obtain a second comparison result;

[0065] Based on the first comparison result, a first edge region is determined to satisfy the preset pixel loss condition for the pixel loss of the first corrected image.

[0066] Based on the second comparison result, a second edge region is determined in which the pixel loss of the second corrected image satisfies the preset pixel loss condition.

[0067] For example, after comparing the first corrected image with the first original image, it is found that a certain edge region in the first corrected image suffers severe pixel loss, meeting a preset pixel loss condition. Therefore, this region is identified as the first edge region. Similarly, after comparing the second corrected image with the second original image, it is found that a certain edge region in the second corrected image suffers severe pixel loss, meeting a preset pixel loss condition. Therefore, this region is identified as the second edge region.

[0068] Step 104: Combine the cropped first corrected image and the second corrected image to generate a target ultra-wide-angle image.

[0069] For example, after cropping the first edge region and the second edge region, the edge pixel loss of the first corrected image and the second corrected image has been reduced to an acceptable range. At this time, the first corrected image and the second corrected image are combined to generate the target ultra-wide-angle image.

[0070] In some embodiments, the step of combining the cropped first corrected image and the second corrected image to generate a target ultra-wide-angle image includes:

[0071] The cropped first corrected image and the second corrected image are combined using an interpolation algorithm to generate the target ultra-wide-angle image.

[0072] The interpolation algorithm in question is an image interpolation algorithm.

[0073] In some embodiments, before acquiring the first original image and the second original image captured by the first wide-angle module and the second wide-angle module, respectively, the method further includes:

[0074] In response to a wide-angle image capture command, the first wide-angle module and the second wide-angle module are controlled to capture images to obtain the first original image and the second original image.

[0075] For example, upon receiving a wide-angle image capture command, the system simultaneously controls the first wide-angle module and the second wide-angle module to capture images. The first wide-angle module captures a first original image, and the second wide-angle module captures a second original image.

[0076] All of the above-mentioned optional technical solutions can be combined in any way to form the optional embodiments of this application, and will not be described in detail here.

[0077] In practice, this application is not limited by the execution order of the described steps. Without causing conflicts, some steps may be performed in other orders or simultaneously.

[0078] As can be seen from the above, the ultra-wide-angle image acquisition method provided in this application embodiment takes pictures simultaneously using two wide-angle modules, then performs image distortion correction on the images obtained by the two wide-angle modules respectively, then performs edge cropping on the two corrected images, and finally combines the two cropped images to obtain an ultra-wide-angle image. Thus, not only can an ultra-wide-angle image be obtained, but the obtained ultra-wide-angle image also has small distortion and small edge pixel loss.

[0079] This application also provides an ultra-wide-angle image acquisition device, which can be integrated into an electronic device. The electronic device can be a smartphone or similar device.

[0080] Please see Figure 2 , Figure 2 A schematic diagram of the structure of the ultra-wide-angle image acquisition device provided in this application embodiment. The ultra-wide-angle image acquisition device 30 may include:

[0081] The acquisition module 31 is used to acquire the first original image and the second original image captured by the first wide-angle module and the second wide-angle module, respectively.

[0082] The correction module 32 is used to perform image distortion correction on the first original image and the second original image respectively to obtain a first corrected image and a second corrected image;

[0083] The cropping module 33 is used to crop the edges of the first corrected image and the second corrected image respectively;

[0084] The generation module 34 is used to synthesize the cropped first corrected image and the second corrected image to generate a target ultra-wide-angle image.

[0085] In some embodiments, the acquisition module 31 is used to acquire the distortion parameters of the first wide-angle module and the second wide-angle module respectively.

[0086] In some embodiments, the acquisition module 31 calibrates the first wide-angle module and the second wide-angle module respectively to obtain the distortion parameters of the first wide-angle module and the second wide-angle module.

[0087] In some embodiments, the correction module 32 is used to perform image distortion correction on the first original image and the second original image respectively based on the distortion parameters and a distortion correction algorithm to obtain the first corrected image and the second corrected image.

[0088] In some embodiments, the cropping module 33 is used to determine a first edge region in which the pixel loss of the first corrected image satisfies a preset pixel loss condition, and a second edge region in which the pixel loss of the second corrected image satisfies a preset pixel loss condition; and to crop the edges of the first corrected image and the second corrected image based on the first edge region and the second edge region, respectively.

[0089] In some embodiments, the generation module 34 is used to synthesize the cropped first corrected image and the second corrected image using an interpolation algorithm to generate the target ultra-wide-angle image.

[0090] In practice, the above modules can be implemented as independent entities or combined in any way to be implemented as the same or several entities.

[0091] As can be seen from the above, the ultra-wide-angle image acquisition device 30 provided in this application embodiment acquires a first original image and a second original image captured by a first wide-angle module and a second wide-angle module, respectively, through an acquisition module 31; performs image distortion correction on the first original image and the second original image, respectively, through a correction module 32, to obtain a first corrected image and a second corrected image; crops the edges of the first corrected image and the second corrected image, respectively, through a cropping module 33; and synthesizes the cropped first corrected image and the second corrected image through a generation module 34 to generate a target ultra-wide-angle image. This application embodiment uses dual wide-angle modules to take pictures simultaneously, then performs image distortion correction on the images obtained by the two wide-angle modules respectively, then crops the edges of the two corrected images, and finally synthesizes the two cropped images to obtain an ultra-wide-angle image. Therefore, it not only obtains an ultra-wide-angle image, but also obtains an ultra-wide-angle image with small distortion and minimal edge pixel loss.

[0092] Please see Figure 3 , Figure 3 This is another schematic diagram of the ultra-wide-angle image acquisition device provided in this application embodiment. The vibration ultra-wide-angle image acquisition device 30 includes a memory 120, one or more processors 180, and one or more application programs, wherein the one or more application programs are stored in the memory 120 and configured to be executed by the processors 180; the processors 180 may include an acquisition module 31, a correction module 32, a cropping module 33, and a generation module 34. For example, the structure and connection relationship of the above components can be as follows:

[0093] Memory 120 can be used to store applications and data. The applications stored in memory 120 contain executable code. Applications can be composed of various functional modules. Processor 180 executes various functional applications and data processing by running the applications stored in memory 120. Furthermore, memory 120 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, memory 120 may also include a memory controller to provide processor 180 with access to memory 120.

[0094] The processor 180 is the control center of the device, connecting various parts of the terminal through various interfaces and lines. It performs various functions and processes data by running or executing applications stored in the memory 120 and calling data stored in the memory 120, thereby providing overall monitoring of the device. Optionally, the processor 180 may include one or more processing cores; preferably, the processor 180 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications.

[0095] Specifically, in this embodiment, the processor 180 loads the executable code corresponding to the processes of one or more applications into the memory 120 according to the following instructions, and the processor 180 runs the applications stored in the memory 120 to achieve various functions:

[0096] The acquisition module 31 is used to acquire the first original image and the second original image captured by the first wide-angle module and the second wide-angle module, respectively.

[0097] The correction module 32 is used to perform image distortion correction on the first original image and the second original image respectively to obtain a first corrected image and a second corrected image;

[0098] The cropping module 33 is used to crop the edges of the first corrected image and the second corrected image respectively;

[0099] The generation module 34 is used to synthesize the cropped first corrected image and the second corrected image to generate a target ultra-wide-angle image.

[0100] In some embodiments, the acquisition module 31 is used to acquire the distortion parameters of the first wide-angle module and the second wide-angle module respectively.

[0101] In some embodiments, the acquisition module 31 calibrates the first wide-angle module and the second wide-angle module respectively to obtain the distortion parameters of the first wide-angle module and the second wide-angle module.

[0102] In some embodiments, the correction module 32 is used to perform image distortion correction on the first original image and the second original image respectively based on the distortion parameters and a distortion correction algorithm to obtain the first corrected image and the second corrected image.

[0103] In some embodiments, the cropping module 33 is used to determine a first edge region in which the pixel loss of the first corrected image satisfies a preset pixel loss condition, and a second edge region in which the pixel loss of the second corrected image satisfies a preset pixel loss condition; and to crop the edges of the first corrected image and the second corrected image based on the first edge region and the second edge region, respectively.

[0104] In some embodiments, the generation module 34 is used to synthesize the cropped first corrected image and the second corrected image using an interpolation algorithm to generate the target ultra-wide-angle image.

[0105] This application also provides an electronic device. The electronic device may be a smartphone or similar device.

[0106] Please see Figure 4 , Figure 4 A schematic diagram of the structure of an electronic device provided in an embodiment of this application is shown. This electronic device can be used to implement the vibration adjustment method provided in the above embodiments. The electronic device 1200 includes a first wide-angle module and a second wide-angle module, and the electronic device 1200 can be a smartphone, etc.

[0107] like Figure 4 As shown, the electronic device 1200 may include an RF (Radio Frequency) circuit 110, a memory 120 including one or more (only one is shown in the figure) computer-readable storage media, an input unit 130, a display unit 140, a sensor 150, an audio circuit 160, a transmission module 170, a processor 180 including one or more (only one is shown in the figure) processing cores, and a power supply 190, etc. Those skilled in the art will understand that... Figure 4 The structure of the electronic device 1200 shown does not constitute a limitation on the electronic device 1200, and may include more or fewer components than shown, or combine certain components, or have different component arrangements. Wherein:

[0108] RF circuit 110 is used to receive and transmit electromagnetic waves, realizing the mutual conversion between electromagnetic waves and electrical signals, thereby enabling communication with communication networks or other devices. RF circuit 110 may include various existing circuit elements used to perform these functions, such as antennas, radio frequency transceivers, digital signal processors, encryption / decryption chips, Subscriber Identity Module (SIM) cards, memory, etc. RF circuit 110 can communicate with various networks such as the Internet, corporate intranets, and wireless networks, or communicate with other devices via wireless networks.

[0109] The memory 120 can be used to store software programs and modules, such as the program instructions / modules corresponding to the vibration adjustment method in the above embodiment. The processor 180 executes various functional applications and data processing by running the software programs and modules stored in the memory 120, thereby obtaining ultra-wide-angle images with minimal distortion and edge pixel loss. The memory 120 may include high-speed random access memory and non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memories. In some instances, the memory 120 may further include memories remotely located relative to the processor 180, which can be connected to the electronic device 1200 via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0110] The input unit 130 can be used to receive input digital or character information, and to generate keyboard, mouse, joystick, optical, or trackball signal inputs related to user settings and function control. Specifically, the input unit 130 may include a touch-sensitive surface 131 and other input devices 132. The touch-sensitive surface 131, also known as a touch display screen or touchpad, can collect touch operations performed by the user on or near it (such as operations performed by the user using a finger, stylus, or any suitable object or accessory on or near the touch-sensitive surface 131), and drive the corresponding connection device according to a pre-set program. Optionally, the touch-sensitive surface 131 may include two parts: a touch detection device and a touch controller. The touch detection device detects the user's touch position and the signal generated by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts it into touch point coordinates, sends it to the processor 180, and can receive and execute commands from the processor 180. In addition, the touch-sensitive surface 131 can be implemented using various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch-sensitive surface 131, the input unit 130 may also include other input devices 132. Specifically, other input devices 132 may include, but are not limited to, one or more of the following: physical keyboard, function keys (such as volume control buttons, power buttons, etc.), trackball, mouse, joystick, etc.

[0111] Display unit 140 can be used to display information input by the user or information provided to the user, as well as various graphical user interfaces of electronic device 1200. These graphical user interfaces can be composed of graphics, text, icons, video, and any combination thereof. Display unit 140 may include display panel 141, optionally configured as LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), etc. Further, touch-sensitive surface 131 may cover display panel 141. When touch-sensitive surface 131 detects a touch operation on or near it, it transmits the information to processor 180 to determine the type of touch event. Subsequently, processor 180 provides corresponding visual output on display panel 141 according to the type of touch event. Although in Figure 4 In this embodiment, the touch-sensitive surface 131 and the display panel 141 are implemented as two separate components to realize input and output functions. However, in some embodiments, the touch-sensitive surface 131 and the display panel 141 can be integrated to realize input and output functions.

[0112] The electronic device 1200 may also include at least one sensor 150, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor. The ambient light sensor can adjust the brightness of the display panel 141 according to the ambient light level, and the proximity sensor can turn off the display panel 141 and / or backlight when the electronic device 1200 is moved to the ear. As a type of motion sensor, a gravity acceleration sensor can detect the magnitude of acceleration in various directions (generally three axes). When stationary, it can detect the magnitude and direction of gravity and can be used for applications that recognize the phone's posture (such as landscape / portrait switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc. Other sensors that may be configured in the electronic device 1200, such as gyroscopes, barometers, hygrometers, thermometers, and infrared sensors, will not be described in detail here.

[0113] Audio circuitry 160, speaker 161, and microphone 162 provide an audio interface between the user and electronic device 1200. Audio circuitry 160 converts received audio data into electrical signals, which are then transmitted to speaker 161, where they are converted into sound signals for output. Conversely, microphone 162 converts collected sound signals into electrical signals, which are received by audio circuitry 160, converted back into audio data, and then processed by processor 180 before being transmitted via RF circuitry 110 to, for example, another terminal, or output to memory 120 for further processing. Audio circuitry 160 may also include an earphone jack to facilitate communication between external headphones and electronic device 1200.

[0114] Electronic device 1200, through transmission module 170 (e.g., Wi-Fi module), enables users to send and receive emails, browse web pages, and access streaming media, providing users with wireless broadband internet access. Although Figure 4 The transmission module 170 is shown, but it is understood that it is not an essential component of the electronic device 1200 and can be omitted as needed without changing the nature of the invention.

[0115] The processor 180 is the control center of the electronic device 1200. It connects to various parts of the phone via various interfaces and lines, and performs various functions and processes data of the electronic device 1200 by running or executing software programs and / or modules stored in the memory 120, and by calling data stored in the memory 120, thereby providing overall monitoring of the phone. Optionally, the processor 180 may include one or more processing cores; in some embodiments, the processor 180 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications, and the modem processor mainly handles wireless communication. It is understood that the modem processor may also not be integrated into the processor 180.

[0116] The electronic device 1200 also includes a power supply 190 (such as a battery) that supplies power to various components. In some embodiments, the power supply may be logically connected to the processor 180 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The power supply 190 may also include one or more DC or AC power supplies, recharging systems, power fault detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0117] Although not shown, the electronic device 1200 may also include a camera (such as a front-facing camera and a rear-facing camera), a Bluetooth module, etc., which will not be described in detail here. Specifically, in this embodiment, the display unit 140 of the electronic device 1200 is a touch screen display, and the electronic device 1200 also includes a memory 120 and one or more programs, one or more of which are stored in the memory 120 and configured to be executed by one or more processors 180. One or more programs contain instructions for performing the following operations:

[0118] The first and second original images captured by the first wide-angle module and the second wide-angle module are acquired respectively.

[0119] Image distortion correction is performed on the first original image and the second original image respectively to obtain the first corrected image and the second corrected image;

[0120] The edges of the first corrected image and the second corrected image are cropped respectively;

[0121] The cropped first corrected image and the second corrected image are combined to generate a target ultra-wide-angle image.

[0122] In some embodiments, the processor 180 is used to acquire distortion parameters of the first wide-angle module and the second wide-angle module respectively;

[0123] Based on the distortion parameters, the first original image and the second original image are respectively subjected to image distortion correction by distortion correction algorithm to obtain the first corrected image and the second corrected image.

[0124] In some embodiments, the processor 180 is configured to calibrate the first wide-angle module and the second wide-angle module respectively to obtain the distortion parameters of the first wide-angle module and the second wide-angle module.

[0125] In some embodiments, the processor 180 is configured to determine a first edge region in which the pixel loss of the first corrected image satisfies a preset pixel loss condition, and a second edge region in which the pixel loss of the second corrected image satisfies the preset pixel loss condition.

[0126] Based on the first edge region and the second edge region, the edges of the first corrected image and the second corrected image are cropped respectively.

[0127] In some embodiments, the processor 180 is configured to compare the first corrected image with the first original image to obtain a first comparison result;

[0128] The second corrected image is compared with the second original image to obtain a second comparison result;

[0129] Based on the first comparison result, a first edge region is determined to satisfy the preset pixel loss condition for the pixel loss of the first corrected image.

[0130] Based on the second comparison result, a second edge region is determined in which the pixel loss of the second corrected image satisfies the preset pixel loss condition.

[0131] In some embodiments, the processor 180 is configured to synthesize the cropped first corrected image and the second corrected image using an interpolation algorithm to generate the target ultra-wide-angle image.

[0132] In some embodiments, the processor 180 is configured to control the first wide-angle module and the second wide-angle module to perform shooting in response to a wide-angle image shooting command, so as to obtain the first original image and the second original image.

[0133] As can be seen from the above, this application embodiment provides an electronic device 1200, which performs the following steps: acquiring a first original image and a second original image captured by a first wide-angle module and a second wide-angle module, respectively; performing image distortion correction on the first original image and the second original image, respectively, to obtain a first corrected image and a second corrected image; cropping the edges of the first corrected image and the second corrected image, respectively; and merging the cropped first corrected image and the second corrected image to generate a target ultra-wide-angle image. This application embodiment uses dual wide-angle modules to take pictures simultaneously, then performs image distortion correction on the images obtained by the two wide-angle modules, then performs edge cropping on the two corrected images, and finally merges the two cropped images to obtain an ultra-wide-angle image. Therefore, it not only obtains an ultra-wide-angle image, but also obtains an ultra-wide-angle image with small distortion and minimal edge pixel loss.

[0134] This application also provides a storage medium storing a computer program. When the computer program is run on a computer, the computer executes the ultra-wide-angle image acquisition method described in any of the above embodiments.

[0135] It should be noted that, for the ultra-wide-angle image acquisition method described in this application, those skilled in the art will understand that implementing all or part of the process of the ultra-wide-angle image acquisition method described in the embodiments of this application can be accomplished by a computer program controlling the relevant hardware. The computer program can be stored in a computer-readable storage medium, such as in the memory of an electronic device, and executed by at least one processor within the electronic device. During execution, it can include the process of the embodiments of the vibration adjustment method described. The storage medium can be a magnetic disk, optical disk, read-only memory (ROM), random access memory (RAM), etc.

[0136] For the ultra-wide-angle image acquisition device described in this application embodiment, its functional modules can be integrated into a single processing chip, or each module can exist physically separately, or two or more modules can be integrated into one module. The integrated module can be implemented in hardware or as a software functional module. If the integrated module is implemented as a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.

[0137] The above provides a detailed description of the ultra-wide-angle image acquisition method, apparatus, storage medium, and electronic device provided in the embodiments of this application. Specific examples have been used to illustrate the principles and implementation methods of this application. The descriptions of the embodiments above are only for the purpose of helping to understand the method and its core ideas; furthermore, those skilled in the art will recognize that, based on the ideas of this application, there will be changes in the specific implementation methods and application scope. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A method for acquiring ultra-wide-angle images, characterized in that, Applied to a terminal device, the terminal device including a first wide-angle module and a second wide-angle module, the method includes: The first and second original images captured by the first wide-angle module and the second wide-angle module are acquired respectively. Image distortion correction is performed on the first original image and the second original image respectively to obtain the first corrected image and the second corrected image; The edges of the first corrected image and the second corrected image are cropped respectively; The cropped first corrected image and the second corrected image are combined to generate a target ultra-wide-angle image; The step of cropping the edges of the first corrected image and the second corrected image respectively includes: A first edge region in which the pixel loss of the first corrected image satisfies a preset pixel loss condition, and a second edge region in which the pixel loss of the second corrected image satisfies a preset pixel loss condition are identified. Based on the first edge region and the second edge region, the edges of the first corrected image and the second corrected image are cropped respectively.

2. The ultra-wide-angle image acquisition method as described in claim 1, characterized in that, Before performing image correction on the first original image and the second original image respectively to obtain the first corrected image and the second corrected image, the method further includes: Obtain the distortion parameters of the first wide-angle module and the second wide-angle module respectively; The step of performing image correction on the first original image and the second original image respectively to obtain a first corrected image and a second corrected image includes: Based on the distortion parameters, the first original image and the second original image are respectively subjected to image distortion correction by distortion correction algorithm to obtain the first corrected image and the second corrected image.

3. The ultra-wide-angle image acquisition method as described in claim 2, characterized in that, The step of obtaining the distortion parameters of the first wide-angle module and the second wide-angle module respectively includes: The first wide-angle module and the second wide-angle module are calibrated respectively to obtain the distortion parameters of the first wide-angle module and the second wide-angle module.

4. The ultra-wide-angle image acquisition method as described in claim 1, characterized in that, The step of determining the first edge region where the pixel loss of the first corrected image satisfies a preset pixel loss condition, and the second edge region where the pixel loss of the second corrected image satisfies the preset pixel loss condition, includes: The first corrected image is compared with the first original image to obtain the first comparison result; The second corrected image is compared with the second original image to obtain a second comparison result; Based on the first comparison result, a first edge region is determined to satisfy the preset pixel loss condition for the pixel loss of the first corrected image. Based on the second comparison result, a second edge region is determined in which the pixel loss of the second corrected image satisfies the preset pixel loss condition.

5. The ultra-wide-angle image acquisition method as described in claim 1, characterized in that, The step of combining the cropped first corrected image and the second corrected image to generate a target ultra-wide-angle image includes: The cropped first corrected image and the second corrected image are combined using an interpolation algorithm to generate the target ultra-wide-angle image.

6. The ultra-wide-angle image acquisition method as described in claim 1, characterized in that, Before acquiring the first and second original images captured by the first wide-angle module and the second wide-angle module respectively, the process further includes: In response to a wide-angle image capture command, the first wide-angle module and the second wide-angle module are controlled to capture images to obtain the first original image and the second original image.

7. An ultra-wide-angle image acquisition device, characterized in that, The device includes: The acquisition module is used to acquire the first original image and the second original image captured by the first wide-angle module and the second wide-angle module, respectively. The correction module is used to correct image distortion in the first original image and the second original image respectively, to obtain a first corrected image and a second corrected image; The cropping module is used to crop the edges of the first corrected image and the second corrected image, respectively. The generation module is used to synthesize the cropped first corrected image and the second corrected image to generate a target ultra-wide-angle image; The step of cropping the edges of the first corrected image and the second corrected image respectively includes: A first edge region in which the pixel loss of the first corrected image satisfies a preset pixel loss condition, and a second edge region in which the pixel loss of the second corrected image satisfies a preset pixel loss condition are identified. Based on the first edge region and the second edge region, the edges of the first corrected image and the second corrected image are cropped respectively.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when run on a computer, causes the computer to perform the ultra-wide-angle image acquisition method according to any one of claims 1 to 6.

9. An electronic device, characterized in that, The electronic device includes a processor and a memory, the memory storing a computer program, and the processor executing the ultra-wide-angle image acquisition method according to any one of claims 1 to 6 by calling the computer program stored in the memory.

Images