Image Processing Method, Electronic Device, and Computer-Readable Storage Medium

Abstract

The present application relates to the field of electronic technologies, and provides an image processing method, an electronic device, and a computer-readable storage medium. The method includes: obtaining first statistical data of a first image, where the first image is an image obtained by a secondary road camera at a first moment; determining image parameters of a second image according to the first statistical data and initial image parameters of the second image, where the second image is an image obtained by a main road camera at a second moment, the frame rate of the main road camera is higher than that of the secondary road camera, the difference degree between the image parameters of the second image and the image parameters of the first image is less than a preset difference degree threshold, the time difference between the second moment and the first moment is less than or equal to a preset time difference threshold, and the preset time difference threshold is the reciprocal of the frame rate of the secondary road camera; and displaying the second image according to the image parameters of the second image. The above method can ensure the consistency of the image display effect during the zooming process in a low-power state.

Description

Technical Field

[0001] The present application relates to the field of image technologies, and in particular, to an image processing method, an electronic device, and a computer-readable storage medium. Background Art

[0002] With the rapid development of electronic technologies, the shooting function of electronic devices has become more and more powerful, and there are more and more scenarios for taking pictures with electronic devices. Current electronic devices support multi-fold zoom, which relies on multiple cameras with different zoom ranges being set on the electronic device. For example, an electronic device can set a wide-angle camera to capture the image when the zoom factor is 1.0X, set an ultra-wide-angle camera to capture the image when the zoom factor is small, and also set a telephoto camera to capture the image when the zoom factor is larger. Different cameras have different shooting functions and often need to be used in combination. For example, when the zoom is 1.0X, the wide-angle camera can be used for shooting; when the zoom is 1.2X, one auxiliary camera needs to be turned on, such as turning on the ultra-wide-angle camera for auxiliary shooting, and then the images captured by these two cameras are fused to obtain the final captured image.

[0003] When the terminal device simultaneously turns on two cameras for shooting, usually one camera is determined as the main camera according to the zoom factor, and the other camera is the auxiliary camera. The image captured by the electronic device is mainly based on the image output by the main camera. Therefore, the parameters of the camera with a higher frequency as the main camera will be finely tuned so that the display effect of the captured image best meets people's requirements.

[0004] When the zoom factor changes significantly, the main camera often switches. For example, when the zoom factor changes from 1.0X to 0.5X, the main camera will switch from the wide-angle camera to the telephoto camera. However, since the telephoto camera and the wide-angle camera are different physical cameras and their physical parameters are different, it will cause a jump in the display effect of the output preview image, affecting the user experience. Summary of the Invention

[0005] The present application provides an image processing method, apparatus, chip, electronic device, computer-readable storage medium, and computer program product, which can maintain the consistency of the display effect during the zoom process and improve the user experience.

[0006] In a first aspect, an image processing method is provided, including: obtaining first statistical data of a first image, where the first image is an image acquired by a secondary road camera at a first moment, the first statistical data is statistical data of image parameters of the first image, and the image parameters of the first image meet a preset display requirement; determining the image parameters of a second image according to the first statistical data and the initial image parameters of the second image, where the second image is an image acquired by a main road camera at a second moment, the frame rate of the main road camera is higher than that of the secondary road camera, the difference degree between the image parameters of the second image and the image parameters of the first image is less than a preset difference degree threshold, the time difference between the second moment and the first moment is less than or equal to a preset time difference threshold, and the preset time difference threshold is the reciprocal of the frame rate of the secondary road camera; and displaying the second image according to the image parameters of the second image.

[0007] The secondary road camera is a target camera that has been finely calibrated. That is to say, the image parameters of the first image output by the secondary road camera can meet the preset display requirement, so that the display effect of the first image meets the viewing needs of people. The preset display requirement is to ensure that the display effect of the image is closest to the physical object observed by the human eye and has the best display effect.

[0008] Generally, the frame rate of the secondary road camera is lower than that of the main road camera. Taking the first image output by the secondary road camera at the first moment as an example, the terminal device can perform statistics on the first image to obtain the first statistical data of the first image. Optionally, the first statistical data may include statistical data of color information or may include statistical data of brightness information.

[0009] When the frame rate of the secondary road camera is generally lower than that of the main road camera, that is to say. During the period when the secondary road camera outputs one image, the main road camera will output multiple images. In the same image output cycle, the time difference between the moments when the main road outputs multiple images and the moment when the secondary road outputs an image is less than one image output cycle. This image output cycle can be used as the preset time difference threshold, which is the reciprocal of the frame rate of the secondary road camera.

[0010] At the second moment, the main road camera outputs a second image. Originally, when the main road camera outputs an image, it would calculate the initial image parameters such as the color and brightness of the second image according to the parameters of its own physical camera. This would result in an inconsistent display effect with that of the target camera. In the embodiment of the present application, the terminal device no longer calculates the image parameters of the second image according to the parameters of the current main road camera's own physical camera, but regenerates the image parameters of the new second image according to the first statistical data of the first image captured by the finely calibrated secondary road camera.

[0011] Optionally, the method of recalculating image parameters using statistical data can be the method of using an AI model. Optionally, the method of recalculating image parameters using statistical data can obtain the coefficients required for conversion based on the first statistical data, and then substitute the coefficients and the initial image parameters into a preset relational expression to calculate the image parameters of the new second image.

[0012] When the terminal device displays the second image according to the calculated image parameters of the second image, the display effect can be ensured to meet the preset display requirements. After the terminal device performs AE and AWB synchronization, it can be ensured that during the process of switching the camera, the color and brightness of the preview screen do not change significantly.

[0013] When the main road camera is switched to a target camera that has not been finely calibrated, and the target camera outputs images as a secondary road camera, the terminal device performs statistics on the first image captured by the target camera serving as the secondary road camera to obtain the first statistical information; then, according to the statistical information, it synchronizes the second image captured by the main road camera, which is a non-target camera, within the same image output cycle to obtain new image parameters, and displays the image acquired by the secondary road camera according to the newly calculated image parameters. This method can ensure that during the zooming process, even if the main road camera is switched, the display effect will not jump due to different physical parameters between the cameras, thus improving the user experience. Moreover, this method does not require detailed and precise calibration of each camera, and can maintain the unity of the display effect during the process of switching the camera. At the same time, this method is applied to a heterogeneous frame rate platform where the main road camera outputs images at a high frame rate and the secondary road camera outputs images at a low frame rate. The terminal device uses the statistical information of the images output at a low frame rate by the secondary road camera to synchronize the image parameters of multiple images output at a high frame rate by the main road camera within the same image output cycle, realizing the synchronization of image parameters with heterogeneous frame rates. Compared with the method of outputting images at the same frame rate by the main road camera and the secondary road camera and then synchronizing the image parameters, this method also reduces the number of images output by the secondary road camera, thereby reducing power consumption.

[0014] In some embodiments, the first statistical data is the statistical data of the color parameters and / or brightness parameters of the first image, and the image parameters include brightness parameters and / or color parameters.

[0015] The terminal device performs statistics on the first image captured by the target camera serving as the auxiliary road camera to obtain the first statistical information; then, based on the statistical information, it synchronizes the second image captured by the main road camera of non-target cameras within the same image output cycle to obtain new color parameters and / or brightness parameters, and displays the image acquired by the auxiliary road camera according to the newly calculated color parameters and / or brightness parameters. This method can ensure that during the zooming process, even if the main road camera is switched, the color and / or brightness will not jump due to different physical parameters between cameras, thus improving the user experience.

[0016] In some embodiments, obtaining the first statistical data of the first image includes: determining whether the main road camera is the calibrated target camera, and the image parameters of the image output by the target camera meet the preset display requirements; if not, then perform the step of obtaining the first statistical data of the first image.

[0017] In some embodiments, the method further includes: if the main road camera is the target camera, then display the second image according to the initial image parameters of the second image, where the initial image parameters are the image parameters of the initial image captured by the main road camera at the second moment.

[0018] Specifically, when the main road camera is the target camera, the terminal device does not need to enable the synchronization function, and only needs to display the second image according to the initial image parameters of the second image captured by the current main road camera, that is, the target camera. At this time, there is no need to synchronize the image parameters and there will be no jump in the display effect, which can avoid an ineffective data processing process.

[0019] When the current main road camera of the terminal device is the target camera, there is no need to synchronize the image parameters and there will be no jump in the display effect, which can avoid an ineffective data processing process; when the current main road camera is not the target camera, the image parameter synchronization process is only executed, making the image parameter synchronization process more effective and more reasonable.

[0020] In some embodiments, when the image parameters include brightness parameters, the frame rate of the auxiliary road camera is the first frame rate; when the image parameters include color parameters, the frame rate of the auxiliary road camera is the second frame rate; the first frame rate is higher than the second frame rate.

[0021] Optionally, generally, the camera responds more significantly to brightness changes, which is manifested as a relatively fast convergence of AE. Then, when performing AE synchronization, if the frame rate of the auxiliary road camera is too low, it will lead to poor AE synchronization effect and a certain degree of brightness jump. Therefore, for the case of AE synchronization, the auxiliary road camera can output images at a higher frame rate. Taking the frame rate of the main road camera as 30 FPS as an example, the auxiliary road camera can output images at 10 - 15 FPS. During the image output process of the camera, its response to color changes is not as obvious as that to brightness changes. That is to say, the convergence of AWB is not that fast. Therefore, when performing AWB synchronization, the auxiliary road camera can output images at a lower frame rate. Taking the frame rate of the main road camera as 30 FPS as an example, the auxiliary road camera can adopt 5 - 10 FPS. Using this method can reasonably set the frame rate of the auxiliary road camera and balance the display effect and power consumption.

[0022] The terminal camera can also maintain a high frame rate output of the auxiliary road camera, and then distinguish the execution frequencies of AWB synchronization and AE synchronization, that is, the frequency of executing AE synchronization is higher than that of executing AWB synchronization. Taking the frame rate of the main road camera as 30 FPS and the auxiliary road camera as 10 FPS as an example, the terminal uses the statistical data of the image obtained by the auxiliary road camera at a certain moment to perform color synchronization on the three images obtained by the main road camera at three moments within the same image output cycle, that is, uses one first image to perform AE synchronization on three consecutive second images. The terminal uses the statistical data of the image obtained by the auxiliary road camera at a certain moment to perform color synchronization on the six images obtained by the main road camera within two image output cycles. And so on, that is, uses one first image to perform AWB synchronization on six consecutive second images. For AE synchronization and AWB synchronization, the auxiliary road camera can adopt different frame rates to balance the display effect and power consumption.

[0023] In some embodiments, when the image parameters include brightness parameters, determining the image parameters of the second image according to the first statistical data and the initial image parameters of the second image includes: performing automatic exposure AW synchronization according to the first statistical data and the initial image parameters of the second image to obtain the image parameters of the second image.

[0024] In some embodiments, when the image parameters include brightness parameters, determining the image parameters of the second image according to the first statistical data and the initial image parameters of the second image includes: performing automatic white balance AWB synchronization according to the first statistical data and the initial image parameters of the second image to obtain the image parameters of the second image.

[0025] In some embodiments, the frame rate of the main road camera is 30 frames per second (FPS) of refresh rate, the first frame rate is 10 - 15 FPS, and the second frame rate is 3 - 5 FPS.

[0026] When the frame rate of the main road camera is 30 FPS and the auxiliary road camera adopts 5 - 15 FPS, it can balance the display effect and power consumption of the image, with strong rationality.

[0027] In a second aspect, an image processing apparatus is provided, including a unit composed of software and / or hardware, and this unit is used to execute any one of the methods in the technical solutions of the first aspect.

[0028] In a third aspect, an embodiment of the present application provides a chip, including a processor; the processor is used to read and execute a computer program stored in a memory to execute any one of the methods in the technical solutions described in the first aspect.

[0029] Optionally, the chip further includes a memory, and the memory is connected to the processor through a circuit or a wire.

[0030] Further optionally, the chip further includes a communication interface.

[0031] In a fourth aspect, an electronic device is provided, and the electronic device includes: a processor, a memory, and an interface; the processor, the memory, and the interface cooperate with each other to enable the electronic device to execute any one of the methods in the technical solutions described in the first aspect.

[0032] In a fifth aspect, an electronic device is provided, and the electronic device includes any one of the chips in the technical solutions described in the third aspect.

[0033] In a sixth aspect, a computer-readable storage medium is provided, and a computer program is stored in the computer-readable storage medium. When the computer program is executed by a processor, the processor is enabled to execute any one of the methods in the technical solutions described in the first aspect.

[0034] In a seventh aspect, a computer program product is provided, and the computer program product includes: computer program code. When the computer program code runs on an electronic device, the electronic device is enabled to execute any one of the methods in the technical solutions described in the first aspect. Description of the Drawings

[0035] Figure 1 It is a schematic structural diagram of a terminal device 100 provided by an embodiment of the present application;

[0036] Figure 2 It is a software structural block diagram of the terminal device 100 provided by an embodiment of the present application;

[0037] Figure 3 It is a schematic diagram of the display effect before and after switching the camera;

[0038] Figure 4 It is a schematic flowchart of an image processing method provided by an embodiment of the present application;

[0039] Figure 5 It is a time comparison diagram of heterogeneous frame rate image output provided by an embodiment of the present application;

[0040] Figure 6 It is a schematic flowchart of another image processing method provided by an embodiment of the present application;

[0041] Figure 7 It is a schematic structural diagram of a multi-camera framework provided by an embodiment of the present application;

[0042] Figure 8 It is a schematic structural diagram of an image processing device provided by an embodiment of the present application. Detailed implementation manners

[0043] Next, the technical solutions in the embodiments of the present application will be described with reference to the accompanying drawings in the embodiments of the present application. Among them, in the description of the embodiments of the present application, unless otherwise specified, " / " means "or". For example, A / B may mean A or B; herein, "and / or" is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B may mean: A exists alone, A and B exist simultaneously, and B exists alone. In addition, in the description of the embodiments of the present application, "a plurality" means two or more than two.

[0044] Hereinafter, the terms "first", "second", and "third" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly specifying the quantity of the indicated technical features. Thus, the features defined with "first", "second", and "third" may explicitly or implicitly include one or more of such features.

[0045] The image processing method provided by the embodiments of the present application can be applied to terminal devices such as mobile phones, tablet computers, wearable devices, in-vehicle devices, augmented reality (AR) / virtual reality (VR) devices, laptop computers, ultra-mobile personal computers (UMPCs), netbooks, and personal digital assistants (PDAs). The embodiments of the present application do not impose any restrictions on the specific types of terminal devices.

[0046] Exemplarily, Figure 1It is a schematic structural diagram of a terminal device 100 provided by an embodiment of the present application. The terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0047] It can be understood that the structure schematically shown in the embodiments of the present application does not constitute a specific limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 may include more or fewer components than those shown in the figure, or combine certain components, or split certain components, or have different component arrangements. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0048] It can be understood that the interface connection relationships between the modules schematically shown in the embodiments of the present application are only illustrative and do not constitute a structural limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 may also adopt different interface connection methods as described in the above embodiments, or a combination of multiple interface connection methods.

[0049] The software system of the terminal device 100 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture. In the embodiments of the present application, the Android system with a layered architecture is taken as an example to exemplarily illustrate the software structure of the terminal device 100.

[0050] Figure 2It is a software architecture block diagram of the terminal device 100 according to an embodiment of the present application. The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom are the application layer, the application framework layer, the Android runtime, and the system library, and the kernel layer. The application layer may include a series of application packages.

[0051] As Figure 2 shown, the application packages may include applications such as cameras, galleries, calendars, calls, maps, navigation, WLAN, Bluetooth, music, videos, short messages, etc.

[0052] The application framework layer provides application programming interfaces (APIs) and programming frameworks for the applications in the application layer. The application framework layer includes some predefined functions.

[0053] As Figure 2 shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, etc.

[0054] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0055] The content provider is used to store and obtain data, and make this data accessible to applications. The data may include videos, images, audio, dialed and received calls, browsing history and bookmarks, phone books, etc.

[0056] The view system includes visible controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a short message notification icon may include a view for displaying text and a view for displaying pictures.

[0057] The phone manager is used to provide the communication function of the terminal device 100. For example, the management of call status (including connection, disconnection, etc.).

[0058] The resource manager provides various resources for applications, such as localized strings, icons, pictures, layout files, video files, etc.

[0059] The notification manager enables applications to display notification information in the status bar, can be used to convey notification-type messages, and can automatically disappear after a short stay without user interaction.

[0060] The Android runtime includes the core libraries and the virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.

[0061] The core libraries consist of two parts: one part is the functional functions that the Java language needs to call, and the other part is the core libraries of Android.

[0062] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0063] The system libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0064] The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.

[0065] The media libraries support the playback and recording of various common audio and video formats, as well as static image files, etc. The media libraries can support multiple audio and video coding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0066] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing, etc.

[0067] The 2D graphics engine is the graphics engine for 2D drawing.

[0068] The kernel layer is the layer between the hardware and the software. The kernel layer contains at least a display driver, a camera driver, an audio driver, and a sensor driver.

[0069] With the rapid development of electronic technology, the shooting functions of electronic devices are becoming more and more powerful, and there are more and more scenes for taking pictures with electronic devices. Current electronic devices can support multiple zooms to adapt to different shooting scenes, which depends on the combination and switching between multiple cameras with different parameters set on the electronic device. For example, an electronic device can use a wide-angle camera to capture images when the zoom factor is 1.0X. If the zoom factor is increased to 1.2X, a telephoto camera can be added as an auxiliary camera to capture images, while the wide-angle camera is still used as the main camera for shooting. If the zoom factor becomes 0.5X, an ultra-wide-angle camera is required for shooting. When two cameras are turned on at the same time for shooting, the images captured by the two cameras need to be fused to obtain the final image.

[0070] When the terminal device opens two cameras at the same time for shooting, one camera is usually determined as the main camera and the other camera is the auxiliary camera according to the zoom ratio. The images captured by the electronic device are mainly the images output by the main camera, so the parameters of the camera with a higher frequency as the main camera (that is, the target camera, referred to as the main camera) will be adjusted in detail (that is, calibrated) so that the display effect of the image captured by the target camera best meets people's requirements. Usually, the target camera is the camera called when the zoom ratio is 1.0X. For example, when the wide-angle camera is the target camera, people will make detailed adjustments to the color temperature, color difference, brightness and other parameters related to the display effect of the wide-angle camera so that the image captured by the wide-angle camera is closest to the picture effect observed by the human eye, that is, the most realistic.

[0071] When the zoom ratio changes significantly, the main camera often switches. For example, when the zoom ratio changes from 1.0X to 0.5X, the main camera will switch from a wide-angle camera to a telephoto camera. However, because the telephoto camera and the wide-angle camera are different physical cameras, the physical parameters of the two are different, and due to differences in post-calibration, the display effects of the images taken by the two cameras will be different, such as different brightness and / or color. When the zoom ratio changes significantly, the switching of the main camera will cause the display effect of the output preview screen to jump. In some scenarios, when the zoom ratio changes from 1.0X to 0.9X, the main camera will switch from a wide-angle camera to an ultra-wide-angle camera, and the preview screen will jump from bright and white to dark and yellow, for example. Figure 3 When the zoom ratio changes from 3.4X to 3.5X, the main camera will switch from a wide-angle camera to a telephoto camera, and the preview image will change from bright and white to dark and red. Figure 3 This display effect jump will affect the user experience.

[0072] In the technical solution provided by this application, it can be applied to Android platform. Specifically, in the case where two cameras output images simultaneously, when the main road camera is not the target camera that has been carefully calibrated, and the target camera outputs images as the auxiliary road camera, the terminal device statistically analyzes the images captured by the target camera acting as the auxiliary road camera to obtain statistical information. Then, the terminal device synchronizes the parameters of the images captured by the main road camera, which is not the target camera, according to the statistical information. That is, it recalculates the parameters of the output images of the main road camera that is not the target camera and displays the images according to the newly calculated parameters. This can ensure that even if the main road camera switches during the zooming process, the display effect will not jump due to different physical parameters between the cameras, thus improving the user experience. This method can maintain the unity of the display effect during the camera switching process without the need to carefully calibrate each camera. At the same time, this method can be applied to platforms that support heterogeneous frame rates. Heterogeneous frame rates refer to the characteristic that when two cameras output images simultaneously, the main road camera outputs images at a high frame rate, and the auxiliary road camera outputs images at a low frame rate. In the technical solution provided by the embodiments of this application, the terminal device synchronizes the parameters of the high-frame-rate images output by the main road with the low-frame-rate images output by the auxiliary road camera. That is to say, within the time period when the auxiliary road camera outputs one image, the main road camera will output multiple images, and the terminal device can use the statistical information of this image output by the auxiliary road camera to synchronize the parameters of the multiple images output by the main road camera within the same time period, achieving parameter synchronization of heterogeneous frame rates. Compared with the method of outputting images at the same frame rate by the main road camera and the auxiliary road camera and then synchronizing the parameters, this method can reduce the number of images output by the auxiliary road camera, thereby reducing power consumption.

[0073] For ease of understanding, the following embodiments of this application will use a terminal device with the structure shown in Figure 1 and Figure 2 as an example, and in combination with the accompanying drawings and application scenarios, specifically elaborate on the image processing method provided by the embodiments of this application.

[0074] Figure 4 The flowchart of an image processing method provided by the embodiments of this application is shown. The method includes:

[0075] S401. Obtain the first statistical data of the first image. The first image is the image obtained by the auxiliary road camera at the first moment, the first statistical data is the statistical data of the image parameters of the first image, and the image parameters of the first image meet the preset display requirements.

[0076] It should be noted that the auxiliary road camera is a target camera that has been finely calibrated. That is to say, the image parameters of the first image output by the auxiliary road camera can meet the preset display requirements, so that the display effect of the first image meets the viewing needs of people. The preset display requirement is to ensure that the display effect of the image is closest to the actual object observed by the human eye and has the best display effect.

[0077] Generally, the frame rate of the auxiliary road camera is lower than that of the main road camera. Taking the first image output by the auxiliary road camera at the first moment as an example, the terminal device can perform statistics on the first image to obtain the first statistical data of the first image. Optionally, the first statistical data may include statistical data of color information or statistical data of brightness information.

[0078] S402. Determine the image parameters of the second image according to the first statistical data and the initial image parameters of the second image. The second image is an image obtained by the main road camera at the second moment. The frame rate of the main road camera is higher than that of the auxiliary road camera. The difference degree between the image parameters of the second image and the image parameters of the first image is less than the preset difference degree threshold. The time difference between the second moment and the first moment is less than the preset time difference threshold. The preset time difference threshold is the reciprocal of the frame rate of the auxiliary road camera.

[0079] When the frame rate of the auxiliary road camera is usually lower than that of the main road camera, that is to say. During the period when the auxiliary road camera outputs one image, the main road camera will output multiple images. Specifically, reference can be made to Figure 5 the corresponding relationship between the image output times of the main road camera and the auxiliary road camera at different frame rates shown. Figure 5 Taking the example that the auxiliary road camera outputs one image in an image output cycle and the main road camera outputs three images in the same image output cycle. In the same image output cycle, the time difference between the moments when the main road outputs three images and the moment when the auxiliary road outputs an image is less than one image output cycle. This image output cycle can be used as the preset time difference threshold, which is the reciprocal of the frame rate of the auxiliary road camera. For example, when the frame rate of the auxiliary road camera is 30 frames per second (FPS), it means that 30 images are output in one second, then the image output cycle is the reciprocal of the frame rate: 1 / 30 second. In Figure 5 At the moments of T4, T5, and T6 shown, the time difference between the three images output by the main road camera and the image output by the auxiliary road camera at T1 moment is less than one image output cycle, and the images output by the main road camera at the moments of T4, T5, and T6 and the image output by the auxiliary road camera at T1 moment form a corresponding relationship. The terminal device can synchronize the image parameters of the images output by the main road camera at the three moments of T4, T5, and T6 in the same image output cycle according to the image output by the auxiliary road camera at T1 moment.

[0080] Specifically, after the terminal device obtains the first statistical data, the first statistical data is in the standby state for synchronizing image parameters.

[0081] Next, taking the main road camera outputting the second image at the second moment as an example, the specific process of this step will be described in detail. For example, when the first moment is the T1 moment as shown in Figure 5 , the second moment can be the T4, T5, and T6 moments as shown in Figure 5 ; when the first moment is the T2 moment as shown in Figure 5 , the second moment can be the T7, T8, and T9 moments as shown in Figure 5 . Taking any moment among T2, T3, and T4 as the second moment for example.

[0082] At the second moment, the main road camera outputs the second image. Originally, when the main road camera outputs an image, it calculates the initial image parameters such as the color and brightness of the second image according to the parameters of its own physical camera. This will result in inconsistent display effects with the target camera. In the embodiments of the present application, the terminal device no longer calculates the image parameters of the second image according to the parameters of the current main road camera's own physical camera, but regenerates the image parameters of the new second image according to the first statistical data of the first image captured by the auxiliary road camera that has been finely calibrated.

[0083] Optionally, the method of recalculating image parameters using statistical data can be the method of using an artificial intelligence (AI) model. The terminal device inputs the first statistical data and the initial image parameters of the second image into a pre-trained AI model, and outputs the image parameters of the new second image after being processed by the AI model. It should be noted that the AI model can be a neural network model, which is a model obtained by training with multiple training images calibrated with image parameters such as brightness information and color information.

[0084] Optionally, the method of recalculating image parameters using statistical data may also be to convert the image parameters using a pre-set relational expression 1. Taking the calculation of the luminance value L1 of a pixel point 1 in the second image as an example, the terminal device may input the luminance value L1, for example, into the pre-set relational expression 1, and obtain the luminance value L1' of the corresponding pixel point 1' in the new second image through the operation of the relational expression 1. In the application of the main road camera, the luminance value L1' is the same as or has very little difference from the luminance shown in the image captured by the auxiliary road camera, and is not easily distinguishable by the naked eye. Optionally, the above relational expression 1 may be to multiply L1 by a coefficient a, and a correction value b may also be added to the product of multiplying by the coefficient a, for example, expressed as: L1' = aL1 + b. Wherein, L1 is the initial image parameter of the second image, that is, the initial luminance parameter, which is the initial luminance value here. The luminance values of other pixel points can also be recalculated according to the relational expression 1. Optionally. The specific values of the coefficients a and b in this relational expression, as well as the specific form of this relational expression, are related to the parameters of the camera itself and can be adjusted and transformed according to specific needs. Again, taking the calculation of the color value C1 of a pixel point 2 in the second image as an example, the terminal device may input the luminance value C1, for example, into the pre-set relational expression 2, and obtain the luminance value C1' of the corresponding pixel point 2' in the new second image through the operation of the relational expression 2. In the application of the main road camera, the color value C1' is the same as or has very little difference from the color shown in the application of the auxiliary road camera, and is not easily distinguishable by the naked eye. Optionally, C1 and C1' may be any one of the color values of red (R), green (G), and blue (B), or may be a matrix of the color values of red (R), green (G), and blue (B), as long as they can express the color characteristics of the pixel point. Optionally, the above relational expression 2 may be to multiply C1 by a coefficient c, and a correction value d may also be added to the product of multiplying C1 by the coefficient c, for example, expressed as: C1' = cC1 + d. Wherein, C1 is the initial image parameter of the second image, that is, the initial color parameter, which is the initial color value here. The color values of other pixel points can also be recalculated according to the relational expression 2. Optionally. The specific values of the coefficients c and d in this relational expression, as well as the specific form of this relational expression 2, are related to the parameters of the camera itself and can be adjusted and transformed according to specific needs. It should be noted that the coefficients a, b, c, and d in the above relational expression 1 and relational expression 2 may be parameters obtained based on the first statistical data. Specifically, when the image parameter is a luminance parameter, the first statistical data may be in the form of a histogram, and the first statistical data may characterize statistical data such as the exposure value that affects the luminance. When the image parameter is a color parameter, the first statistical data may include white point information, such as the value of the correlated colour temperature (CCT).

[0085] As can be seen from the above description, the image parameters may include color parameters and / or brightness parameters. Optionally, the color parameters may include the auto white balance (AWB) parameter, and the recalculation of the color parameters may be referred to as AWB synchronization (AWB sync). Optionally, the brightness parameters may further include parameters capable of expressing brightness, such as RGGB (Bayer color filter array) and RGBW (red, yellow, blue, and white four-color pixels). The recalculation of the brightness parameters may be referred to as auto exposure synchronization (AE sync). Specifically, the terminal device may perform AE sync alone to ensure that the brightness does not jump, or perform AWB sync alone to ensure that the color does not jump, or perform both AE sync and AWB sync simultaneously to ensure that neither the color nor the brightness jumps.

[0086] Generally, when the frame rate of the main camera is 30 FPS and the frame rate of the auxiliary camera is 5 - 15 FPS, the display effect and power consumption of the image can be balanced, and the rationality is strong.

[0087] Optionally, generally, the camera's response to brightness changes is more obvious, which is manifested as a relatively fast convergence of AE. Then, when performing AE sync, if the frame rate of the auxiliary camera is too low, it will result in poor AE sync effect and a certain degree of brightness jump. Therefore, for the case of AE sync, the auxiliary camera can output images at a higher frame rate. Taking the frame rate of the main camera as 30 FPS as an example, the auxiliary camera can output images at 10 - 15 FPS. During the image output process of the camera, the response to color changes is not as obvious as that to brightness changes. That is to say, the convergence of AWB is not that fast. Therefore, when performing AWB sync, the auxiliary camera can output images at a lower frame rate. Taking the frame rate of the main camera as 30 FPS as an example, the auxiliary camera can use 5 - 10 FPS.

[0088] Optionally, the terminal camera can also keep the auxiliary camera outputting images at a higher frame rate, and then distinguish the execution frequencies of AWB sync and AE sync, that is, the frequency of executing AE sync is higher than that of executing AWB sync. For example Figure 5Taking the frame rate of the main road camera shown as 30 FPS and the frame rate of the secondary road camera as 10 FPS as an example, the terminal uses the statistical data of the image obtained by the secondary road camera at time T1 to perform color synchronization on the images obtained by the main road camera at T4, T5, and T6. The statistical data of the image obtained by the secondary road camera at time T2 is used to perform color synchronization on the images obtained by the main road camera at T7, T8, and T9. And so on, that is, using one first image to perform AE synchronization on three consecutive second images. The terminal uses the statistical data of the image obtained by the secondary road camera at time T1 to perform color synchronization on the images obtained by the main road camera from T4 to T9. And so on, that is, using one first image to perform AWB synchronization on six consecutive second images. For AE synchronization and AWB synchronization, the secondary road camera can use different frame rates to balance the display effect and power consumption.

[0089] S403. Display the second image according to the image parameters of the second image.

[0090] When the terminal device displays the second image according to the calculated image parameters of the second image, it can ensure that the display effect meets the preset display requirements. After the terminal device performs AE and AWB synchronization, it can make the color and brightness of the preview screen not change significantly during the process of switching cameras.

[0091] The above Figure 4 In the above-described embodiment, when the main road camera is switched to a target camera that has not been finely calibrated, and the target camera outputs images as the secondary road camera, the terminal device performs statistics on the first image captured by the target camera serving as the secondary road camera to obtain the first statistical information; then synchronizes the second image captured by the main road camera, which is a non-target camera, within the same image output cycle according to the statistical information to obtain new image parameters, and displays the image obtained by the secondary road camera according to the newly calculated image parameters. This method can ensure that during the zooming process, even if the main road camera is switched, the display effect will not jump due to different physical parameters between cameras, thus improving the user experience. And this method can maintain the unity of the display effect during the process of switching cameras without having to perform detailed and precise calibration on each camera. At the same time, this method is applied to a heterogeneous frame rate platform where the main road camera outputs images at a high frame rate and the secondary road camera outputs images at a low frame rate. The terminal device uses the statistical information of the images output at a low frame rate by the secondary road camera to synchronize the image parameters of multiple images output at a high frame rate by the main road camera within the same image output cycle, realizing the synchronization of image parameters for heterogeneous frame rates. Compared with the method of outputting images at the same frame rate by the main road camera and the secondary road camera and then synchronizing the image parameters, this method also reduces the number of images output by the secondary road camera, thereby reducing power consumption.

[0092] Based on the above embodiments, when the main road camera is the target camera, even if the zoom ratio changes, the switching of the main road camera does not necessarily occur. The terminal device still uses the target camera as the main road camera to output images, so there will be no jump in the display effect, and thus there is no need to start the synchronization of image parameters. Specifically, reference can be made to Figure 6 the process shown below, including:

[0093] S601. Determine whether the main road camera is the calibrated target camera, and the image parameters of the image output by the target camera meet the preset display requirements. If so, execute S602A; if not, execute S602B.

[0094] S602A. Display the second image according to the initial image parameters corresponding to the second image, where the initial image parameters are the image parameters of the initial image captured by the main road camera at the second moment.

[0095] Specifically, when the main road camera is the target camera, the terminal device does not need to enable the synchronization function, and only needs to display the second image according to the initial image parameters of the second image captured by the current main road camera, that is, the target camera. At this time, there is no need to synchronize the image parameters and there will be no jump in the display effect, which can avoid an invalid data processing process.

[0096] S602B. Enable the synchronization function.

[0097] Specifically, when the main road camera is the target camera, the terminal device can enable the synchronization function and perform AE and / or AWB synchronization, that is, execute the steps of S401 above.

[0098] The above Figure 6 In the embodiments shown above, when the current main road camera of the terminal device is the target camera, there is no need to synchronize the image parameters, and there will be no jump in the display effect, which can avoid an invalid data processing process; when the current main road camera is not the target camera, the image parameter synchronization process is executed, making the image parameter synchronization process more effective and reasonable.

[0099] To implement the above method, the following will be described in conjunction with the software architecture diagram to which the method is applied. The cooperation of multiple cameras (abbreviated as multi-camera) can be based on, for example, Figure 7The shown Multicamera Usecase Base framework includes: Resource Manager, Policy Manager, Decide Capability, and Region of Interest Translator (ROI Translator). This framework also includes a Logical device xml.

[0100] Resource Manager is used to manage and allocate the software and hardware resources of the shooting system.

[0101] Policy Manager is used to manage the combination and call policies of multiple cameras, and adapt with the multicamera xform (MCX) policy adaptation module (MCXpolicy) to determine which cameras are currently enabled according to the scene. For example, when the zoom ratio is 1.0X, only the wide-angle camera is called for shooting; when the zoom ratio is 1.2X, the wide-angle camera and the ultra-wide-angle camera are called for shooting, and so on.

[0102] ROI Translator is used to manage the regions of interest in the image. For example, the face region when shooting a person can be the region of interest, and the tree region when shooting a landscape can be the region of interest. ROI Translator is used to adapt with the MCX Translator adaptation module to correct the displayed positions of the regions of interest captured by different cameras, ensuring that the displayed position of the same object in the image does not undergo obvious displacement during multicamera switching.

[0103] Decide Capability is used to make decisions on the algorithms and modes of the images output by the cameras.

[0104] Logical device xml is used to provide corresponding parameters for the operation of the above-mentioned managers.

[0105] The above Multicamera Usecase Base framework needs to implement multicamera policies with the support of the Feature function module. Among them, Feature includes: GraphManager, GraphSelector, and PoolManager. Among them, GraphManager, GraphSelector, and PoolManager work together to provide underlying functions for multicamera policies.

[0106] The Feature also includes the MCX super feature detail graph (Feature detail Graph, FDG). The MCX super FDG includes: Real-Time Multicamera (RealTimeMC), Multicamera Report Real-Time (MCReportRT), and Real-Time Post-Process (RTPostProcess).

[0107] Among them, MCReportRT includes multiple source buffers. These multiple sources are encapsulated by the CHi node wrapper module and stored in the target buffer. The CHi node wrapper module also interacts through the SIT SAT adaptation node (SIT SAT adaptation Node) and the extended framework super image turbo (SIT) to establish a smooth zoom (Spatial Alignment Transform, SAT) graphics path, realizing the evolution of the basic framework for multicamera use. Between SIT and the basic framework for multicamera use, a request control path (Request control path) and a result feedback path (Result feedback path) are also established for interaction to jointly implement a richer multicamera strategy.

[0108] Next, the architecture of the extended framework SIT is introduced. SIT is an extended image engine, which includes: a feature management module. The feature management module includes: a perception engine, a decision engine, and a multicamera feature module.

[0109] The perception engine is used to perceive the data collected by the camera, such as parameters like brightness, contrast, and exposure.

[0110] The decision engine is used to decide what algorithms and strategies to use for image generation based on the parameters perceived by the perception engine.

[0111] The multicamera feature module is used to adapt various aspects of features according to the algorithms and strategies decided by the decision engine, such as calling combinations of those cameras for image generation. The multicamera feature module is also used to control whether the heterogeneous frame rate synchronization module (variable frames per second, VFPS) enables the heterogeneous frame rate synchronization function and the smooth operation of the synchronization function.

[0112] Specifically, the multi-camera feature module includes: a multi-camera configuration module, a multi-camera decision-making module, and a multi-camera fusion module (multi-camera CROP calculation). The multi-camera configuration module, the multi-camera decision-making module, and the multi-camera fusion calculation module cooperate together to perform various aspects of adaptation based on heterogeneous frame rates, such as the adaptation of cameras with heterogeneous frame rates. Specifically, it controls whether the VFPS enables the synchronization function of heterogeneous frame rates and the smooth operation of the synchronization function of heterogeneous frame rates. Among them, the multi-camera fusion module can also be combined with an extended fusion strategy to achieve the evolution of the fusion scheme.

[0113] As mentioned above, VFPS is an attribute configured for the camera. Specifically, when the zoom ratio is 1.0X, there is no need for a secondary road camera, that is, only one main road camera is turned on for shooting, and the main road camera is the target camera that has been precisely calibrated. When the zoom ratio changes from 1.0X to 0.9X, the terminal device requires the heterogeneous frame rate synchronization module to call the corresponding parameters to configure the main road camera as an ultra-wide-angle camera and the secondary road as a wide-angle camera. The target camera is an attribute of one sensor. When it is 1.0, there is no need to turn on the secondary road, that is, the main road output, and the main road is the debugged target camera. So this function is not needed.

[0114] In addition, an algorithm platform is also included in the entire SIT architecture. Through the combined action of a pipe, a plugin, an executor, and a scheduler in the algorithm platform, the smooth operation of the algorithm is ensured. Specifically, the algorithm platform includes: a source, a SAT plugin, YuvEnhance, and a sink, which are used to support the rotation of multi-camera synchronization.

[0115] Among them, the SAT plugin interacts with the extended SAT module to achieve the extension of the smooth zoom scheme.

[0116] YuvEnhance can implement image preview based on the drawing module (IPE).

[0117] The algorithm platform can also set a heterogeneous computing acceleration module to accelerate the image output in the heterogeneous frame rate scenario.

[0118] In addition, the multi-camera uses the basic framework and the feature management in the SIt architecture to establish a request control path and a result feedback path, and combines them to achieve more functional multi-camera usage scenarios.

[0119] Examples of the method provided in this application are described in detail above. It can be understood that, in order to implement the above functions, the corresponding device includes the corresponding hardware structure and / or software module for executing each function. Those skilled in the art should easily realize that, combining the units and algorithm steps of each example described in the embodiments disclosed in this article, this application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed in the way of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of this application.

[0120] This application can divide the functional modules of the image processing device according to the above method examples. For example, each function can be divided into each functional module, or two or more functions can be integrated into one module. The above integrated module can be implemented in the form of hardware or in the form of a software functional module. It should be noted that the division of modules in this application is illustrative, only a logical function division, and there can be other division methods in actual implementation.

[0121] Figure 8 shows a schematic structural diagram of an image processing device provided in this application. The device 800 includes:

[0122] An acquisition module 801, configured to acquire first statistical data of a first image, where the first image is an image acquired by a secondary road camera at a first moment, the first statistical data is statistical data of image parameters of the first image, and the image parameters of the first image meet a preset display requirement;

[0123] A synchronization module 802, configured to determine the image parameters of a second image according to the first statistical data and the initial image parameters of the second image, where the second image is an image acquired by a main road camera at a second moment, the frame rate of the main road camera is higher than that of the secondary road camera, the difference degree between the image parameters of the second image and the image parameters of the first image is less than a preset difference degree threshold, the time difference between the second moment and the first moment is less than or equal to a preset time difference threshold, and the preset time difference threshold is the reciprocal of the frame rate of the secondary road camera;

[0124] A display module 803, configured to display the second image according to the image parameters of the second image.

[0125] In some embodiments, the first statistical data is statistical data of the color parameters and / or brightness parameters of the first image, and the image parameters include brightness parameters and / or color parameters.

[0126] In some embodiments, the acquisition module 801 is further configured to determine whether the main road camera is a calibrated target camera, and the image parameters of the image output by the target camera meet the preset display requirements; if not, then the step of acquiring the first statistical data of the first image is executed.

[0127] In some embodiments, the display module 803 is further configured to, if the main road camera is the target camera, display the second image according to the initial image parameters of the second image, where the initial image parameters are the image parameters of the initial image captured by the main road camera at the second moment.

[0128] In some embodiments, when the image parameters include brightness parameters, the frame rate of the auxiliary road camera is the first frame rate; when the image parameters include color parameters, the frame rate of the auxiliary road camera is the second frame rate; the first frame rate is higher than the second frame rate.

[0129] In some embodiments, when the image parameters include brightness parameters, the synchronization module 802 is specifically configured to perform automatic exposure (AW) synchronization according to the first statistical data and the initial image parameters of the second image to obtain the image parameters of the second image.

[0130] In some embodiments, when the image parameters include brightness parameters, the synchronization module 802 is specifically configured to perform automatic white balance (AWB) synchronization according to the first statistical data and the initial image parameters of the second image to obtain the image parameters of the second image.

[0131] In some embodiments, the frame rate of the main road camera is 30 frames per second (FPS), the first frame rate is 10 - 15 FPS, and the second frame rate is 3 - 5 FPS.

[0132] The specific manner in which the apparatus 800 executes the image processing method and the beneficial effects produced can be referred to the relevant descriptions in the method embodiments, and will not be elaborated here.

[0133] The embodiments of the present application further provide an electronic device, including the above-mentioned processor. The electronic device provided in this embodiment may be Figure 1 the terminal device 100 shown in the figure, which is used to execute the above-mentioned image processing method. In the case of adopting an integrated unit, the terminal device may include a processing module, a storage module, and a communication module. Among them, the processing module may be used to control and manage the actions of the terminal device. For example, it may be used to support the terminal device to execute the steps performed by the display unit, the detection unit, and the processing unit. The storage module may be used to support the terminal device to execute storing program codes and data, etc. The communication module may be used to support the communication between the terminal device and other devices.

[0134] Among them, the processing module can be a processor or a controller. It can implement or execute various exemplary logical blocks, modules, and circuits described in connection with the disclosure of this application. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a digital signal processor (DSP) and a microprocessor, and so on. The storage module can be a memory. The communication module can specifically be a device that interacts with other terminal devices, such as a radio frequency circuit, a Bluetooth chip, a Wi-Fi chip, etc.

[0135] In one embodiment, when the processing module is a processor and the storage module is a memory, the terminal device involved in this embodiment can be a device with Figure 1 the structure shown.

[0136] The embodiments of this application also provide a computer-readable storage medium. A computer program is stored in the computer-readable storage medium. When the computer program is executed by a processor, the processor is caused to execute the image processing method described in any of the above embodiments.

[0137] The embodiments of this application also provide a computer program product. When the computer program product runs on a computer, the computer is caused to execute the above-related steps to implement the image processing method in the above embodiments.

[0138] Among them, the electronic device, computer-readable storage medium, computer program product, or chip provided in this embodiment is all used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be elaborated here.

[0139] In several embodiments provided in this application, it should be understood that the disclosed device and method can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of modules or units is only a logical function division. In actual implementation, there can be other division methods. For example, multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the displayed or discussed coupling or direct coupling or communication connection to each other can be through some interfaces, indirect coupling or communication connection of devices or units. The replaced units may or may not be physically separated. The components displayed as units can be one physical unit or multiple physical units, that is, they can be located in one place, or they can be distributed to multiple different places. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0140] In addition, in each embodiment of the present application, each functional unit can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

[0141] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiments of the present application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. The software product is stored in a storage medium and includes several instructions for causing a device (which can be a single-chip microcomputer, a chip, etc.) or a processor to execute all or part of the steps of the methods of the various embodiments of the present application. The foregoing storage medium includes: various media such as USB flash drives, mobile hard disks, read only memory (ROM), random access memory (RAM), magnetic disks, or optical discs that can store program codes.

[0142] The above content is only the specific implementation manner of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present application, and all of them should be covered by the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. An image processing method, characterized in that, applied to an electronic device, the electronic device being a device of a heterogeneous frame rate platform, the method comprising: obtaining first statistical data of a first image, the first image being an image obtained by a secondary camera at a first moment, the first statistical data being statistical data of image parameters of the first image, and the image parameters of the first image satisfying a preset display requirement; determining image parameters of a second image according to the first statistical data and initial image parameters of the second image, the second image being an image obtained by a main camera at a second moment, the frame rate of the main camera being higher than that of the secondary camera, the difference degree between the image parameters of the second image and the image parameters of the first image being less than a preset difference degree threshold, the time difference between the second moment and the first moment being less than or equal to a preset time difference threshold, and the preset time difference threshold being the reciprocal of the frame rate of the secondary camera; displaying the second image according to the image parameters of the second image; when the image parameters include brightness parameters, the frame rate of the secondary camera is a first frame rate; when the image parameters include color parameters, the frame rate of the secondary camera is a second frame rate; the first frame rate is higher than the second frame rate.

2. The method according to claim 1, characterized in that, the first statistical data is statistical data of color parameters and / or brightness parameters of the first image, and the image parameters include brightness parameters and / or color parameters.

3. The method according to claim 2, characterized in that, the obtaining of the first statistical data of the first image includes: determining whether the main camera is a calibrated target camera, and the image parameters of the image output by the target camera satisfy the preset display requirement; if not, then performing the step of obtaining the first statistical data of the first image.

4. The method according to claim 3, characterized in that, the method further comprises: if the main camera is the target camera, then displaying the second image according to the initial image parameters of the second image, and the initial image parameters being the image parameters of the initial image captured by the main camera at the second moment.

5. The method according to claim 1, characterized in that, when the image parameters include brightness parameters, the determining of the image parameters of the second image according to the first statistical data and the initial image parameters of the second image includes: performing automatic exposure (AE) synchronization according to the first statistical data and the initial image parameters of the second image to obtain the image parameters of the second image.

6. The method according to claim 5, characterized in that, when the image parameters include color parameters, the determining of the image parameters of the second image according to the first statistical data and the initial image parameters of the second image includes: performing automatic white balance (AWB) synchronization according to the first statistical data and the initial image parameters of the second image to obtain the image parameters of the second image.

7. The method according to claim 1, characterized in that, The frame rate of the main road camera is 30 frames per second (FPS), the first frame rate is 10 - 15 FPS, and the second frame rate is 3 - 5 FPS.

8. An electronic device, characterized in that, it includes: a processor, a memory, and an interface; The processor, the memory, and the interface cooperate with each other to enable the electronic device to execute the method according to any one of claims 1 to 7.

9. A computer-readable storage medium, characterized in that, a computer program is stored in the computer-readable storage medium, and when the computer program is executed by the processor, the processor is enabled to execute the method according to any one of claims 1 to 7.

Images