Image processing method, electronic equipment and computer readable storage medium

By obtaining the image statistics of the secondary camera, recalculating the image parameters of the main camera, the display effect jump problem caused by camera switching is solved, and the consistency of display effect and user experience is improved during the zoom process, while reducing power consumption .

CN119071633AActive Publication Date: 2024-12-03SHANGHAI GLORY SMART TECH DEV CO LTD
View PDF 11 Cites 0 Cited by

Patent Information

Application Number
CN202311284913.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-09-28
Publication Date
2024-12-03
Estimated Expiration
2043-09-28

AI Technical Summary

Technical Problem

In electronic devices, the display effect jumps caused by camera switching during zooming, affecting the user experience, and the prior art requires detailed adjustment of each camera to maintain the consistency of the display effect.

Method used

通过获取辅路摄像头的图像统计数据,重新计算主路摄像头的图像参数,确保在变焦过程中显示效果的一致性,甚至在主路摄像头切换时也能保持统一,且无需对每个摄像头进行详细调校。

Benefits of technology

It realizes the continuity of display effects during zooming, improves user experience, and reduces the number of pictures produced by auxiliary cameras and reduces power consumption.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119071633A_ABST
    Figure CN119071633A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of electronics, and provides an image processing method, electronic equipment and a computer readable storage medium, and the method comprises the steps: obtaining first statistical data of a first image, the first image being an image obtained by an auxiliary road camera at a first moment; image parameters of the second image are determined according to the first statistical data and initial image parameters of the second image, the second image is an image obtained by the main path camera at the second moment, and the frame rate of the main path camera is higher than that of the auxiliary path camera; the difference degree between the image parameter of the second image and the image parameter of the first image is smaller than a preset difference degree threshold value, the time difference between the second moment and the first moment is smaller than or equal to a preset time difference threshold value, and the preset time difference threshold value is the reciprocal of the frame rate of the side road camera; and displaying the second image according to the image parameters of the second image. According to the method, the consistency of the image display effect in the zooming process can be ensured in a low-power-consumption state.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of image technology, and in particular to an image processing method, an electronic device, and a computer-readable storage medium. Background Art

[0002] With the rapid development of electronic technology, the shooting function of electronic devices is becoming more and more powerful, and there are more and more scenes for taking pictures with electronic devices. Current electronic devices support multi-fold zoom, which relies on the setting of multiple cameras with different zoom ranges on the electronic device. For example, the electronic device can set a wide-angle camera to shoot the picture when the zoom factor is 1.0X, set an ultra-wide-angle camera to shoot the picture when the zoom factor is small, and set a telephoto camera to shoot the picture when the zoom factor is larger. Different cameras have different shooting functions and often need to be used in combination. For example, when the zoom is 1.0X, a wide-angle camera can be used to shoot; when the zoom is 1.2X, it is necessary to open an auxiliary camera, such as an ultra-wide-angle camera for auxiliary shooting, and then fuse the images taken by these two cameras to obtain the final captured image.

[0003] When a terminal device opens two cameras at the same time for shooting, one camera is usually determined as the main camera and the other camera is the auxiliary camera according to the zoom ratio. The images captured by the electronic device are mainly the images output by the main camera, so the parameters of the camera with a higher frequency as the main camera will be adjusted in detail to make the display effect of the captured image best meet people's requirements.

[0004] When the zoom ratio changes significantly, the main camera often switches. For example, when the zoom ratio changes from 1.0X to 0.5X, the main camera switches from a wide-angle camera to a telephoto camera. However, since the telephoto camera and the wide-angle camera are different physical cameras, their physical parameters are different, which will cause the display effect of the output preview screen to jump, affecting the user experience. Summary of the invention

[0005] The present application provides an image processing method, device, chip, electronic device, computer-readable storage medium and computer program product, which can maintain the consistency of display effects during zooming and improve user experience.

[0006] In a first aspect, an image processing method is provided, including: obtaining first statistical data of a first image, the first image is an image obtained by an auxiliary camera at a first moment, the first statistical data is statistical data of image parameters of the first image, and the image parameters of the first image meet preset display requirements; determining image parameters of the second image according to the first statistical data and initial image parameters of the second image, the second image is an image obtained by a main camera at a second moment, the frame rate of the main camera is higher than the frame rate of the auxiliary camera, the difference between the image parameters of the second image and the image parameters of the first image is less than a preset difference threshold, the time difference between the second moment and the first moment is less than or equal to a preset time difference threshold, and the preset time difference threshold is the inverse of the frame rate of the auxiliary camera; and displaying the second image according to the image parameters of the second image.

[0007] The auxiliary camera is a finely calibrated target camera. That is, the image parameters of the first image output by the auxiliary camera can meet the preset display requirements, so that the display effect of the first image meets people's viewing needs. The preset display requirements are to ensure that the display effect of the image is closest to the real object observed by the human eye and the display effect is the best.

[0008] Typically, the frame rate of the auxiliary camera is lower than that of the main camera. Taking the first image output by the auxiliary camera at the first moment as an example, the terminal device can perform statistics on the first image to obtain first statistical data of the first image. Optionally, the first statistical data may include statistical data of color information or statistical data of brightness information.

[0009] When the frame rate of the auxiliary camera is usually lower than that of the main camera, that is, during the period when the auxiliary camera outputs one image, the main camera outputs multiple images. In the same image output cycle, the time difference between the moment when the main channel outputs multiple images and the moment when the auxiliary channel outputs an image is less than one image output cycle. The image output cycle can be used as a preset time difference threshold, which is the inverse of the frame rate of the auxiliary camera.

[0010] At the second moment, the main camera outputs the second image. Originally, when the main camera outputs the image, it will calculate the initial image parameters such as color and brightness of the second image based on the parameters of the physical camera of the main camera itself, which will cause the display effect to be inconsistent with the display effect of the target camera. In the embodiment of the present application, the terminal device no longer calculates the image parameters of the second image based on the parameters of the physical camera of the current main camera itself, but regenerates the new image parameters of the second image based on the first statistical data of the first image taken by the auxiliary camera that has been finely adjusted.

[0011] Optionally, the method of recalculating the image parameters using statistical data may be a method of using an AI model. Optionally, the method of recalculating the image parameters using statistical data may be to obtain coefficients required for conversion based on the first statistical data, and then bring the coefficients and the initial image parameters into a preset relationship to calculate the new image parameters of the second image.

[0012] When the terminal device displays the second image according to the calculated image parameters of the second image, it can ensure that the display effect meets the preset display requirements. After the terminal device performs AE and AWB synchronization, the color and brightness of the preview image will not change significantly during the camera switching process.

[0013] When the main camera is switched to a target camera that is not calibrated in detail and the target camera is used as an auxiliary camera to output images, the terminal device performs statistics on the first image taken by the target camera as the auxiliary camera to obtain first statistical information; then, according to the statistical information, the second image taken by the main camera that is not the target camera in the same output cycle is synchronized to obtain new image parameters, and the image obtained by the auxiliary camera is displayed according to the newly calculated image parameters. This method can ensure that during the zoom process, even if the main camera is switched, the display effect will not jump due to the different physical parameters between the cameras, thereby improving the user experience. And this method does not need to perform detailed and precise adjustments on each camera, and can maintain the uniformity of the display effect during the camera switching process. At the same time, this method is applied to a platform with heterogeneous frame rates in which the main camera outputs images at a high frame rate and the auxiliary camera outputs images at a low frame rate. The terminal device uses the statistical information of the image output at a low frame rate of the auxiliary camera to synchronize the image parameters of multiple images output at a high frame rate by the main camera in the same output cycle, thereby realizing the synchronization of image parameters of heterogeneous frame rates. Compared with the method in which the main camera and the auxiliary camera output images at the same frame rate and then synchronize image parameters, this method also reduces the number of images output by the auxiliary camera, thereby reducing power consumption.

[0014] In some embodiments, the first statistical data are statistical data of color parameters and / or brightness parameters of the first image, and the image parameters include brightness parameters and / or color parameters.

[0015] The terminal device collects statistics on the first image captured by the target camera as the auxiliary camera to obtain first statistical information; then synchronizes the second image captured by the main camera that is not the target camera in the same image output cycle according to the statistical information to obtain new color parameters and / or brightness parameters, and displays the image acquired by the auxiliary camera according to the newly calculated color parameters and / or brightness parameters. This method can ensure that during the zoom process, even if the main camera is switched, the color and / or brightness will not jump due to the different physical parameters between the cameras, thereby improving the user experience.

[0016] In some embodiments, obtaining first statistical data of the first image includes: determining whether the main road camera is a calibrated target camera, and image parameters of the image output by the target camera meet preset display requirements; if not, executing the step of obtaining first statistical data of the first image.

[0017] In some embodiments, the method further includes: if the main camera is the target camera, displaying the second image according to initial image parameters of the second image, where the initial image parameters are image parameters of the initial image captured by the main camera at the second moment.

[0018] Specifically, when the main camera is the target camera, the terminal device does not need to enable the synchronization function, and only needs to display the second image according to the initial image parameters of the second image captured by the current main camera, that is, the target camera. At this time, there is no need to synchronize the image parameters and the display effect will not change, which can avoid invalid data processing flow.

[0019] When the current main camera of the terminal device is the target camera, there is no need to synchronize the image parameters, and there will be no display effect jump, which can avoid invalid data processing processes; when the current main camera is not the target camera, the image parameter synchronization process is executed, making the image parameter synchronization process more effective and more reasonable.

[0020] In some embodiments, when the image parameters include brightness parameters, the frame rate of the auxiliary camera is a first frame rate; when the image parameters include color parameters, the frame rate of the auxiliary camera is a second frame rate; the first frame rate is higher than the second frame rate.

[0021] Alternatively, the camera usually reacts more obviously to brightness changes, which is manifested in that the AE convergence is faster. So when doing AE synchronization, if the frame rate of the auxiliary camera is too low, the AE synchronization effect will be poor, and a certain degree of brightness jump will occur. Therefore, in the case of AE synchronization, the auxiliary camera can output images at a higher frame rate. Taking the frame rate of the main camera as 30FPS as an example, the auxiliary camera can output images at 10-15FPS. However, during the image output process, the camera's reaction to color changes is not as obvious as that to brightness changes. In other words, the convergence of AWB is not that fast. Therefore, when doing AWB synchronization, the auxiliary camera can output images at a lower frame rate. Taking the frame rate of the main camera as 30FPS as an example, the auxiliary camera can use 5-10FPS. This method can reasonably set the frame rate of the auxiliary camera, taking into account the balance between display effect and power consumption.

[0022] The terminal camera can also maintain the high frame rate of the auxiliary camera to output images, and then distinguish the execution frequency of AWB synchronization and AE synchronization, that is, the frequency of executing AE synchronization is higher than the frequency of executing AWB synchronization. Taking the frame rate of the main camera as 30FPS and the auxiliary camera as 10FPS as an example, the terminal uses the statistical data of the image obtained by the auxiliary camera at one time to perform color synchronization on the three images obtained by the main camera at three times in the same image output cycle, that is, one first image is used to perform AE synchronization on three consecutive second images. The terminal uses the statistical data of the image obtained by the auxiliary camera at one time to perform color synchronization on the six images obtained by the main camera in two image output cycles. And so on, that is, one first image is used to perform AWB synchronization on six consecutive second images. For AE synchronization and AWB synchronization, the auxiliary camera can use different frame rates to balance the display effect and power consumption.

[0023] In some embodiments, when the image parameters include brightness parameters, the image parameters of the second image are determined based on the first statistical data and the initial image parameters of the second image, including: performing automatic exposure AW synchronization based on the first statistical data and the initial image parameters of the second image to obtain the image parameters of the second image.

[0024] In some embodiments, when the image parameters include brightness parameters, the image parameters of the second image are determined based on the first statistical data and the initial image parameters of the second image, including: performing automatic white balance AWB synchronization based on the first statistical data and the initial image parameters of the second image to obtain the image parameters of the second image.

[0025] In some embodiments, the frame rate of the main camera is 30 FPS, the first frame rate is 10-15 FPS, and the second frame rate is 3-5 FPS.

[0026] When the frame rate of the main camera is 30FPS and the auxiliary camera uses 5-15FPS, both the image display effect and power consumption can be taken into account, which is very reasonable.

[0027] In a second aspect, an image processing device is provided, comprising a unit composed of software and / or hardware, wherein the unit is used to execute any one of the methods in the technical solution of the first aspect.

[0028] In a third aspect, an embodiment of the present application provides a chip, comprising a processor; the processor is used to read and execute a computer program stored in a memory to execute any one of the methods in the technical solution described in the first aspect.

[0029] Optionally, the chip also includes a memory, and the memory is connected to the processor via a circuit or wire.

[0030] Further optionally, the chip also includes a communication interface.

[0031] In a fourth aspect, an electronic device is provided, comprising: a processor, a memory and an interface; the processor, the memory and the interface cooperate with each other so that the electronic device executes any one of the methods in the technical solution described in the first aspect.

[0032] In a fifth aspect, an electronic device is provided, the electronic device comprising any chip in the technical solution described in the third aspect.

[0033] In a sixth aspect, a computer-readable storage medium is provided, in which a computer program is stored. When the computer program is executed by a processor, the processor executes any one of the methods in the technical solution described in the first aspect.

[0034] In a seventh aspect, a computer program product is provided, the computer program product comprising: a computer program code, when the computer program code is run on an electronic device, the electronic device executes any one of the methods in the technical solution described in the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 is a schematic diagram of the structure of a terminal device 100 provided in an embodiment of the present application;

[0036] Figure 2 is a software structure block diagram of the terminal device 100 provided in an embodiment of the present application;

[0037] Figure 3 It is a schematic diagram of the display effect before and after switching the camera;

[0038] Figure 4 is a flowchart of an image processing method provided in an embodiment of the present application;

[0039] Figure 5 This is a comparison diagram of the timing of outputting images at heterogeneous frame rates provided in an embodiment of the present application;

[0040] Figure 6 is a flowchart of another image processing method provided in an embodiment of the present application;

[0041] Figure 7 is a schematic diagram of the structure of a multi-camera framework provided in an embodiment of the present application;

[0042] Figure 8 It is a schematic diagram of the structure of an image processing device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0043] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0044] In the following, the terms "first", "second", and "third" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first", "second", and "third" may explicitly or implicitly include one or more of the features.

[0045] The image processing method provided in the embodiments of the present application can be applied to terminal devices such as mobile phones, tablet computers, wearable devices, vehicle-mounted devices, augmented reality (AR) / virtual reality (VR) devices, laptop computers, ultra-mobile personal computers (UMPC), netbooks, personal digital assistants (PDA), etc. The embodiments of the present application do not impose any restrictions on the specific types of terminal devices.

[0046] For example, Figure 11 is a schematic diagram of the structure of an example of a terminal device 100 provided in an embodiment of the present application. The terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0047] It is understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0048] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0049] The software system of the terminal device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The present application embodiment takes the Android system of the layered architecture as an example to exemplify the software structure of the terminal device 100.

[0050] Figure 21 is a software structure diagram of the terminal device 100 of the embodiment of the present application. The layered architecture divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely, the application layer, the application framework layer, the Android runtime (Android runtime) and the system library, and the kernel layer. The application layer can include a series of application packages.

[0051] like Figure 2 As shown, the application package may include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.

[0052] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0053] like Figure 2 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0054] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0055] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0056] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0057] The phone manager is used to provide communication functions of the terminal device 100, such as management of call status (including connection, disconnection, etc.).

[0058] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0059] The notification manager enables applications to display notification information in the status bar, which can be used to convey notification-type messages and disappear automatically after a short stay without user interaction.

[0060] Android runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0061] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0062] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0063] The system library may include multiple functional modules, such as surface manager, media libraries, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0064] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0065] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0066] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0067] A 2D graphics engine is a drawing engine for 2D drawings.

[0068] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0069] With the rapid development of electronic technology, the shooting functions of electronic devices are becoming more and more powerful, and there are more and more scenes for taking pictures with electronic devices. Current electronic devices can support multiple zooms to adapt to different shooting scenes, which depends on the combination and switching between multiple cameras with different parameters set on the electronic device. For example, an electronic device can use a wide-angle camera to capture images when the zoom factor is 1.0X. If the zoom factor is increased to 1.2X, a telephoto camera can be added as an auxiliary camera to capture images, while the wide-angle camera is still used as the main camera for shooting. If the zoom factor becomes 0.5X, an ultra-wide-angle camera is required for shooting. When two cameras are turned on at the same time for shooting, the images captured by the two cameras need to be fused to obtain the final image.

[0070] When the terminal device opens two cameras at the same time for shooting, one camera is usually determined as the main camera and the other camera is the auxiliary camera according to the zoom ratio. The images captured by the electronic device are mainly the images output by the main camera, so the parameters of the camera with a higher frequency as the main camera (that is, the target camera, referred to as the main camera) will be adjusted in detail (that is, calibrated) so that the display effect of the image captured by the target camera best meets people's requirements. Usually, the target camera is the camera called when the zoom ratio is 1.0X. For example, when the wide-angle camera is the target camera, people will make detailed adjustments to the color temperature, color difference, brightness and other parameters related to the display effect of the wide-angle camera so that the image captured by the wide-angle camera is closest to the picture effect observed by the human eye, that is, the most realistic.

[0071] When the zoom ratio changes significantly, the main camera often switches. For example, when the zoom ratio changes from 1.0X to 0.5X, the main camera will switch from a wide-angle camera to a telephoto camera. However, because the telephoto camera and the wide-angle camera are different physical cameras, the physical parameters of the two are different, and due to differences in post-calibration, the display effects of the images taken by the two cameras will be different, such as different brightness and / or color. When the zoom ratio changes significantly, the switching of the main camera will cause the display effect of the output preview screen to jump. In some scenarios, when the zoom ratio changes from 1.0X to 0.9X, the main camera will switch from a wide-angle camera to an ultra-wide-angle camera, and the preview screen will jump from bright and white to dark and yellow, for example. Figure 3 When the zoom ratio changes from 3.4X to 3.5X, the main camera will switch from a wide-angle camera to a telephoto camera, and the preview image will change from bright and white to dark and red. Figure 3 This display effect jump will affect the user experience.

[0072] The technical solution provided in this application can be applied to Android Platform. Specifically, when two cameras are outputting images at the same time, when the main camera is not a target camera that has been adjusted in detail, and the target camera is used as an auxiliary camera to output images, the terminal device counts the images taken by the target camera as the auxiliary camera to obtain statistical information. Then the terminal device synchronizes the parameters of the images taken by the main camera that is not the target camera according to the statistical information, that is, recalculates the parameters of the image output by the main camera of the non-target camera, and displays the image according to the newly calculated parameters. In this way, it can be ensured that even if the main camera is switched during the zoom process, the display effect will not jump due to the different physical parameters between the cameras, thereby improving the user experience. This method does not require detailed and precise adjustment of each camera, and can maintain the uniformity of the display effect during the camera switching process. At the same time, the method can be applied to platforms that support heterogeneous frame rates. Heterogeneous frame rates refer to the characteristics that when two cameras are outputting images at the same time, the main camera outputs images at a high frame rate, and the auxiliary camera outputs images at a low frame rate. In the technical solution provided in the embodiment of the present application, the terminal device uses the low frame rate image output by the auxiliary camera to synchronize the parameters of the high frame rate image output by the main road. That is to say, when the auxiliary camera outputs one image, the main camera will output multiple images. The terminal device can use the statistical information of the image output by the auxiliary camera to synchronize the parameters of multiple images output by the main camera in the same period, thus achieving parameter synchronization of heterogeneous frame rates. Compared with the method of using the same frame rate for the main camera and the auxiliary camera to output images and then synchronize parameters, this method can reduce the number of images output by the auxiliary camera, thereby reducing power consumption.

[0073] For ease of understanding, the following embodiments of the present application will be described in detail with Figure 1 and Figure 2 Taking the terminal device with the shown structure as an example, the image processing method provided in the embodiment of the present application is specifically explained in combination with the accompanying drawings and application scenarios.

[0074] Figure 4 This is a flowchart of an image processing method provided in an embodiment of the present application. The method includes:

[0075] S401. Obtain first statistical data of a first image, where the first image is an image acquired by an auxiliary road camera at a first moment, and the first statistical data is statistical data of image parameters of the first image, and the image parameters of the first image meet preset display requirements.

[0076] It should be noted that the auxiliary camera is a finely calibrated target camera. That is to say, the image parameters of the first image output by the auxiliary camera can meet the preset display requirements, so that the display effect of the first image meets people's viewing needs. The preset display requirements are to ensure that the display effect of the image is closest to the real object observed by the human eye and the display effect is the best.

[0077] Typically, the frame rate of the auxiliary camera is lower than that of the main camera. Taking the first image output by the auxiliary camera at the first moment as an example, the terminal device can perform statistics on the first image to obtain first statistical data of the first image. Optionally, the first statistical data may include statistical data of color information or statistical data of brightness information.

[0078] S402. Determine image parameters of the second image based on first statistical data and initial image parameters of the second image, where the second image is an image acquired by the main camera at the second moment, the frame rate of the main camera is higher than the frame rate of the auxiliary camera, the difference between image parameters of the second image and image parameters of the first image is less than a preset difference threshold, the time difference between the second moment and the first moment is less than a preset time difference threshold, and the preset time difference threshold is the inverse of the frame rate of the auxiliary camera.

[0079] When the frame rate of the auxiliary camera is usually lower than that of the main camera, that is, during the period when the auxiliary camera outputs one image, the main camera will output multiple images. For details, please refer to Figure 5 The corresponding relationship between the main camera and the auxiliary camera at the time of outputting images at different frame rates is shown. Figure 5 In the figure, it is taken that the auxiliary camera outputs one image in one image output cycle, and the main camera outputs three images in the same image output cycle as an example. In the same image output cycle, the time difference between the moment when the main channel outputs three images and the moment when the auxiliary channel outputs an image is less than one image output cycle. The image output cycle can be used as a preset time difference threshold, which is the reciprocal of the frame rate of the auxiliary camera. For example, when the frame rate of the auxiliary camera is a refresh rate of 30 per second (Frames Per Second, FPS), it means that thirty images are output in one second, and the image output cycle is the reciprocal of the frame rate: 1 / 30 second. In the example Figure 5 At the moments T4, T5 and T6 shown, the time difference between the three images output by the main camera and the image output by the auxiliary camera at moment T1 is less than one image output cycle, and the images output by the main camera at moments T4, T5 and T6 and the image output by the auxiliary camera at moment T1 form a corresponding relationship. The terminal device can synchronize the image parameters of the images output by the main camera at moments T4, T5 and T6 within the same image output cycle based on the image output by the auxiliary camera at moment T1.

[0080] Specifically, after the terminal device obtains the first statistical data, the first statistical data is in a standby state to prepare for synchronization of image parameters.

[0081] Next, the specific process of this step is described in detail by taking the main road camera outputting the second image at the second moment as an example. Figure 5 At the time T1 shown, the second time can be as follows Figure 5 The T4, T5 and T6 moments shown; when the first moment is as Figure 5 At the time T2 shown, the second time can be as follows Figure 5 The time points T7, T8 and T9 are shown. Any time point among T2, T3 and T4 is used as the second time point for illustration.

[0082] At the second moment, the main camera outputs the second image. Originally, when the main camera outputs the image, it will calculate the initial image parameters such as color and brightness of the second image based on the parameters of the physical camera of the main camera itself, which will cause the display effect to be inconsistent with the display effect of the target camera. In the embodiment of the present application, the terminal device no longer calculates the image parameters of the second image based on the parameters of the physical camera of the current main camera itself, but regenerates the new image parameters of the second image based on the first statistical data of the first image taken by the auxiliary camera that has been finely adjusted.

[0083] Optionally, the method of recalculating the image parameters using statistical data may be a method of using an artificial intelligence (AI) model. The terminal device inputs the first statistical data and the initial image parameters of the second image into a pre-trained AI model, and outputs the new image parameters of the second image after processing by the AI ​​model. It should be noted that the AI ​​model may be a neural network model, which is a model obtained by training with a plurality of training images calibrated with image parameters such as brightness information and color information.

[0084] Optionally, the method of recalculating the image parameters using statistical data can also be to convert the image parameters using a preset relational expression 1. Taking the calculation of the brightness value L1 of a pixel point 1 in the second image as an example, the terminal device can, for example, input the brightness value L1 into the preset relational expression 1, and obtain the brightness value L1' of the corresponding pixel point 1' of the new second image through the operation of the relational expression 1. The brightness value L1' in the application of the main road camera is the same as or has a small difference from the brightness value L1 in the image taken by the auxiliary road camera, and it is not easy to distinguish by the naked eye. Optionally, the above relational expression 1 can be multiplied by a coefficient a for L1, and a correction value b can be added to the product multiplied by the coefficient a, for example, expressed as: L1'=aL1+b. Among them, L1 is the initial image parameter of the second image, that is, the initial brightness parameter, which is the initial brightness value here. The brightness values ​​of other pixel points can also be recalculated based on the relational expression 1. Optionally. The specific values ​​of the coefficients a and b in the relational expression, as well as the specific form of the relational expression are related to the parameters of the camera itself, and can be adjusted and transformed according to specific needs. For another example, taking the calculation of the color value C1 of a pixel 2 in the second image as an example, the terminal device can input the brightness value C1 into the preset relational expression 2, and obtain the brightness value C1' of the corresponding pixel 2' in the new second image through the operation of the relational expression 2. The color value C1' in the application of the main road camera is the same as or has a small difference with the color value C1 in the application of the auxiliary road camera, and it is not easy to distinguish with the naked eye. Optionally, C1 and C1' can be any one of the color values ​​of the three colors red (R), green (G), and blue (B), or a matrix of the color values ​​of the three colors red (R), green (G), and blue (B), as long as the color characteristics of the pixel can be expressed. Optionally, the above relational expression 2 can be C1 multiplied by a coefficient c, and a correction value d can be added to the product of C1 multiplied by the coefficient c, for example, expressed as: C1'=cC1+d. Among them, C1 is the initial image parameter of the second image, that is, the initial color parameter, which is the initial color value here. The color values ​​of other pixels can also be recalculated based on the relational expression 2. Optionally. The specific values ​​of the coefficients c and d in the relational expression, and the specific form of the relational expression 2 are related to the parameters of the camera itself, and can be adjusted and transformed according to specific needs. It should be noted that the coefficients a, b, c and d in the above relational expressions 1 and 2 can be parameters obtained based on the first statistical data. Specifically, when the image parameter is a brightness parameter, the first statistical data can be in the form of a histogram, and the first statistical data can characterize statistical data that affect brightness, such as exposure values. When the image parameter is a color parameter, the first statistical data can include white point information, such as a value of correlated color temperature (CCT).

[0085] As can be seen from the above description, the image parameters may include color parameters and / or brightness parameters. Optionally, the color parameters may include white balance parameters (auto white balance, AWB), and the recalculation of the color parameters may be referred to as white balance synchronization (AWB synchronization, AWB sync). Optionally, the brightness parameters may also include RGGB (Bayer color filter matrix), RGBW (red, yellow, blue, and white four-color pixels), and other parameters that can express brightness. The recalculation of the brightness parameters may be referred to as auto exposure synchronization (auto exposure synchronization, AE sync). Specifically, the terminal device may perform AE synchronization alone to ensure that the brightness does not jump, or perform AWB synchronization alone to ensure that the color does not jump, or perform AE synchronization and AWB synchronization at the same time to ensure that neither the color nor the brightness jumps.

[0086] Usually, the frame rate of the main camera is 30FPS, and the auxiliary camera uses 5-15FPS, which can take into account both image display effect and power consumption, and is very reasonable.

[0087] Optionally, the camera usually reacts more obviously to brightness changes, which is manifested in that AE converges faster. So when doing AE synchronization, if the frame rate of the auxiliary camera is too low, it will lead to poor AE synchronization effect and a certain degree of brightness jump. Therefore, in the case of AE synchronization, the auxiliary camera can output images at a higher frame rate. Taking the frame rate of the main camera as 30FPS, the auxiliary camera can output images at 10-15FPS. However, during the image output process, the camera's reaction to color changes is not as obvious as its reaction to brightness changes. In other words, AWB converges slower. Therefore, when doing AWB synchronization, the auxiliary camera can output images at a lower frame rate. Taking the frame rate of the main camera as 30FPS, the auxiliary camera can use 5-10FPS.

[0088] Optionally, the terminal camera can also maintain the high frame rate of the auxiliary camera to output images, and then distinguish the execution frequencies of AWB synchronization and AE synchronization, that is, the frequency of executing AE synchronization is higher than the frequency of executing AWB synchronization. Figure 5Taking the frame rate of the main camera as 30FPS and that of the auxiliary camera as 10FPS as an example, the terminal uses the statistical data of the image acquired by the auxiliary camera at time T1 to perform color synchronization on the images acquired by the main camera at T4, T5 and T6, and uses the statistical data of the image acquired by the auxiliary camera at time T2 to perform color synchronization on the images acquired by the main camera at T7, T8 and T9. And so on, that is, a first image is used to perform AE synchronization on three consecutive second images. The terminal uses the statistical data of the image acquired by the auxiliary camera at time T1 to perform color synchronization on the images acquired by the main camera from T4 to T9. And so on, that is, a first image is used to perform AWB synchronization on six consecutive second images. For AE synchronization and AWB synchronization, the auxiliary camera can use different frame rates to balance the display effect and power consumption.

[0089] S403: Display the second image according to the image parameters of the second image.

[0090] When the terminal device displays the second image according to the calculated image parameters of the second image, it can ensure that the display effect meets the preset display requirements. After the terminal device performs AE and AWB synchronization, the color and brightness of the preview image will not change significantly during the camera switching process.

[0091] Above Figure 4 In the embodiment shown, when the main camera is switched to a target camera that is not calibrated in detail and the target camera is used as an auxiliary camera to output images, the terminal device performs statistics on the first image captured by the target camera as the auxiliary camera to obtain first statistical information; then, according to the statistical information, the second image captured by the main camera that is not the target camera in the same output cycle is synchronized to obtain new image parameters, and the image acquired by the auxiliary camera is displayed according to the newly calculated image parameters. This method can ensure that during the zoom process, even if the main camera is switched, the display effect will not jump due to the different physical parameters between the cameras, thereby improving the user experience. And this method does not require detailed and precise calibration of each camera, and can maintain the uniformity of the display effect during the camera switching process. At the same time, this method is applied to a platform with heterogeneous frame rates in which the main camera outputs images at a high frame rate and the auxiliary camera outputs images at a low frame rate. The terminal device uses the statistical information of the image output at a low frame rate of the auxiliary camera to synchronize the image parameters of multiple images output at a high frame rate by the main camera in the same output cycle, thereby realizing the synchronization of image parameters of heterogeneous frame rates. Compared with the method in which the main camera and the auxiliary camera output images at the same frame rate and then synchronize image parameters, this method also reduces the number of images output by the auxiliary camera, thereby reducing power consumption.

[0092] Based on the above embodiment, when the main camera is the target camera, even if the zoom factor changes, the main camera may not necessarily switch. The terminal device still uses the target camera as the main camera to output images, and there will be no jump in the display effect. Therefore, there is no need to start the synchronization of image parameters. For details, please refer to Figure 6 The process shown includes:

[0093] S601: Determine whether the main road camera is a calibrated target camera, and whether the image parameters of the image output by the target camera meet the preset display requirements. If yes, execute S602A; if not, execute S602B.

[0094] S602A: Display the second image according to initial image parameters corresponding to the second image, where the initial image parameters are image parameters of the initial image captured by the main road camera at the second moment.

[0095] Specifically, when the main camera is the target camera, the terminal device does not need to enable the synchronization function, and only needs to display the second image according to the initial image parameters of the second image captured by the current main camera, that is, the target camera. At this time, there is no need to synchronize the image parameters and the display effect will not change, which can avoid invalid data processing flow.

[0096] S602B, turn on the synchronization function.

[0097] Specifically, when the main road camera is the target camera terminal device, the synchronization function can be turned on to perform AE and / or AWB synchronization, that is, to perform the above-mentioned step S401.

[0098] Above Figure 6 In the embodiment shown, when the current main camera of the terminal device is the target camera, there is no need to synchronize the image parameters, and there will be no jump in the display effect, thereby avoiding invalid data processing processes; when the current main camera is not the target camera, the image parameter synchronization process is executed, making the image parameter synchronization process more efficient and more reasonable.

[0099] In order to implement the above method, the following will be explained in conjunction with the software architecture diagram of the method. The collaboration of multiple cameras (referred to as multi-camera) can be based on the following Figure 7The multi-camera use case base framework (MulticameraUsecaseBase) shown in the figure includes: Resource Manager, Policy Manager, Decide Capability Manager and Region of Interest Translator (ROI Translator). The framework also includes a logical configuration file (Logicaldevice xml).

[0100] Resource Manager is used to manage and allocate the software and hardware resources of the shooting system.

[0101] Policy Manager is used to manage the combination and calling policies of multiple cameras, and is adapted to the multicamera xform (MCX) policy adapter module (MCXpolicy) to determine which cameras are currently turned on according to the scene. For example, when the zoom ratio is 1.0X, only the wide-angle camera is called to shoot; when the zoom ratio is 1.2X, the wide-angle camera and the ultra-wide-angle camera are called to shoot, and so on.

[0102] ROI Translator is used to manage the region of interest in the image. For example, the face area when shooting people can be the region of interest, and the tree area when shooting scenery can be the region of interest. ROI Translator is used to adapt to the MCX converter adapter module (MCX Translator) to achieve the correction of the displayed position of the region of interest captured by different cameras, ensuring that the display position of the same object in the image when switching between multiple cameras will not be significantly displaced.

[0103] Decide Capability is used to decide the camera's image output algorithm and mode.

[0104] Logical device xml is used to provide corresponding parameters for each of the above managers when they are running.

[0105] The above multi-camera basic framework needs to implement the multi-camera strategy with the support of the feature function module (Feature). Among them, the Feature includes: GraphManager, GraphSelector and PoolManager. Among them, GraphManager, GraphSelector and PoolManager work together to provide the underlying functions for the multi-camera strategy.

[0106] Feature also includes MCX super feature detail graph (FDG). MCX superFDG includes: RealTimemulticamera (RealTimeMC), MC report real-time (multicameraReportRealTime, MCReportRT), RT post-processing (RealTimePostProcess, RTPostProcess).

[0107] Among them, MCReportRT includes multiple source buffers (SourceBuffer), and the multiple sources are stored in the target buffer through the CHi node encapsulation module (CHiNodeWrapper). The CHi node encapsulation module also interacts with the SIT SAT adapter node (SIT SAT adapter Node) and the extended framework super image engine (super image turbo, SIT) to establish a smooth zoom (Spatial Alignment Transform, spatial alignment transform, SAT) graphics path to achieve the evolution of the multi-camera basic framework. Between SIT and the multi-camera basic framework, a request control path (Request control path) and a result return path (Result return path) are also established to interact with each other to jointly realize richer multi-camera strategies.

[0108] Next, we will introduce the architecture of the extended framework SIT, which is an extended imaging engine, including a feature management module. The feature management module includes a perception engine, a decision engine, and a multi-camera feature module.

[0109] The perception engine is used to perceive the data collected by the camera, such as brightness, contrast, exposure and other parameters.

[0110] The decision engine is used to decide what algorithm and strategy to use to generate the image based on the parameters perceived by the perception engine.

[0111] The multi-camera feature module is used to adapt various features according to the algorithms and strategies determined by the decision engine, such as calling the combination of cameras to produce images. The multi-camera feature module is also used to control whether the heterogeneous frame rate synchronization module (variable frames per second, VFPS) enables the synchronization function of heterogeneous frame rates and the smooth operation of the synchronization function.

[0112] Specifically, the multi-camera feature module includes: a multi-camera configuration module, a multi-camera decision module and a multi-camera fusion module (multi-camera CROP calculation). The multi-camera configuration module, the multi-camera decision module and the multi-camera fusion calculation module work together to adapt various aspects based on heterogeneous frame rates, such as the adaptation of cameras with heterogeneous frame rates. Specifically, it controls whether VFPS turns on the synchronization function of heterogeneous frame rates, and the smooth operation of the synchronization function of heterogeneous frame rates. Among them, the multi-camera fusion module can also be combined with the extended fusion strategy to achieve the evolution of the fusion solution.

[0113] As mentioned above, VFPS is the property configured for the camera. Specifically, when the zoom ratio is 1.0X, there is no need for an auxiliary camera, that is, only one main camera is opened for shooting, and the main camera is a precisely calibrated target camera. When the zoom ratio changes from 1.0X to 0.9X, the terminal device needs the heterogeneous frame rate synchronization module to call the corresponding parameters, configure the main camera as an ultra-wide-angle camera, and the auxiliary camera as a wide-angle camera. The target camera is a property of a sensor. When it is 1.0, there is no need to open the auxiliary channel, that is, the main channel output, and the main channel is a debugged target camera. This function is not needed.

[0114] In addition, the entire SIT architecture also includes an algorithm platform. The algorithm platform ensures the smooth operation of the algorithm through the joint action of pipelines, plugins, executors, and schedulers. Specifically, the algorithm platform includes: source, SAT plugin, original image preview (YuvEnhance), and sink, which are used to support the rotation of multi-camera synchronization.

[0115] The SAT plug-in and the extended SAT module interact to implement the extension of the smooth zoom solution.

[0116] YuvEnhance can realize image preview based on the drawing module (IPE).

[0117] The algorithm platform can also set up a heterogeneous computing acceleration module to accelerate the output of images in heterogeneous frame rate scenarios.

[0118] In addition, the multi-camera usage basic framework and feature management in the SIt architecture establish request control paths and result feedback paths, and combine them to achieve more functional multi-camera usage scenarios.

[0119] The above describes in detail an example of the method provided by the present application. It is understandable that, in order to implement the above functions, the corresponding device includes a hardware structure and / or software module corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present application.

[0120] The present application can divide the functional modules of the image processing device according to the above method example. For example, each function can be divided into each functional module, or two or more functions can be integrated into one module. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0121] Figure 8 The structure diagram of an image processing device provided by the present application is shown. The device 800 includes:

[0122] An acquisition module 801 is used to acquire first statistical data of a first image, where the first image is an image acquired by the auxiliary road camera at a first moment, and the first statistical data is statistical data of image parameters of the first image, and the image parameters of the first image meet preset display requirements;

[0123] A synchronization module 802 is used to determine image parameters of the second image according to the first statistical data and the initial image parameters of the second image, where the second image is an image acquired by the main camera at the second moment, the frame rate of the main camera is higher than the frame rate of the auxiliary camera, the difference between the image parameters of the second image and the image parameters of the first image is less than a preset difference threshold, the time difference between the second moment and the first moment is less than or equal to a preset time difference threshold, and the preset time difference threshold is the inverse of the frame rate of the auxiliary camera;

[0124] The display module 803 is configured to display the second image according to the image parameters of the second image.

[0125] In some embodiments, the first statistical data are statistical data of color parameters and / or brightness parameters of the first image, and the image parameters include brightness parameters and / or color parameters.

[0126] In some embodiments, the acquisition module 801 is also used to determine whether the main road camera is a calibrated target camera, and the image parameters of the image output by the target camera meet the preset display requirements; if not, the step of acquiring the first statistical data of the first image is executed.

[0127] In some embodiments, the display module 803 is also used to display the second image according to the initial image parameters of the second image if the main camera is the target camera, where the initial image parameters are image parameters of the initial image taken by the main camera at the second moment.

[0128] In some embodiments, when the image parameters include brightness parameters, the frame rate of the auxiliary camera is a first frame rate; when the image parameters include color parameters, the frame rate of the auxiliary camera is a second frame rate; the first frame rate is higher than the second frame rate.

[0129] In some embodiments, when the image parameters include brightness parameters, the synchronization module 802 is specifically configured to perform automatic exposure AW synchronization according to the first statistical data and the initial image parameters of the second image to obtain the image parameters of the second image.

[0130] In some embodiments, when the image parameters include brightness parameters, the synchronization module 802 is specifically configured to perform automatic white balance AWB synchronization according to the first statistical data and the initial image parameters of the second image to obtain the image parameters of the second image.

[0131] In some embodiments, the frame rate of the main camera is 30 FPS, the first frame rate is 10-15 FPS, and the second frame rate is 3-5 FPS.

[0132] The specific manner in which the device 800 executes the image processing method and the beneficial effects produced can be found in the relevant description in the method embodiment, which will not be repeated here.

[0133] The present application also provides an electronic device, including the above processor. The electronic device provided by this embodiment can be Figure 1 The terminal device 100 shown is used to perform the above-mentioned image processing method. In the case of an integrated unit, the terminal device may include a processing module, a storage module and a communication module. Among them, the processing module can be used to control and manage the actions of the terminal device, for example, it can be used to support the terminal device to execute the steps performed by the display unit, the detection unit and the processing unit. The storage module can be used to support the terminal device to execute and store program codes and data, etc. The communication module can be used to support the communication between the terminal device and other devices.

[0134] Among them, the processing module can be a processor or a controller. It can implement or execute various exemplary logic boxes, modules and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of digital signal processor (DSP) and a microprocessor, etc. The storage module can be a memory. The communication module can specifically be a device that interacts with other terminal devices, such as a radio frequency circuit, a Bluetooth chip, a Wi-Fi chip, etc.

[0135] In one embodiment, when the processing module is a processor and the storage module is a memory, the terminal device involved in this embodiment may be a Figure 1 Device of the structure shown.

[0136] An embodiment of the present application further provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, the processor executes the image processing method described in any of the above embodiments.

[0137] The embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, the computer is enabled to execute the above-mentioned related steps to implement the image processing method in the above-mentioned embodiment.

[0138] Among them, the electronic device, computer-readable storage medium, computer program product or chip provided in this embodiment are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above and will not be repeated here.

[0139] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, the replaced units may or may not be physically separated, and the components displayed as units may be one physical unit or multiple physical units, that is, they may be located in one place, or they may be distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the scheme of this embodiment.

[0140] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0141] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0142] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. An image processing method, characterized in that: include: Acquire first statistical data of a first image, where the first image is an image acquired by the auxiliary road camera at a first moment, the first statistical data is statistical data of image parameters of the first image, and the image parameters of the first image meet preset display requirements; Determine, according to the first statistical data and the initial image parameters of the second image, the image parameters of the second image, the second image is an image acquired by the main camera at the second moment, the frame rate of the main camera is higher than the frame rate of the auxiliary camera, the difference between the image parameters of the second image and the image parameters of the first image is less than a preset difference threshold, the time difference between the second moment and the first moment is less than or equal to a preset time difference threshold, and the preset time difference threshold is the inverse of the frame rate of the auxiliary camera; The second image is displayed according to the image parameters of the second image.

2. The method according to claim 1, characterized in that: The first statistical data is statistical data of color parameters and / or brightness parameters of the first image, and the image parameters include brightness parameters and / or color parameters.

3. The method according to claim 2, characterized in that The obtaining first statistical data of the first image includes: Determine whether the main road camera is a calibrated target camera, and whether image parameters of the image output by the target camera meet the preset display requirements; If not, the step of acquiring first statistical data of the first image is performed.

4. The method according to any one of claims 1 to 3, characterized in that The method further comprises: If the main road camera is the target camera, the second image is displayed according to the initial image parameters of the second image, where the initial image parameters are image parameters of the initial image captured by the main road camera at the second moment.

5. The method according to claim 4, characterized in that When the image parameters include brightness parameters, the frame rate of the auxiliary camera is a first frame rate; When the image parameters include color parameters, the frame rate of the auxiliary camera is a second frame rate; The first frame rate is higher than the second frame rate.

6. The method according to claim 4 or 5, characterized in that: When the image parameters include brightness parameters, The determining the image parameters of the second image according to the first statistical data and the initial image parameters of the second image includes: Automatic exposure AW synchronization is performed according to the first statistical data and the initial image parameters of the second image to obtain image parameters of the second image.

7. The method according to claim 6, characterized in that When the image parameters include brightness parameters, determining the image parameters of the second image according to the first statistical data and the initial image parameters of the second image includes: Automatic white balance (AWB) synchronization is performed according to the first statistical data and initial image parameters of the second image to obtain image parameters of the second image.

8. The method according to any one of claims 5 to 7, characterized in that The frame rate of the main camera is 30 FPS, the first frame rate is 10-15 FPS, and the second frame rate is 3-5 FPS.

9. An electronic device, characterized in that: include: Processors, memory, and interfaces; The processor, the memory and the interface cooperate with each other so that the electronic device executes the method as claimed in any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor is caused to perform the method according to any one of claims 1 to 8.

Citation Information

Patent Citations

  • Multi-camera image correction method and equipment

    CN102438153A

  • White balance synchronization method and apparatus, and terminal device

    CN107277480A

  • Video camera day-night mode switching system based on AE and AWB statistical information

    CN107948521A

  • Shooting parameter adjustment method, terminal and computer readable storage medium

    CN108848294A

  • Camera module switching control method and system, medium and electronic equipment

    CN111432143A