Digital overwriting switching method and device and terminal equipment

Abstract

The embodiment of the invention provides a digital overwriting switching method and device and terminal equipment, and the method comprises the steps: obtaining exposure compensation and scene dynamic range information corresponding to a preset scene mode in the preset scene mode; if the scene dynamic range information corresponding to the exposure compensation and the preset scene mode represents that digital overwriting switching needs to be carried out, digital overwriting switching information is determined; based on the digital overwriting switching information, reconfiguring the hardware parameter information to obtain target hardware parameter information; and based on the target hardware parameter information, carrying out digital overwriting switching on the plurality of cameras at the same time at the latest frame outlet time point of the camera with the lowest frame rate, and outputting a switched image.

Description

Technical Field

[0001] The present application relates to the field of image vision, and in particular to a digital overwrite switching method, device and terminal equipment. Background Art

[0002] As the usage scenarios of mobile phone cameras become more complex, the requirements for image quality in scenes with different light intensities and different color ranges are increasing. High Dynamic Range Imaging technology, by virtue of its ability to expand the standard dynamic display range, enables images to present a wider color range and a larger brightness range, expands the upper limit of image brightness and the lower limit of dark parts, giving users a better sense of immersion, and has become a widely used function in mainstream flagship mobile phone cameras.

[0003] The implementation of High Dynamic Range (HDR) technology depends on HDR Sensor. Currently, flagship phones generally support multiple sensors, where different sensors support different Digital Overlap (DOL) capabilities to support better HDR functions. When the camera application scenario changes, such as the brightness of the shooting scene changes, multiple cameras need to switch DOL to support the exposure requirements of different scenarios. The existing switching Digital Overlap (DOL) includes manual switching by the user and automatic switching by multiple cameras.

[0004] Manual switching has the problem of abrupt switching and sudden changes in picture brightness. Automatic switching also has the problem of sudden changes in brightness and abrupt changes in the exposure status of the front and back scenes, which leads to poor output image quality. Summary of the invention

[0005] The embodiments of the present application are intended to provide a digital overwrite switching method, apparatus and terminal device, which can improve the output image quality effect.

[0006] The technical solution of the present invention is achieved in this way:

[0007] In a first aspect, an embodiment of the present application provides a digital overwrite switching method, comprising: in a preset scene mode, obtaining exposure compensation and scene dynamic range information corresponding to the preset scene mode; if the exposure compensation and the scene dynamic range information corresponding to the preset scene mode indicate that digital overwrite switching is required, determining digital overwrite switching information; based on the digital overwrite switching information, reconfiguring hardware parameter information to obtain target hardware parameter information; based on the target hardware parameter information, simultaneously performing digital overwrite switching on multiple cameras at the most recent frame output time point of the camera with the lowest frame rate, and outputting the switched image.

[0008] In a second aspect, an embodiment of the present application provides a digital overwrite switching device, the digital overwrite switching device comprising: an acquisition unit, a determination unit, a configuration unit and a switching unit, wherein:

[0009] The acquisition unit is used to acquire, in a preset scene mode, exposure compensation and scene dynamic range information corresponding to the preset scene mode;

[0010] The determining unit is configured to determine digital overwrite switching information if the exposure compensation and the scene dynamic range information corresponding to the preset scene mode indicate that digital overwrite switching is required;

[0011] The configuration unit is used to reconfigure the hardware parameter information based on the digital overwrite switching information to obtain the target hardware parameter information;

[0012] The switching unit is used to digitally overwrite and switch multiple cameras at the same time based on the target hardware parameter information at the latest frame output time point of the camera with the lowest frame rate, and output the switched images.

[0013] In a third aspect, an embodiment of the present application provides a terminal device, the terminal device comprising: a processor and a memory; wherein:

[0014] The memory is used to store computer programs;

[0015] The processor is used to call and run the computer program from the memory to execute the method as described in the first aspect.

[0016] The embodiment of the present application provides a digital overwrite switching method, device and terminal device, the method comprising: in a preset scene mode, obtaining exposure compensation and scene dynamic range information corresponding to the preset scene mode; if the exposure compensation and scene dynamic range information corresponding to the preset scene mode indicate that digital overwrite switching is required, then determining digital overwrite switching information; based on the digital overwrite switching information, reconfiguring hardware parameter information to obtain target hardware parameter information; based on the target hardware parameter information, performing digital overwrite switching on multiple cameras at the latest frame output time point of the camera with the lowest frame rate at the same time, and outputting the switched image. Determine whether to perform digital overwrite switching by using exposure compensation and scene dynamic range information corresponding to the preset scene mode. Since different scene modes require different brightness, using the scene dynamic range information corresponding to the preset scene mode as an influencing factor for whether to perform digital overwrite switching can more accurately determine whether to perform digital overwrite switching. After determining to perform digital overwrite switching, reconfigure the hardware parameter information to obtain the target hardware parameter information; under the target hardware parameter information, perform digital overwrite switching on multiple cameras at the same time at the most recent frame output time point of the camera with the lowest frame rate, and output the switched images, so that multiple cameras maintain the same digital overwrite state in each frame, thereby improving the output image quality effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments consistent with the present application and are used together with the specification to illustrate the technical solution of the present application. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0018] The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps can be decomposed, and some operations / steps can be combined or partially combined, so the actual execution order may change according to actual conditions.

[0019] Figure 1 An optional process diagram of a digital overwrite switching method is provided for an embodiment of the present application Figure 1 ;

[0020] Figure 2 An optional 3DOL row interleaving technology schematic diagram of a digital overwrite switching method is provided for an embodiment of the present application;

[0021] Figure 3 An optional DOL technology Overlap schematic diagram of a digital overwrite switching method is provided for an embodiment of the present application;

[0022] Figure 4 An optional architecture diagram of a digital overwrite switching method is provided for an embodiment of the present application;

[0023] Figure 5 An optional process diagram of a digital overwrite switching method is provided for an embodiment of the present application Figure 2 ;

[0024] Figure 6 An optional process diagram of a digital overwrite switching method is provided for an embodiment of the present application Figure 3 ;

[0025] Figure 7 An optional process diagram of a digital overwrite switching method is provided for an embodiment of the present application Figure 4 ;

[0026] Figure 8 An optional process diagram of a digital overwrite switching method is provided for an embodiment of the present application Figure 5 ;

[0027] Fig. 9 An optional switching process diagram of a digital overwrite switching method is provided for an embodiment of the present application;

[0028] Fig.10 A structural schematic diagram of a digital overwrite switching device is provided for an embodiment of the present application;

[0029] Fig.11 A schematic diagram of the structure of a terminal device is provided for an embodiment of the present application. DETAILED DESCRIPTION

[0030] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the specific technical solution of the present application will be further described in detail below in conjunction with the drawings in the embodiments of the present application. The following embodiments are used to illustrate the present application, but are not used to limit the scope of the present application.

[0031] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0032] In the following description, reference is made to “some embodiments”, “this embodiment”, “embodiments of the present application” and examples, etc., which describe a subset of all possible embodiments, but it can be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0033] If similar descriptions of "first / second" appear in the application documents, the following instructions are added. In the following description, the terms "first\second\third" involved are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It can be understood that "first\second\third" can be interchanged in a specific order or sequence where permitted, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0034] Currently, existing digital overlays exist in the spatiotemporal alignment transformation scenarios between multiple cameras, as well as high dynamic range scenarios. The following takes the high dynamic range scenario as an example. The details are as follows:

[0035] (1) DOL switching in multi-camera HDR scenes

[0036] As the usage scenarios of mobile phone cameras become more complex, the requirements for image quality in scenes with different light intensities and different color ranges are increasing. High Dynamic Range Imaging technology, by virtue of its ability to expand the standard dynamic display range, enables images to present a wider color range and a larger brightness range, expands the upper limit of image brightness and the lower limit of dark parts, giving users a better sense of immersion, and has become a widely used function in mainstream flagship mobile phone cameras.

[0037] The implementation of HDR technology depends on HDR Sensor. Currently, flagship mobile phones generally support multiple sensors, where different sensors support different DOL capabilities to support better HDR functions. When the camera application scenario changes, for example, the brightness of the shooting scene changes, multiple cameras need to switch DOL to support the exposure requirements of different scenarios. There are two ways to switch DOL: manual switching by the user and automatic switching of multiple cameras. Manual switching will bring about problems such as poor user experience, abrupt switching, and sudden changes in screen brightness. Automatic switching requires determining the timing of multi-camera switching and the coordination of multi-camera switching.

[0038] (2) Existing DOL switching technology

[0039] When the scene brightness changes while using the camera (mobile phone camera), the multi-camera DOL state switching is required to expand the shooting dynamic range. There are two methods for DOL state switching:

[0040] a) Trigger the multi-camera DOL state switching according to the exposure value after the Auto Exposure (AE) converges. When the brightness of the scene range used by the user changes, AE detects the change in the brightness dynamic range and triggers the DOL switching according to the scene brightness requirements. The brightness dims from 2DOL->1DOL, and the brightness variable dynamic range increases from 1DOL->2DOL;

[0041] b) The user manually switches DOL according to needs. When the user needs to perform HDR shooting or turn off HDR shooting, the user manually adjusts the multi-camera DOL state to trigger the multi-camera DOL state switch.

[0042] Taking into account the scene brightness changes that may occur during the switching of multiple cameras by the Spatiotemporal Alignment Transform (SAT) between multiple cameras, or the need for multiple cameras to adapt to the current scene brightness and the user's manual switching of HDR status during cold start, it is necessary to switch the DOL of multiple cameras. Manually switching the DOL status of multiple cameras will result in inconsistent DOL status of multiple cameras when outputting images. For example, if the main camera outputs images in the 2DOL (double exposure image) state and the secondary camera outputs images in the QBIN (single exposure image) state, compared to the main and secondary cameras both outputting images in the 2DOL state or both outputting images in the QBIN state, there will be problems such as brightness jumps and abrupt changes in the exposure status of the front and back scenes when the main and secondary cameras are fused (Blending) during the SAT process, which will bring a poor user experience when the user previews.

[0043] Based on this, the present application proposes a DOL fully synchronized seamless switching method based on the minimum frame rate secondary camera alignment, which can enable multiple cameras to maintain consistent DOL status. When SAT switching is performed, it can better ensure that the brightness of the preview picture does not change suddenly and the focal length switching picture is natural, thereby improving the user experience.

[0044] The embodiment of the present application provides a digital overwrite switching method. Figure 1 This is an optional process diagram of a digital overwrite switching method provided by the embodiment of the present application. Figure 1 , will combine Figure 1 The steps shown are explained.

[0045] S101. In a preset scene mode, obtain exposure compensation and scene dynamic range information corresponding to the preset scene mode.

[0046] In the embodiment of the present application, the preset scene mode includes multiple scene modes, and the multiple scene modes may be night scene modes or daytime modes, etc. In this regard, the embodiment of the present application does not impose any specific limitation.

[0047] In some embodiments of the present application, the DOL switching in HDR or the DOL switching in SAT is applicable. The DOL technology in HDR includes: the brightness range in the real world and the brightness range that the human eye can perceive are much larger than the standard dynamic display range. The maximum brightness range that the human eye can perceive is 10 -3 to 10 6 nits, the maximum brightness range in nature is 10 -6 to 10 9nits, the dynamic range of consumer electronic products is 200 to 400 nits, and the peak brightness of flagship mobile phones can reach more than 500 nits. In order to better restore the real world to the image, HDR can provide brighter highlight details and darker shadow details, bringing contrast improvement and improving user experience.

[0048] The implementation of HDR technology depends on the HDR Sensor. Usually the following formula (1) expresses the dynamic range capability of the Sensor:

[0049] DR=20*log 10 (i_max / i_min) (1)

[0050] Among them, i_max is the maximum unsaturated current of the sensor, i_min is the minimum bottom current of the sensor, and DR is the dynamic range. In order to increase the DR range, the Bit Width of the sensor output can be increased, but this will bring about problems such as increased memory consumption, increased bandwidth requirements for image processing chips (Image Signal Processor, ISP), and increased system costs. To solve the above contradictions, the time domain multi-frame HDR technology has been widely used in the industry by virtue of its advantage of fusing multiple frames of different exposure images to achieve a high dynamic range.

[0051] The traditional time-domain multi-frame fusion HDR method is shown in formula (2):

[0052]

[0053] Among them, x k refers to images with different exposures; i, j refer to pixel positions respectively; x f (i,j) is the multi-exposure fusion result.

[0054] The above formula gives W for K frame image pixels ij,k The weights are calculated by multi-frame weighting, and the final weighted sum of the multi-frame images is the pixel value of the fused image. Traditional time-domain multi-frame HDR technology will cause ghosting when fusing fast-moving objects. The line interleaving HDR technology based on Digital Overlap (DOL) greatly reduces the time interval between long and short exposures, improves the ghosting problem, and is widely used.

[0055] Figure 2 This is a schematic diagram of 3DOL row interleaving technology. Figure 1 There are 3 rows of exposure data, each row including short exposure (ShortExposure), medium exposure (Mid Exposure) and long exposure (Long Exposure). Figure 3 This is a schematic diagram of DOL technology overlap. Figure 3 Including short exposure, medium exposure and long exposure, short exposure and medium exposure are intertwined, medium exposure and long exposure are intertwined. DOL HDR technology, with its interlaced output, has overlaps between frames, supports "quasi-simultaneous output" of different exposure frames, and greatly reduces the interval between long and short exposure frames.

[0056] The multi-exposure DOL dynamic range expansion is shown in formula (3):

[0057] Exposure Ratio=Long Exposure Time / Short Exposure Time (3)

[0058] According to the above formula, the long and short exposure 2DOL with an Exposure Ratio of 16 can expand the dynamic range of 4 bits without reaching signal saturation.

[0059] When faced with scenes with different dynamic ranges, the multi-camera sensor needs to switch DOL according to the changes in the dynamic range in the scene to adapt to better HDR effects.

[0060] DOL technology in SAT: Traditional photography can achieve good optical zoom effects with the zoom ring of the camera lens. Due to limited space, mobile phone cameras cannot support the complex zoom structure of traditional cameras, so multi-focal length cameras are generally used to support shooting needs of different focal lengths and realize the zoom function.

[0061] Traditional cameras can smoothly switch between different focal lengths with the help of zoom rings. To achieve smooth switching between different focal lengths, mobile phone cameras need to coordinate multiple cameras. If multiple cameras are switched individually, the image content will change suddenly (suddenly zoom in or suddenly zoom out), affecting the user experience. The spatiotemporal alignment transformation between multiple cameras is called SAT technology, which aims to support smooth switching of different focal lengths of mobile phone cameras.

[0062] Taking the triple-camera system as an example, it supports three sensors with different focal lengths, namely Ultra Wide, Wide, and Telephoto. When the user zooms in and out of the camera, the output frame rates of the main and secondary cameras are adjusted to perform SAT fusion according to the different focal length requirements of different zooms, so as to achieve smooth focal length switching. The adjustment method is as follows:

[0063] a) The zoom focal length is divided into four sections: ultra wide angle, wide angle, telephoto, and ultra telephoto;

[0064] b) Determine different main and secondary cameras according to different focal lengths. In the ultra-wide-angle focal length, UW is cut as the main camera, and the image is output at a high frame rate Fhigh, W is the secondary camera, and the image is output at a medium frame rate Fmid, and T is the low frame rate Flow. In the wide-angle focal length, W is cut as the main camera, and the image is output at a high frame rate Fhigh, UW is the secondary camera, and the image is output at a medium frame rate Fmid, and T is the low frame rate Flow. In the telephoto focal length, W is cut as the main camera, and the image is output at a high frame rate Fhigh, T is the secondary camera, and the image is output at a medium frame rate Fmid, and UW is the low frame rate Flow. In the ultra-telephoto focal length, T is cut as the main camera, and the image is output at a high frame rate Fhigh, W is the secondary camera, and the image is output at a medium frame rate Fmid, and UW is the low frame rate Flow.

[0065] c) In order to ensure smooth and seamless switching of focal length and no jumps in the output image or color changes, the main and secondary cameras are kept outputting images at a high frame rate Fhigh during the switching process until the switching state stabilizes. If brightness changes after the stable state, the Sensor DOL needs to be switched to expand the dynamic range.

[0066] The DOL switching of multiple cameras during the SAT process needs to be synchronized to avoid problems such as sudden changes in image brightness and abrupt scene switching, which can lead to poor user experience.

[0067] In some embodiments of the present application, the terminal mainly relies on the Android mobile phone system, such as Figure 4 As shown in the figure, the Android phone system architecture is mainly divided into the following layers: HAL layer, HW Layer layer, Kernel layer, Firmware layer and HardWare layer. Among them, the HAL layer is responsible for building Software Pipeline / Usecase, customized features, memory pool construction, sensor management, SAT nodes, 5A processing node implementation, DOL conversion decision, scene switching decision, hardware Pipeline configuration, IQ&5A management and other tasks. The HW Layer is mainly responsible for HAL sending ISP information management, ISP Service registration and other tasks. The Kernel layer is responsible for ISP, Sensor and peripheral management. The ISP Firmware layer loads the AE / AF algorithm library. Hardware is the bottom layer, responsible for providing hardware computing support, including actual hardware support such as FE (Front-End) / ME (Middle-End) / BE (Back-End) and Sensor.

[0068] It should be noted that the terminal is the terminal device.

[0069] In some embodiments of the present application, the terminal calculates the automatic exposure convergence result of the current frame in a preset scene mode, and determines exposure compensation according to the automatic exposure convergence result of the current frame. Alternatively, the automatic exposure convergence results of multiple frames are calculated; the exposure compensation is determined according to the automatic exposure convergence results of multiple frames. According to the preset scene mode, the scene dynamic range information corresponding to the preset scene mode is obtained.

[0070] S102: If the exposure compensation and the scene dynamic range information corresponding to the preset scene mode indicate that digital overwrite switching is required, determine digital overwrite switching information.

[0071] In an embodiment of the present application, if the exposure compensation and the scene dynamic range information representation corresponding to the preset scene mode need to be digitally overwritten and switched, that is, in the preset scene mode, when the exposure compensation represents the exposure compensation of the current frame, if the exposure compensation is the second preset threshold, it is determined to perform digital overwrite switching; wherein the second preset threshold is an integer that is not zero.

[0072] In some embodiments of the present application, in a preset scene mode, when the exposure compensation represents the exposure compensation of the current frame, if the exposure compensation is a first preset threshold, it is determined not to perform digital overwrite switching; wherein the first preset threshold is zero.

[0073] In some embodiments of the present application, if the exposure compensation and the scene dynamic range information corresponding to the preset scene mode need to be digitally overwritten and switched, that is, in the preset scene mode, when the exposure compensation represents the exposure compensation of multiple frames, if the exposure compensation is greater than the third preset threshold, it is determined to perform digital overwrite switching.

[0074] In some embodiments of the present application, in a preset scene mode, when the exposure compensation represents exposure compensation of multiple frames, if the exposure compensation is less than or equal to a third preset threshold, it is determined not to perform digital overwrite switching.

[0075] In some embodiments of the present application, if exposure compensation and scene dynamic range information representation corresponding to a preset scene mode require digital overwrite switching, the digital overwrite switching type is determined based on the exposure compensation; and the digital overwrite switching information is determined based on the digital overwrite switching type.

[0076] S103: reconfigure the hardware parameter information based on the digital overwrite switching information to obtain target hardware parameter information.

[0077] In the embodiment of the present application, the hardware parameter information refers to any one of processing single-exposure parameter information, double-exposure parameter information, or triple-exposure parameter information.

[0078] In some embodiments of the present application, if the digital overwrite switching information indicates switching from the first brightness to the second brightness, the parameters of the second brightness are determined; if the digital overwrite switching information indicates switching from the second brightness to the first brightness, the parameters of the first brightness are determined. According to the parameters of the second brightness or the parameters of the first brightness, the hardware parameter information is reconfigured to obtain the target hardware parameter information.

[0079] S104: Based on the target hardware parameter information, digital overwrite switching is performed on multiple cameras at the latest frame output time point of the camera with the lowest frame rate at the same time, and the switched images are output.

[0080] In the embodiment of the present application, the most recent frame-generating time point of the camera with the lowest frame rate represents the moment when multiple cameras are most likely to generate images simultaneously.

[0081] In some embodiments of the present application, the terminal can determine the most recent frame-out time point of the camera with the lowest frame rate among multiple cameras as the switching time based on the target hardware parameter information; in the next frame, digitally overwrite and switch multiple cameras at the same time according to the switching time, and output the switched image.

[0082] It should be noted that the "simultaneous" in the simultaneous digital overwrite switching of multiple cameras means that the switching behavior of multiple cameras is consistent, or the time difference of the switching behavior of multiple cameras is within a preset time interval, and the preset time interval is generally one frame. Among them, the setting principle of the preset time interval is a relatively short period of time, and the embodiment of the present application does not limit it.

[0083] It can be understood that, in the preset scene mode, the terminal obtains the exposure compensation and the scene dynamic range information corresponding to the preset scene mode; if the exposure compensation and the scene dynamic range information corresponding to the preset scene mode indicate that digital overwrite switching is required, the digital overwrite switching information is determined; based on the digital overwrite switching information, the hardware parameter information is reconfigured to obtain the target hardware parameter information; based on the target hardware parameter information, multiple cameras are digitally overwritten and switched at the latest frame-out time point of the camera with the lowest frame rate at the same time, and the switched image is output. Through the exposure compensation and the scene dynamic range information corresponding to the preset scene mode, it is determined whether to perform digital overwrite switching. Since different scene modes require different brightness, the scene dynamic range information corresponding to the preset scene mode is used as an influencing factor for whether to perform digital overwrite switching, which can more accurately determine whether to perform digital overwrite switching. After determining to perform digital overwrite switching, the hardware parameter information is reconfigured to obtain the target hardware parameter information; under the target hardware parameter information, multiple cameras are digitally overwritten and switched at the latest frame-out time point of the camera with the lowest frame rate at the same time, and the switched image is output, so that multiple cameras maintain the same digital overwrite state in each frame, thereby improving the output image quality effect.

[0084] In the embodiment of the present application, Figure 5 An optional process diagram of a digital overwrite switching method is provided for an embodiment of the present application Figure 2 ,like Figure 5 As shown, S101 can be implemented by S1011, S1012 and S1013 as follows:

[0085] S1011. In a preset scene mode, calculate an automatic exposure convergence result of a current frame, or calculate automatic exposure convergence results of multiple frames.

[0086] In the embodiment of the present application, in the preset scene mode, the terminal can calculate the automatic exposure convergence result of the current frame to obtain the automatic exposure convergence result of the current frame. Generally, the preset scene mode can be a night mode or a day mode.

[0087] In some embodiments of the present application, in night mode or in day mode, the terminal may calculate the automatic exposure convergence result of the current frame to obtain the automatic exposure convergence result of the current frame. Alternatively, the terminal may calculate the automatic exposure convergence results of multiple frames to obtain the automatic exposure convergence results of multiple frames.

[0088] S1012: Determine exposure compensation according to the automatic exposure convergence result of the current frame or the automatic exposure convergence results of multiple frames.

[0089] In an embodiment of the present application, the terminal may use the automatic exposure convergence result of the current frame as exposure compensation, or use the automatic exposure convergence results of multiple frames as exposure compensation.

[0090] S1013. According to the preset scene mode, obtain scene dynamic range information corresponding to the preset scene mode.

[0091] In the embodiment of the present application, the terminal can obtain scene dynamic range information corresponding to the preset scene mode according to the preset scene mode.

[0092] In some embodiments of the present application, the terminal may obtain scene dynamic range information corresponding to the night mode according to the night mode.

[0093] In some embodiments of the present application, the terminal may also obtain scene dynamic range information corresponding to the daytime mode based on the daytime mode.

[0094] It should be noted that different scene modes obtain different scene dynamic range information.

[0095] It can be understood that, in the preset scene mode, the terminal calculates the automatic exposure convergence result of the current frame, or calculates the automatic exposure convergence results of multiple frames, determines the exposure compensation based on the automatic exposure convergence result of the current frame, or the automatic exposure convergence results of multiple frames, and obtains the scene dynamic range information corresponding to the preset scene mode according to the preset scene mode, thereby enriching the diversity of exposure compensation acquisition.

[0096] In an embodiment of the present application, if the exposure compensation and the scene dynamic range information corresponding to the preset scene mode indicate that digital overwrite switching is required, before determining the digital overwrite switching information, the terminal also executes in the preset scene mode, when the exposure compensation represents the exposure compensation of the current frame, if the exposure compensation is a first preset threshold, it is determined not to perform digital overwrite switching; the first preset threshold is zero; if the exposure compensation is a second preset threshold, it is determined to perform digital overwrite switching; the second preset threshold is a non-zero integer.

[0097] In an embodiment of the present application, when the exposure compensation and the scene dynamic range information corresponding to the preset scene mode represent the need for digital overwrite switching, before determining the digital overwrite switching information, the terminal also executes in the preset scene mode, when the exposure compensation represents the exposure compensation of multiple frames, if the exposure compensation is greater than the third preset threshold, it is determined to perform digital overwrite switching; if the exposure compensation is less than or equal to the third preset threshold, it is determined not to perform digital overwrite switching.

[0098] In the embodiment of the present application, Figure 6 An optional process diagram of a digital overwrite switching method is provided for an embodiment of the present application Figure 3 ,like Figure 6 As shown, S102 can be implemented by S1021 and S1022 as follows:

[0099] S1021: If the exposure compensation and the scene dynamic range information corresponding to the preset scene mode represent that digital overwrite switching is required, determine the digital overwrite switching type according to the exposure compensation.

[0100] In the embodiment of the present application, the digital override switching type includes a first digital override switching type and a second digital override switching type.

[0101] In some embodiments of the present application, if the exposure compensation is a second preset threshold and the second preset threshold is a positive integer, the first digital overwrite switching type is determined; the first digital overwrite switching type is the first brightness switching to the second brightness; the exposure level of the first brightness is greater than the exposure level of the second brightness.

[0102] In some embodiments of the present application, if the exposure compensation is a second preset threshold and the second preset threshold is a negative integer, a second digital override switching type is determined; the second digital override switching type is switching from the second brightness to the first brightness.

[0103] In some embodiments of the present application, the first digital overwrite switching type is switching from the first brightness to the second brightness, including: switching from the double exposure mode to the single exposure mode, switching from the triple exposure mode to the double exposure mode, and switching from the triple exposure mode to the single exposure mode.

[0104] In some embodiments of the present application, the second digital overwrite switching type is switching from the second brightness to the first brightness, including: switching from the double exposure mode to the triple exposure mode, switching from the single exposure mode to the double exposure mode, and switching from the single exposure mode to the triple exposure mode.

[0105] In some embodiments of the present application, the parameters of the first brightness include double exposure parameters or triple exposure parameters.

[0106] In some embodiments of the present application, the parameter of the second brightness includes a double exposure parameter or a single exposure parameter.

[0107] In an embodiment of the present application, if the exposure compensation and the scene dynamic range information corresponding to the preset scene mode need to be digitally overwritten and switched, the exposure compensation is the second preset threshold, and the second preset threshold is a positive integer, then the first digital overwrite switching type is determined; or, if the exposure compensation and the scene dynamic range information corresponding to the preset scene mode need to be digitally overwritten and switched, the exposure compensation is the second preset threshold, and the second preset threshold is a negative integer, then the second digital overwrite switching type is determined.

[0108] S1022. Determine digital override switching information according to the digital override switching type.

[0109] In the embodiment of the present application, the terminal may determine the digital override switching information according to the digital override switching type.

[0110] In some embodiments of the present application, the terminal may determine the digital overwrite switching information of the first brightness switching to the second brightness according to the first digital overwrite switching type. Alternatively, the terminal may determine the digital overwrite switching information of the second brightness switching to the first brightness according to the second digital overwrite switching type.

[0111] It can be understood that if the exposure compensation and the scene dynamic range information representation corresponding to the preset scene mode need to be digitally overwritten and switched, the terminal can determine the digital overwrite switching type based on the exposure compensation, determine the digital overwrite switching information based on the digital overwrite switching type, and indirectly determine the digital overwrite switching information based on the exposure compensation, thereby improving the quality of the output image.

[0112] In the embodiment of the present application, Figure 7 An optional process diagram of a digital overwrite switching method is provided for an embodiment of the present application Figure 4 ,like Figure 7As shown, S103 can be implemented by S1031, S1032 and S1033 as follows:

[0113] S1031: If the digital overwrite switching information indicates switching from the first brightness to the second brightness, determine parameters of the second brightness.

[0114] In the embodiment of the present application, if the digital overwrite switching information represents switching from the first brightness to the second brightness, the terminal determines the parameters of the second brightness.

[0115] In some embodiments of the present application, if the digital overwrite switching information indicates switching from the first brightness to the second brightness, and the dual exposure mode is switched to the single exposure mode, the parameters of the second brightness are determined to be single exposure parameters.

[0116] In some embodiments of the present application, if the digital overwrite switching information indicates switching from the first brightness to the second brightness, and the triple exposure mode is switched to the double exposure mode, the parameter of the second brightness is determined to be a double exposure parameter.

[0117] In some embodiments of the present application, if the digital overwrite switching information indicates switching from the first brightness to the second brightness, and the triple exposure mode is switched to the single exposure mode, the parameter of the second brightness is determined to be a single exposure parameter.

[0118] S1032: If the digital overwrite switching information indicates switching from the second brightness to the first brightness, determine parameters of the first brightness.

[0119] In the embodiment of the present application, if the digital overwrite switching information indicates switching from the second brightness to the first brightness, the parameters of the first brightness are determined.

[0120] In some embodiments of the present application, if the digital overwrite switching information indicates switching from the second brightness to the first brightness, and switching from the single exposure mode to the double exposure mode, the parameters of the first brightness are determined to be double exposure parameters.

[0121] In some embodiments of the present application, if the digital overwrite switching information indicates switching from the second brightness to the first brightness, and the double exposure mode is switched to the triple exposure mode, the parameter of the first brightness is determined to be the triple exposure parameter.

[0122] In some embodiments of the present application, if the digital overwrite switching information indicates switching from the second brightness to the first brightness, and switching from the single exposure mode to the triple exposure mode, the parameters of the first brightness are determined to be triple exposure parameters.

[0123] S1033. Reconfigure the hardware parameter information according to the second brightness parameter or the first brightness parameter to obtain target hardware parameter information.

[0124] In the embodiment of the present application, the terminal can reconfigure the hardware parameter information according to the parameters of the second brightness or the parameters of the first brightness to obtain the target hardware parameter information.

[0125] In some embodiments of the present application, the terminal may reconfigure hardware parameter information according to the single exposure parameter or the double exposure parameter to obtain target hardware parameter information corresponding to the single exposure parameter or the double exposure parameter.

[0126] In some embodiments of the present application, the terminal may reconfigure hardware parameter information according to the double exposure parameters or the triple exposure parameters to obtain target hardware parameter information corresponding to the double exposure parameters or the triple exposure parameters.

[0127] It can be understood that if the digital overwrite switching information indicates switching from the first brightness to the second brightness, the terminal determines the parameters of the second brightness; if the digital overwrite switching information indicates switching from the second brightness to the first brightness, the terminal determines the parameters of the first brightness, and reconfigures the hardware parameter information according to the parameters of the second brightness or the parameters of the first brightness to obtain the target hardware parameter information. In this process, the target hardware parameter information corresponding to the parameters of the second brightness or the parameters of the first brightness is determined, which facilitates the subsequent hardware parameter configuration, thereby improving the output image quality effect.

[0128] In the embodiment of the present application, before reconfiguring the hardware parameter information based on the digital overwrite switching information to obtain the target hardware parameter information, the terminal continues to capture and output images based on the hardware parameter information.

[0129] It is understandable that before the hardware parameter information is reconfigured based on the digital overwrite switching information to obtain the target hardware parameter information, the terminal continues to take pictures based on the hardware parameter information to ensure normal picture output.

[0130] In the embodiment of the present application, Figure 8 An optional process diagram of a digital overwrite switching method is provided for an embodiment of the present application Figure 5 ,like Figure 8 As shown, S104 can be implemented by S1041 and S1042 as follows:

[0131] S1041. Based on the target hardware parameter information, determine the most recent frame output time point of the camera with the lowest frame rate among the multiple cameras as the switching time point.

[0132] In an embodiment of the present application, the terminal can determine the most recent frame-out time point of the camera with the lowest frame rate among multiple cameras as the switching time point based on the target hardware parameter information corresponding to the single exposure parameter or the double exposure parameter.

[0133] In some embodiments of the present application, the terminal may use the target hardware parameter information corresponding to the double exposure parameters or the triple exposure parameters to determine the most recent frame-out time point of the camera with the lowest frame rate among multiple cameras as the switching time point.

[0134] S1042. In the next frame, digital overwriting switching is performed on multiple cameras simultaneously according to the switching time, and the switched images are output.

[0135] In an embodiment of the present application, in the next frame, the terminal can digitally overwrite and switch multiple cameras simultaneously according to the switching time, and output the switched image.

[0136] It can be understood that, based on the target hardware parameter information, the terminal determines the most recent frame-out time point of the camera with the lowest frame rate among multiple cameras as the switching time point, and in the next frame, digital overwrites and switches multiple cameras at the same time according to the switching time point, and outputs the switched image. In this process, under the target hardware parameter information, digital overwrites and switches multiple cameras at the most recent frame-out time point of the camera with the lowest frame rate at the same time, and outputs the switched image, so that multiple cameras maintain the same digital overwrite state in each frame, improving the output image quality effect.

[0137] based on Figure 4The architecture diagram of the software and hardware of the Android-based Camera system is shown. When the user turns on the camera, the system selects a Usecase (i.e., preset scene mode) according to the current user scenario, and builds a software pipeline based on the Usecase. The multi-camera starts to output images (including preview, focus, and focus), and the ISP uploads the multi-camera 5A Stats information to the HAL 5A Process Node (including AE). The 5A Node is responsible for automatic exposure, automatic white balance, automatic focus, lens shading correction, and anti-flicker processing in the HAL Pipeline. When the automatic exposure node completes the calculation convergence, the system decides whether DOL switching is required based on the exposure compensation (AE output value) and the scene dynamic range information (the scene dynamic range information of the preset scene mode). The DOL switching decision is made through the DOL Switch Policy (digital overwrite conversion decision) submodule. The 5A ProcessNode (global module) sends the Meta information (exposure compensation) after AE convergence to the DOLSwitch Policy submodule through the Commander (command) submodule, and the DOL switching decision is made by this submodule (the AE output value is 0, no switching is performed; a positive integer is used to switch from single exposure to double exposure; a negative integer is used to switch from double exposure to single exposure). After the DOL Switch Policy submodule completes the DOL decision based on the Metadata (exposure compensation), it returns the decision information to the 5A Process Node (global module), and the Commander (command) sends the decision information to the HW Layer, Kernel, and image processing firmware, and then transmits it to the ISP (image processing chip) in turn. The ISP starts to perform seamless DOL switching of multiple cameras based on the DOL decision information.

[0138] based on Figure 4 , Fig. 9 An optional switching process diagram of a digital overwrite switching method is provided for an embodiment of the present application. The specific digital overwrite switching method is described by taking the switching of multi-camera 2DOL to 1DOL as an example, as follows:

[0139] 1) When the dynamic range of the scene changes, the multi-camera automatic exposure AE is triggered first. The system needs to wait for the multi-camera AE (hardware) to converge before the multi-camera synchronizes to the HAL (the middle layer between software and hardware, which belongs to software. Figure 3 The AE convergence result is reported in the dashed box.

[0140] 2) After HAL receives the AE convergence result, the DOL Switch Policy decides whether to switch to multi-camera DOL for the current scene based on the AE algorithm compensation information and the scene dynamic range information.

[0141] 3) DOL Switch Policy returns the multi-camera DOL switching decision information to the 5A Process Node, and the Commander sends the decision information to the ISP (software sends hardware).

[0142] 4) After HAL triggers DOL switching, it needs to send the Firmware DOL switching command. HAL still needs to send multi-camera 2DOL parameters to ISP (including front-end, mid-end and back-end).

[0143] 5) When the ISP receives the DOL switching command (digital overwrite switching command), the ISP will reconfigure the hardware parameters to enable it to process 1DOL data, and then configure the Sensor to output data with 1DOL. When the Sensor confirms that it has returned 1DOL data, the ISP notifies the HAL that the DOL switching has been completed. After receiving the notification, the HAL begins to send multi-camera 1DOL parameters (camera APP parameters).

[0144] 6) After receiving the DOL switching command and the new ISP configuration information, the ISP starts the multi-camera DOL switching. The multi-camera will wait for the sub-camera with the lowest frame rate to output the latest frame time point to switch the multi-camera to DOL at the same time. For example, the multi-camera outputs images at Fhigh, Fmid and Flow frame rates respectively. After the ISP receives the DOL switching command, the multi-camera waits for the Flow sub-camera to output the latest frame time point as the multi-camera synchronous DOL switching moment, and completes the multi-camera DOL switching in the next frame, and outputs the image with the DOL type after switching.

[0145] 7) Frame counting is performed simultaneously in the ISP, and the camera with the lowest frame rate is used to predict the next synchronization point, and the corresponding frame parameters are prepared before the synchronization point.

[0146] 8) In order to achieve full HW frame synchronization of multiple cameras, the HW Sensor Manager (hardware clock source) is used as the synchronization source in the ISP (the traditional synchronization source is between sensors, which is limited by the influence of modules, and the timing of synchronization is difficult to control). At the synchronization moments decided in 6) and 7), the Sensor Manager triggers the simultaneous DOL switching of multiple cameras.

[0147] It should be noted that when the multi-camera AE converges, the DOL switch is triggered and accurately switches from 2DOL to 1DOL. The ISP will reconfigure the hardware parameters (i.e., multi-camera 1DOL parameter configuration) to enable it to process 1DOL data, and then configure the sensor to output data with 1DOL. When the sensor confirms that the 1DOL data is returned (1DOL parameter configuration is completed), the switching timing is determined and the multi-camera switches simultaneously.

[0148] In the embodiment of the present application, the main and secondary cameras have different frame rate states. After AE converges, the secondary camera with the lowest frame rate is used to align multiple cameras to complete DOL switching at the same time; based on the lowest secondary camera, the Sensor Manager is used as the synchronization control source to prepare the corresponding parameter controls before synchronization of each synchronization point to ensure that the corresponding frames of multiple cameras are switched at the same time.

[0149] In the embodiment of the present application, for the change of brightness range in the scene during SAT, it can be in the SAT multi-camera DOL state switching. When the user switches the focal length, when SAT switches the main and secondary cameras, after the main and secondary cameras stably produce frames at the planned frame rate, the secondary camera with the lowest frame rate is used as the basis for selecting the synchronization point for switching the multi-camera DOL state, so that the multi-camera same frame triggers the switching and the next frame completes the switching, ensuring that the image frame does not have a sudden change in brightness.

[0150] In the embodiment of the present application, the DOL switching timing can be expanded in different exposure scenarios in combination with AE. When the brightness in the scene changes, the timing of DOL switching can be determined based on the exposure change trend when AE converges. For example, the brightness change range within a specific number of frames in the detection environment (3 frames of detected brightness change value) is greater than L- limit lux (threshold), trigger DOL switching, and the specific switching timing is determined by this solution. The above technical expansion combined with this solution can enable the camera to adaptively switch multiple camera DOLs when the brightness in the scene changes to adapt to the dynamic range requirements of different scenes, while ensuring that the picture does not change suddenly during switching, thereby improving the user experience.

[0151] In the embodiment of the present application, synchronization timing protection: after the AE completes convergence, multiple cameras simultaneously report to HAL to trigger DOL switching, and multiple cameras maintain their own frame rates (such as high frame rate Fhigh + medium frame rate Fmid + low frame rate Flow). After HAL configures the DOL Pipeline information and ISP Frame parameters after switching, it is sent to ISP-FW through an immediate command (online-request). After ISP-FW selects the synchronization point according to the frame rate of the lowest secondary camera (see above, it is the low frame rate Flow), multiple cameras simultaneously perform DOL switching at the selected synchronization point. At the synchronization point, multiple cameras all have frame output at this moment, completing the DOL switching. At the same time, frame counting is performed in the ISP, and the frame output timestamp of the camera with the lowest frame rate among the multiple cameras is used to predict the next DOL switching synchronization point. Before the synchronization point, the SensorManager prepares the corresponding frame parameters after the DOL switching in advance. When the synchronization point arrives, the prepared parameters are immediately sent to the ISP-FW to accelerate the DOL switching process.

[0152] In the embodiment of the present application, synchronization source protection: the lowest frame rate secondary camera is used as the basis for selecting the DOL synchronization point for switching, and the Sensor Manager is designed as the synchronization control source. The Sensor Manager configures the DOL switching frame parameters and Pipeline information in advance before each selected synchronization point, and triggers multiple cameras to perform DOL switching at the same time at the synchronization point, so as to ensure that the corresponding frames of multiple cameras after triggering the DOL switching complete the DOL switching at the same time after the synchronization point, and ensure that the SAT fusion effect is not affected by the DOL switching of multiple cameras.

[0153] It is understandable that the problem of picture brightness jump caused by the traditional DOL switching scheme can be avoided by virtue of the characteristic of triggering multi-camera DOL switching based on the minimum frame rate sub-camera alignment. The DOL fully synchronized seamless switching method based on the minimum frame rate sub-camera alignment allows multiple cameras to maintain the same DOL state in each frame. When the user turns HDR shooting on or off or performs focal length smooth switching (Zoom), cold start (Cold Start) of the camera, and the brightness in the scene changes, the multi-camera of this scheme always maintains the same DOL state. When the multi-camera outputs images at different frame rates, the exposure gain of the multi-camera output is consistent. The user's mobile phone preview screen is kept smooth when zooming and changing scenes, avoiding brightness jumps between frames and abrupt brightness changes in different scenes, thereby improving the user experience.

[0154] Based on the digital overwrite switching method of the above embodiment, the present application embodiment also provides a digital overwrite switching device, such as Fig.10 As shown, Fig.10 The present invention provides a structural diagram of a digital overwrite switching device according to an embodiment of the present invention. The digital overwrite switching device 10 comprises: an acquisition unit 1001, a determination unit 1002, a configuration unit 1003 and a switching unit 1004, wherein:

[0155] The acquisition unit 1001 is used to acquire exposure compensation and scene dynamic range information corresponding to the preset scene mode through image processing firmware, kernel, HW layer and pipeline in the preset scene mode;

[0156] The determining unit 1002 is configured to determine digital overwrite switching information if the exposure compensation and the scene dynamic range information corresponding to the preset scene mode indicate that digital overwrite switching is required;

[0157] The configuration unit 1003 is used to reconfigure the hardware parameter information based on the digital overwrite switching information to obtain the target hardware parameter information;

[0158] The switching unit 1004 is used to digitally overwrite and switch multiple cameras at the same time based on the target hardware parameter information at the latest frame output time point of the camera with the lowest frame rate, and output the switched images.

[0159] In some embodiments of the present application, the determining unit 1002 is further configured to calculate, in the preset scene mode, an automatic exposure convergence result of a current frame, or calculate automatic exposure convergence results of multiple frames; determine the exposure compensation according to the automatic exposure convergence result of the current frame, or the automatic exposure convergence results of the multiple frames;

[0160] The acquisition unit 1001 is further configured to acquire scene dynamic range information corresponding to the preset scene mode according to the preset scene mode.

[0161] In some embodiments of the present application, the determination unit 1002 is also used to, if the exposure compensation and the scene dynamic range information corresponding to the preset scene mode represent the need for digital overwrite switching, then before determining the digital overwrite switching information, in the preset scene mode, when the exposure compensation represents the exposure compensation of the current frame, if the exposure compensation is a first preset threshold, it is determined that no digital overwrite switching is performed; the first preset threshold is zero; if the exposure compensation is a second preset threshold, it is determined that digital overwrite switching is performed; the second preset threshold is an integer that is not zero.

[0162] In some embodiments of the present application, the determination unit 1002 is also used to determine that the exposure compensation and the scene dynamic range information corresponding to the preset scene mode need to be digitally overwritten before determining the digital overwrite switching information. In the preset scene mode, when the exposure compensation represents the exposure compensation of multiple frames, if the exposure compensation is greater than a third preset threshold, it is determined to perform digital overwrite switching; if the exposure compensation is less than or equal to the third preset threshold, it is determined not to perform digital overwrite switching.

[0163] In some embodiments of the present application, the determination unit 1002 is further used to determine the digital overwrite switching type according to the exposure compensation if the scene dynamic range information representation corresponding to the exposure compensation and the preset scene mode requires digital overwrite switching; and determine the digital overwrite switching information according to the digital overwrite switching type.

[0164] In some embodiments of the present application, the digital override switching type includes a first digital override switching type and a second digital override switching type;

[0165] In some embodiments of the present application, the determination unit 1002 is also used to determine the first digital override switching type if the exposure compensation is a second preset threshold and the second preset threshold is a positive integer; the first digital override switching type is the first brightness switching to the second brightness; the exposure level of the first brightness is greater than the exposure level of the second brightness; if the exposure compensation is a second preset threshold and the second preset threshold is a negative integer, determine the second digital override switching type; the second digital override switching type is the second brightness switching to the first brightness.

[0166] In some embodiments of the present application, the determining unit 1002 is further configured to determine the parameters of the second brightness if the digital overwrite switching information indicates switching from the first brightness to the second brightness; and determine the parameters of the first brightness if the digital overwrite switching information indicates switching from the second brightness to the first brightness;

[0167] The configuration unit 1003 is further configured to reconfigure the hardware parameter information according to the second brightness parameter or the first brightness parameter to obtain the target hardware parameter information.

[0168] In some embodiments of the present application, the switching unit 1004 is further used to reconfigure the hardware parameter information based on the digital overwrite switching information, and continue to capture images based on the hardware parameter information before obtaining the target hardware parameter information.

[0169] In some embodiments of the present application, the determining unit 1002 is further configured to determine, based on the target hardware parameter information, a most recent frame-out time point of a camera with the lowest frame rate among the multiple cameras as the switching time point;

[0170] The switching unit 1004 is further configured to simultaneously digitally overwrite and switch the multiple cameras according to the switching time in the next frame, and output the switched image.

[0171] In some embodiments of the present application, the first digital overwrite switching type is switching from the first brightness to the second brightness, including: switching from the double exposure mode to the single exposure mode, switching from the triple exposure mode to the double exposure mode, and switching from the triple exposure mode to the single exposure mode.

[0172] In some embodiments of the present application, the second digital overwrite switching type is switching from the second brightness to the first brightness, including: switching from the double exposure mode to the triple exposure mode, switching from the single exposure mode to the double exposure mode, and switching from the single exposure mode to the triple exposure mode.

[0173] In some embodiments of the present application, the parameters of the first brightness include double exposure parameters or triple exposure parameters.

[0174] In some embodiments of the present application, the parameter of the second brightness includes a double exposure parameter or a single exposure parameter.

[0175] The embodiment of the present application provides another digital overwrite switching device, which includes: a global module, a digital overwrite decision module and an image processing module, wherein:

[0176] The global module is used to obtain exposure compensation and scene dynamic range information corresponding to the preset scene mode through image processing firmware, kernel, HW layer and pipeline in the preset scene mode;

[0177] The digital overwrite decision module is used to determine digital overwrite switching information if the exposure compensation and the scene dynamic range information corresponding to the preset scene mode indicate that digital overwrite switching is required;

[0178] The global module is further used to reconfigure the hardware parameter information based on the digital overwrite switching information to obtain the target hardware parameter information;

[0179] The image processing module is used to digitally overwrite and switch multiple cameras at the same time based on the target hardware parameter information at the latest frame output time point of the camera with the lowest frame rate, and output the switched images.

[0180] It is understandable that the terminal determines whether to perform digital overwrite switching through exposure compensation and scene dynamic range information corresponding to the preset scene mode. Since different scene modes require different brightness, the scene dynamic range information corresponding to the preset scene mode is used as an influencing factor for whether to perform digital overwrite switching, which can more accurately determine whether to perform digital overwrite switching. After determining to perform digital overwrite switching, reconfigure the hardware parameter information to obtain the target hardware parameter information; under the target hardware parameter information, perform digital overwrite switching on multiple cameras at the same time at the most recent frame output time point of the camera with the lowest frame rate, and output the switched image, so that multiple cameras maintain the same digital overwrite state in each frame, improving the output image quality effect.

[0181] Based on the digital overwrite switching method of the above embodiment, the embodiment of the present application also provides a terminal device, such as Fig.11 As shown, Fig.11 A schematic diagram of the structure of a terminal device provided in an embodiment of the present application, the terminal device 11 includes: a processor 1101 and a memory 1102. The memory 1102 is used to store a computer program; the processor 1101 is used to call and run the computer program from the memory to execute the digital overwrite switching method as described in the above embodiment.

[0182] In the embodiment of the present application, the processor 1101 may be at least one of an application-specific integrated circuit (ASIC), a digital signal processor (DSP), a digital signal processing device (DSPD), a programmable logic device (PLD), a field programmable gate array (FPGA), a central processing unit (CPU), a controller, a microcontroller, and a microprocessor. It is understandable that for different devices, the electronic device used to implement the above-mentioned processor function may also be other, and the embodiment of the present application does not specifically limit it.

[0183] An embodiment of the present application provides a computer-readable storage medium storing a computer program for implementing the digital overwrite switching method as described in any of the above embodiments when executed by a processor.

[0184] Exemplarily, program instructions corresponding to a digital overwrite switching method in this embodiment can be stored on a storage medium such as a CD, a hard disk, or a USB flash drive. When the program instructions corresponding to a digital overwrite switching method in the storage medium are read or executed by an electronic device, the digital overwrite switching method described in any of the above embodiments can be implemented.

[0185] In addition, each functional module in the embodiment of the present application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of software functional modules.

[0186] If the integrated unit is implemented in the form of a software function module and is not sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this embodiment is essentially or the part that contributes to the prior art or the whole or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server, or network device, etc.) or a processor to perform all or part of the steps of the method of this embodiment. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk, etc., various media that can store program codes.

[0187] It should be understood that "one embodiment" or "an embodiment" or "some embodiments" mentioned throughout the specification means that specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in one embodiment" or "in some embodiments" appearing throughout the specification may not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the size of the sequence number of the above-mentioned processes does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application. The above-mentioned sequence numbers of the embodiments of the present application are only for description and do not represent the advantages and disadvantages of the embodiments. The above description of each embodiment tends to emphasize the differences between the various embodiments, and the same or similar aspects can be referenced to each other. For the sake of brevity, this article will not repeat them.

[0188] The modules described above as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules; they may be located in one place or distributed on multiple network units; some or all of the modules may be selected according to actual needs to achieve the purpose of the present embodiment.

[0189] In addition, all functional modules in the embodiments of the present application may be integrated into one processing unit, or each module may be a separate unit, or two or more modules may be integrated into one unit; the above-mentioned integrated modules may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0190] A person skilled in the art can understand that all or part of the steps of implementing the above method embodiment can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above method embodiment; and the aforementioned storage medium includes: mobile storage devices, read-only memories (ROM), magnetic disks or optical disks, etc., various media that can store program codes.

[0191] The methods disclosed in several method embodiments provided in the embodiments of the present application can be arbitrarily combined without conflict to obtain new method embodiments.

[0192] The features disclosed in several product embodiments provided in the embodiments of the present application can be arbitrarily combined without conflict to obtain new product embodiments.

[0193] The features disclosed in several method or device embodiments provided in the embodiments of the present application can be arbitrarily combined without conflict to obtain new method embodiments or device embodiments.

[0194] The above is only an implementation method of the embodiment of the present application, but the protection scope of the embodiment of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the embodiment of the present application. Therefore, the protection scope of the embodiment of the present application should be based on the protection scope of the claims.

Claims

1. A digital overwrite switching method, characterized in that: include: In a preset scene mode, acquiring exposure compensation and scene dynamic range information corresponding to the preset scene mode; If the exposure compensation and the scene dynamic range information corresponding to the preset scene mode indicate that digital overwrite switching is required, determining digital overwrite switching information; Based on the digital overwrite switching information, reconfigure the hardware parameter information to obtain the target hardware parameter information; Based on the target hardware parameter information, multiple cameras are digitally overwritten and switched simultaneously at the latest frame output time point of the camera with the lowest frame rate, and the switched images are output.

2. The method according to claim 1, characterized in that The step of obtaining exposure compensation and scene dynamic range information corresponding to the preset scene mode in the preset scene mode includes: In the preset scene mode, calculating the automatic exposure convergence result of the current frame, or calculating the automatic exposure convergence results of multiple frames; Determining the exposure compensation according to the automatic exposure convergence result of the current frame, or the automatic exposure convergence results of the multiple frames; According to the preset scene mode, scene dynamic range information corresponding to the preset scene mode is acquired.

3. The method according to claim 1 or 2, characterized in that: If the exposure compensation and the scene dynamic range information corresponding to the preset scene mode represent that digital overwrite switching is required, before determining the digital overwrite switching information, the method further includes: In the preset scene mode, when the exposure compensation represents the exposure compensation of the current frame, if the exposure compensation is a first preset threshold, it is determined not to perform digital overwrite switching; the first preset threshold is zero; If the exposure compensation is a second preset threshold, it is determined to perform digital overwrite switching; the second preset threshold is an integer not equal to zero.

4. The method according to claim 1 or 2, characterized in that: The exposure compensation and the scene dynamic range information corresponding to the preset scene mode indicate that digital overwrite switching is required, and before determining the digital overwrite switching information, the method further includes: In the preset scene mode, when the exposure compensation represents exposure compensation of multiple frames, if the exposure compensation is greater than a third preset threshold, determining to perform digital overwrite switching; If the exposure compensation is less than or equal to the third preset threshold, it is determined not to perform digital overwrite switching.

5. The method according to any one of claims 1 to 4, characterized in that: If the exposure compensation and the scene dynamic range information corresponding to the preset scene mode represent that digital overwrite switching is required, determining digital overwrite switching information includes: If the exposure compensation and the scene dynamic range information representation corresponding to the preset scene mode need to be digitally overwritten and switched, determining the digital overwrite switching type according to the exposure compensation; The digital override switching information is determined according to the digital override switching type.

6. The method according to claim 5, characterized in that The digital override switching type includes a first digital override switching type and a second digital override switching type; The step of determining the digital overwrite switching type according to the exposure compensation comprises: If the exposure compensation is a second preset threshold value, and the second preset threshold value is a positive integer, a first digital override switching type is determined; the first digital override switching type is a switch from a first brightness to a second brightness; the exposure level of the first brightness is greater than the exposure level of the second brightness; If the exposure compensation is a second preset threshold, and the second preset threshold is a negative integer, a second digital override switching type is determined; the second digital override switching type is switching from the second brightness to the first brightness.

7. The method according to any one of claims 1 to 5, characterized in that: The reconfiguring of hardware parameter information based on the digital overwrite switching information to obtain target hardware parameter information includes: If the digital overwrite switching information indicates switching from the first brightness to the second brightness, determining a parameter of the second brightness; If the digital overwrite switching information indicates switching from the second brightness to the first brightness, determining a parameter of the first brightness; The hardware parameter information is reconfigured according to the second brightness parameter or the first brightness parameter to obtain the target hardware parameter information.

8. The method according to claim 1 or 7, characterized in that: Before reconfiguring the hardware parameter information based on the digital overwrite switching information to obtain the target hardware parameter information, the method further includes: Continue to take pictures based on the hardware parameter information.

9. The method according to any one of claims 1 to 5, characterized in that: Based on the target hardware parameter information, the multiple cameras are digitally overwritten and switched at the latest frame output time point of the camera with the lowest frame rate at the same time, and the switched images are output, including: Based on the target hardware parameter information, determining the most recent frame output time point of the camera with the lowest frame rate among the multiple cameras as the switching time point; In the next frame, the multiple cameras are digitally overwritten and switched simultaneously according to the switching time, and the switched images are output.

10. The method according to claim 6 or 7, characterized in that: The first digital overwrite switching type is switching from the first brightness to the second brightness, including: switching from the double exposure mode to the single exposure mode, switching from the triple exposure mode to the double exposure mode, and switching from the triple exposure mode to the single exposure mode; The second digital overwrite switching type is switching from the second brightness to the first brightness, including: switching from the double exposure mode to the triple exposure mode, switching from the single exposure mode to the double exposure mode, and switching from the single exposure mode to the triple exposure mode. The first brightness parameter includes a double exposure parameter or a triple exposure parameter; The parameter of the second brightness includes a double exposure parameter or a single exposure parameter.

11. A digital overwrite switching device, characterized in that: include: an acquisition unit, a determination unit, a configuration unit and a switching unit, wherein: The acquisition unit is used to acquire, in a preset scene mode, exposure compensation and scene dynamic range information corresponding to the preset scene mode; The determining unit is configured to determine digital overwrite switching information if the exposure compensation and the scene dynamic range information corresponding to the preset scene mode indicate that digital overwrite switching is required; The configuration unit is used to reconfigure the hardware parameter information based on the digital overwrite switching information to obtain the target hardware parameter information; The switching unit is used to digitally overwrite and switch multiple cameras at the same time based on the target hardware parameter information at the latest frame output time point of the camera with the lowest frame rate, and output the switched images.

12. A terminal device, characterized in that: include: processor and memory, wherein The memory is used to store computer programs; The processor is configured to call and run the computer program from the memory to execute the method according to any one of claims 1 to 10.

Images