Exposure correction method and device, equipment, storage medium and product

Abstract

The embodiment of the invention provides an exposure correction method and device, equipment, a storage medium and a product. The method comprises the following steps: acquiring image data shot by a camera module by using an initial exposure parameter; the camera module comprises a first camera and a second camera, and the image data comprises first image data shot by the first camera and second image data shot by the second camera; the shooting view angle of the first camera is larger than that of the second camera; determining a first target exposure parameter corresponding to the first camera according to the first image data, and determining a second target exposure parameter corresponding to the second camera according to the first image data, the second image data and the first target exposure parameter; and returning the first target exposure parameter and the second target exposure parameter to the camera module as preset exposure parameters, so that the camera module continues to shoot based on the preset exposure parameters.

Description

Technical Field

[0001] The present application relates to the field of image processing, and in particular to an exposure correction method and apparatus, equipment, storage medium, and product. Background Art

[0002] When users use a multi-camera system to take photos, keeping the brightness of the captured images consistent can improve the shooting effect and provide a more pleasant visual experience. In the prior art, the exposure synchronization of the main and secondary cameras is usually achieved by pre-calibration or statistical value brightness alignment. When the scenes of different cameras are very different, it is easy to over-exposure or under-exposure at a small viewing angle, which seriously affects the image quality. Summary of the invention

[0003] The embodiments of the present application provide an exposure correction method and apparatus, equipment, storage medium, and product, which can improve shooting effects and imaging quality.

[0004] The technical solution of this application is implemented as follows:

[0005] In a first aspect, an embodiment of the present application provides an exposure correction method, the method comprising:

[0006] Acquire image data captured by a camera module using initial exposure parameters; the camera module includes a first camera and a second camera, the image data includes first image data captured by the first camera and second image data captured by the second camera; the shooting angle of the first camera is greater than the shooting angle of the second camera;

[0007] Determine a first target exposure parameter corresponding to the first camera according to the first image data, and determine a second target exposure parameter corresponding to the second camera according to the first image data, the second image data, and the first target exposure parameter;

[0008] The first target exposure parameter and the second target exposure parameter are returned to the camera module as preset exposure parameters, so that the camera module continues to shoot based on the preset exposure parameters.

[0009] In the above exposure correction method, determining the first target exposure parameter corresponding to the first camera according to the first image data includes:

[0010] Counting first brightness information of the first image data;

[0011] A first shooting scene under a shooting angle of view of the first camera is determined according to the first brightness information, and an exposure parameter configured for the first shooting scene is determined as the first target exposure parameter corresponding to the first camera.

[0012] In the above exposure correction method, determining the second target exposure parameter corresponding to the second camera according to the first image data, the second image data and the first target exposure parameter includes:

[0013] collecting statistics of second brightness information of the second image data;

[0014] Acquire, from the first brightness information of the first image data, a first brightness value corresponding to the shooting angle of view of the first camera and a second brightness value corresponding to the shooting angle of view of the second camera;

[0015] Determining a second reference exposure parameter corresponding to the second camera in a shooting angle of view of the first camera according to the first target exposure parameter, the first brightness value, and the second brightness value;

[0016] A second shooting scene under the shooting angle of view of the second camera is determined according to the second image data, and the second target exposure parameter is determined according to the exposure parameter configured for the second shooting scene and the second reference exposure parameter.

[0017] In the above exposure correction method, the determining the second target exposure parameter according to the exposure parameter configured for the second shooting scene and the second reference exposure parameter includes:

[0018] determining an exposure parameter interval according to the exposure parameters configured for the second shooting scene;

[0019] The second target exposure parameter of the second camera is determined according to the second reference exposure parameter and the exposure parameter range.

[0020] In the above exposure correction method, the step of determining the exposure parameter interval according to the exposure parameter configured for the second shooting scene includes:

[0021] determining adjustable parameters configured for the second shooting scene;

[0022] Determine the difference between the exposure parameter configured for the second shooting scene and the adjustable parameter as the exposure parameter lower limit, and determine the sum of the exposure parameter configured for the second shooting scene and the adjustable parameter as the exposure parameter upper limit;

[0023] The exposure parameter interval is determined according to the exposure parameter lower limit and the exposure parameter upper limit.

[0024] In the above exposure correction method, determining the second target exposure parameter of the second camera according to the second reference exposure parameter and the exposure parameter range includes:

[0025] When the second reference exposure parameter is within the exposure parameter interval, determining the second reference exposure parameter as the second target exposure parameter;

[0026] When the second reference exposure parameter is not within the exposure parameter interval, the second target exposure parameter is determined according to the exposure parameter interval.

[0027] In the above exposure correction method, determining the second target exposure parameter according to the exposure parameter interval includes:

[0028] When the second target exposure parameter is less than the exposure parameter lower limit, determining the exposure parameter lower limit as the second target exposure parameter;

[0029] When the second target exposure parameter is greater than the exposure parameter upper limit, the exposure parameter upper limit is determined as the second target exposure parameter.

[0030] In a second aspect, an embodiment of the present application provides an exposure correction device, the device comprising:

[0031] an acquisition unit, configured to acquire image data captured by a camera module using an initial exposure parameter; the camera module includes a first camera and a second camera, the image data includes first image data captured by the first camera and second image data captured by the second camera; a shooting angle of the first camera is greater than a shooting angle of the second camera;

[0032] a determining unit, configured to determine a first target exposure parameter corresponding to the first camera according to the first image data, and to determine a second target exposure parameter corresponding to the second camera according to the first image data, the second image data, and the first target exposure parameter;

[0033] A sending unit is used to return the first target exposure parameter and the second target exposure parameter to the camera module as preset exposure parameters, so that the camera module continues to shoot based on the preset exposure parameters.

[0034] In a third aspect, an embodiment of the present application provides an image processing device, characterized in that the device includes: a processor, a memory and a communication bus; when the processor executes an operating program stored in the memory, the exposure correction method as described in any one of the above items is implemented.

[0035] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the exposure correction method as described in any one of the above items.

[0036] In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program or instructions, which, when executed by a processor, performs an exposure correction method as described in any one of the above items.

[0037] The embodiment of the present application provides an exposure correction method and device, equipment, storage medium, and product, the method comprising: obtaining image data captured by a camera module using initial exposure parameters; the camera module comprises a first camera and a second camera, the image data comprises first image data captured by the first camera and second image data captured by the second camera; the shooting angle of the first camera is greater than the shooting angle of the second camera; determining the first target exposure parameter corresponding to the first camera according to the first image data, and determining the second target exposure parameter corresponding to the second camera according to the first image data, the second image data, and the first target exposure parameter; returning the first target exposure parameter and the second target exposure parameter to the camera module as preset exposure parameters, so that the camera module can continue shooting based on the preset exposure parameters. By adopting the above implementation scheme, the exposure parameters of the first camera can be used as a reference, and the exposure parameters of the second camera can be determined in combination with the image data of the second camera. This method can ensure the shooting effect while making the brightness of different cameras consistent, thereby improving the imaging quality. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0039] Figure 1 A flow chart of an exposure correction method provided in an embodiment of the present application;

[0040] Figure 2 A flowchart of an exemplary method for determining a first target exposure parameter provided in an embodiment of the present application;

[0041] Figure 3 An exemplary method flow for determining the second target exposure parameter provided in the embodiment of the present application Figure 1 ;

[0042] Figure 4 An exemplary method flow for determining the second target exposure parameter provided in the embodiment of the present application Figure 2 ;

[0043] Figure 5 A flowchart of an exemplary method for determining an exposure parameter interval provided in an embodiment of the present application;

[0044] Figure 6An exemplary method flow for determining the second target exposure parameter provided in the embodiment of the present application Figure 3 ;

[0045] Figure 7 An exemplary method flow for determining the second target exposure parameter provided in the embodiment of the present application Figure 4 ;

[0046] Figure 8 A schematic diagram of an exemplary exposure process provided in an embodiment of the present application;

[0047] Fig. 9 A schematic diagram of an exemplary first image data provided in an embodiment of the present application;

[0048] Fig.10 A schematic diagram of an exemplary second image data provided in an embodiment of the present application;

[0049] Fig.11 An exemplary secondary exposure target determination flow chart provided in an embodiment of the present application;

[0050] Fig.12 A schematic diagram of an exemplary primary and secondary viewing angle provided in an embodiment of the present application;

[0051] Fig.13 Comparison between an exemplary prior art and this solution provided for the embodiments of this application Figure 1 ;

[0052] Fig.14 Comparison between an exemplary prior art and this solution provided for the embodiments of this application Figure 2 ;

[0053] Fig.15 A schematic diagram of the structure of an exposure correction device provided in an embodiment of the present application;

[0054] Fig.16 A schematic diagram of the composition structure of an exposure correction device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0055] The following will describe the technical solutions in the embodiments of the present application in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0056] Common multi-camera systems, such as smartphone systems, usually have ultra-wide-angle, wide-angle, telephoto, and ultra-telephoto configurations. There is a large difference in the field of view (FOV) between different cameras. When the scenes of different cameras are very different, if only the single dimension of brightness consistency is considered at this time, it is easy to over-exposure or under-exposure at a small viewing angle, seriously affecting the image quality.

[0057] In one case, when a small viewing angle is in a bright area of ​​a large viewing angle, overexposure is likely to occur in the bright area due to the dynamic limitation of the image sensor. If only the brightness consistency is considered to synchronize the main camera exposure, overexposure is likely to occur.

[0058] In another case, when the small viewing angle is in the dark area of ​​the large viewing angle, only considering the brightness consistency to synchronize the main camera exposure is prone to underexposure, resulting in loss of details.

[0059] Based on the above technical problems, the embodiment of the present application provides an exposure correction method, which is applied to an exposure correction device. Figure 1 A flow chart of an exposure correction method provided in an embodiment of the present application is as follows: Figure 1 As shown, the exposure correction method may include the following steps S100 to S102:

[0060] Step S100, obtaining image data captured by the camera module using initial exposure parameters; the camera module includes a first camera and a second camera, and the image data includes first image data captured by the first camera and second image data captured by the second camera; the shooting angle of the first camera is greater than the shooting angle of the second camera.

[0061] In an embodiment of the present application, the exposure correction device obtains image data captured by the camera module using initial exposure parameters; the camera module includes a first camera and a second camera, and the image data includes first image data captured by the first camera and second image data captured by the second camera; the shooting angle of the first camera is greater than the shooting angle of the second camera.

[0062] In some embodiments, the camera module can be a module installed on an electronic device for shooting, and the electronic device can be a mobile phone, a portable computer, a camera or a camcorder, etc.; the specific application entity of the camera module can be determined according to actual conditions, and the embodiments of the present application do not make specific limitations here.

[0063] In some embodiments, the camera module may include a first camera and a second camera. The first camera may generally be a main camera in the camera module, and the second camera may generally be a secondary camera in the camera module. The number of the second cameras may be one or more.

[0064] In some embodiments, the initial exposure parameter includes a first initial exposure parameter set for the first camera and a second initial exposure parameter set for the second camera.

[0065] In some embodiments, the shooting angle of the first camera is greater than the shooting angle of the second camera, which can be understood as the first camera can capture a larger range of pictures than the second camera, and the first camera can accommodate more scenes. Therefore, the first image data includes the scenes captured by the second image data.

[0066] In some embodiments, when the camera module just starts shooting, since it does not know what specific exposure parameters to use to achieve the best shooting effect, it can first use the initial exposure parameters to shoot, that is, the first camera first uses the first initial exposure parameters to shoot to obtain the first image data, and the second camera first uses the second initial exposure parameters to shoot to obtain the second image data, and then through subsequent steps, the first initial exposure parameters and the second initial exposure parameters are respectively calibrated based on the first image data and the second image data to obtain the preset exposure parameters for the best shooting effect, so that the camera module can continue to shoot using the preset exposure parameters.

[0067] Step S101: determining a first target exposure parameter corresponding to a first camera according to first image data, and determining a second target exposure parameter corresponding to a second camera according to the first image data, second image data and the first target exposure parameter.

[0068] In an embodiment of the present application, after acquiring the first image data and the second image data, the exposure correction device determines the first target exposure parameter corresponding to the first camera according to the first image data, and determines the second target exposure parameter corresponding to the second camera according to the first image data, the second image data and the first target exposure parameter.

[0069] In some embodiments, since the first camera can be understood as the main camera in the camera module, this solution is based on the fact that the first camera remains turned on at any time and executes a normal automatic exposure process. The second camera is adjusted based on the exposure parameters of the first camera, so that the brightness of the images collected by the first camera and the second camera can be kept consistent. Based on this, the exposure correction device can first determine the first target exposure parameters corresponding to the first camera according to the first image data.

[0070] In some embodiments, after determining the first target exposure parameter of the first camera, the first target exposure parameter can be used as a reference to determine the second target exposure parameter of the second camera, thereby achieving the purpose of consistent brightness when the first camera and the second camera are capturing images.

[0071] Step S102: returning the first target exposure parameter and the second target exposure parameter to the camera module as preset exposure parameters, so that the camera module continues to shoot based on the preset exposure parameters.

[0072] In an embodiment of the present application, after determining the first target exposure parameter corresponding to the first camera and the second target exposure parameter corresponding to the second camera, the exposure correction device returns the first target exposure parameter and the second target exposure parameter as preset exposure parameters to the camera module, so that the camera module can continue shooting based on the preset exposure parameters.

[0073] In some embodiments, the exposure correction device uses a first target exposure parameter to replace the first initial exposure parameter of the first camera, and uses a second target exposure parameter to replace the second initial exposure parameter of the second camera. Thus, when the camera module is shooting, it can use the updated exposure parameters to shoot, thereby improving the shooting effect.

[0074] In an optional implementation, the exposure correction device determines the first target exposure parameter corresponding to the first camera according to the first image data, referring to Figure 2 , including the following steps S200 to S201:

[0075] Step S200: Count first brightness information of first image data.

[0076] In the embodiment of the present application, the exposure correction device counts the first brightness information of the first image data.

[0077] In some embodiments, since the first image data is the original image data captured by the image sensor of the first camera, such as a complementary metal oxide semiconductor sensor (CMOSSensor), it is usually RAW data. When counting the first brightness information of the first image data, the first image data can be input into an image signal (Image Signal Processor, ISP) processor. After passing through the ISP processor, the first brightness information of the first image data can be obtained. The specific method for counting the first brightness information can be selected according to actual conditions, and the embodiments of the present application do not make specific limitations here.

[0078] Step S201: determining a first shooting scene under a shooting angle of view of a first camera according to first brightness information, and determining an exposure parameter configured for the first shooting scene as a first target exposure parameter corresponding to the first camera.

[0079] In an embodiment of the present application, after the exposure correction device counts the first brightness information of the first image data, it determines the first shooting scene under the shooting angle of view of the first camera according to the first brightness information, and determines the exposure parameters configured for the first shooting scene as the first target exposure parameters corresponding to the first camera.

[0080] In some embodiments, the first shooting scene can be represented as the shooting time of the first image data, such as shooting during the day or at night, etc., and can also be represented as the shooting location of the first image data, such as shooting at the beach or on the grassland, etc.; the specific first shooting scene can be determined according to actual conditions; the embodiments of the present application are not specifically limited here.

[0081] In some embodiments, since different exposure parameters are usually set for different shooting scenes, the shooting effect is best when shooting the scene under the exposure parameters. Therefore, after determining the first shooting scene of the first image data, the exposure parameters configured for the first shooting scene can be determined as the first target exposure parameters corresponding to the first camera.

[0082] In an optional implementation, the exposure correction device determines the second target exposure parameter corresponding to the second camera according to the first image data, the second image data and the first target exposure parameter, referring to Figure 3 , including the following steps S300 to S303:

[0083] Step S300: Count the second brightness information of the second image data.

[0084] In the embodiment of the present application, the exposure correction device counts the second brightness information of the second image data.

[0085] In some embodiments, since the second image data is the original image data captured by the image sensor of the second camera, such as a complementary metal oxide semiconductor sensor (CMOSSensor), it is usually RAW data. When counting the second brightness information of the second image data, the second image data can be input into an image signal (Image Signal Processor, ISP) processor. After passing through the ISP processor, the second brightness information of the second image data can be obtained. The specific method for counting the second brightness information can be selected according to actual conditions, and the embodiments of the present application do not make specific limitations here.

[0086] Step S301: Acquire a first brightness value corresponding to a shooting angle of view of a first camera and a second brightness value corresponding to a shooting angle of view of a second camera from first brightness information of first image data.

[0087] In the embodiment of the present application, after counting the second brightness information of the second image data, the exposure correction device obtains the first brightness value corresponding to the shooting angle of view of the first camera and the second brightness value corresponding to the shooting angle of view of the second camera from the first brightness information of the first image data.

[0088] In some embodiments, the shooting angle of the first camera can be understood as the range of the picture that can be captured by the first camera, so that the first brightness value is the brightness value within the range of the picture in the first image data, which can be the average brightness value of the picture range or the brightness value within a specific area within the picture range; the specific first brightness value can be determined according to actual conditions, and the embodiments of the present application do not make specific limitations here.

[0089] In some embodiments, the shooting angle of the second camera can be understood as the range of the picture that can be captured by the second camera. Since the angle of view of the first camera is larger than that of the second camera, the first image data includes the image that can be captured by the second camera, so that the second brightness value is the brightness value of the target picture within the picture range, wherein the target picture is the range of the picture that can be captured by the second camera, which can be the average brightness value of the target picture or the brightness value within a specific area within the target range; the specific second brightness value can be determined according to actual conditions, and the embodiments of the present application are not specifically limited here.

[0090] Step S302: Determine a second reference exposure parameter corresponding to the second camera in the shooting angle of view of the first camera according to the first target exposure parameter, the first brightness value, and the second brightness value.

[0091] In the embodiment of the present application, after acquiring the first brightness value and the second brightness value, the exposure correction device determines the second reference exposure parameter corresponding to the second camera in the shooting angle of view of the first camera according to the first target exposure parameter, the first brightness value and the second brightness value.

[0092] In some embodiments, the first target exposure parameter corresponding to the first camera viewing angle may be converted into an exposure parameter expected by the second camera viewing angle, that is, a second reference exposure parameter.

[0093] In some embodiments, during conversion, the second reference exposure parameter Target2 may be calculated using the following formula:

[0094]

[0095] In formula (1), Target1 is the first target exposure parameter, Luma1 is the first brightness value, and Luma2 is the second brightness value.

[0096] Step S303: determine a second shooting scene under the shooting angle of view of the second camera according to the second image data, and determine a second target exposure parameter according to the exposure parameter configured for the second shooting scene and the second reference exposure parameter.

[0097] In an embodiment of the present application, after determining the second reference exposure parameter, the exposure correction device determines the second shooting scene under the shooting angle of view of the second camera according to the second image data, and determines the second target exposure parameter according to the exposure parameter configured for the second shooting scene and the second reference exposure parameter.

[0098] In some embodiments, after converting the first target exposure parameter corresponding to the first camera viewing angle into the second reference exposure parameter expected by the second camera viewing angle, the second reference exposure parameter is used as a reference, and the second target exposure parameter is determined based on the exposure parameter configured for the second shooting scene under the shooting angle of the second camera.

[0099] In some embodiments, the second shooting scene can be represented by the shooting time of the second image data, such as shooting during the day or at night, etc., and can also be represented by the shooting location of the second image data, such as shooting at the beach or on the grassland, etc.; the specific second shooting scene can be determined according to actual conditions; the embodiments of the present application are not specifically limited here.

[0100] In some embodiments, since different exposure parameters are usually set for different shooting scenes, the shooting effect is best when shooting the scene under the exposure parameters. Therefore, after determining the second shooting scene of the second image data, the second target exposure parameters corresponding to the second camera can be determined based on the exposure parameters configured for the second shooting scene and the second reference exposure parameters.

[0101] In an optional implementation, the exposure correction device determines the second target exposure parameter according to the exposure parameter configured for the second shooting scene and the second reference exposure parameter. Figure 4 , including the following steps S400 to S401:

[0102] Step S400: determining an exposure parameter interval according to the exposure parameters configured for the second shooting scene.

[0103] In the embodiment of the present application, before the exposure correction device determines the second target exposure parameter according to the exposure parameter configured for the second shooting scene and the second reference exposure parameter, it is necessary to first determine the exposure parameter range according to the exposure parameter configured for the second shooting scene.

[0104] In some embodiments, a reasonable exposure parameter range can be determined according to the exposure parameters configured for the second shooting scene. It can be understood that better shooting effects can be achieved when the exposure parameters within the exposure parameter range are used to shoot the second shooting scene.

[0105] Step S401: Determine a second target exposure parameter of a second camera according to a second reference exposure parameter and an exposure parameter range.

[0106] In the embodiment of the present application, after determining the exposure parameter interval, the exposure correction device determines the second target exposure parameter of the second camera according to the second reference exposure parameter and the exposure parameter interval.

[0107] In some embodiments, the second reference exposure parameter is an exposure parameter of the second camera obtained based on the first camera, and the exposure parameter range is a reasonable parameter range determined according to the second shooting scene of the second camera. Based on the two, an optimal second target exposure parameter can be determined as the final exposure parameter of the second camera.

[0108] In an optional implementation, the exposure correction device determines the exposure parameter interval according to the exposure parameter configured for the second shooting scene, referring to Figure 5 , including the following steps S500 to S502:

[0109] Step S500: Determine adjustable parameters configured for a second shooting scene.

[0110] In the embodiment of the present application, when the exposure correction device determines the exposure parameter interval according to the exposure parameters configured for the second shooting scene, the adjustable parameters configured for the second shooting scene may be determined first.

[0111] In some embodiments, the adjustable parameters can be understood as floating parameters configured for different shooting scenes. The adjustable parameters configured for each shooting scene can be the same or different. When shooting with the floating exposure parameters within the adjustable parameters, better shooting effects can be achieved.

[0112] Step S501: Determine the difference between the exposure parameter configured for the second shooting scene and the adjustable parameter as the exposure parameter lower limit, and determine the sum of the exposure parameter configured for the second shooting scene and the adjustable parameter as the exposure parameter upper limit.

[0113] In an embodiment of the present application, after determining the adjustable parameters configured for the second shooting scene, the exposure correction device determines the difference between the exposure parameters configured for the second shooting scene and the adjustable parameters as the lower limit of the exposure parameters, and determines the sum of the exposure parameters configured for the second shooting scene and the adjustable parameters as the upper limit of the exposure parameters.

[0114] In some embodiments, Target3 is used to represent the exposure parameter configured for the second shooting scene, and R is used to represent the adjustable parameter configured for the second shooting scene. Based on this, the upper limit TargetMax of the exposure parameter can be Target3+R, and the lower limit TargetMin of the exposure parameter can be Target3-R.

[0115] Step S502: determining an exposure parameter interval according to an exposure parameter lower limit and an exposure parameter upper limit.

[0116] In the embodiment of the present application, after determining the exposure parameter lower limit and the exposure parameter upper limit, the exposure correction device determines the exposure parameter interval according to the exposure parameter lower limit and the exposure parameter upper limit.

[0117] In some embodiments, the exposure parameter interval determined based on the exposure parameter upper limit TargetMax and the exposure parameter lower limit TargetMin can be expressed as [Target3-R, Target3+R].

[0118] In an optional implementation, the exposure correction device determines the second target exposure parameter of the second camera according to the second reference exposure parameter and the exposure parameter interval. Figure 6 , including the following steps S600 to S601:

[0119] Step S600: When the second reference exposure parameter is within the exposure parameter interval, the second reference exposure parameter is determined as the second target exposure parameter.

[0120] In the embodiment of the present application, when the exposure correction device determines the second target exposure parameter of the second camera according to the second reference exposure parameter and the exposure parameter range, it can first determine whether the second reference exposure parameter is within the exposure parameter range.

[0121] In some embodiments, if the second reference exposure parameter is within the exposure parameter interval, that is, Target2 is greater than or equal to Target3-R, and Target2 is less than or equal to Target3+R, Target2 is determined as the second target exposure parameter.

[0122] Step S601: when the second reference exposure parameter is not within the exposure parameter interval, determine a second target exposure parameter according to the exposure parameter interval.

[0123] In the embodiment of the present application, when the second reference exposure parameter is not within the exposure parameter interval, the exposure correction device determines the second target exposure parameter according to the exposure parameter interval.

[0124] In some embodiments, if the second reference exposure parameter is not within the exposure parameter interval, that is, Target2 is less than Target3-R, or Target2 is greater than Target3+R, the second target exposure parameter is determined according to [Target3-R, Target3+R].

[0125] In an optional implementation, the exposure correction device determines the second target exposure parameter according to the exposure parameter interval, referring to Figure 7 , including the following steps S700 to S701:

[0126] Step S700: When the second target exposure parameter is less than the exposure parameter lower limit, the exposure parameter lower limit is determined as the second target exposure parameter.

[0127] In some embodiments, if the second target exposure parameter is less than the exposure parameter lower limit of the exposure parameter interval, that is, Target2 is less than Target3-R, then Target3-R is determined as the second target exposure parameter.

[0128] Step S701: when the second target exposure parameter is greater than the upper limit of the exposure parameter, determine the upper limit of the exposure parameter as the second target exposure parameter.

[0129] In some embodiments, if the second target exposure parameter is greater than the upper limit of the exposure parameter interval, that is, Target2 is less than Target3+R, then Target3+R is determined as the second target exposure parameter.

[0130] The embodiment of the present application provides an exposure correction method, which includes: obtaining image data captured by a camera module using initial exposure parameters; the camera module includes a first camera and a second camera, and the image data includes first image data captured by the first camera and second image data captured by the second camera; the shooting angle of the first camera is greater than the shooting angle of the second camera; determining the first target exposure parameter corresponding to the first camera according to the first image data, and determining the second target exposure parameter corresponding to the second camera according to the first image data, the second image data and the first target exposure parameter; returning the first target exposure parameter and the second target exposure parameter to the camera module as preset exposure parameters, so that the camera module can continue shooting based on the preset exposure parameters. By adopting the above implementation scheme, the exposure parameters of the first camera can be used as a reference, and the exposure parameters of the second camera can be determined in combination with the image data of the second camera. This method can ensure the shooting effect while making the brightness of different cameras consistent, thereby improving the imaging quality.

[0131] The above introduces the exposure correction method provided in the embodiment of the present application. To facilitate understanding of the embodiment of the present application, the following introduces possible implementation schemes of the exposure correction method applicable to the embodiment of the present application based on actual application scenarios.

[0132] The following embodiment uses the example of a user taking a photo with a camera module on a mobile phone to explain the above exposure correction method. The camera module includes a main camera (the first camera in the above embodiment) and a secondary camera (the second camera in the above embodiment).

[0133] In this solution, the main camera remains on at all times and performs the normal automatic exposure process. When the secondary camera is on, the main camera provides reference information to the secondary camera. The secondary camera combines its own statistical information with the reference information provided by the main camera to achieve the purpose of improving brightness consistency while ensuring that its own image effect meets the standard.

[0134] refer to Figure 8 , is the overall flow chart of this solution. For the main camera, the process includes the following steps:

[0135] Step 1: The image sensor (CMOS Sensor) on the main camera captures the first image data (raw data), refer to Fig. 9 .

[0136] Step 2: input the first image data into the ISP processor, and after being processed by the ISP processor, output the main camera brightness statistical information of the first image data (the first brightness information in the above embodiment).

[0137] Step 3: Input the main camera brightness statistics into the exposure correction module.

[0138] Step 4: The exposure correction module outputs the main exposure target of the main camera (the first target exposure parameter in the above embodiment), and converts the main exposure target into exposure information and gain information and sends them to the image sensor on the main camera.

[0139] Similarly, for the secondary camera, the process includes the following steps:

[0140] Step 1: The image sensor (CMOS Sensor) on the secondary camera captures the second image data (raw data), refer to Fig.10 .

[0141] Step 2: input the second image data into the ISP processor, and after being processed by the ISP processor, output the secondary camera brightness statistical information of the second image data (the second brightness information in the above embodiment).

[0142] Step 3: Input the secondary camera brightness statistics, the main camera brightness statistics and the main exposure target into the exposure correction module.

[0143] Step 4: The exposure correction module outputs the secondary exposure target of the secondary camera (the second target exposure parameter in the above embodiment), and converts the secondary exposure target into exposure information and gain information and sends them to the image sensor on the secondary camera.

[0144] The following describes how to implement the exposure correction module:

[0145] The exposure correction module has a built-in automatic exposure control algorithm (Automatic Exposure Control, AEC), which is the exposure correction method in the embodiment of the present application. In order to achieve the requirement of improving brightness consistency while ensuring the image effect of the secondary camera itself, it is necessary to calculate the first reference exposure target that meets the brightness consistency (the second reference exposure parameter in the above embodiment) and the second reference exposure target that meets the image effect of the secondary camera itself (the exposure parameter configured for the second shooting scene in the above embodiment), and make corresponding decisions. Fig.11 ; The process includes the following steps:

[0146] Step 1: Calculate a first reference exposure target that satisfies brightness consistency.

[0147] 1. Calculate a first brightness value Luma1 corresponding to the main camera viewing angle and a second brightness value Luma2 corresponding to the auxiliary camera viewing angle according to the main camera brightness statistical information.

[0148] 2. Reference Fig.12 , the main exposure target Target1 corresponding to the main camera angle of view is converted into the reference exposure target Target2 corresponding to the secondary camera angle of view. The calculation formula is shown in the above formula (1). Target2 is the exposure target that satisfies brightness consistency. Setting the exposure target of the secondary camera to Target2 can make the brightness of the overlapping area of ​​the main and secondary cameras consistent.

[0149] Step 2: Calculate a second reference exposure target that satisfies the image effect of the secondary camera itself.

[0150] Target3 is determined by the secondary camera brightness statistics information, and Target3 is the second reference exposure target that satisfies the secondary camera's own image effect.

[0151] Step 3: Calculate the reasonable exposure interval of the secondary camera (the exposure parameter interval in the above embodiment).

[0152] The reasonable exposure range consists of the underexposure lower limit TargetMin and the overexposure upper limit TargetMax, that is, [TargetMin, TargetMax]. Among them, TargetMin is Target3 - R, TargetMax is Target3 + R, and R is a configurable parameter set according to different scenarios (the adjustable parameter in the above embodiments).

[0153] Step 4: Determine the secondary exposure target.

[0154] Judge the obtained Target2 and the reasonable exposure range, and output the final secondary exposure target Target4.

[0155] The decision method is as follows:

[0156] If Target2 < TargetMin, then Target4 = TargetMin = Target3 - R;

[0157] If Target2 > TargetMin and Target2 < TargetMax, then Target4 = Target2.

[0158] If Target2 > TargetMax, then Target4 = TargetMax = Target3 + R.

[0159] It should be noted that referring to Fig.13 , Fig.13 (A) is a picture taken in the prior art, and there is overexposure in some areas of the picture, that is, Fig.13 (B). After the exposure correction of this solution, the effect of taking pictures again is Fig.13 (C), that is, the overexposure in some areas is eliminated; correspondingly, referring to Fig.14 (A) is a picture taken in the prior art, and there is underexposure in some areas of the picture, that is, Fig.14 (B). After the exposure correction of this solution, the effect of taking pictures again is Fig.14 (C), that is, the underexposure in some areas is eliminated.

[0160] It can be understood that this solution starts from the dual perspectives of brightness consistency and image effect, and realizes the goal of improving brightness consistency on the basis of ensuring that its own image effect meets the standard.

[0161] The preferred embodiments of the present application are described in detail above in conjunction with the accompanying drawings. However, the present application is not limited to the specific details in the above embodiments. Within the technical concept of the present application, the technical solution of the present application can be subjected to a variety of simple modifications, and these simple modifications all belong to the protection scope of the present application. For example, the various specific technical features described in the above specific embodiments can be combined in any suitable manner without contradiction. In order to avoid unnecessary repetition, the present application will not further explain various possible combinations. For another example, the various different embodiments of the present application can also be arbitrarily combined, as long as they do not violate the idea of ​​the present application, they should also be regarded as the contents disclosed in the present application. For another example, under the premise of no conflict, the various embodiments and / or the technical features in the various embodiments described in the present application can be arbitrarily combined with the prior art, and the technical solution obtained after the combination should also fall within the protection scope of the present application.

[0162] Based on the above embodiment, in another embodiment of the present application, an exposure correction device 15 is provided. Fig.15 A schematic diagram of the structure of an exposure correction device provided in this application is shown in FIG. Fig.15 As shown, the exposure correction device 15 comprises:

[0163] The acquisition unit 1500 is used to acquire image data captured by the camera module using the initial exposure parameters; the camera module includes a first camera and a second camera, and the image data includes first image data captured by the first camera and second image data captured by the second camera; the shooting angle of the first camera is greater than the shooting angle of the second camera;

[0164] A determining unit 1501 is configured to determine a first target exposure parameter corresponding to the first camera according to the first image data, and determine a second target exposure parameter corresponding to the second camera according to the first image data, the second image data, and the first target exposure parameter;

[0165] The sending unit 1502 is used to return the first target exposure parameter and the second target exposure parameter to the camera module as preset exposure parameters, so that the camera module continues to shoot based on the preset exposure parameters.

[0166] In some embodiments, the exposure correction device 15 further includes: a statistical unit;

[0167] The statistical unit is used to count the first brightness information of the first image data;

[0168] The determining unit 1501 is further configured to determine a first shooting scene under a shooting angle of view of the first camera according to the first brightness information, and determine an exposure parameter configured for the first shooting scene as the first target exposure parameter corresponding to the first camera.

[0169] In some embodiments, the statistical unit is further used to count second brightness information of the second image data;

[0170] The acquisition unit 1500 is further configured to acquire, from the first brightness information of the first image data, a first brightness value corresponding to the shooting angle of view of the first camera and a second brightness value corresponding to the shooting angle of view of the second camera;

[0171] The determining unit 1501 is further configured to determine a second reference exposure parameter corresponding to the second camera in the shooting angle of view of the first camera according to the first target exposure parameter, the first brightness value, and the second brightness value;

[0172] The determining unit 1501 is further configured to determine a second shooting scene under a shooting angle of view of the second camera according to the second image data, and determine the second target exposure parameter according to the exposure parameter configured for the second shooting scene and the second reference exposure parameter.

[0173] In some embodiments, the determination unit 1501 is further used to determine an exposure parameter interval according to the exposure parameter configured for the second shooting scene; and determine the second target exposure parameter of the second camera according to the second reference exposure parameter and the exposure parameter interval.

[0174] In some embodiments, the determination unit 1501 is further used to determine an adjustable parameter configured for the second shooting scene; determine the difference between the exposure parameter configured for the second shooting scene and the adjustable parameter as the exposure parameter lower limit, and determine the sum of the exposure parameter configured for the second shooting scene and the adjustable parameter as the exposure parameter upper limit; determine the exposure parameter range according to the exposure parameter lower limit and the exposure parameter upper limit.

[0175] In some embodiments, the determination unit 1501 is further used to determine the second reference exposure parameter as the second target exposure parameter when the second reference exposure parameter is within the exposure parameter interval; and to determine the second target exposure parameter according to the exposure parameter interval when the second reference exposure parameter is not within the exposure parameter interval.

[0176] In some embodiments, the determination unit 1501 is further used to determine the exposure parameter lower limit as the second target exposure parameter when the second target exposure parameter is less than the exposure parameter lower limit; and to determine the exposure parameter upper limit as the second target exposure parameter when the second target exposure parameter is greater than the exposure parameter upper limit.

[0177] The embodiment of the present application provides an exposure correction device, which includes: an acquisition unit, which is used to acquire image data captured by a camera module using initial exposure parameters; the camera module includes a first camera and a second camera, and the image data includes first image data captured by the first camera and second image data captured by the second camera; the shooting angle of the first camera is greater than the shooting angle of the second camera; a determination unit, which is used to determine the first target exposure parameter corresponding to the first camera according to the first image data, and determine the second target exposure parameter corresponding to the second camera according to the first image data, the second image data and the first target exposure parameter; a sending unit, which is used to return the first target exposure parameter and the second target exposure parameter to the camera module as preset exposure parameters, so that the camera module can continue to shoot based on the preset exposure parameters. By adopting the above implementation scheme, the exposure parameters of the first camera can be used as a reference, and the exposure parameters of the second camera can be determined in combination with the image data of the second camera. This method can ensure the shooting effect while making the brightness of different cameras consistent, thereby improving the imaging quality.

[0178] Fig.16 This is a schematic diagram of the composition structure of an exposure correction device provided in an embodiment of the present application. In practical applications, based on the same disclosed concept of the above embodiments, Fig.16 As shown, the exposure correction device 16 of this embodiment includes: a processor 1600 , a memory 1601 and a communication bus 1602 .

[0179] In the process of a specific embodiment, the acquisition unit 1300, the determination unit 1301, the fusion unit 1302, the data processing unit, the update unit and the exposure correction unit can be implemented by a processor 1600 located on the exposure correction device 16, and the processor 1600 can be at least one of an application-specific integrated circuit (ASIC, Application Specific Integrated Circuit), a digital signal processor (DSP, Digital Signal Processor), a digital signal processing exposure correction device (DSPD, Digital Signal Processing Device), a programmable logic exposure correction device (PLD, Programmable Logic Device), a field programmable gate array (FPGA, Field Programmable Gate Array), a CPU, a controller, a microcontroller, and a microprocessor. It can be understood that for different exposure correction devices, the electronic device used to implement the above-mentioned processor function can also be other, and this embodiment does not specifically limit it.

[0180] In the embodiment of the present application, the communication bus 1602 is used to realize the connection and communication between the processor 1600 and the memory 1601; when the processor 1600 executes the running program stored in the memory 1601, the following exposure correction method is implemented:

[0181] Acquire image data captured by a camera module using initial exposure parameters; the camera module includes a first camera and a second camera, the image data includes first image data captured by the first camera and second image data captured by the second camera; the shooting angle of the first camera is greater than the shooting angle of the second camera;

[0182] Determine a first target exposure parameter corresponding to the first camera according to the first image data, and determine a second target exposure parameter corresponding to the second camera according to the first image data, the second image data, and the first target exposure parameter;

[0183] The first target exposure parameter and the second target exposure parameter are returned to the camera module as preset exposure parameters, so that the camera module continues to shoot based on the preset exposure parameters.

[0184] In some embodiments, the processor 1600 is also used to count first brightness information of the first image data; determine a first shooting scene under the shooting angle of view of the first camera based on the first brightness information, and determine the exposure parameters configured for the first shooting scene as the first target exposure parameters corresponding to the first camera.

[0185] In some embodiments, the processor 1600 is further used to count second brightness information of the second image data; obtain a first brightness value corresponding to the shooting angle of view of the first camera and a second brightness value corresponding to the shooting angle of view of the second camera from the first brightness information of the first image data; determine a second reference exposure parameter corresponding to the second camera in the shooting angle of view of the first camera according to the first target exposure parameter, the first brightness value and the second brightness value; determine a second shooting scene under the shooting angle of view of the second camera according to the second image data, and determine the second target exposure parameter according to the exposure parameter configured for the second shooting scene and the second reference exposure parameter.

[0186] In some embodiments, the processor 1600 is further used to determine an exposure parameter interval according to the exposure parameter configured for the second shooting scene; and determine the second target exposure parameter of the second camera according to the second reference exposure parameter and the exposure parameter interval.

[0187] In some embodiments, the processor 1600 is further used to determine an adjustable parameter configured for the second shooting scene; determine the difference between the exposure parameter configured for the second shooting scene and the adjustable parameter as the exposure parameter lower limit, and determine the sum of the exposure parameter configured for the second shooting scene and the adjustable parameter as the exposure parameter upper limit; determine the exposure parameter range according to the exposure parameter lower limit and the exposure parameter upper limit.

[0188] In some embodiments, the processor 1600 is further used to determine the second reference exposure parameter as the second target exposure parameter when the second reference exposure parameter is within the exposure parameter interval; and to determine the second target exposure parameter according to the exposure parameter interval when the second reference exposure parameter is not within the exposure parameter interval.

[0189] In some embodiments, the processor 1600 is further used to determine the exposure parameter lower limit as the second target exposure parameter when the second target exposure parameter is less than the exposure parameter lower limit; and to determine the exposure parameter upper limit as the second target exposure parameter when the second target exposure parameter is greater than the exposure parameter upper limit.

[0190] An embodiment of the present application provides a computer-readable storage medium, which stores one or more programs. The one or more programs can be executed by one or more processors to implement the steps of the exposure correction method of any of the above embodiments.

[0191] An embodiment of the present application provides a computer program product, including a computer program or instructions, which, when executed by a processor, implements some or all of the steps in the above-mentioned exposure correction method.

[0192] The above-mentioned computer storage medium / memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory (FRAM), a flash memory (Flash Memory), a magnetic surface memory, an optical disk, or a compact disc read-only memory (CD-ROM) and the like; it can also be various terminals including one or any combination of the above-mentioned memories, such as mobile phones, computers, tablet devices, personal digital assistants, etc.

[0193] It should be understood that "one embodiment" or "an embodiment" mentioned throughout the specification means that specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the size of the serial number of each step / process mentioned above does not mean the order of execution, and the execution order of each step / process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application. The serial numbers of the embodiments of the present application mentioned above are for description only and do not represent the advantages and disadvantages of the embodiments.

[0194] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0195] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.

[0196] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; they may be located in one place or distributed on multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0197] In addition, all functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may be a separate unit, or two or more units may be integrated into one unit; the above-mentioned integrated units may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0198] A person skilled in the art can understand that all or part of the steps of implementing the above method embodiment can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above method embodiment; and the aforementioned storage medium includes: mobile storage devices, read-only memories (ROM), magnetic disks or optical disks, etc., various media that can store program codes.

[0199] Alternatively, if the above-mentioned integrated unit of the present application is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can essentially or in other words, the part that contributes to the relevant technology can be embodied in the form of a software product, which is stored in a storage medium and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROMs, magnetic disks, or optical disks.

[0200] The above is only an implementation method of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application.

Claims

1. An exposure correction method, characterized in that: The method comprises: Acquire image data captured by a camera module using initial exposure parameters; the camera module includes a first camera and a second camera, the image data includes first image data captured by the first camera and second image data captured by the second camera; the shooting angle of the first camera is greater than the shooting angle of the second camera; Determine a first target exposure parameter corresponding to the first camera according to the first image data, and determine a second target exposure parameter corresponding to the second camera according to the first image data, the second image data, and the first target exposure parameter; The first target exposure parameter and the second target exposure parameter are returned to the camera module as preset exposure parameters, so that the camera module continues to shoot based on the preset exposure parameters.

2. The method according to claim 1, characterized in that The determining, according to the first image data, a first target exposure parameter corresponding to the first camera includes: Counting first brightness information of the first image data; A first shooting scene under a shooting angle of view of the first camera is determined according to the first brightness information, and an exposure parameter configured for the first shooting scene is determined as the first target exposure parameter corresponding to the first camera.

3. The method according to claim 1 or 2, characterized in that: The determining, according to the first image data, the second image data, and the first target exposure parameter, a second target exposure parameter corresponding to the second camera includes: collecting statistics of second brightness information of the second image data; Acquire, from the first brightness information of the first image data, a first brightness value corresponding to the shooting angle of view of the first camera and a second brightness value corresponding to the shooting angle of view of the second camera; Determining a second reference exposure parameter corresponding to the second camera in a shooting angle of view of the first camera according to the first target exposure parameter, the first brightness value, and the second brightness value; A second shooting scene under the shooting angle of view of the second camera is determined according to the second image data, and the second target exposure parameter is determined according to the exposure parameter configured for the second shooting scene and the second reference exposure parameter.

4. The method according to claim 3, characterized in that The determining the second target exposure parameter according to the exposure parameter configured for the second shooting scene and the second reference exposure parameter includes: determining an exposure parameter interval according to the exposure parameters configured for the second shooting scene; The second target exposure parameter of the second camera is determined according to the second reference exposure parameter and the exposure parameter range.

5. The method according to claim 4, characterized in that The determining the exposure parameter interval according to the exposure parameter configured for the second shooting scene includes: determining adjustable parameters configured for the second shooting scene; Determine the difference between the exposure parameter configured for the second shooting scene and the adjustable parameter as the exposure parameter lower limit, and determine the sum of the exposure parameter configured for the second shooting scene and the adjustable parameter as the exposure parameter upper limit; The exposure parameter interval is determined according to the exposure parameter lower limit and the exposure parameter upper limit.

6. The method according to claim 5, characterized in that The determining the second target exposure parameter of the second camera according to the second reference exposure parameter and the exposure parameter range includes: When the second reference exposure parameter is within the exposure parameter interval, determining the second reference exposure parameter as the second target exposure parameter; When the second reference exposure parameter is not within the exposure parameter interval, the second target exposure parameter is determined according to the exposure parameter interval.

7. The method according to claim 6, characterized in that The determining the second target exposure parameter according to the exposure parameter interval includes: When the second target exposure parameter is less than the exposure parameter lower limit, determining the exposure parameter lower limit as the second target exposure parameter; When the second target exposure parameter is greater than the exposure parameter upper limit, the exposure parameter upper limit is determined as the second target exposure parameter.

8. An image processing device, characterized in that: The device comprises: an acquisition unit, configured to acquire image data captured by a camera module using an initial exposure parameter; the camera module includes a first camera and a second camera, the image data includes first image data captured by the first camera and second image data captured by the second camera; a shooting angle of the first camera is greater than a shooting angle of the second camera; a determining unit, configured to determine a first target exposure parameter corresponding to the first camera according to the first image data, and to determine a second target exposure parameter corresponding to the second camera according to the first image data, the second image data, and the first target exposure parameter; A sending unit is used to return the first target exposure parameter and the second target exposure parameter to the camera module as preset exposure parameters, so that the camera module continues to shoot based on the preset exposure parameters.

9. An image processing device, characterized in that: The device comprises: a processor, a memory and a communication bus; when the processor executes the running program stored in the memory, the method according to any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and when the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

11. A computer program product comprising a computer program or instructions, characterized in that When the computer program or instruction is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images