Multi-frame wide dynamic exposure control method and device
By acquiring exposure frame sequence and automatic exposure information, calculating the target exposure amount, the problem of insufficient flexibility and accuracy of exposure control in the prior art is solved, and efficient exposure control for wide dynamic scenes is realized, which is suitable for the naturalness of multi-frame images Transition and precise exposure.
Patent Information
- Application Number
- CN202410882582.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-02
- Publication Date
- 2024-12-03
AI Technical Summary
When shooting wide dynamic scenes in the prior art, the exposure control method is insufficient in flexibility and accuracy, and the exposure amount of images in each frame cannot be effectively adjusted, resulting in limited image dynamic range.
By acquiring the exposure frame sequence and its automatic exposure information, the evaluation value is determined based on the frame exposure information of the target frame, and the target exposure amount is calculated based on the reference exposure amount and evaluation value, flexible exposure control for multi-frame images is achieved.
Improves the flexibility and accuracy of multi-frame wide dynamic exposure control, ensures natural image transition, accurately controls overexposure areas, and is suitable for scenes with different dynamic ranges.
Smart Images

Figure CN119071644A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of image processing technology, and in particular to a multi-frame wide dynamic exposure control method and device. Background Art
[0002] At present, since most camera devices use image sensors with limited dynamic range to achieve imaging, when shooting wide dynamic scenes, the camera devices need to obtain wide dynamic images by shooting multiple frames of images with different exposure amounts and fusing the multiple frames into one image.
[0003] In practical applications, in order to increase the dynamic range of an image, it is necessary to control the exposure between each frame of the image within a certain ratio range. There are two existing methods for determining the exposure ratio in the industry: fixed exposure ratio and dynamic exposure ratio. However, the existing exposure control methods are limited in scope and cannot flexibly adjust the exposure of each frame. Therefore, it is particularly important to propose a technical solution that can improve the flexibility and accuracy of exposure control for multi-frame wide dynamic range. Summary of the invention
[0004] The present invention provides a multi-frame wide dynamic exposure control method and device, which can improve the exposure control flexibility and exposure control accuracy of the multi-frame wide dynamic exposure.
[0005] In order to solve the above technical problems, the first aspect of the present invention discloses a multi-frame wide dynamic exposure control method, the method comprising:
[0006] Acquire an exposure frame sequence and automatic exposure information corresponding to the exposure frame sequence; the exposure frame sequence includes a plurality of exposure frames and the exposure frame sequence is sorted in descending order based on the automatic exposure amount of each exposure frame; the automatic exposure information includes frame exposure information of each exposure frame;
[0007] For each of the exposure frames, determining an evaluation value corresponding to the target frame according to frame exposure information of the target frame; the target frame is the exposure frame or an adjacent exposure frame corresponding to the exposure frame; the adjacent exposure frame is adjacent to the exposure frame in the exposure frame sequence;
[0008] For each exposure frame, determining a reference exposure corresponding to the exposure frame;
[0009] For each of the exposure frames, a target exposure corresponding to the exposure frame is determined according to a reference exposure corresponding to the exposure frame and an evaluation value corresponding to the target frame.
[0010] As an optional implementation, in the first aspect of the present invention, each of the exposure frames includes a plurality of blocks; the frame exposure information of each of the exposure frames includes an exposure statistic corresponding to each of the blocks included in the exposure frame;
[0011] Wherein, for each of the exposure frames, determining the evaluation value corresponding to the target frame according to the frame exposure information of the target frame includes:
[0012] Acquire an exposure histogram corresponding to a target frame, and determine an evaluation value corresponding to the target frame according to frame exposure information of the target frame and / or the exposure histogram corresponding to the target frame;
[0013] Wherein, for each of the exposure frames, determining the evaluation value corresponding to the target frame according to the frame exposure information of the target frame and / or the exposure histogram corresponding to the target frame includes:
[0014] When the exposure frame is the first exposure frame in the exposure frame sequence, obtaining block weight information corresponding to the exposure frame sequence, and determining an exposure evaluation value corresponding to the exposure frame according to the frame exposure information of the exposure frame and the block weight information;
[0015] When the exposure frame is not the first exposure frame in the exposure frame sequence, determining the overexposure evaluation value corresponding to the target frame according to the frame exposure information of the target frame and the exposure histogram corresponding to the target frame; wherein, when the target frame is an adjacent exposure frame corresponding to the exposure frame, the adjacent exposure frame is ranked first in the exposure frame sequence compared to the exposure frame;
[0016] The evaluation value corresponding to the target frame is the exposure evaluation value corresponding to the exposure frame or the overexposure evaluation value corresponding to the target frame.
[0017] As an optional implementation manner, in the first aspect of the present invention, the block weight information includes a block weight of each of the blocks included in each of the exposure frames;
[0018] Wherein, for each of the exposure frames, determining the exposure evaluation value corresponding to the exposure frame according to the frame exposure information of the exposure frame and the block weight information includes:
[0019] Filter out at least one low-brightness statistical value lower than a first preset threshold from the exposure statistical values corresponding to all the blocks included in the exposure frame, and determine the block corresponding to each low-brightness statistical value as the low-brightness block of the exposure frame;
[0020] The exposure evaluation value corresponding to the exposure frame is calculated according to the exposure statistics of each of the low-brightness blocks in the frame exposure information of the exposure frame and the block weight of each of the low-brightness blocks in the block weight information.
[0021] As an optional implementation manner, in the first aspect of the present invention, for each of the exposure frames, determining the overexposure evaluation value corresponding to the target frame according to the frame exposure information of the target frame and the exposure histogram corresponding to the target frame includes:
[0022] According to the frame exposure information of the target frame, the number of highlight blocks contained in the target frame is counted as the number of highlight blocks; the exposure statistical value of each highlight block is higher than a second preset threshold;
[0023] Determine the proportion of highlighted blocks corresponding to the target frame according to the total number of blocks included in the target frame and the number of highlighted blocks;
[0024] According to the exposure histogram corresponding to the target frame, the number of highlight pixels in the exposure histogram is counted as the number of highlight pixels; the brightness value corresponding to each of the highlight pixels is higher than a third preset threshold;
[0025] Determine the ratio of highlight pixels corresponding to the target frame according to the total number of pixels included in the exposure histogram and the number of highlight pixels;
[0026] According to the ratio of the highlight blocks and / or the ratio of the highlight pixels, the overexposure evaluation value corresponding to the target frame is calculated.
[0027] As an optional implementation manner, in the first aspect of the present invention, for each of the exposure frames, determining the target exposure corresponding to the exposure frame according to the reference exposure corresponding to the exposure frame and the evaluation value corresponding to the target frame includes:
[0028] When the exposure frame is the first exposure frame in the exposure frame sequence, a preset exposure target value is obtained, and a first target exposure corresponding to the exposure frame is determined according to the exposure target value, a reference exposure corresponding to the exposure frame, and an evaluation value corresponding to the exposure frame;
[0029] When the exposure frame is not the first exposure frame in the exposure frame sequence, obtaining a reference exposure ratio corresponding to the exposure frame, and determining a second target exposure corresponding to the exposure frame according to the reference exposure ratio corresponding to the exposure frame, a reference exposure corresponding to the exposure frame, and an evaluation value corresponding to the target frame;
[0030] The target exposure corresponding to each exposure frame is the first target exposure or the second target exposure.
[0031] As an optional implementation manner, in the first aspect of the present invention, for each of the exposure frames, determining the second target exposure corresponding to the exposure frame according to the reference exposure ratio corresponding to the exposure frame, the reference exposure corresponding to the exposure frame, and the evaluation value corresponding to the target frame includes:
[0032] Obtaining a preset ratio range, and determining a relative exposure ratio corresponding to the target frame according to the ratio range and an evaluation value corresponding to the target frame;
[0033] Acquire a previous relative exposure ratio set corresponding to the exposure frame, and determine the absolute exposure ratio corresponding to the exposure frame according to the previous relative exposure ratio set and the relative exposure ratio corresponding to the target frame; the previous relative exposure ratio set includes relative exposure ratios corresponding to all exposure frames that are ranked earlier than the exposure frame in the exposure frame sequence; the target exposure ratio corresponding to the exposure frame is the exposure ratio of the exposure frame relative to the first exposure frame in the exposure frame sequence;
[0034] Determining a target exposure ratio corresponding to the exposure frame according to a reference exposure ratio corresponding to the exposure frame and an absolute exposure ratio corresponding to the exposure frame;
[0035] According to the target exposure ratio corresponding to the exposure frame and the reference exposure corresponding to the exposure frame, a second target exposure corresponding to the exposure frame is calculated.
[0036] As an optional implementation manner, in the first aspect of the present invention, the proportion range includes a first proportion threshold and a second proportion threshold; the first proportion threshold is greater than the second proportion threshold;
[0037] Wherein, for each of the exposure frames, determining the relative exposure ratio corresponding to the target frame according to the proportion range and the evaluation value corresponding to the target frame includes:
[0038] Determine whether the evaluation value corresponding to the target frame is within the proportion range;
[0039] When it is determined that the evaluation value corresponding to the target frame is within the proportion range, based on the determined interpolation formula, the relative exposure ratio corresponding to the target frame is calculated according to the first proportion threshold, the second proportion threshold and the evaluation value corresponding to the target frame;
[0040] When it is determined that the evaluation value corresponding to the target frame is not within the proportion range, and when the evaluation value corresponding to the target frame is greater than the first proportion threshold, the maximum value of the adjustable exposure ratio corresponding to the first proportion threshold is determined as the relative exposure ratio corresponding to the target frame;
[0041] When the evaluation value corresponding to the target frame is less than the second proportion threshold, the minimum value of the adjustable exposure ratio corresponding to the second proportion threshold is determined as the relative exposure ratio corresponding to the target frame.
[0042] A second aspect of the present invention discloses a multi-frame wide dynamic exposure control device, the device comprising:
[0043] An acquisition module, configured to acquire an exposure frame sequence and automatic exposure information corresponding to the exposure frame sequence; the exposure frame sequence includes a plurality of exposure frames and the exposure frame sequence is sorted in descending order based on the automatic exposure amount of each exposure frame; the automatic exposure information includes frame exposure information of each exposure frame;
[0044] a determination module, configured to determine, for each of the exposure frames, an evaluation value corresponding to the target frame according to the frame exposure information of the target frame; the target frame is the exposure frame or an adjacent exposure frame corresponding to the exposure frame; the adjacent exposure frame is adjacent to the exposure frame in the exposure frame sequence;
[0045] The determination module is further configured to determine, for each exposure frame, a reference exposure value corresponding to the exposure frame;
[0046] The determination module is further configured to determine, for each exposure frame, a target exposure corresponding to the exposure frame according to a reference exposure corresponding to the exposure frame and an evaluation value corresponding to the target frame.
[0047] As an optional implementation, in the second aspect of the present invention, each of the exposure frames includes a plurality of blocks; the frame exposure information of each of the exposure frames includes an exposure statistic corresponding to each of the blocks included in the exposure frame;
[0048] Wherein, for each of the exposure frames, the specific manner in which the determination module determines the evaluation value corresponding to the target frame according to the frame exposure information of the target frame includes:
[0049] Acquire an exposure histogram corresponding to a target frame, and determine an evaluation value corresponding to the target frame according to frame exposure information of the target frame and / or the exposure histogram corresponding to the target frame;
[0050] Wherein, for each of the exposure frames, the specific manner in which the determination module determines the evaluation value corresponding to the target frame according to the frame exposure information of the target frame and / or the exposure histogram corresponding to the target frame includes:
[0051] When the exposure frame is the first exposure frame in the exposure frame sequence, obtaining block weight information corresponding to the exposure frame sequence, and determining an exposure evaluation value corresponding to the exposure frame according to the frame exposure information of the exposure frame and the block weight information;
[0052] When the exposure frame is not the first exposure frame in the exposure frame sequence, determining the overexposure evaluation value corresponding to the target frame according to the frame exposure information of the target frame and the exposure histogram corresponding to the target frame; wherein, when the target frame is an adjacent exposure frame corresponding to the exposure frame, the adjacent exposure frame is ranked first in the exposure frame sequence compared to the exposure frame;
[0053] The evaluation value corresponding to the target frame is the exposure evaluation value corresponding to the exposure frame or the overexposure evaluation value corresponding to the target frame.
[0054] As an optional implementation manner, in the second aspect of the present invention, the block weight information includes a block weight of each of the blocks included in each of the exposure frames;
[0055] Wherein, for each of the exposure frames, the specific manner in which the determination module determines the exposure evaluation value corresponding to the exposure frame according to the frame exposure information of the exposure frame and the block weight information includes:
[0056] Filter out at least one low-brightness statistical value lower than a first preset threshold from the exposure statistical values corresponding to all the blocks included in the exposure frame, and determine the block corresponding to each low-brightness statistical value as the low-brightness block of the exposure frame;
[0057] The exposure evaluation value corresponding to the exposure frame is calculated according to the exposure statistics of each of the low-brightness blocks in the frame exposure information of the exposure frame and the block weight of each of the low-brightness blocks in the block weight information.
[0058] As an optional implementation, in the second aspect of the present invention, for each of the exposure frames, the specific manner in which the determination module determines the overexposure evaluation value corresponding to the target frame according to the frame exposure information of the target frame and the exposure histogram corresponding to the target frame includes:
[0059] According to the frame exposure information of the target frame, the number of highlight blocks contained in the target frame is counted as the number of highlight blocks; the exposure statistical value of each highlight block is higher than a second preset threshold;
[0060] Determine the proportion of highlighted blocks corresponding to the target frame according to the total number of blocks included in the target frame and the number of highlighted blocks;
[0061] According to the exposure histogram corresponding to the target frame, the number of highlight pixels in the exposure histogram is counted as the number of highlight pixels; the brightness value corresponding to each of the highlight pixels is higher than a third preset threshold;
[0062] Determine the ratio of highlight pixels corresponding to the target frame according to the total number of pixels included in the exposure histogram and the number of highlight pixels;
[0063] According to the ratio of the highlight blocks and / or the ratio of the highlight pixels, the overexposure evaluation value corresponding to the target frame is calculated.
[0064] As an optional implementation, in the second aspect of the present invention, for each of the exposure frames, the specific manner in which the determination module determines the target exposure corresponding to the exposure frame according to the reference exposure corresponding to the exposure frame and the evaluation value corresponding to the target frame includes:
[0065] When the exposure frame is the first exposure frame in the exposure frame sequence, a preset exposure target value is obtained, and a first target exposure corresponding to the exposure frame is determined according to the exposure target value, a reference exposure corresponding to the exposure frame, and an evaluation value corresponding to the exposure frame;
[0066] When the exposure frame is not the first exposure frame in the exposure frame sequence, obtaining a reference exposure ratio corresponding to the exposure frame, and determining a second target exposure corresponding to the exposure frame according to the reference exposure ratio corresponding to the exposure frame, a reference exposure corresponding to the exposure frame, and an evaluation value corresponding to the target frame;
[0067] The target exposure corresponding to each exposure frame is the first target exposure or the second target exposure.
[0068] As an optional implementation manner, in the second aspect of the present invention, for each of the exposure frames, the specific manner in which the determination module determines the second target exposure corresponding to the exposure frame according to the reference exposure ratio corresponding to the exposure frame, the reference exposure corresponding to the exposure frame, and the evaluation value corresponding to the target frame includes:
[0069] Obtaining a preset ratio range, and determining a relative exposure ratio corresponding to the target frame according to the ratio range and an evaluation value corresponding to the target frame;
[0070] Acquire a previous relative exposure ratio set corresponding to the exposure frame, and determine the absolute exposure ratio corresponding to the exposure frame according to the previous relative exposure ratio set and the relative exposure ratio corresponding to the target frame; the previous relative exposure ratio set includes relative exposure ratios corresponding to all exposure frames that are ranked earlier than the exposure frame in the exposure frame sequence; the target exposure ratio corresponding to the exposure frame is the exposure ratio of the exposure frame relative to the first exposure frame in the exposure frame sequence;
[0071] Determining a target exposure ratio corresponding to the exposure frame according to a reference exposure ratio corresponding to the exposure frame and an absolute exposure ratio corresponding to the exposure frame;
[0072] According to the target exposure ratio corresponding to the exposure frame and the reference exposure corresponding to the exposure frame, a second target exposure corresponding to the exposure frame is calculated.
[0073] As an optional implementation manner, in the second aspect of the present invention, the proportion range includes a first proportion threshold and a second proportion threshold; the first proportion threshold is greater than the second proportion threshold;
[0074] Among them, for each of the exposure frames, the specific manner in which the determination module determines the relative exposure ratio corresponding to the target frame according to the proportion range and the evaluation value corresponding to the target frame includes:
[0075] Determine whether the evaluation value corresponding to the target frame is within the proportion range;
[0076] When it is determined that the evaluation value corresponding to the target frame is within the proportion range, based on the determined interpolation formula, the relative exposure ratio corresponding to the target frame is calculated according to the first proportion threshold, the second proportion threshold and the evaluation value corresponding to the target frame;
[0077] When it is determined that the evaluation value corresponding to the target frame is not within the proportion range, and when the evaluation value corresponding to the target frame is greater than the first proportion threshold, the maximum value of the adjustable exposure ratio corresponding to the first proportion threshold is determined as the relative exposure ratio corresponding to the target frame;
[0078] When the evaluation value corresponding to the target frame is less than the second proportion threshold, the minimum value of the adjustable exposure ratio corresponding to the second proportion threshold is determined as the relative exposure ratio corresponding to the target frame.
[0079] A third aspect of the present invention discloses another multi-frame wide dynamic exposure control device, the device comprising:
[0080] A memory storing executable program code;
[0081] a processor coupled to the memory;
[0082] The processor calls the executable program code stored in the memory to execute the multi-frame wide dynamic exposure control method disclosed in the first aspect of the present invention.
[0083] The fourth aspect of the present invention discloses a computer storage medium, wherein the computer storage medium stores computer instructions, and when the computer instructions are called, they are used to execute the multi-frame wide dynamic exposure control method disclosed in the first aspect of the present invention.
[0084] Compared with the prior art, the embodiments of the present invention have the following beneficial effects:
[0085] In an embodiment of the present invention, an exposure frame sequence and automatic exposure information corresponding to the exposure frame sequence are obtained; the exposure frame sequence includes multiple exposure frames and the exposure frame sequence is sorted in descending order based on the automatic exposure amount of each exposure frame; the automatic exposure information includes frame exposure information of each exposure frame; for each exposure frame, an evaluation value corresponding to the target frame is determined according to the frame exposure information of the target frame; the target frame is the exposure frame or an adjacent exposure frame corresponding to the exposure frame; the adjacent exposure frame is adjacent to the exposure frame in the exposure frame sequence; for each exposure frame, a reference exposure amount corresponding to the exposure frame is determined, and according to the reference exposure amount corresponding to the exposure frame and the evaluation value corresponding to the target frame, a target exposure amount corresponding to the exposure frame is determined. It can be seen that, after the exposure frame sequence and the frame exposure information of each exposure frame in the exposure frame sequence are acquired, the implementation of the present invention can determine a corresponding evaluation value for each exposure frame based on the frame exposure information of the exposure frame or the frame exposure information of an adjacent exposure frame corresponding to the exposure frame, and then determine the target exposure of the exposure frame based on the determined reference exposure of the exposure frame and the above evaluation value. The exposure can be dynamically changed according to the scene for a multi-frame wide dynamic scheme of two or more frames to achieve automatic exposure control. The target exposure of the exposure frame can be calculated based on the exposure statistical information of the exposure frame itself or the exposure statistical information of the exposure frame that is adjacent to the exposure frame in sequence, thereby improving the flexibility and accuracy of determining the target exposure, thereby improving the flexibility and accuracy of exposure control of the multi-frame wide dynamic, thereby facilitating a natural transition of the exposure effects between multiple exposure frames, and facilitating accurate control of the over-exposed area of the composite image synthesized by all the exposure frames after the exposure adjustment, thereby facilitating appropriate exposure for both the highlight part and the low-brightness part of the composite image, thereby being applicable to scenes with different dynamic ranges, and further improving the flexibility of exposure control and scene applicability. BRIEF DESCRIPTION OF THE DRAWINGS
[0086] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0087] Figure 1 It is a flowchart of a multi-frame wide dynamic exposure control method disclosed in an embodiment of the present invention;
[0088] Figure 2 It is a flow chart of another multi-frame wide dynamic exposure control method disclosed in an embodiment of the present invention;
[0089] Figure 3It is a flowchart diagram of another multi-frame wide dynamic exposure control method disclosed in an embodiment of the present invention;
[0090] Figure 4 It is a flowchart diagram of another multi-frame wide dynamic exposure control method disclosed in an embodiment of the present invention;
[0091] Figure 5 It is a flowchart diagram of another multi-frame wide dynamic exposure control method disclosed in an embodiment of the present invention;
[0092] Figure 6 It is a structural schematic diagram of a multi-frame wide dynamic exposure control device disclosed in an embodiment of the present invention;
[0093] Figure 7 It is a schematic structural diagram of another multi-frame wide dynamic exposure control device disclosed in an embodiment of the present invention. DETAILED DESCRIPTION
[0094] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0095] The terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish different objects rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, device, product or end including a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units that are not listed, or may optionally include other steps or units inherent to these processes, methods, products or ends.
[0096] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present invention. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.
[0097] The present invention discloses a multi-frame wide dynamic exposure control method and device, which can determine a corresponding evaluation value for each exposure frame based on the frame exposure information of the exposure frame or the frame exposure information of an adjacent exposure frame corresponding to the exposure frame after acquiring an exposure frame sequence and the frame exposure information of each exposure frame in the exposure frame sequence, and then determine a target exposure value of the exposure frame based on the determined reference exposure value of the exposure frame and the above evaluation value, and can dynamically change the exposure value according to the scene for a multi-frame wide dynamic scheme of two or more frames to realize automatic exposure control, and can dynamically change the exposure value according to the scene according to the exposure statistical information of the exposure frame itself or the exposure statistical information related to the exposure frame sorting. The target exposure of the exposure frame is calculated based on the exposure statistics of the adjacent exposure frames, so as to improve the flexibility and accuracy of determining the target exposure, and further improve the flexibility and accuracy of exposure control of multi-frame wide dynamic, which is conducive to making the exposure effect transition between multiple exposure frames natural, and is conducive to accurately controlling the over-exposed area of the composite image synthesized by all the exposure frames after the exposure adjustment, which is conducive to obtaining appropriate exposure for both the highlight part and the low-brightness part of the composite image, and can be applied to scenes with different dynamic ranges, further improving the flexibility of exposure control and scene applicability. The following are detailed descriptions.
[0098] Embodiment 1
[0099] See also Figure 1 , Figure 1 is a flow chart of a multi-frame wide dynamic exposure control method disclosed in an embodiment of the present invention. Figure 1 The described multi-frame wide dynamic exposure control method can be applied to a multi-frame wide dynamic exposure control device, which may include an exposure control device, an exposure control terminal, an exposure control system and a server, wherein the server is a local server or a cloud server, which is not limited by the embodiments of the present invention; further, the exposure control device can be applied to a camera device provided with an image sensor, wherein, exemplarily, the image sensor can be a multi-frame exposure wide dynamic image sensor or a common image sensor, which is not limited by the embodiments of the present invention; the exposure control device can also be applied to devices with diverse requirements for dynamic range, which is not limited by the embodiments of the present invention. Figure 1 As shown, the multi-frame wide dynamic exposure control method may include the following operations:
[0100] 101. Obtain an exposure frame sequence and automatic exposure information corresponding to the exposure frame sequence.
[0101] In the embodiment of the present invention, the exposure frame sequence includes multiple exposure frames and the exposure frame sequence is sorted in descending order based on the automatic exposure amount of each exposure frame, that is, the automatic exposure amount of the exposure frame sorted first in the exposure frame sequence is the highest, and the automatic exposure amount of the exposure frame sorted last in the exposure frame sequence is the lowest. Optionally, each exposure frame can be evenly divided into multiple blocks, that is, each exposure frame can include multiple blocks of m rows and n columns; further optionally, each block can include multiple pixels, which is not limited in the embodiment of the present invention.
[0102] In an embodiment of the present invention, the automatic exposure information corresponding to the exposure frame sequence includes frame exposure information of each exposure frame; optionally, the frame exposure information of each exposure frame may include an exposure statistic corresponding to each block included in the exposure frame, which is not limited in the embodiment of the present invention; further optionally, for each block, the exposure statistic corresponding to the block may be determined in the following manner: calculating the average brightness of all pixels included in the block as the exposure statistic corresponding to the block, which is not limited in the embodiment of the present invention.
[0103] 102. For each exposure frame, determine an evaluation value corresponding to the target frame according to the frame exposure information of the target frame.
[0104] In an embodiment of the present invention, for each exposure frame, the target frame is the exposure frame or an adjacent exposure frame corresponding to the exposure frame; wherein the adjacent exposure frame corresponding to the exposure frame is adjacent to the exposure frame in the exposure frame sequence; further, the adjacent exposure frame corresponding to the exposure frame may be sorted earlier than the exposure frame in the exposure frame sequence, which is not limited in the embodiment of the present invention.
[0105] 103. For each exposure frame, determine a reference exposure amount corresponding to the exposure frame.
[0106] In the embodiment of the present invention, optionally, for each exposure frame, determining a reference exposure value corresponding to the exposure frame may include the following operations:
[0107] Detecting whether there is a historical exposure amount sequence corresponding to the historical exposure frame sequence, and obtaining a detection result; wherein the historical exposure frame sequence is an exposure frame sequence processed last time and the historical exposure frame sequence includes multiple historical exposure frames, and the historical exposure amount sequence includes the historical exposure amount corresponding to each historical exposure frame in the historical exposure frame sequence;
[0108] When the exposure frame is the first exposure frame in the exposure frame sequence, and when the detection result is used to indicate that the above historical exposure amount sequence exists, the historical exposure amount corresponding to the first historical exposure frame in the historical exposure frame sequence is determined as the reference exposure amount corresponding to the exposure frame; when the detection result is used to indicate that the above historical exposure amount sequence does not exist, the pre-set initial exposure amount is determined as the reference exposure amount corresponding to the exposure frame;
[0109] When the exposure frame is not the first exposure frame in the exposure frame sequence, the exposure amount of the first exposure frame in the exposure frame sequence is determined as the reference exposure amount corresponding to the exposure frame; wherein the exposure amount of the first exposure frame in the exposure frame sequence can be one of the target exposure amount of the first exposure frame in the exposure frame sequence, the automatic exposure amount corresponding to the first exposure frame in the exposure frame sequence, and the historical exposure amount corresponding to the first historical exposure frame in the historical exposure frame sequence, which is not limited in the embodiment of the present invention.
[0110] This can improve the flexibility and accuracy of determining the reference exposure amount of each exposure frame, which is beneficial to improving the accuracy of determining the target exposure amount of each exposure frame.
[0111] 104. For each exposure frame, determine a target exposure corresponding to the exposure frame according to a reference exposure corresponding to the exposure frame and an evaluation value corresponding to the target frame.
[0112] In an embodiment of the present invention, the target exposure amount corresponding to each exposure frame is the new exposure amount of the processed exposure frame; further, the exposure frame sequence can be synthesized based on the target exposure amount corresponding to each exposure frame to obtain a synthesized image corresponding to the exposure frame sequence.
[0113] It can be seen that the method described in the embodiment of the present invention can be implemented to obtain the exposure frame sequence and the frame exposure information of each exposure frame in the exposure frame sequence, and then, for each exposure frame, determine the corresponding evaluation value based on the frame exposure information of the exposure frame or the frame exposure information of the adjacent exposure frame corresponding to the exposure frame, and then determine the target exposure of the exposure frame according to the determined reference exposure of the exposure frame and the above evaluation value. For a multi-frame wide dynamic scheme of two or more frames, the exposure can be changed dynamically according to the scene to achieve automatic exposure control, and the target exposure of the exposure frame can be calculated based on the exposure statistical information of the exposure frame itself or the exposure statistical information of the exposure frame that is adjacent to the exposure frame in order, so as to improve the flexibility and accuracy of determining the target exposure, thereby improving the flexibility and accuracy of exposure control of the multi-frame wide dynamic, thereby facilitating a natural transition of the exposure effects between the multiple exposure frames, and facilitating accurate control of the over-exposed area of the composite image synthesized by all the exposure frames after the exposure is adjusted, thereby facilitating the high-brightness part or the low-brightness part of the composite image to obtain appropriate exposure, thereby being applicable to scenes with different dynamic ranges, and further improving the flexibility of exposure control and scene applicability.
[0114] In an optional embodiment, for each exposure frame, determining the evaluation value corresponding to the target frame according to the frame exposure information of the target frame may include the following operations:
[0115] An exposure histogram corresponding to the target frame is obtained, and an evaluation value corresponding to the target frame is determined according to frame exposure information of the target frame and / or the exposure histogram corresponding to the target frame.
[0116] Optionally, the corresponding evaluation value of the exposure frame can be calculated based on the frame exposure information of the exposure frame and / or the exposure histogram corresponding to the exposure frame, and the corresponding evaluation values of adjacent exposure frames can be calculated based on the frame exposure information of adjacent exposure frames and / or the exposure histogram corresponding to adjacent exposure frames, which is not limited to the embodiments of the present invention.
[0117] It can be seen that this optional embodiment can determine the evaluation value corresponding to the target frame based on the frame exposure information of the target frame and / or the exposure histogram corresponding to the target frame, which can improve the determination accuracy and flexibility of the evaluation value of the target frame, thereby helping to improve the determination accuracy and flexibility of the target exposure.
[0118] In this optional embodiment, optionally, each exposure frame includes a plurality of blocks; the frame exposure information of each exposure frame includes an exposure statistic corresponding to each block included in the exposure frame;
[0119] Wherein, for each exposure frame, determining the evaluation value corresponding to the target frame according to the frame exposure information of the target frame and / or the exposure histogram corresponding to the target frame may include the following operations:
[0120] When the exposure frame is the first exposure frame in the exposure frame sequence, obtaining block weight information corresponding to the exposure frame sequence, and determining an exposure evaluation value corresponding to the exposure frame according to the frame exposure information and the block weight information of the exposure frame;
[0121] When the exposure frame is not the first exposure frame in the exposure frame sequence, the overexposure evaluation value corresponding to the target frame is determined according to the frame exposure information of the target frame and the exposure histogram corresponding to the target frame; wherein, when the target frame is an adjacent exposure frame corresponding to the exposure frame, the adjacent exposure frame is ranked first in the exposure frame sequence compared to the exposure frame;
[0122] The evaluation value corresponding to the target frame is the exposure evaluation value corresponding to the exposure frame or the overexposure evaluation value corresponding to the target frame.
[0123] Optionally, when the exposure frame is the first exposure frame in the exposure frame sequence, multiple low-brightness pixels whose brightness values are lower than a preset brightness threshold can be screened out from the exposure histogram corresponding to the exposure frame, and the average brightness value corresponding to all the low-brightness pixels can be calculated as the exposure evaluation value corresponding to the exposure frame.
[0124] It can be seen that this optional embodiment can also determine the exposure evaluation value of the exposure frame that is sorted first through the block weight information and the frame exposure information; for the remaining exposure frames, the overexposure evaluation value can be determined in combination with the frame exposure information and the exposure histogram, and different evaluation value determination bases and determination methods can be used for exposure frames with different exposure amounts, thereby further improving the accuracy and flexibility of determining the exposure evaluation value or the overexposure evaluation value, and thus being beneficial to improving the accuracy and flexibility of determining the target exposure amount; and, for the remaining exposure frames, compared with the method of only using block weighted brightness for calculation in the prior art, this method can be applied to wide dynamic range dominated by point light sources, and can have better anti-overexposure effect on point light sources than the prior art method of only using exposure histogram for calculation, and can reduce the possibility of interference of scattered highlight pixels in individual non-interested areas with exposure calculation, thereby improving the accuracy and reliability of exposure control.
[0125] In this optional embodiment, optionally, the block weight information includes a block weight of each block included in each exposure frame;
[0126] Wherein, for each exposure frame, determining the exposure evaluation value corresponding to the exposure frame according to the frame exposure information and the block weight information of the exposure frame may include the following operations:
[0127] Filtering out at least one low-brightness statistical value lower than a first preset threshold from the exposure statistical values corresponding to all the blocks included in the exposure frame, and determining the block corresponding to each low-brightness statistical value as the low-brightness block of the exposure frame;
[0128] The exposure evaluation value corresponding to the exposure frame is calculated according to the exposure statistics of each low-brightness block in the frame exposure information of the exposure frame and the block weight of each low-brightness block in the block weight information.
[0129] Among them, optionally, the block weight of each block can be assigned based on the importance of the content of different parts of the picture, or can be assigned based on the face detection result, which is not limited in the embodiment of the present invention; further, the higher the importance of the block, the higher the weight assigned.
[0130] Optionally, calculating the exposure evaluation value corresponding to the exposure frame according to the exposure statistics of each low-brightness block in the frame exposure information of the exposure frame and the block weight of each low-brightness block in the block weight information may include the following operations:
[0131] Based on the determined exposure evaluation value calculation formula, the exposure evaluation value corresponding to the exposure frame is calculated according to the exposure statistics of each low-brightness block in the frame exposure information of the exposure frame and the block weight of each low-brightness block in the block weight information;
[0132] Among them, the exposure evaluation value calculation formula can be as follows:
[0133] (where Y i,j <Th1)
[0134] Among them, E1 is the exposure evaluation value corresponding to the exposure frame, Y i,j is the exposure statistic of each low-brightness block in the exposure frame, W i,j is the block weight of each low-brightness block in the exposure frame, Th1 is the first preset threshold, and i and j are used to represent the position of the block in the exposure frame.
[0135] It can be seen that this optional embodiment can also filter out low-brightness blocks from all blocks included in the exposure frame that is sorted first, and calculate the exposure evaluation value corresponding to the exposure frame according to the exposure statistics of each low-brightness block in the frame exposure information of the exposure frame and the block weight of each low-brightness block in the block weight information, and can calculate the exposure evaluation value of the longest frame based on a low-light priority manner, so as to facilitate the subsequent calculation of the exposure amount of the longest frame based on the exposure evaluation value obtained by low-light priority, thereby improving the accuracy of determining the low-brightness area of the longest frame, thereby improving the calculation accuracy and precision of the exposure evaluation value, and further facilitating improving the accuracy of determining the target exposure amount of the longest frame.
[0136] In this optional embodiment, optionally, for each exposure frame, determining the exposure evaluation value corresponding to the exposure frame according to the frame exposure information and the block weight information of the exposure frame may include the following operations:
[0137] Determine the lowest exposure statistical value among the exposure statistical values corresponding to all blocks included in the exposure frame, and determine the block corresponding to the lowest exposure statistical value as the darkest block of the exposure frame, then obtain a preset ratio, and calculate the exposure evaluation value corresponding to the exposure frame according to the preset ratio, the lowest exposure statistical value and the block weight of the darkest block.
[0138] It can be seen that this optional embodiment can also determine the darkest block from the exposure frame that is sorted first, and calculate the exposure evaluation value corresponding to the exposure frame based on the preset ratio, the lowest exposure statistic and the block weight of the darkest block, thereby providing another low-light priority calculation method, thereby improving the flexibility and accuracy of determining the low-light priority exposure evaluation value.
[0139] In this optional embodiment, optionally, for each exposure frame, determining the overexposure evaluation value corresponding to the target frame according to the frame exposure information of the target frame and the exposure histogram corresponding to the target frame may include the following operations:
[0140] According to the frame exposure information of the target frame, the number of highlight blocks contained in the target frame is counted as the number of highlight blocks; the exposure statistical value of each highlight block is higher than the second preset threshold;
[0141] According to the total number of blocks and the number of highlighted blocks contained in the target frame, determine the proportion of highlighted blocks corresponding to the target frame;
[0142] According to the exposure histogram corresponding to the target frame, the number of highlight pixels in the exposure histogram is counted as the number of highlight pixels; the brightness value corresponding to each highlight pixel is higher than a third preset threshold;
[0143] According to the total number of pixels and the number of highlight pixels contained in the exposure histogram, the highlight pixel ratio corresponding to the target frame is determined;
[0144] According to the ratio of highlight blocks and / or highlight pixels, the overexposure evaluation value corresponding to the target frame is calculated.
[0145] Optionally, the overexposure evaluation value corresponding to the target frame can be calculated based only on the proportion of highlighted blocks, or based only on the proportion of highlighted pixels. The overexposure evaluation value corresponding to the target frame can also be calculated based on the proportion of highlighted blocks and the proportion of highlighted pixels, and the embodiment of the present invention does not limit this.
[0146] Optionally, calculating the overexposure evaluation value corresponding to the target frame according to the ratio of highlight blocks and / or the ratio of highlight pixels may include the following operations:
[0147] Based on the determined overexposure evaluation value calculation formula, the overexposure evaluation value corresponding to the target frame is calculated according to the highlight block ratio, the highlight pixel ratio and a preset control constant; wherein the preset control constant may include a first control constant and a second control constant;
[0148] Among them, the calculation formula of overexposure evaluation value can be as follows:
[0149] E b =P1*C1+P2*C2
[0150] Among them, E b is the overexposure evaluation value corresponding to the target frame, P1 is the ratio of highlight blocks, C1 is the first control constant, P2 is the ratio of highlight pixels, and C2 is the second control constant.
[0151] Exemplarily, when the target frame is the adjacent exposure frame corresponding to the exposure frame, the above-mentioned highlight block ratio is the highlight block ratio of the adjacent exposure frame, and the above-mentioned highlight pixel ratio is the highlight block ratio of the adjacent exposure frame. That is, based on the above-mentioned overexposure evaluation value calculation formula, according to the highlight block ratio of the adjacent exposure frame, the highlight block ratio of the adjacent exposure frame and the preset control constant, the overexposure evaluation value corresponding to the target frame is calculated.
[0152] It can be seen that this optional embodiment can also count the proportion of highlighted blocks in the target frame and the proportion of highlighted pixels in the exposure histogram corresponding to the target frame for each exposure frame, and calculate the overexposure evaluation value corresponding to the target frame based on the proportion of highlighted blocks and / or the proportion of highlighted pixels, and can calculate the overexposure evaluation value by comprehensively considering the highlighted blocks and / or the highlighted pixels in the histogram, thereby improving the flexibility and accuracy in determining the overexposure evaluation value of the target frame, which is beneficial to improving the accuracy in determining the exposure amounts of exposure frames other than the longest frame, and is beneficial to improving the accuracy in controlling the area of the overexposed region of the composite image obtained by subsequent synthesis.
[0153] Embodiment 2
[0154] See also Figure 2 , Figure 2 is a flow chart of a multi-frame wide dynamic exposure control method disclosed in an embodiment of the present invention. Figure 2 The described multi-frame wide dynamic exposure control method can be applied to a multi-frame wide dynamic exposure control device, which may include an exposure control device, an exposure control terminal, an exposure control system and a server, wherein the server is a local server or a cloud server, which is not limited by the embodiments of the present invention; further, the exposure control device can be applied to a camera device provided with an image sensor, wherein, exemplarily, the image sensor can be a multi-frame exposure wide dynamic image sensor or a common image sensor, which is not limited by the embodiments of the present invention; the exposure control device can also be applied to devices with diverse requirements for dynamic range, which is not limited by the embodiments of the present invention. Figure 2 As shown, the multi-frame wide dynamic exposure control method may include the following operations:
[0155] 201. Obtain an exposure frame sequence and automatic exposure information corresponding to the exposure frame sequence.
[0156] In the embodiment of the present invention, the exposure frame sequence includes multiple exposure frames and the exposure frame sequence is sorted in descending order based on the automatic exposure amount of each exposure frame; the automatic exposure information corresponding to the exposure frame sequence includes frame exposure information of each exposure frame.
[0157] 202. For each exposure frame, determine an evaluation value corresponding to the target frame according to the frame exposure information of the target frame.
[0158] In an embodiment of the present invention, for each exposure frame, the target frame is the exposure frame or an adjacent exposure frame corresponding to the exposure frame; the adjacent exposure frame corresponding to the exposure frame is adjacent to the exposure frame in the exposure frame sequence; further, the adjacent exposure frame corresponding to the exposure frame can be sorted before the exposure frame in the exposure frame sequence.
[0159] 203. For each exposure frame, determine a reference exposure amount corresponding to the exposure frame.
[0160] In the embodiment of the present invention, for other detailed descriptions of steps 201 to 203, please refer to the detailed description of steps 101 to 103 in the first embodiment, and the embodiment of the present invention will not be repeated here.
[0161] In an embodiment of the present invention, optionally, for each exposure frame, when the exposure frame is the first exposure frame in the exposure frame sequence, the operations of step 204-step 205 are performed; when the exposure frame is not the first exposure frame in the exposure frame sequence, the operations of step 206-step 207 are performed, and the embodiment of the present invention does not limit this.
[0162] 204. When the exposure frame is the first exposure frame in the exposure frame sequence, a preset exposure target value is obtained.
[0163] In the embodiment of the present invention, the exposure target value is the target value that the exposure degree of the first exposure frame in the sorting needs to reach; optionally, the exposure target value may also be a target brightness, which is not limited in the embodiment of the present invention.
[0164] 205. Determine a first target exposure corresponding to the exposure frame according to the exposure target value, the reference exposure corresponding to the exposure frame, and the evaluation value corresponding to the exposure frame.
[0165] In the embodiment of the present invention, optionally, determining the first target exposure corresponding to the exposure frame according to the exposure target value, the reference exposure corresponding to the exposure frame, and the evaluation value corresponding to the exposure frame may include the following operations:
[0166] Based on the determined first exposure calculation formula, a first target exposure corresponding to the exposure frame is calculated according to the exposure target value, the historical exposure corresponding to the exposure frame, and the exposure evaluation value corresponding to the exposure frame;
[0167] The first exposure calculation formula may be as follows:
[0168] V new =V ori *E T / E
[0169] Among them, V new is the first target exposure corresponding to the exposure frame, V ori is the historical exposure corresponding to the exposure frame, E T is the exposure target value, and E is the exposure evaluation value corresponding to the exposure frame.
[0170] 206. When the exposure frame is not the first exposure frame in the exposure frame sequence, obtain a reference exposure ratio corresponding to the exposure frame.
[0171] In the embodiment of the present invention, optionally, when there is a historical exposure frame sequence, the reference exposure ratio corresponding to the exposure frame is the target exposure ratio corresponding to the historical exposure frame at the same sorting position as the exposure frame in the historical exposure frame sequence.
[0172] 207. Determine a second target exposure corresponding to the exposure frame according to a reference exposure ratio corresponding to the exposure frame, a reference exposure corresponding to the exposure frame, and an evaluation value corresponding to the target frame.
[0173] In the embodiment of the present invention, optionally, the second target exposure corresponding to the exposure frame can be determined based on a reference exposure ratio corresponding to the exposure frame, a reference exposure corresponding to the exposure frame, and an overexposure evaluation value corresponding to an adjacent exposure frame corresponding to the exposure frame.
[0174] In the embodiment of the present invention, the target exposure corresponding to each exposure frame is the first target exposure or the second target exposure.
[0175] It can be seen that the method described in the embodiment of the present invention can be implemented to obtain the exposure frame sequence and the frame exposure information of each exposure frame in the exposure frame sequence, and then, for each exposure frame, determine the corresponding evaluation value based on the frame exposure information of the exposure frame or the frame exposure information of the adjacent exposure frame corresponding to the exposure frame, and then determine the target exposure of the exposure frame according to the determined reference exposure of the exposure frame and the above evaluation value. For a multi-frame wide dynamic scheme of two or more frames, the exposure can be changed dynamically according to the scene to achieve automatic exposure control, and the target exposure of the exposure frame can be calculated based on the exposure statistical information of the exposure frame itself or the exposure statistical information of the exposure frame that is adjacent to the exposure frame in order, so as to improve the flexibility and accuracy of determining the target exposure, thereby improving the flexibility and accuracy of exposure control of the multi-frame wide dynamic, thereby facilitating a natural transition of the exposure effects between the multiple exposure frames, and facilitating accurate control of the over-exposed area of the composite image synthesized by all the exposure frames after the exposure is adjusted, thereby facilitating the high-brightness part or the low-brightness part of the composite image to obtain appropriate exposure, thereby being applicable to scenes with different dynamic ranges, and further improving the flexibility of exposure control and scene applicability. In addition, for the exposure frame that is sorted first, a first target exposure corresponding to the exposure frame can be determined based on the exposure target value, the reference exposure amount and the exposure evaluation value. For the remaining exposure frames, a second target exposure frame corresponding to the exposure frame can be determined based on the reference exposure ratio, the reference exposure amount and the overexposure evaluation value of the corresponding target frame. Different exposure determination methods can be adopted for exposure frames with different exposure amounts, thereby further improving the flexibility and accuracy of determining the target exposure amount, which is beneficial to improving the exposure control flexibility and exposure control accuracy of multi-frame wide dynamic.
[0176] In an optional embodiment, for each exposure frame, determining the second target exposure corresponding to the exposure frame according to the reference exposure ratio corresponding to the exposure frame, the reference exposure corresponding to the exposure frame, and the evaluation value corresponding to the target frame may include the following operations:
[0177] Obtaining a preset ratio range, and determining a relative exposure ratio corresponding to the target frame according to the ratio range and the evaluation value corresponding to the target frame;
[0178] Acquire a previous relative exposure ratio set corresponding to the exposure frame, and determine the absolute exposure ratio corresponding to the exposure frame according to the previous relative exposure ratio set and the relative exposure ratio corresponding to the target frame; wherein the previous relative exposure ratio set includes relative exposure ratios corresponding to all exposure frames that are ranked earlier than the exposure frame in the exposure frame sequence; and the target exposure ratio corresponding to the exposure frame is the exposure ratio of the exposure frame relative to the first exposure frame in the exposure frame sequence;
[0179] Determining a target exposure ratio corresponding to the exposure frame according to a reference exposure ratio corresponding to the exposure frame and an absolute exposure ratio corresponding to the exposure frame;
[0180] According to the target exposure ratio corresponding to the exposure frame and the reference exposure corresponding to the exposure frame, a second target exposure corresponding to the exposure frame is calculated.
[0181] Optionally, calculating the second target exposure corresponding to the exposure frame according to the target exposure ratio corresponding to the exposure frame and the reference exposure corresponding to the exposure frame may include the following operations:
[0182] When the reference exposure corresponding to the exposure frame is the target exposure of the exposure frame ranked first in the exposure frame sequence, based on the determined second exposure calculation formula, the second target exposure corresponding to the exposure frame is calculated according to the target exposure ratio corresponding to the exposure frame and the target exposure of the exposure frame ranked first in the exposure frame sequence;
[0183] The second exposure calculation formula may be as follows:
[0184] V2=V1 / R new
[0185] Wherein, V2 is the second target exposure value corresponding to the exposure frame, V1 is the target exposure value of the first exposure frame in the exposure frame sequence, and R new is the target exposure ratio corresponding to the exposure frame.
[0186] It can be seen that this optional embodiment can determine, for each exposure frame, the relative exposure ratio corresponding to the target frame according to the preset proportion range and the evaluation value corresponding to the target frame, and then determine the absolute exposure ratio of the exposure frame relative to the longest frame according to the previous relative exposure ratio set and the relative exposure ratio corresponding to the target frame, and then determine the target exposure ratio corresponding to the exposure frame according to the reference exposure ratio corresponding to the exposure frame and the absolute exposure ratio corresponding to the exposure frame, and then calculate the second target exposure amount corresponding to the exposure frame according to the above target exposure ratio and the above reference exposure amount, and can perform layer-by-layer correction and optimization on the exposure ratio of each exposure frame by successively calculating the relative exposure ratio, the absolute exposure ratio and the target exposure ratio, thereby further improving the accuracy of determining the target exposure ratio of each exposure frame, and further improving the accuracy of calculating the target exposure amount, and the exposure ratio of each exposure frame can be freely adjusted separately, thereby improving the flexibility of determining the target exposure ratio of each exposure frame, which is conducive to improving the flexibility and accuracy of calculating the target exposure amount.
[0187] In this optional embodiment, optionally, the proportion range includes a first proportion threshold and a second proportion threshold; the first proportion threshold is greater than the second proportion threshold;
[0188] For each exposure frame, determining the relative exposure ratio corresponding to the target frame according to the proportion range and the evaluation value corresponding to the target frame may include the following operations:
[0189] Determine whether the evaluation value corresponding to the target frame is within the proportion range; wherein the evaluation value corresponding to the target frame may be an overexposure evaluation value corresponding to the target frame;
[0190] When it is determined that the evaluation value corresponding to the target frame is within the proportion range, based on the determined interpolation formula, the relative exposure ratio corresponding to the target frame is calculated according to the first proportion threshold, the second proportion threshold and the evaluation value corresponding to the target frame;
[0191] When it is determined that the evaluation value corresponding to the target frame is not within the proportion range, and when the evaluation value corresponding to the target frame is greater than the first proportion threshold, the maximum value of the adjustable exposure ratio corresponding to the first proportion threshold is determined as the relative exposure ratio corresponding to the target frame;
[0192] When the evaluation value corresponding to the target frame is less than the second proportion threshold, the minimum value of the adjustable exposure ratio corresponding to the second proportion threshold is determined as the relative exposure ratio corresponding to the target frame.
[0193] Optionally, the interpolation formula can be as follows:
[0194]
[0195] Among them, R is the relative exposure ratio corresponding to the target frame, E b is the overexposure evaluation value corresponding to the target frame, Th uis the first proportion threshold, Th d is the second proportion threshold, R max is the maximum value of the adjustable exposure ratio, R min is the minimum value of the adjustable exposure ratio; wherein the first proportion threshold corresponds to the maximum value of the adjustable exposure ratio, and the second proportion threshold corresponds to the minimum value of the adjustable exposure ratio.
[0196] It can be seen that this optional embodiment can also calculate the relative exposure ratio of the target frame based on the determined interpolation formula for each exposure frame, if the evaluation value corresponding to the target frame is within the proportion range, according to the first proportion threshold, the second proportion threshold and the evaluation value corresponding to the target frame; if the evaluation value corresponding to the target frame is not within the proportion range, when the evaluation value corresponding to the target frame is greater than the first proportion threshold, the maximum value of the adjustable exposure ratio corresponding to the first proportion threshold is determined as the relative exposure ratio corresponding to the target frame; when the evaluation value corresponding to the target frame is less than the second proportion threshold, the minimum value of the adjustable exposure ratio corresponding to the second proportion threshold is determined as the relative exposure ratio corresponding to the target frame, which can improve the flexibility and accuracy of determining the relative exposure ratio, thereby helping to improve the accuracy of determining the absolute exposure ratio and the target exposure ratio.
[0197] In this optional embodiment, optionally, for each exposure frame, determining the absolute exposure ratio corresponding to the exposure frame according to the previous relative exposure ratio set and the relative exposure ratio corresponding to the target frame may include the following operations:
[0198] When the target frame is an adjacent exposure frame, the product of the previous relative exposure ratio set and the relative exposure ratio corresponding to the target frame is calculated to obtain the absolute exposure ratio corresponding to the exposure frame.
[0199] Specifically, the exposure of the first exposure frame in the exposure frame sequence is divided by the exposure of the second exposure frame to obtain the relative exposure ratio R1, the exposure of the second exposure frame is divided by the exposure of the third exposure frame to obtain the relative exposure ratio R2, and the exposure of the exposure frame ranked N-1 is divided by the exposure of the exposure frame ranked N to obtain the relative exposure ratio R n-1 The absolute exposure ratio of the Nth exposure frame is R = R1*R2*…*R n-1 .
[0200] When the target frame is an adjacent exposure frame, the previous relative exposure ratio set may include the relative exposure ratio corresponding to the target frame.
[0201] It can be seen that this optional embodiment can also perform a product of the previous relative exposure ratio set and the relative exposure ratio corresponding to the target frame to obtain the absolute exposure ratio corresponding to the exposure frame, which can improve the accuracy of determining the absolute exposure ratio.
[0202] In this optional embodiment, optionally, for each exposure frame, determining the target exposure ratio corresponding to the exposure frame according to the reference exposure ratio corresponding to the exposure frame and the absolute exposure ratio corresponding to the exposure frame may include the following operations:
[0203] Calculating an exposure ratio difference between an absolute exposure ratio corresponding to the exposure frame and a reference exposure ratio corresponding to the exposure frame;
[0204] When the exposure ratio difference is less than or equal to the preset exposure ratio difference, determining the reference exposure ratio corresponding to the exposure frame as the target exposure ratio corresponding to the exposure frame;
[0205] When the exposure ratio difference is greater than the preset exposure ratio difference, based on the determined exposure ratio calculation formula, according to the preset damping coefficient, the exposure ratio difference and the reference exposure ratio corresponding to the exposure frame, the target exposure ratio corresponding to the exposure frame is calculated;
[0206] Among them, the exposure ratio calculation formula can be as follows:
[0207] R new =(R T -R ori )*ζ+R ori
[0208] Among them, R T is the absolute exposure ratio corresponding to the exposure frame, R ori is the reference exposure ratio corresponding to the exposure frame, ζ is the damping coefficient, R new is the target exposure ratio corresponding to the exposure frame.
[0209] It can be seen that this optional embodiment can also determine the reference exposure ratio corresponding to the exposure frame as the target exposure ratio corresponding to the exposure frame when the exposure ratio difference between the calculated absolute exposure ratio corresponding to the exposure frame and the reference exposure ratio corresponding to the exposure frame is less than or equal to the preset exposure ratio difference; when the exposure ratio difference is greater than the preset exposure ratio difference, based on the determined exposure ratio calculation formula, according to the preset damping coefficient, the exposure ratio difference and the reference exposure ratio corresponding to the exposure frame, the target exposure ratio corresponding to the exposure frame is calculated, which can improve the flexibility and accuracy of determining the target exposure ratio, and, adding the damping coefficient when calculating the target exposure ratio can prevent the calculated exposure ratio from changing suddenly, improve the stability of the exposure ratio change, and improve the reliability of the target exposure ratio.
[0210] In the embodiment of the present invention, illustratively, the flow chart of the multi-frame wide dynamic exposure control method can be as follows: Figure 3 As shown, Figure 3 is a flow chart of another multi-frame wide dynamic exposure control method disclosed in an embodiment of the present invention. Specifically, the method may include the following operations:
[0211] After obtaining the exposure frame sequence and the automatic exposure information corresponding to the exposure frame sequence (i.e. Figure 3 The statistics of the automatic exposure shown) and the block weight information (i.e. Figure 3 After that, the exposure frame with the largest exposure is determined as the first exposure frame, the exposure frame with the second largest exposure is determined as the second exposure frame, and so on, until the Nth exposure frame with the smallest exposure. Taking the first exposure frame and the second exposure frame as examples, the exposure evaluation value corresponding to the first exposure frame (i.e. Figure 3 The low-brightness area of the first exposure frame shown in the figure is divided into blocks with weighted brightness) and the exposure target value (i.e. Figure 3 The target brightness shown in FIG. 1 is calculated to calculate the first target exposure corresponding to the first exposure frame (i.e. Figure 3 The new exposure of the first exposure frame shown in FIG. 1 is then calculated based on the block ratio of the highlight area of the adjacent exposure frame (i.e., the first exposure frame) corresponding to the second exposure frame and the highlight pixel ratio in the exposure histogram corresponding to the first exposure frame (i.e., Figure 3 The histogram ratio shown in FIG. 1 is used to calculate the second target exposure corresponding to the second exposure frame (i.e. Figure 3 The new exposure amount of the second exposure frame shown in the figure) is calculated, and the calculation steps corresponding to the new exposure amount of the second exposure frame are repeated, and the new exposure amount of the Nth exposure frame is calculated using the block ratio and the histogram ratio of the highlight area of the N-1th exposure frame;
[0212] Furthermore, the specific calculation method of the new exposure amount of the first exposure frame can be as follows: Figure 4 As shown, Figure 4 is a flow chart of another multi-frame wide dynamic exposure control method disclosed in an embodiment of the present invention, specifically: the exposure statistical value of the low-brightness area block of the first exposure frame is multiplied by the block weight ratio to obtain the exposure evaluation value of the first exposure frame, and then according to the exposure evaluation value, the exposure target value (equivalent to Figure 3 The target brightness in the first exposure frame) and the reference exposure corresponding to the first exposure frame (i.e. Figure 3 The original exposure value shown in the figure is used to obtain the new exposure value of the first exposure frame;
[0213] Furthermore, the specific calculation method of the new exposure amount of the Nth exposure frame (taking the second exposure frame as an example, and assuming that the target frame is the first exposure frame) can be as follows: Figure 5 As shown, Figure 51 is a flow chart of another multi-frame wide dynamic exposure control method disclosed in an embodiment of the present invention, specifically: the block ratio of the highlight area of the first exposure frame and the ratio of the highlight pixels in the exposure histogram of the first exposure frame are calculated, and the overexposure evaluation value of the first exposure frame is obtained after multiplying by the corresponding weights, and then the relative exposure ratio corresponding to the first exposure frame is calculated according to the overexposure control area (including the first ratio threshold and the second ratio threshold), the adjustable exposure ratio area (including the maximum adjustable exposure ratio and the minimum adjustable exposure ratio) and the overexposure evaluation value, and then the absolute exposure ratio (i.e., the absolute exposure ratio) of the second exposure frame relative to the longest frame (i.e., the first exposure frame) is obtained. Figure 5 ), if the reference exposure ratio corresponding to the second exposure frame (i.e. Figure 5 The original exposure ratio in the second exposure frame) is within a certain range of the absolute exposure ratio, then the target exposure ratio of the second exposure frame (i.e. Figure 5 The new exposure ratio in (the new exposure ratio in) is the original exposure ratio, otherwise the target exposure ratio of the second exposure frame is calculated according to the reference exposure ratio and the absolute exposure ratio, and then the second target exposure amount corresponding to the second exposure frame is equal to the exposure amount of the first exposure frame divided by the target exposure ratio of the second exposure frame.
[0214] Embodiment 3
[0215] See also Figure 6 , Figure 6 1 is a schematic diagram of the structure of a multi-frame wide dynamic exposure control device disclosed in an embodiment of the present invention. Figure 6 The described multi-frame wide dynamic exposure control device may include one of an exposure control device, an exposure control terminal, an exposure control system and a server, wherein the server is a local server or a cloud server, which is not limited in the embodiments of the present invention; further, the exposure control device may be applied to a camera device provided with an image sensor, wherein, exemplarily, the image sensor may be a multi-frame exposure wide dynamic image sensor or a common image sensor, which is not limited in the embodiments of the present invention; the exposure control device may also be applied to devices with diverse requirements for dynamic range, which is not limited in the embodiments of the present invention. Figure 6 As shown, the multi-frame wide dynamic exposure control device may include:
[0216] An acquisition module 301 is used to acquire an exposure frame sequence and automatic exposure information corresponding to the exposure frame sequence; the exposure frame sequence includes multiple exposure frames and the exposure frame sequence is sorted in descending order based on the automatic exposure amount of each exposure frame; the automatic exposure information includes frame exposure information of each exposure frame;
[0217] The determination module 302 is used to determine, for each exposure frame, an evaluation value corresponding to the target frame according to the frame exposure information of the target frame; the target frame is the exposure frame or an adjacent exposure frame corresponding to the exposure frame; the adjacent exposure frame is adjacent to the exposure frame in the exposure frame sequence;
[0218] The determination module 302 is further configured to determine, for each exposure frame, a reference exposure value corresponding to the exposure frame;
[0219] The determination module 302 is further configured to determine, for each exposure frame, a target exposure corresponding to the exposure frame according to a reference exposure corresponding to the exposure frame and an evaluation value corresponding to the target frame.
[0220] It can be seen that the device described in the embodiment of the present invention can determine a corresponding evaluation value for each exposure frame based on the frame exposure information of the exposure frame or the frame exposure information of an adjacent exposure frame corresponding to the exposure frame after acquiring the exposure frame sequence and the frame exposure information of each exposure frame in the exposure frame sequence, and then determine the target exposure of the exposure frame based on the determined reference exposure of the exposure frame and the above evaluation value. The exposure can be dynamically changed according to the scene for a multi-frame wide dynamic scheme of two or more frames to achieve automatic exposure control. The target exposure of the exposure frame can be calculated based on the exposure statistical information of the exposure frame itself or the exposure statistical information of the exposure frame that is adjacent to the exposure frame in sequence, thereby improving the flexibility and accuracy of determining the target exposure, thereby improving the flexibility and accuracy of exposure control of the multi-frame wide dynamic, thereby facilitating a natural transition of the exposure effects between multiple exposure frames, and facilitating accurate control of the over-exposed area of the composite image synthesized by all the exposure frames after the exposure adjustment, thereby facilitating appropriate exposure for both the highlight part and the low-brightness part of the composite image, thereby being applicable to scenes with different dynamic ranges, and further improving the flexibility of exposure control and scene applicability.
[0221] In an optional embodiment, each exposure frame includes a plurality of blocks; the frame exposure information of each exposure frame includes an exposure statistic corresponding to each block included in the exposure frame;
[0222] For each exposure frame, the specific manner in which the determination module 302 determines the evaluation value corresponding to the target frame according to the frame exposure information of the target frame may include:
[0223] Acquire an exposure histogram corresponding to the target frame, and determine an evaluation value corresponding to the target frame according to frame exposure information of the target frame and / or the exposure histogram corresponding to the target frame;
[0224] For each exposure frame, the specific manner in which the determination module 302 determines the evaluation value corresponding to the target frame according to the frame exposure information of the target frame and / or the exposure histogram corresponding to the target frame may include:
[0225] When the exposure frame is the first exposure frame in the exposure frame sequence, obtaining block weight information corresponding to the exposure frame sequence, and determining an exposure evaluation value corresponding to the exposure frame according to the frame exposure information and the block weight information of the exposure frame;
[0226] When the exposure frame is not the first exposure frame in the exposure frame sequence, the overexposure evaluation value corresponding to the target frame is determined according to the frame exposure information of the target frame and the exposure histogram corresponding to the target frame; wherein, when the target frame is an adjacent exposure frame corresponding to the exposure frame, the adjacent exposure frame is ranked first in the exposure frame sequence compared to the exposure frame;
[0227] The evaluation value corresponding to the target frame is an exposure evaluation value or an overexposure evaluation value.
[0228] It can be seen that the device described in the implementation of this optional embodiment can determine the evaluation value corresponding to the target frame based on the frame exposure information of the target frame and / or the exposure histogram corresponding to the target frame, which can improve the accuracy and flexibility of determining the evaluation value of the target frame, thereby facilitating improving the accuracy and flexibility of determining the target exposure amount; and, for the exposure frame that is sorted first, the exposure evaluation value of the exposure frame can be determined by the block weight information and the frame exposure information; for the remaining exposure frames, the overexposure evaluation value can be determined in combination with the frame exposure information and the exposure histogram, and different evaluation value determination bases and determination bases can be used for exposure frames with different exposure amounts. method, thereby further improving the accuracy and flexibility of determining the exposure evaluation value or the overexposure evaluation value, and further facilitating improving the accuracy and flexibility of determining the target exposure; and, for the remaining exposure frames, compared with the method of only using block weighted brightness for calculation in the prior art, the method can be applied to wide dynamic range dominated by point light sources, and can have better anti-overexposure effect on point light sources than the prior art method of only using exposure histogram for calculation in the prior art, it can reduce the possibility of interference of scattered highlight pixels in individual non-interested areas with exposure calculation, thereby improving the accuracy and reliability of exposure control.
[0229] In this optional embodiment, optionally, the block weight information includes a block weight of each block included in each exposure frame;
[0230] For each exposure frame, the specific manner in which the determination module 302 determines the exposure evaluation value corresponding to the exposure frame according to the frame exposure information and the block weight information of the exposure frame may include:
[0231] Filtering out at least one low-brightness statistical value lower than a first preset threshold from the exposure statistical values corresponding to all the blocks included in the exposure frame, and determining the block corresponding to each low-brightness statistical value as the low-brightness block of the exposure frame;
[0232] The exposure evaluation value corresponding to the exposure frame is calculated according to the exposure statistics of each low-brightness block in the frame exposure information of the exposure frame and the block weight of each low-brightness block in the block weight information.
[0233] It can be seen that the device described in the implementation of this optional embodiment can also filter out low-brightness blocks from all blocks included in the exposure frame that is sorted first, and calculate the exposure evaluation value corresponding to the exposure frame according to the exposure statistics of each low-brightness block in the frame exposure information of the exposure frame and the block weight of each low-brightness block in the block weight information, and can calculate the exposure evaluation value of the longest frame based on a low-light priority manner, so as to facilitate the subsequent calculation of the exposure amount of the longest frame based on the exposure evaluation value obtained by low-light priority, thereby improving the accuracy of determining the low-brightness area of the longest frame, thereby improving the accuracy and precision of calculating the exposure evaluation value, and further facilitating improving the accuracy of determining the target exposure amount of the longest frame.
[0234] In this optional embodiment, optionally, for each exposure frame, the specific manner in which the determination module 302 determines the overexposure evaluation value corresponding to the target frame according to the frame exposure information of the target frame and the exposure histogram corresponding to the target frame may include:
[0235] According to the frame exposure information of the target frame, the number of highlight blocks contained in the target frame is counted as the number of highlight blocks; the exposure statistical value of each highlight block is higher than the second preset threshold;
[0236] According to the total number of blocks and the number of highlighted blocks contained in the target frame, determine the proportion of highlighted blocks corresponding to the target frame;
[0237] According to the exposure histogram corresponding to the target frame, the number of highlight pixels in the exposure histogram is counted as the number of highlight pixels; the brightness value corresponding to each highlight pixel is higher than a third preset threshold;
[0238] According to the total number of pixels and the number of highlight pixels contained in the exposure histogram, the highlight pixel ratio corresponding to the target frame is determined;
[0239] According to the ratio of highlight blocks and / or highlight pixels, the overexposure evaluation value corresponding to the target frame is calculated.
[0240] It can be seen that the device described in the implementation of this optional embodiment can also, for each exposure frame, count the proportion of highlighted blocks in the target frame, and count the proportion of highlighted pixels in the exposure histogram corresponding to the target frame, and calculate the overexposure evaluation value corresponding to the target frame based on the proportion of highlighted blocks and / or the proportion of highlighted pixels, and can calculate the overexposure evaluation value by comprehensively considering the highlighted blocks and / or the highlighted pixels in the histogram, thereby improving the flexibility and accuracy in determining the overexposure evaluation value of the target frame, which is beneficial to improving the accuracy in determining the exposure amounts of exposure frames other than the longest frame, and is beneficial to improving the accuracy in controlling the area of the overexposed region of the composite image obtained by subsequent synthesis.
[0241] In another optional embodiment, for each exposure frame, the determination module 302 determines the target exposure corresponding to the exposure frame according to the reference exposure corresponding to the exposure frame and the evaluation value corresponding to the target frame. The specific manner includes:
[0242] When the exposure frame is the first exposure frame in the exposure frame sequence, a preset exposure target value is obtained, and a first target exposure corresponding to the exposure frame is determined according to the exposure target value, a reference exposure corresponding to the exposure frame, and an evaluation value corresponding to the exposure frame;
[0243] When the exposure frame is not the first exposure frame in the exposure frame sequence, a reference exposure ratio corresponding to the exposure frame is obtained, and a second target exposure corresponding to the exposure frame is determined according to the reference exposure ratio corresponding to the exposure frame, the reference exposure corresponding to the exposure frame, and the evaluation value corresponding to the target frame;
[0244] The target exposure corresponding to each exposure frame is the first target exposure or the second target exposure.
[0245] It can be seen that the device described in the implementation of this optional embodiment can determine the first target exposure amount corresponding to the exposure frame that is sorted first based on the exposure target value, the reference exposure amount and the exposure evaluation value, and for the remaining exposure frames, determine the second target exposure frame corresponding to the exposure frame based on the reference exposure ratio, the reference exposure amount and the overexposure evaluation value of the corresponding target frame. Different exposure determination methods can be adopted for exposure frames with different exposure amounts, thereby further improving the flexibility and accuracy of determining the target exposure amount, which is beneficial to improving the exposure control flexibility and exposure control accuracy of multi-frame wide dynamic.
[0246] In this optional embodiment, optionally, for each exposure frame, the determination module 302 determines the second target exposure corresponding to the exposure frame according to the reference exposure ratio corresponding to the exposure frame, the reference exposure corresponding to the exposure frame, and the evaluation value corresponding to the target frame. The specific manner may include:
[0247] Obtaining a preset ratio range, and determining a relative exposure ratio corresponding to the target frame according to the ratio range and the evaluation value corresponding to the target frame;
[0248] Acquire a previous relative exposure ratio set corresponding to the exposure frame, and determine the absolute exposure ratio corresponding to the exposure frame according to the previous relative exposure ratio set and the relative exposure ratio corresponding to the target frame; the previous relative exposure ratio set includes relative exposure ratios corresponding to all exposure frames that are ranked earlier than the exposure frame in the exposure frame sequence; the target exposure ratio corresponding to the exposure frame is the exposure ratio of the exposure frame relative to the first exposure frame in the exposure frame sequence;
[0249] Determining a target exposure ratio corresponding to the exposure frame according to a reference exposure ratio corresponding to the exposure frame and an absolute exposure ratio corresponding to the exposure frame;
[0250] According to the target exposure ratio corresponding to the exposure frame and the reference exposure corresponding to the exposure frame, a second target exposure corresponding to the exposure frame is calculated.
[0251] It can be seen that the device described in the implementation of this optional embodiment can also determine, for each exposure frame, the relative exposure ratio corresponding to the target frame according to the preset proportion range and the evaluation value corresponding to the target frame, and then determine the absolute exposure ratio of the exposure frame relative to the longest frame according to the previous relative exposure ratio set and the relative exposure ratio corresponding to the target frame, and then determine the target exposure ratio corresponding to the exposure frame according to the reference exposure ratio corresponding to the exposure frame and the absolute exposure ratio corresponding to the exposure frame, and then calculate the second target exposure amount corresponding to the exposure frame according to the above target exposure ratio and the above reference exposure amount, and can perform layer-by-layer correction and optimization on the exposure ratio of each exposure frame by successively calculating the relative exposure ratio, the absolute exposure ratio and the target exposure ratio, so as to further improve the determination accuracy of the target exposure ratio of each exposure frame, thereby improving the calculation accuracy of the target exposure amount, and the exposure ratio of each exposure frame can be freely adjusted separately, so as to improve the flexibility of determining the target exposure ratio of each exposure frame, which is conducive to improving the calculation flexibility and accuracy of the target exposure amount.
[0252] In this optional embodiment, optionally, the proportion range includes a first proportion threshold and a second proportion threshold; the first proportion threshold is greater than the second proportion threshold;
[0253] For each exposure frame, the specific manner in which the determination module 302 determines the relative exposure ratio corresponding to the target frame according to the proportion range and the evaluation value corresponding to the target frame may include:
[0254] Determine whether the evaluation value corresponding to the target frame is within the proportion range;
[0255] When it is determined that the evaluation value corresponding to the target frame is within the proportion range, based on the determined interpolation formula, the relative exposure ratio corresponding to the target frame is calculated according to the first proportion threshold, the second proportion threshold and the evaluation value corresponding to the target frame;
[0256] When it is determined that the evaluation value corresponding to the target frame is not within the proportion range, and when the evaluation value corresponding to the target frame is greater than the first proportion threshold, the maximum value of the adjustable exposure ratio corresponding to the first proportion threshold is determined as the relative exposure ratio corresponding to the target frame;
[0257] When the evaluation value corresponding to the target frame is less than the second proportion threshold, the minimum value of the adjustable exposure ratio corresponding to the second proportion threshold is determined as the relative exposure ratio corresponding to the target frame.
[0258] It can be seen that the device described in the implementation of this optional embodiment can also, for each exposure frame, if the evaluation value corresponding to the target frame is within the proportion range, then based on the determined interpolation formula, calculate the relative exposure ratio corresponding to the target frame according to the first proportion threshold, the second proportion threshold and the evaluation value corresponding to the target frame; if the evaluation value corresponding to the target frame is not within the proportion range, when the evaluation value corresponding to the target frame is greater than the first proportion threshold, the maximum value of the adjustable exposure ratio corresponding to the first proportion threshold is determined as the relative exposure ratio corresponding to the target frame; when the evaluation value corresponding to the target frame is less than the second proportion threshold, the minimum value of the adjustable exposure ratio corresponding to the second proportion threshold is determined as the relative exposure ratio corresponding to the target frame, which can improve the flexibility and accuracy of determining the relative exposure ratio, thereby helping to improve the accuracy of determining the absolute exposure ratio and the target exposure ratio.
[0259] Embodiment 4
[0260] See also Figure 7 , Figure 7 FIG. 1 is a schematic diagram of another multi-frame wide dynamic exposure control device disclosed in an embodiment of the present invention. Figure 7 As shown, the multi-frame wide dynamic exposure control device may include:
[0261] A memory 401 storing executable program codes;
[0262] a processor 402 coupled to the memory 401;
[0263] The processor 402 calls the executable program code stored in the memory 401 to execute the steps in the multi-frame wide dynamic exposure control method described in the first embodiment of the present invention or the second embodiment of the present invention.
[0264] Embodiment 5
[0265] An embodiment of the present invention discloses a computer storage medium, which stores computer instructions. When the computer instructions are called, they are used to execute the steps in the multi-frame wide dynamic exposure control method described in Embodiment 1 or Embodiment 2 of the present invention.
[0266] Embodiment 6
[0267] An embodiment of the present invention discloses a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to enable a computer to execute the steps in the multi-frame wide dynamic exposure control method described in Embodiment 1 or Embodiment 2.
[0268] The device embodiments described above are only illustrative, wherein the modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, i.e., they may be located in one place, or they may be distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Those of ordinary skill in the art may understand and implement it without creative work.
[0269] Through the specific description of the above embodiments, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on such an understanding, the above technical solution can be essentially or partly contributed to the prior art in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, and the storage medium includes a read-only memory (ROM), a random access memory (RAM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), a one-time programmable read-only memory (OTPROM), an electronically erasable rewritable read-only memory (EEPROM), a compact disc (CD-ROM) or other optical disc storage, magnetic disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.
[0270] Finally, it should be noted that the multi-frame wide dynamic exposure control method and device disclosed in the embodiment of the present invention discloses only the preferred embodiments of the present invention, which are only used to illustrate the technical solution of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, it should be understood by those skilled in the art that the technical solutions described in the aforementioned embodiments can still be modified, or some of the technical features therein can be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention.
Claims
1. A multi-frame wide dynamic exposure control method, characterized in that: The method comprises: Acquire an exposure frame sequence and automatic exposure information corresponding to the exposure frame sequence; the exposure frame sequence includes a plurality of exposure frames and the exposure frame sequence is sorted in descending order based on the automatic exposure amount of each exposure frame; the automatic exposure information includes frame exposure information of each exposure frame; For each of the exposure frames, determining an evaluation value corresponding to the target frame according to frame exposure information of the target frame; the target frame is the exposure frame or an adjacent exposure frame corresponding to the exposure frame; the adjacent exposure frame is adjacent to the exposure frame in the exposure frame sequence; For each exposure frame, determining a reference exposure corresponding to the exposure frame; For each of the exposure frames, a target exposure corresponding to the exposure frame is determined according to a reference exposure corresponding to the exposure frame and an evaluation value corresponding to the target frame.
2. The multi-frame wide dynamic exposure control method according to claim 1, characterized in that: Each of the exposure frames includes a plurality of blocks; the frame exposure information of each of the exposure frames includes an exposure statistic corresponding to each of the blocks included in the exposure frame; Wherein, for each of the exposure frames, determining the evaluation value corresponding to the target frame according to the frame exposure information of the target frame includes: Acquire an exposure histogram corresponding to a target frame, and determine an evaluation value corresponding to the target frame according to frame exposure information of the target frame and / or the exposure histogram corresponding to the target frame; Wherein, for each of the exposure frames, determining the evaluation value corresponding to the target frame according to the frame exposure information of the target frame and / or the exposure histogram corresponding to the target frame includes: When the exposure frame is the first exposure frame in the exposure frame sequence, obtaining block weight information corresponding to the exposure frame sequence, and determining an exposure evaluation value corresponding to the exposure frame according to the frame exposure information of the exposure frame and the block weight information; When the exposure frame is not the first exposure frame in the exposure frame sequence, determining the overexposure evaluation value corresponding to the target frame according to the frame exposure information of the target frame and the exposure histogram corresponding to the target frame; wherein, when the target frame is an adjacent exposure frame corresponding to the exposure frame, the adjacent exposure frame is ranked first in the exposure frame sequence compared to the exposure frame; The evaluation value corresponding to the target frame is the exposure evaluation value corresponding to the exposure frame or the overexposure evaluation value corresponding to the target frame.
3. The multi-frame wide dynamic exposure control method according to claim 2, characterized in that: The block weight information includes a block weight of each of the blocks included in each of the exposure frames; Wherein, for each of the exposure frames, determining the exposure evaluation value corresponding to the exposure frame according to the frame exposure information of the exposure frame and the block weight information includes: Filter out at least one low-brightness statistical value lower than a first preset threshold from the exposure statistical values corresponding to all the blocks included in the exposure frame, and determine the block corresponding to each low-brightness statistical value as the low-brightness block of the exposure frame; The exposure evaluation value corresponding to the exposure frame is calculated according to the exposure statistics of each of the low-brightness blocks in the frame exposure information of the exposure frame and the block weight of each of the low-brightness blocks in the block weight information.
4. The multi-frame wide dynamic exposure control method according to claim 2, characterized in that: For each of the exposure frames, determining the overexposure evaluation value corresponding to the target frame according to the frame exposure information of the target frame and the exposure histogram corresponding to the target frame includes: According to the frame exposure information of the target frame, the number of highlight blocks contained in the target frame is counted as the number of highlight blocks; the exposure statistical value of each highlight block is higher than a second preset threshold; Determine the proportion of highlighted blocks corresponding to the target frame according to the total number of blocks included in the target frame and the number of highlighted blocks; According to the exposure histogram corresponding to the target frame, the number of highlight pixels in the exposure histogram is counted as the number of highlight pixels; the brightness value corresponding to each of the highlight pixels is higher than a third preset threshold; Determine the ratio of highlight pixels corresponding to the target frame according to the total number of pixels included in the exposure histogram and the number of highlight pixels; According to the ratio of the highlight blocks and / or the ratio of the highlight pixels, the overexposure evaluation value corresponding to the target frame is calculated.
5. The multi-frame wide dynamic exposure control method according to any one of claims 1 to 4, characterized in that: For each of the exposure frames, determining the target exposure corresponding to the exposure frame according to the reference exposure corresponding to the exposure frame and the evaluation value corresponding to the target frame includes: When the exposure frame is the first exposure frame in the exposure frame sequence, a preset exposure target value is obtained, and a first target exposure corresponding to the exposure frame is determined according to the exposure target value, a reference exposure corresponding to the exposure frame, and an evaluation value corresponding to the exposure frame; When the exposure frame is not the first exposure frame in the exposure frame sequence, obtaining a reference exposure ratio corresponding to the exposure frame, and determining a second target exposure corresponding to the exposure frame according to the reference exposure ratio corresponding to the exposure frame, a reference exposure corresponding to the exposure frame, and an evaluation value corresponding to the target frame; The target exposure corresponding to each exposure frame is the first target exposure or the second target exposure.
6. The multi-frame wide dynamic exposure control method according to claim 5, characterized in that: For each of the exposure frames, determining a second target exposure corresponding to the exposure frame according to a reference exposure ratio corresponding to the exposure frame, a reference exposure corresponding to the exposure frame, and an evaluation value corresponding to the target frame, comprises: Obtaining a preset ratio range, and determining a relative exposure ratio corresponding to the target frame according to the ratio range and an evaluation value corresponding to the target frame; Acquire a previous relative exposure ratio set corresponding to the exposure frame, and determine the absolute exposure ratio corresponding to the exposure frame according to the previous relative exposure ratio set and the relative exposure ratio corresponding to the target frame; the previous relative exposure ratio set includes relative exposure ratios corresponding to all exposure frames that are ranked earlier than the exposure frame in the exposure frame sequence; the target exposure ratio corresponding to the exposure frame is the exposure ratio of the exposure frame relative to the first exposure frame in the exposure frame sequence; Determining a target exposure ratio corresponding to the exposure frame according to a reference exposure ratio corresponding to the exposure frame and an absolute exposure ratio corresponding to the exposure frame; According to the target exposure ratio corresponding to the exposure frame and the reference exposure corresponding to the exposure frame, a second target exposure corresponding to the exposure frame is calculated.
7. The multi-frame wide dynamic exposure control method according to claim 6, characterized in that: The proportion range includes a first proportion threshold and a second proportion threshold; the first proportion threshold is greater than the second proportion threshold; Wherein, for each of the exposure frames, determining the relative exposure ratio corresponding to the target frame according to the proportion range and the evaluation value corresponding to the target frame includes: Determine whether the evaluation value corresponding to the target frame is within the proportion range; When it is determined that the evaluation value corresponding to the target frame is within the proportion range, based on the determined interpolation formula, the relative exposure ratio corresponding to the target frame is calculated according to the first proportion threshold, the second proportion threshold and the evaluation value corresponding to the target frame; When it is determined that the evaluation value corresponding to the target frame is not within the proportion range, and when the evaluation value corresponding to the target frame is greater than the first proportion threshold, the maximum value of the adjustable exposure ratio corresponding to the first proportion threshold is determined as the relative exposure ratio corresponding to the target frame; When the evaluation value corresponding to the target frame is less than the second proportion threshold, the minimum value of the adjustable exposure ratio corresponding to the second proportion threshold is determined as the relative exposure ratio corresponding to the target frame.
8. A multi-frame wide dynamic exposure control device, characterized in that: The device comprises: An acquisition module, configured to acquire an exposure frame sequence and automatic exposure information corresponding to the exposure frame sequence; the exposure frame sequence includes a plurality of exposure frames and the exposure frame sequence is sorted in descending order based on the automatic exposure amount of each exposure frame; the automatic exposure information includes frame exposure information of each exposure frame; a determination module, configured to determine, for each of the exposure frames, an evaluation value corresponding to the target frame according to the frame exposure information of the target frame; the target frame is the exposure frame or an adjacent exposure frame corresponding to the exposure frame; the adjacent exposure frame is adjacent to the exposure frame in the exposure frame sequence; The determination module is further configured to determine, for each exposure frame, a reference exposure value corresponding to the exposure frame; The determination module is further configured to determine, for each exposure frame, a target exposure corresponding to the exposure frame according to a reference exposure corresponding to the exposure frame and an evaluation value corresponding to the target frame.
9. A multi-frame wide dynamic exposure control device, characterized in that: The device comprises: A memory storing executable program code; a processor coupled to the memory; The processor calls the executable program code stored in the memory to execute the multi-frame wide dynamic exposure control method as described in any one of claims 1-7.
10. A computer storage medium, characterized in that: The computer storage medium stores computer instructions, and when the computer instructions are called, they are used to execute the multi-frame wide dynamic exposure control method as described in any one of claims 1-7.
