Image processing apparatus and automatic exposure control method

Abstract

The invention discloses an image processing device and an automatic exposure control method, and relates to the technical field of image processing. The image processing apparatus includes a controller, an image processor, and a processor. The controller outputs a plurality of mutually different preset exposure control parameters to the image sensor in a first period after the device is started, so that the image sensor generates a plurality of first image frame data based on the preset exposure control parameters. The image processor generates a plurality of statistical data according to the preset image frame data. The processor determines a second exposure control parameter according to the statistical data, and outputs the first exposure control parameter to the image sensor through the controller, so that the image sensor generates second image frame data based on the first exposure control parameter in a second period, wherein the image frame rate of each of the first image frame data is higher than that of the second image frame data, and the resolution of each of the first image frame data is lower than that of the second image frame data.

Description

Technical Field

[0001] The present application relates to the field of image processing technology, and in particular to an image processing device and an automatic exposure control method. Background Art

[0002] The automatic exposure control mechanism in the prior art controls the image sensor to generate the first frame to determine an exposure parameter according to the brightness information of the first frame, and controls the image sensor to continue to generate the second frame according to the exposure parameter. Then, the automatic exposure control mechanism updates the exposure parameter according to the brightness information of the second frame, and controls the image sensor to generate the third frame according to the updated exposure parameter. Similarly, the automatic exposure control mechanism can repeatedly perform the above operations to find the exposure parameter suitable for the current shooting scene. However, in the above-mentioned prior art, the multiple frames taken all have the same original preset frame rate and resolution, which makes the overall generation time of the above-mentioned multiple frames too long and requires a long computing time, resulting in low processing efficiency of automatic exposure control. Summary of the invention

[0003] In some embodiments, one of the objectives of the present application is to provide an image processing device and an automatic exposure control method thereof that can improve the efficiency of automatic exposure control, so as to improve the deficiencies of the prior art.

[0004] In some embodiments, the image processing device includes a controller, an image processor, and a processor. The controller sequentially outputs a plurality of first exposure control parameters to an image sensor in a first period after the image processing device is turned on, so that the image sensor generates a plurality of first image frame data based on the plurality of first exposure control parameters, wherein the plurality of first exposure control parameters are different from each other. The image processor generates a plurality of statistical data based on the plurality of first image frame data. The processor determines a second exposure control parameter based on the plurality of statistical data, and outputs the second exposure control parameter to the image sensor via the controller, so that the image sensor generates a second image frame data based on the second exposure control parameter in a second period, wherein the image frame rate of each of the plurality of first image frame data is higher than the image frame rate of the second image frame data, and the resolution of each of the plurality of first image frame data is lower than the resolution of the second image frame data.

[0005] In some embodiments, an automatic exposure control method performed by an image processing device includes: sequentially outputting multiple first exposure control parameters to an image sensor during a first period after the image processing device is turned on, so that the image sensor generates multiple first frame data based on the multiple first exposure control parameters, wherein the multiple first exposure control parameters are different from each other; sequentially generating multiple statistical data based on the multiple first frame data; and determining a second exposure control parameter based on the multiple statistical data, and outputting the second exposure control parameter to the image sensor, so that the image sensor generates a second frame data based on the second exposure control parameter during a second period, wherein the frame rate of each of the multiple first frame data is higher than the frame rate of the second frame data, and the resolution of each of the multiple first frame data is lower than the resolution of the second frame data.

[0006] The features, implementation and effects of the present application are described in detail below with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Figure 1 A schematic diagram of an image processing device is drawn according to some embodiments of the present application;

[0008] Figure 2A According to some embodiments of the present application, Figure 1 Operation flow chart of the image processing device;

[0009] Figure 2B To draw a connection according to some embodiments of the present application Figure 2A A flowchart of subsequent operations;

[0010] Figure 3A According to some embodiments of the present application, Figure 1 An operation timing diagram of an image processing device;

[0011] Figure 3B To generate a drawing according to some embodiments of the present application Figure 1 A schematic diagram of waveforms of multiple image frame data;

[0012] Figure 4A According to some embodiments of the present application, Figure 1 A schematic diagram of a processor performing a linear interpolation operation based on multiple statistical data;

[0013] Figure 4B According to some embodiments of the present application, Figure 1 A schematic diagram of a processor performing a linear interpolation operation based on multiple statistical data;

[0014] Figure 4C According to some embodiments of the present application, Figure 1A schematic diagram of a processor performing a linear interpolation operation based on multiple statistical data; and

[0015] Figure 5 A flowchart of an automatic exposure control method is drawn according to some embodiments of the present application.

[0016] 100: image processing device;

[0017] 101: Image sensor;

[0018] 110: image input interface circuit;

[0019] 120: controller;

[0020] 125: instruction storage circuit;

[0021] 130: image processor;

[0022] 135: data storage circuit;

[0023] 140: processor;

[0024] 500: Automatic exposure control method;

[0025] CL: Curve;

[0026] CMD1~CMD5: preset commands;

[0027] ET4, ET5: exposure time;

[0028] F1~F5: Preset exposure control parameters;

[0029] F6: Exposure control parameters;

[0030] FD11~FD15: image frame data;

[0031] FD2: image frame data;

[0032] FI1~FI4: picture frame period;

[0033] FT: frame synchronization timing information;

[0034] S201 to S220 operations;

[0035] S510, S520, S530: operation;

[0036] SA: address information;

[0037] SD1~SD5: Statistical data;

[0038] T1: first period;

[0039] T2: second period;

[0040] TL: target brightness value;

[0041] t0~t19: time. DETAILED DESCRIPTION

[0042] All words used in this application have their usual meanings. The definitions of the above words in commonly used dictionaries, including any use examples of words discussed herein in the content of this application are only examples and should not limit the scope and meaning of this application. Similarly, this application is not limited to the various embodiments shown in this specification.

[0043] As used in this application, "coupled" or "connected" may refer to two or more components making direct physical or electrical contact with each other, or making indirect physical or electrical contact with each other, or may refer to two or more components operating or acting on each other. As used in this application, the term "circuit" may refer to a device composed of at least one transistor and / or at least one active and passive component connected in a certain manner to process signals.

[0044] Figure 1 A schematic diagram of an image processing device 100 is drawn according to some embodiments of the present application. In some embodiments, the image processing device 100 may be operated during a first period (e.g., Figure 3A In the first period T1, the image sensor 101 is configured with different multiple preset exposure control parameters F1-F5, so that the image sensor 101 can generate multiple frame data FD11-FD15 in sequence based on the multiple different preset exposure control parameters F1-F5 during the first period. In this way, the image processing device 100 can further determine the exposure control parameter F6 suitable for the current environment based on the frame data FD11-FD15, and in the second period (for example, Figure 3A The image sensor 101 is configured with the exposure control parameter F6 during the second period T2 of the image sensor 101, so that the image sensor 101 can subsequently generate frame data FD2 with a more appropriate exposure level. In some embodiments, each of the plurality of preset exposure control parameters F1-F5 and the exposure control parameter F6 may include configuration parameter information of the shutter time (i.e., exposure time) of the image sensor 101, the gain of the image sensor 101 (and / or the image processor 130), and / or the aperture size of the image sensor 101.

[0045] Specifically, in some embodiments, the image processing device 100 may include an image input interface circuit 110, a controller 120, an instruction storage circuit 125, an image processor 130, a data storage circuit 135, and a processor 140. The image input interface circuit 110 is coupled to the image sensor 101 to receive the image frame data (e.g., the aforementioned plurality of image frame data FD11-FD15 and image frame data FD2) generated by the image sensor 101, and transmit the received image frame data to the image processor 130. In some embodiments, during the process of transmitting the image frame data, the image input interface circuit 110 may obtain image frame synchronization timing information FT related to the image frame data, and provide the image frame synchronization timing information FT to the controller 120. In some embodiments, the image frame synchronization timing information FT includes, but is not limited to, the image frame start time, the image frame end time, and / or the specific line number information of the corresponding image frame data. For example, in the process of transmitting multiple image frame data FD11~FD15 to the image processor 130, the image input interface circuit 110 can obtain the frame synchronization timing information FT of each of the multiple image frame data FD11~FD15, and can provide the frame synchronization timing information FT to the controller 120, so that the controller 120 can perform corresponding operations in sequence according to the relevant timing information of the current image frame.

[0046] The instruction storage circuit 125 may be a buffer that stores a plurality of preset instructions CMD1-CMD5 executed in the aforementioned first period. The controller 120 may read the instruction storage circuit 125 in the first period after the image processing device 100 is powered on, so as to sequentially execute the plurality of preset instructions CMD1-CMD5. In some embodiments, each of the plurality of preset instructions CMD1-CMD5 is used to configure a corresponding storage address (e.g., address information SA described later) of preset exposure control parameters F1-F5 and / or a plurality of statistical data SD1-SD5 corresponding to the image sensor 101 in the first period. The controller 120 may sequentially execute the plurality of preset instructions CMD1-CMD5 according to the aforementioned frame synchronization timing information FT, so as to sequentially output the plurality of preset exposure control parameters F1-F5 to the image sensor 101 in the first period, so as to configure the image sensor 101 to generate a plurality of frame data FD11-FD15 with different plurality of preset exposure control parameters F1-F5. The plurality of preset exposure control parameters F1 - F5 are preset and have different setting values ​​respectively. That is, the plurality of preset exposure control parameters F1 - F5 are not generated according to the image frame data output by the image sensor 101 .

[0047] The image processor 130 may generate a plurality of statistical data SD1-SD5 according to the plurality of image frame data FD11-FD15. For example, the image processor 130 may perform brightness statistics according to the image frame data FD11 to determine brightness information of the image frame data FD11 and generate statistical data SD1 accordingly. In other words, the statistical data SD1 may be used to indicate brightness information of the image frame data FD11. Similarly, the image processor 130 may perform brightness statistics according to the image frame data FD12 to determine brightness information of the image frame data FD12 and generate statistical data SD2 accordingly. Similarly, the image processor 130 may perform brightness statistics according to the plurality of image frame data FD11-FD15 to determine brightness information of the plurality of image frame data FD11-FD15 and generate a plurality of statistical data SD1-SD5.

[0048] The data storage circuit 135 stores a plurality of statistical data SD1-SD5. In some embodiments, the data storage circuit 135 may be a buffer, but the present application is not limited thereto. Based on the plurality of preset instructions CMD1-CMD5 executed by the controller 120, the image processor 130 may successively obtain the address information SA for storing each statistical data SD1-SD5 in the data storage circuit 135. In this way, the image processor 130 may obtain the address information SA of the corresponding data before generating the corresponding data in the plurality of statistical data SD1-SD5. Accordingly, when the image processor 130 generates the corresponding data, the image processor 130 may store the corresponding data in the storage space corresponding to the address information SA in the data storage circuit 135 according to the address information SA. It should be noted that, it should be particularly noted that the time point at which the controller 120 executes each preset instruction CMD1-CMD5 and the time point at which the controller 120 transmits the address information SA corresponding to each statistical data SD1-SD5 may be asynchronous.

[0049] The processor 140 is coupled to the data storage circuit 135 to obtain a plurality of statistical data SD1-SD5. The processor 140 determines the exposure control parameter F6 according to the plurality of statistical data SD1-SD5, and outputs the exposure control parameter F6 to the image sensor 101 via the controller 120 in a second period after the first period. Thus, the image sensor 101 can generate the image frame data FD2 having brightness information suitable for the current environment according to the exposure control parameter F6 in the second period.

[0050] Figure 2A According to some embodiments of the present application, Figure 1 An operation flow chart of the image processing apparatus 100, and Figure 2B To draw a connection according to some embodiments of the present application Figure 2A Flowchart of subsequent operations. Figure 3A According to some embodiments of the present application, Figure 1 For ease of understanding, the following will refer to the operation timing diagram of the image processing device 100. Figure 1 and Figure 3A illustrate Figure 2A and Figure 2B Multiple operations.

[0051] In operation S201, during the first period after the image processing device 100 is powered on, the initialization configuration is performed and the preset command CMD1 is executed to output the initial setting and the preset exposure control parameter F1 to the image sensor 101 and output the address information SA corresponding to the statistical data SD1 to the image processor 130. For example, Figure 3A As shown, at time t0, the image processing device 100 is turned on, so that each circuit in the image processing device 100 (for example, including, but not limited to, the image input interface circuit 110, the image processor 130, etc.) and the image sensor 101 are initialized. After the initialization is completed, the controller 120 can read the instruction storage circuit 125 to execute the preset instruction CMD1 and output the preset exposure control parameter F1 to the image sensor 101 and output the address information SA corresponding to the statistical data SD1 to the image processor 130. It should be noted that in different embodiments, the controller 120 can also transmit the address information SA corresponding to the statistical data SD1 to the image processor 130 at any time between time t0 and time t3.

[0052] In operation S202, the preset command CMD2 is executed to output the preset exposure control parameter F2 to the image sensor 101. Figure 3A As shown, at time t1 , the controller 120 may read the command storage circuit 125 to execute the preset command CMD2 and output the preset exposure control parameter F2 to the image sensor 101 .

[0053] In operation S203, the image sensor 101 generates frame data FD11 based on the preset exposure control parameter F1. Figure 3A As shown, at time t2, the configuration based on the preset exposure control parameter F1 takes effect, so that the image sensor 101 can start to generate the image frame data FD11 accordingly. In operation S204, the preset instruction CMD3 is executed to output the preset exposure control parameter F3 to the image sensor 101. The relevant operation sequence corresponds to Figure 3A The time t3 in the process.

[0054] In operation S205, the image frame synchronization timing information FT is waited for and the image processor 130 generates statistical data SD1 according to the image frame data FD11. Figure 3AAs shown, at time t4, the image input interface circuit 110 may output the frame synchronization timing information FT after the frame data FD11 ends, and the image processor 130 may generate statistical data SD1 according to the frame data FD11, and store the statistical data SD1 in the corresponding position of the data storage circuit 135. In operation S206, the image sensor 101 generates the frame data FD12 based on the preset exposure control parameter F2. For example, Figure 3A As shown, at time t5, the configuration based on the preset exposure control parameter F2 takes effect, so that the image sensor 101 can start to generate the image frame data FD12 accordingly.

[0055] In operation S207, the preset command CMD4 is executed to output the preset exposure control parameter F4 to the image sensor 101 and output the address information SA corresponding to the statistical data SD2 to the image processor 130. The relevant operation sequence corresponds to Figure 3A In operation S208, the image frame synchronization timing information FT is waited for and the image processor 130 generates statistical data SD2 according to the image frame data FD12. Figure 3A As shown, at time t7, the image input interface circuit 110 can output the frame synchronization timing information FT after the frame data FD12 ends, and the image processor 130 can generate statistical data SD2 according to the frame data FD12, and store the statistical data SD2 in the corresponding position in the data storage circuit 135 according to the address information SA corresponding to the statistical data SD2.

[0056] In operation S209, the image sensor 101 generates frame data FD13 based on the preset exposure control parameter F3. Figure 3A As shown, at time t8, the configuration based on the preset exposure control parameter F3 takes effect, so that the image sensor 101 can start to generate the frame data FD13 accordingly. In operation S210, the preset instruction CMD5 is executed to output the preset exposure control parameter F5 to the image sensor 101 and output the address information SA corresponding to the statistical data SD3 to the image processor 130. The relevant operation sequence corresponds to Figure 3A The time t9 in the.

[0057] In operation S211, the image frame synchronization timing information FT is waited for and the image processor 130 generates statistical data SD3 according to the image frame data FD13. Figure 3AAs shown, at time t10, the image input interface circuit 110 may output the frame synchronization timing information FT after the frame data FD13 ends, and the image processor 130 may generate statistical data SD3 according to the frame data FD13, and store the statistical data SD3 in a corresponding position in the data storage circuit 135 according to the address information SA corresponding to the statistical data SD3. In operation S212, the image sensor 101 generates the frame data FD14 based on the preset exposure control parameter F4. For example, Figure 3A As shown, at time t11 , the configuration based on the preset exposure control parameter F4 takes effect, so that the image sensor 101 can start to generate the image frame data FD14 accordingly.

[0058] In operation S213, the preset exposure control parameter F5 is output to the image sensor 101 again, and the address information SA corresponding to the statistical data SD4 is output to the image processor 130. The relevant operation sequence corresponds to Figure 3A The time t12 in the process.

[0059] In operation S214, the image frame synchronization timing information FT is waited for and the image processor 130 generates statistical data SD4 according to the image frame data FD14. Figure 3A As shown, at time t13, the image input interface circuit 110 can output the frame synchronization timing information FT after the frame data FD14 ends, and the image processor 130 can generate statistical data SD4 according to the frame data FD14, and store the statistical data SD4 in the corresponding position in the data storage circuit 135 according to the address information SA corresponding to the statistical data SD4.

[0060] In operation S215, the image sensor 101 generates frame data FD15 based on the preset exposure control parameter F5. Figure 3A As shown, at time t14, the preset exposure control parameter F5 configured in operation S210 takes effect, so that the image sensor 101 can start to generate the frame data FD15 accordingly. In operation S216, the address information SA corresponding to the statistical data SD5 is output to the image processor 130.

[0061] In operation S217, the image frame synchronization timing information FT is waited for and the image processor 130 generates statistical data SD5 according to the image frame data FD15. Figure 3AAs shown, at time t16, the image input interface circuit 110 may output the frame synchronization timing information FT after the frame data FD15 ends, and the image processor 130 may generate statistical data SD5 according to the frame data FD15, and store the statistical data SD5 at a corresponding position in the data storage circuit 135 according to the address information SA corresponding to the statistical data SD5. In some embodiments, after the frame data FD15 is generated, the image sensor 101 enters an idle state and does not immediately take a picture.

[0062] In operation S218, the processor 140 determines the exposure control parameter F6 according to the plurality of statistical data SD1-SD5. In operation S219, the controller 120 outputs the exposure control parameter F6 to the image sensor 101, and increases the resolution of the frame data generated by the image sensor 101 and reduces the frame rate. In operation S220, the image sensor 101 generates the frame data FD2 with a higher resolution based on the exposure control parameter F6 during the second period. For example, the processor 140 may determine the exposure control parameter F6 according to the plurality of statistical data SD1-SD5 at time t17, and output the exposure control parameter F6 to the image sensor 101 via the controller 120 at time t18, and simultaneously increases the frame resolution of the image sensor 101 and reduces the frame rate. In this way, the image sensor 101 may generate the frame data FD2 with a higher resolution based on the exposure control parameter F6 during the second period T2 after time t19.

[0063] like Figure 3A As shown, each of the plurality of frame data FD11-FD15 generated in the first period T1 has the same frame period FI1, and the frame period FI1 is shorter than the frame period FI2 of the frame data FD2 generated in the second period T2. In other words, the frame rate of each of the plurality of frame data FD11-FD15 is higher than the frame rate of the frame data FD2. In addition, since the resolution of the image sensor 101 is improved in operation S220, the resolution of each of the plurality of frame data FD11-FD15 is lower than the resolution of the frame data FD2.

[0064] Through the above configuration, the image processing device 100 can quickly generate a plurality of image frame data FD11-FD15 with a relatively low resolution within the first period T1 after power-on, so as to reduce the data volume of the plurality of image frame data FD11-FD15 and determine the corresponding plurality of statistical data SD1-SD5 more quickly. In this way, the processing efficiency of determining the exposure control parameter F6 can be improved, so that the image processing device 100 can subsequently control the image sensor 101 more quickly to generate image frame data FD2 with a brightness suitable for the current scene based on the appropriate exposure control parameter F6 and a higher resolution.

[0065] In some related technologies, the image processing device controls the image sensor to generate the first frame data first, and determines the new exposure control parameters according to the first frame data and the target brightness value. Then, the image processing device configures the image sensor with the new exposure control parameters to control the image sensor to continue to generate the second frame data at the same frame rate and the same resolution as the first frame data, and determines the new exposure control parameters according to the second frame data and the target brightness value. Then, the image processing device configures the image sensor with the new exposure control parameters to control the image sensor to continue to generate the third frame data at the same frame rate and the same resolution. In this way, by repeatedly performing the above operations, the image processing device can make the brightness information of the last generated frame data meet the requirements of the target brightness value. However, the above-mentioned related technologies need to continuously generate multiple frame data at a lower frame rate and a larger resolution in order to make the brightness value of the image content close to the target brightness value, and it takes a lot of time to determine the appropriate exposure parameters. Compared to the above-mentioned technology, in some embodiments of the present application, the image processing device 100 can control the image sensor 101 with a plurality of different preset exposure control parameters in the first period T1 after power-on to quickly generate a plurality of frame data FD11-FD15 (which respectively correspond to different preset exposure control parameters F1-F5) at a higher frame rate (i.e., a lower frame period) and a lower resolution, and determine the appropriate exposure control parameter F6 based on the frame data FD11-FD15. In this way, the overall time for determining the exposure control parameters in the early stage can be significantly reduced, thereby improving the processing efficiency of determining the exposure parameters.

[0066] Figure 3B To generate a drawing according to some embodiments of the present application Figure 1 The waveform diagram of multiple frame data FD11 to FD15 in FIG. Figure 3A In the example of , each of the plurality of frame data FD11 to FD15 has the same frame period FI1 (ie, has the same frame rate). Figure 3A ,exist Figure 3B In the example, the frame rates of at least two of the multiple frame data FD11-FD15 are different from each other. For example, based on the configuration of the controller 120, the image sensor 101 generates the frame data FD14 with the frame period FI3 and the frame data FD15 with the frame period FI4, wherein the frame period FI4 is greater than the frame period FI3, and the frame period FI3 is greater than the frame period FI1. In some embodiments, according to the actual application needs or different scene requirements, the controller 120 can extend the corresponding exposure time by extending the frame period of each of the multiple frame data FD11-FD15. Figure 3BAs shown, compared with the frame data FD11-FD13, the exposure time ET4 of the frame data FD14 and the exposure time ET5 of the frame data FD15. In other words, in this example, the frame rate of each of the plurality of frame data FD11-FD13 is lower than the frame rate of the frame data FD14, and the frame rate of the frame data FD14 is lower than the frame rate of the frame data FD15. Therefore, it should be understood that the frame period and exposure time of each of the plurality of frame data FD11-FD15 generated during the first period T1 can be adjusted according to actual needs, and are not limited to Figure 3A and Figure 3B The setup method shown.

[0067] Figure 4A According to some embodiments of the present application, Figure 1 Schematic diagram of the processor 140 performing linear interpolation operation according to multiple statistical data SD1-SD5. Figure 4A As shown, multiple statistical data SD1-SD5 correspond to multiple preset exposure control parameters F1-F5, respectively, wherein the exposure values ​​corresponding to the multiple preset exposure control parameters F1-F5 are from low to high. For example, the exposure time corresponding to the multiple preset exposure control parameters F1-F5 may be from short time to long time or the corresponding gain of the image sensor 101 (and / or the image processor 130) may be from low gain to high gain. In some embodiments, the aforementioned exposure value may be defined as the product of the exposure time and the gain of the image sensor 101 (and / or the image processor 130). In some embodiments, the upper limit of the gain of the image sensor 101 (and / or the image processor 130) may be determined according to the requirements of the actual application (e.g., noise performance). Accordingly, the brightness values ​​corresponding to the multiple statistical data SD1-SD5 will also be from low to high.

[0068] In some embodiments, the brightness range covered by the multiple preset exposure control parameters F1~F5 can be configured as approximately 16 dynamic ranges (or 16 exposure compensation values), which can cover darker shooting scenes (such as indoor scenes) to brighter shooting scenes (such as outdoor scenes). Through the above configuration, the multiple statistical data SD1~SD5 generated based on the multiple preset exposure control parameters F1~F5 can cover more applicable scenes. In some embodiments, the exposure value spacing corresponding to two adjacent ones of the multiple preset exposure control parameters F1~F5 is approximately 4 to 5 dynamic ranges (or exposure compensation values). In some embodiments, the brightness range covered by the multiple preset exposure control parameters F1~F5 can be approximately 10 to 20 dynamic ranges (or exposure compensation values). In some embodiments, the brightness range covered by the multiple preset exposure control parameters F1~F5 can be approximately 12 to 18 dynamic ranges (or exposure compensation values).

[0069] By connecting multiple brightness values ​​corresponding to multiple statistical data SD1~SD5, we can get Figure 4A The processor 140 can execute the automatic exposure algorithm according to the plurality of statistical data SD1-SD5 to determine the exposure control parameters required to achieve the target brightness value TL. In this example, since the brightness distribution of the plurality of statistical data SD1-SD5 is relatively even, the target brightness value TL can usually be, but is not limited to, an average value or a median determined based on the plurality of statistical data SD1-SD5. Figure 4A As shown, the intersection point of the target brightness value TL and the curve CL corresponds to the exposure control parameter F6. In some embodiments, the processor 140 may use at least two of the plurality of statistical data SD1-SD5 to perform an interpolation operation (for example, but not limited to, a linear interpolation operation) to estimate the exposure control parameter F6 corresponding to the intersection point. For example, the processor 140 may use the statistical data SD3 and the statistical data SD2 to perform a linear interpolation operation (in this case, an interpolation operation) to determine the exposure control parameter F6.

[0070] Figure 4B According to some embodiments of the present application, Figure 1 Schematic diagram of the processor 140 performing linear interpolation operation according to multiple statistical data SD1-SD5. Figure 4A In this example, since the brightness distribution of the plurality of statistical data SD1-SD5 is concentrated in a lower brightness range, it means that the brightness of the current shooting scene may be lower. Under this condition, the processor 140 may set the target brightness value TL to a higher value, and use at least two of the plurality of statistical data SD1-SD5 corresponding to the higher brightness value (for example, the statistical data SD4 and the statistical data SD5) to perform a linear interpolation operation (in this example, an extrapolation operation) to estimate the exposure control parameter F6 corresponding to the intersection point.

[0071] Figure 4C According to some embodiments of the present application, Figure 1 Schematic diagram of the processor 140 performing linear interpolation operation according to multiple statistical data SD1-SD5. Figure 4A In this example, since the brightness distribution of the plurality of statistical data SD1-SD5 is concentrated in a higher brightness range, it means that the brightness of the current shooting scene may be higher. Under this condition, the processor 140 may set the target brightness value TL to a lower value, and use at least two of the plurality of statistical data SD1-SD5 corresponding to the lower brightness value (for example, the statistical data SD1 and the statistical data SD2) to perform a linear interpolation operation (in this example, an extrapolation operation) to estimate the exposure control parameter F6 corresponding to the intersection point.

[0072] Figure 5A flowchart of an automatic exposure control method 500 is drawn according to some embodiments of the present application. In some embodiments, the automatic exposure control method 500 may be, but is not limited to, Figure 1 The image processing device 100 is executed.

[0073] In operation S510, a plurality of preset exposure control parameters are sequentially output to an image sensor during a first period after the image processing device is turned on, so that the image sensor generates a plurality of first frame data based on the plurality of preset exposure control parameters, wherein the plurality of preset exposure control parameters are different from each other. In operation S520, a plurality of statistical data are sequentially generated according to the plurality of first frame data. In operation S530, a first exposure control parameter is determined according to the plurality of statistical data, and the first exposure control parameter is output to the image sensor, so that the image sensor generates a second frame data based on the first exposure control parameter during a second period, wherein the frame rate of each of the plurality of first frame data is higher than the frame rate of the second frame data, and the resolution of each of the plurality of first frame data is lower than the resolution of the second frame data.

[0074] The description of the multiple operations of the automatic exposure control method 500 can refer to the aforementioned multiple embodiments, so it will not be repeated here. The above multiple operations are only examples and are not limited to being performed in the order in this example. Without violating the operation mode and scope of each embodiment of the present application, the various operations under the automatic exposure control method 500 can be appropriately increased, replaced, omitted or performed in a different order. Alternatively, one or more operations under the automatic exposure control method 500 can be performed simultaneously or partially simultaneously.

[0075] In summary, the image processing device and automatic exposure control method provided in some embodiments of the present application can generate multiple frame data with lower resolution and higher frame rate with different multiple preset exposure control parameters in the first period after the device is turned on, and determine the exposure control parameters suitable for the current scene accordingly, so as to generate frame data with suitable brightness value with the exposure control parameters in the subsequent period. In this way, the processing efficiency of the automatic exposure control can be improved, so as to generate image data suitable for the current scene more quickly.

[0076] Although the embodiments of the present application are described above, these embodiments are not intended to limit the present application. Technicians in this technical field may change the technical features of the present application based on the explicit or implicit contents of the present application. All these changes may fall within the scope of patent protection sought by the present application. The scope of patent protection of the present application shall be based on the scope of the patent application of this specification.

Claims

1. An image processing device, characterized in that: include: a controller, which sequentially outputs a plurality of preset exposure control parameters to an image sensor during a first period after the image processing device is powered on, so that the image sensor generates a plurality of first image frame data based on the plurality of preset exposure control parameters, wherein the plurality of preset exposure control parameters are different from each other; an image processor, generating a plurality of statistical data according to the plurality of first image frame data; as well as a processor that determines a first exposure control parameter according to the plurality of statistical data, and outputs the first exposure control parameter to the image sensor via the controller, so that the image sensor generates a second frame data based on the first exposure control parameter during a second period, The frame rate of each of the plurality of first image frame data is higher than the frame rate of the second image frame data, and the resolution of each of the plurality of first image frame data is lower than the resolution of the second image frame data.

2. The image processing device according to claim 1, wherein: Also includes: An instruction storage circuit stores a plurality of preset instructions. The controller executes the plurality of preset instructions during the first period to sequentially output the plurality of preset exposure control parameters to the image sensor.

3. The image processing device according to claim 2, wherein: Also includes: an image input interface circuit, receiving the plurality of first image frame data from the image sensor to output to the image processor, and providing a frame synchronization timing information related to each of the plurality of first image frame data to the controller according to the plurality of first image frame data, The controller further executes the plurality of preset instructions in sequence according to the image frame synchronization timing information.

4. The image processing device according to claim 2, wherein: Also includes: a data storage circuit for storing the plurality of statistical data, The controller executes the plurality of preset instructions during the first period to sequentially output address information for storing a corresponding one of the plurality of statistical data in the data storage circuit to the image processor.

5. The image processing device according to claim 1, wherein: The image processor performs a brightness statistics according to the plurality of first image frame data to determine brightness information of the plurality of first image frame data and generate the plurality of statistical data accordingly.

6. The image processing device according to claim 1, wherein: The processor performs an interpolation operation according to the plurality of statistical data to determine the first exposure control parameter.

7. The image processing device according to claim 1, wherein: At least two of the plurality of first image frame data have different image frame rates.

8. An automatic exposure control method, characterized in that: Executed by an image processing device, the automatic exposure control method includes: Outputting a plurality of preset exposure control parameters to an image sensor in sequence within a first period after the image processing device is turned on, so that the image sensor generates a plurality of first image frame data based on the plurality of preset exposure control parameters, wherein the plurality of preset exposure control parameters are different from each other; Generate a plurality of statistical data in sequence according to the plurality of first image frame data; and determining a first exposure control parameter according to the plurality of statistical data, and outputting the first exposure control parameter to the image sensor, so that the image sensor generates a second frame data based on the first exposure control parameter during a second period, The frame rate of each of the plurality of first image frame data is higher than the frame rate of the second image frame data, and the resolution of each of the plurality of first image frame data is lower than the resolution of the second image frame data.

9. The automatic exposure control method according to claim 8, characterized in that: Outputting the plurality of preset exposure control parameters to the image sensor in sequence during the first period after the image processing device is powered on includes: A plurality of preset instructions are executed during the first period to sequentially output the plurality of preset exposure control parameters to the image sensor.

10. The automatic exposure control method according to claim 8, characterized in that: Determining the first exposure control parameter according to the plurality of statistical data includes: An interpolation operation is performed according to the plurality of statistical data to determine the first exposure control parameter.

Images