Image generation method and device, equipment and storage medium

Abstract

The invention belongs to the technical field of image processing, and discloses an image generation method and device, equipment and a storage medium. According to the invention, the control parameter adopted by the current frame image is adjusted to the target control parameter according to the statistical brightness information corresponding to the statistical image contained in the current frame image, and when the adjusted statistical brightness information does not meet the preset condition, the state of the filtering assembly is adjusted. Generating a preset number of frames of image signals after the current frame according to the target control parameter and the optical signal collected by the state of the filtering assembly, and performing digital gain and compression processing on the preset number of frames of image signals after the current frame based on the target control parameter to obtain a preset number of frames of target images after the current frame, the light filtering device capable of reducing the light incoming amount is utilized, the stroboflash phenomenon caused by exposure time reduction is avoided, the statistical brightness information is utilized to adjust the control parameters of image acquisition and processing, and result images with proper brightness and a proper dynamic range can be obtained in different scenes.

Description

Technical Field

[0001] The present invention relates to the field of image processing technology, and in particular to an image generation method, device, equipment and storage medium. Background Art

[0002] The current image processing method is to obtain a first image; determine whether the current scene captured by the shooting device is a high dynamic range scene based on the first image; when it is determined that the current scene is a high dynamic range scene, reduce the exposure of the shooting device when the current scene is a high dynamic range scene; and perform local correction on the brightness of the reference image obtained after reducing the exposure. This method can directly use the pixel statistical data of the shooting device, and there is no need to use long and short frame exposure fusion. In comparison, the amount of calculation is small, CPU computing power is saved, and overexposure can be prevented or mitigated without relying on high dynamic range photosensitive components, saving costs. However, the problem with this method is that the brightness of the collected image is reduced by reducing the exposure of the shooting device, and the stroboscopic phenomenon cannot be avoided. The brightness correction of the local reference image obtained after reducing the exposure makes it difficult to ensure the relative brightness and darkness relationship between different parts of the same scene, and the relationship between brightness adjustment and dynamic range adjustment is not established, so it is difficult to ensure the brightness stability of the result image and the adaptability of the dynamic range.

[0003] The above contents are only used to assist in understanding the technical solution of the present invention and do not constitute an admission that the above contents are prior art. Summary of the invention

[0004] The main purpose of the present invention is to provide an image generation method, device, equipment and storage medium, aiming to solve the technical problems in the prior art that flicker cannot be avoided when obtaining underexposed images by reducing the exposure time and the brightness stability and dynamic range adaptability of the generated image are difficult to ensure.

[0005] To achieve the above object, the present invention provides an image generation method, which comprises the following steps:

[0006] According to the statistical brightness information corresponding to the statistical image contained in the current frame image, the control parameter adopted by the current frame image is adjusted to obtain the target control parameter, and the adjusted statistical brightness information is obtained according to the target control parameter, wherein the control parameter is calculated by a preset number of frame images before the current frame, and the target control parameter is used to control the acquisition and processing of a preset number of frame images after the current frame;

[0007] If the adjusted statistical brightness information does not meet the preset condition, the state of the filter component is adjusted until the adjusted statistical brightness information meets the preset condition, and the filter component is used to adjust the amount of light entering during image acquisition;

[0008] Collecting a light signal based on the target control parameter and the state of the filter component, and generating a preset number of image signal frames after the current frame according to the light signal;

[0009] Based on the target control parameters, digital gain processing and compression processing are performed on a preset number of frame image signals after the current frame to obtain a target image of the preset number of frames after the current frame, wherein a pixel value range of the target image is a target pixel value range, a pixel value range of the image after the digital gain processing is not less than a pixel value range of the image before the digital gain processing, and the target pixel value range is pre-set based on application requirements of the current frame image.

[0010] Optionally, performing digital gain processing and compression processing on a preset number of frames of image signals after the current frame based on the target control parameter to obtain a preset number of frames of target images after the current frame includes:

[0011] Pre-processing a preset number of image signals after the current frame to obtain a pre-processed image;

[0012] Performing a gain process on the pre-processed image based on the target processing control parameter to obtain a reference image;

[0013] The reference image is compressed to obtain a target image of a preset number of frames after the current frame.

[0014] Optionally, performing digital gain processing and compression processing on a preset number of frames of image signals after the current frame based on the target control parameter to obtain a preset number of frames of target images after the current frame includes:

[0015] Performing a gain process on a preset number of frames of image signals after the current frame based on the target processing control parameter to obtain a first reference image;

[0016] performing data compression on the first reference image to obtain a second reference image;

[0017] The second reference image is post-processed to obtain a target image of a preset number of frames after the current frame.

[0018] Optionally, performing digital gain processing and compression processing on a preset number of frames of image signals after the current frame based on the target control parameter to obtain a preset number of frames of target images after the current frame includes:

[0019] Pre-processing a preset number of image signals after the current frame to obtain a pre-processed image;

[0020] Performing a gain process on the pre-processed image according to the target processing control parameter to obtain a first reference image;

[0021] performing data compression on the first reference image to obtain a second reference image;

[0022] The second reference image is post-processed to obtain a target image of a preset number of frames after the current frame.

[0023] Optionally, performing digital gain processing and compression processing on a preset number of frames of image signals after the current frame based on the target control parameter to obtain a preset number of frames of target images after the current frame includes:

[0024] Determine a first gain processing control parameter and a second gain processing control parameter according to the target processing control parameter, wherein a product of the first gain processing control parameter and the second gain processing control parameter is equal to the target processing control parameter;

[0025] Performing a first gain processing on a preset number of frames of image signals after the current frame according to the first gain processing control parameter to obtain a first reference image;

[0026] performing data compression on the first reference image to obtain a second reference image;

[0027] performing intermediate processing on the second reference image to obtain a third reference image;

[0028] performing a second gain processing on the third reference image according to the second gain processing control parameter to obtain a fourth reference image;

[0029] Data compression is performed on the fourth reference image to obtain a target image of a preset number of frames after the current frame, wherein the compressed images have the same brightness value range.

[0030] Optionally, bit width truncation is not performed in the gain processing or the gain processing is truncated to a preset brightness value range, the preset brightness value range is not less than the brightness value range of a preset number of frames of image signals after the current frame, and the compression parameters of the data compression are related to the gain of the gain processing.

[0031] Optionally, the statistical brightness information includes a statistical brightness value and a dynamic range extension value, and the step of adjusting the control parameters used by the current frame image according to the statistical brightness information corresponding to the statistical image contained in the current frame image to obtain the target control parameters includes:

[0032] The control parameters used by the current frame image are adjusted according to the statistical brightness value and the dynamic range extension value to obtain target control parameters.

[0033] Optionally, adjusting the control parameters adopted by the current frame image according to the statistical brightness value and the dynamic range extension value to obtain target control parameters includes:

[0034] Adjust the control parameters used by the current frame image according to the statistical brightness value to obtain initial control parameters;

[0035] The initial control parameter is adjusted according to the dynamic range extension value to obtain the target control parameter.

[0036] Optionally, adjusting the control parameters adopted by the current frame image according to the statistical brightness value to obtain initial control parameters includes:

[0037] Comparing the statistical brightness value with a preset brightness value;

[0038] Determine the parameter adjustment direction based on the comparison result;

[0039] The control parameters used by the current frame image are adjusted according to the parameter adjustment direction to obtain initial control parameters.

[0040] Optionally, adjusting the control parameters adopted by the current frame image according to the parameter adjustment direction to obtain initial control parameters includes:

[0041] When the parameter adjustment direction is parameter upward adjustment, if the adjusted control parameter is greater than the corresponding first parameter threshold, the first parameter threshold is used as the adjusted control parameter, and the next control parameter is adjusted according to the parameter adjustment direction;

[0042] Returning to the step of: if the adjusted control parameter is greater than the corresponding first parameter threshold, taking the first parameter threshold as the adjusted control parameter, and continuing to adjust the next control parameter according to the parameter adjustment direction to obtain the initial control parameter;

[0043] When the parameter adjustment direction is parameter downward adjustment, if the adjusted control parameter is less than the corresponding second parameter threshold, the second parameter threshold is used as the adjusted control parameter, and the next control parameter is adjusted according to the parameter adjustment direction;

[0044] Return to the step of using the second parameter threshold as the adjusted control parameter if the adjusted control parameter is less than the corresponding second parameter threshold, and continue to adjust the next control parameter according to the parameter adjustment direction to obtain the initial control parameter, and the first parameter threshold is greater than the second parameter threshold.

[0045] Optionally, when the parameter adjustment direction is parameter increase, the next control parameter is determined by a first parameter adjustment sequence; when the parameter adjustment direction is parameter decrease, the next control parameter is determined by a second parameter adjustment sequence, and the first parameter adjustment sequence is opposite to the second parameter adjustment sequence.

[0046] Optionally, adjusting the initial control parameter according to the dynamic range extension value to obtain the target control parameter includes:

[0047] Obtaining an initial digital gain parameter according to the initial control parameter;

[0048] When the initial digital gain parameter is less than the dynamic range extension value, adjusting the initial digital gain parameter based on the dynamic range extension value to obtain a target digital gain parameter, and reducing other current initial control parameters except the initial digital gain parameter;

[0049] If the other initial control parameter after reduction is less than the corresponding parameter threshold, the parameter threshold is used as the adjusted control parameter, and the next other initial control parameter corresponding to the current other initial control parameter is further reduced;

[0050] Return to the step of continuing to reduce the next other initial control parameter corresponding to the current other initial control parameter if the other initial control parameter after reduction is less than the corresponding parameter threshold, so as to obtain the target control parameter corresponding to the other initial control parameter, wherein the target control parameter includes the target digital gain parameter and the target control parameter corresponding to the other initial control parameter.

[0051] Optionally, if the adjusted statistical brightness information does not meet a preset condition, adjusting the state of the filter component until the adjusted statistical brightness information meets the preset condition includes:

[0052] If the adjusted statistical brightness value is still greater than the preset brightness value, the filter component is adjusted to a target state until the adjusted statistical brightness value reaches the preset brightness value, wherein the target state is a first state, a combination of the first state and the second state, or a combination of the first state and the third state, wherein the first state is a low light pass rate state, the second state is a state allowing visible light to pass, and the third state is a state allowing visible light and infrared light to pass.

[0053] In addition, to achieve the above object, the present invention further provides an image generating device, the image generating device comprising:

[0054] An adjustment module, used to adjust the control parameters used by the current frame image according to the statistical brightness information corresponding to the statistical image contained in the current frame image, obtain a target control parameter, and obtain the adjusted statistical brightness information according to the target control parameter, wherein the control parameter is calculated by a preset number of frame images before the current frame, and the target control parameter is used to control the acquisition and processing of a preset number of frame images after the current frame;

[0055] The adjustment module is further used to adjust the state of the filter component if the adjusted statistical brightness information does not meet the preset condition, until the adjusted statistical brightness information meets the preset condition, and the filter component is used to adjust the amount of light entering during image acquisition;

[0056] A processing module, configured to collect light signals based on the target control parameter and the state of the filter component, and generate a preset number of image signal frames after the current frame according to the light signals;

[0057] The processing module is further used to perform digital gain processing and compression processing on a preset number of frames of image signals after the current frame based on the target control parameters to obtain a target image of a preset number of frames after the current frame, wherein the pixel value range of the target image is a target pixel value range, the pixel value range of the image after the digital gain processing is not less than the pixel value range of the image before the digital gain processing, and the target pixel value range is pre-set based on the application requirements of the current frame image.

[0058] In addition, to achieve the above-mentioned purpose, the present invention also proposes an image generating device, which includes: a memory, a processor, and an image generating program stored in the memory and executable on the processor, wherein the image generating program is configured to implement the steps of the image generating method described above.

[0059] In addition, to achieve the above-mentioned purpose, the present invention further proposes a storage medium, on which an image generation program is stored, and when the image generation program is executed by a processor, the steps of the image generation method described above are implemented.

[0060] The present invention adjusts the control parameters used by the current frame image to the target control parameters according to the statistical brightness information corresponding to the statistical image contained in the current frame image, and adjusts the state of the filter component when the adjusted statistical brightness information does not meet the preset conditions, generates a preset number of frame image signals after the current frame according to the light signal collected according to the target control parameters and the state of the filter component, performs digital gain processing and compression processing on the preset number of frame image signals after the current frame based on the target control parameters, obtains the target image of the preset number of frames after the current frame, uses a filter device capable of reducing the amount of incoming light to avoid the stroboscopic phenomenon caused by the reduction of exposure time, and uses the statistical brightness information of the image to adjust the control parameters of image collection and processing, so as to obtain a result image with good quality, appropriate brightness and appropriate dynamic range in different scenes. BRIEF DESCRIPTION OF THE DRAWINGS

[0061] Figure 1 It is a structural schematic diagram of an image generating device in a hardware operating environment involved in an embodiment of the present invention;

[0062] Figure 2 It is the overall process framework of image acquisition and processing in the image generation method of the present invention;

[0063] Figure 3 It is a schematic diagram of the image acquisition unit in the image generation method of the present invention;

[0064] Figure 4 It is a schematic diagram of the image processing unit in the image generation method of the present invention;

[0065] Figure 5 It is a schematic diagram of the composition of the statistical unit in the image generation method of the present invention;

[0066] Figure 6 It is a schematic diagram of the exposure control unit in the image generation method of the present invention;

[0067] Figure 7 It is a flowchart of a first embodiment of an image generating method of the present invention;

[0068] Figure 8 It is a flowchart of a second embodiment of the image generating method of the present invention;

[0069] Fig. 9 This is a schematic diagram of a pre-processing module in an embodiment of an image generation method of the present invention;

[0070] Fig.10 This is a schematic diagram of a post-processing module in an embodiment of the image generation method of the present invention;

[0071] Fig.11 A schematic diagram of adding a pre-processing module and a post-processing module in an embodiment of the image generation method of the present invention;

[0072] Fig.12 A schematic diagram of adding an intermediate module, a second gain processing module and a second data compression module in an embodiment of an image generation method of the present invention;

[0073] Fig.13 It is a flowchart of a third embodiment of the image generating method of the present invention;

[0074] Fig.14 It is a structural block diagram of the first embodiment of the image generating device of the present invention.

[0075] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0076] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0077] Reference Figure 1 , Figure 1 The figure is a schematic diagram of the structure of an image generation device in a hardware operating environment involved in an embodiment of the present invention.

[0078] like Figure 1 As shown, the image generating device may include: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a wireless fidelity (Wireless-Fidelity, Wi-Fi) interface). The memory 1005 may be a high-speed random access memory (Random Access Memory, RAM) memory, or a stable non-volatile memory (Non-Volatile Memory, NVM), such as a disk memory. The memory 1005 may also be a storage device independent of the aforementioned processor 1001.

[0079] Those skilled in the art will understand that Figure 1 The structure shown in the figure does not constitute a limitation on the image generating device, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

[0080] like Figure 1As shown, the memory 1005 as a storage medium may include an operating system, a network communication module, a user interface module, and an image generation program.

[0081] exist Figure 1 In the image generating device shown, the network interface 1004 is mainly used for data communication with the network server; the user interface 1003 is mainly used for data interaction with the user; the processor 1001 and the memory 1005 in the image generating device of the present invention can be set in the image generating device, and the image generating device calls the image generating program stored in the memory 1005 through the processor 1001, and executes the image generating method provided by the embodiment of the present invention.

[0082] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0083] It should be noted that, in this article, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "includes a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element. In addition, components, features, and elements with the same name in different embodiments of the present application may have the same meaning or different meanings, and their specific meanings need to be determined by their explanation in the specific embodiment or further combined with the context of the specific embodiment.

[0084] It should be understood that, although the terms first, second, third, etc. may be used to describe various information in this article, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of this article, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein can be interpreted as "at the time of" or "when" or "in response to determination". Furthermore, as used in this article, the singular forms "one", "one" and "the" are intended to also include plural forms, unless there is an opposite indication in the context. It should be further understood that the terms "comprising" and "including" indicate that there are the described features, steps, operations, elements, components, projects, kinds, and / or groups, but do not exclude the existence, occurrence or addition of one or more other features, steps, operations, elements, components, projects, kinds, and / or groups. The terms "or", "and / or", "including at least one of the following" etc. used in this application can be interpreted as inclusive, or mean any one or any combination. For example, “comprising at least one of the following: A, B, C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”, and for another example, “A, B or C” or “A, B and / or C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”. An exception to this definition will only occur when a combination of elements, functions, steps or operations are inherently mutually exclusive in some manner.

[0085] It should be understood that, although the various steps in the flowchart in the embodiment of the present application are displayed in sequence according to the indication of the arrows, these steps are not necessarily performed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and it can be performed in other orders. Moreover, at least a portion of the steps in the figure may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and their execution order is not necessarily performed in sequence, but can be performed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.

[0086] As used herein, the words "if" and "if" may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to determining" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)", depending on the context.

[0087] It should be noted that in this article, step codes such as S10 and S20 are used for the purpose of expressing the corresponding content more clearly and concisely, and do not constitute a substantial limitation on the sequence. When implementing the step, those skilled in the art may execute S20 first and then S10, etc., but these should all be within the scope of protection of this application.

[0088] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0089] In the embodiments of the present application, an image generation is proposed, which may involve the following concepts:

[0090] Image dynamic range: The range of brightness differences between the darkest and lightest parts of an image that can be displayed.

[0091] Exposure control: The brightness of the captured image is controlled by adjusting the aperture size of the lens, the exposure time (shutter speed) of the image sensor, the gain, etc.

[0092] Digital gain: A gain method used in digital signal processing, usually achieved by performing arithmetic operations on the digital signal, such as multiplication.

[0093] Analog Gain: A method of gaining an analog signal, usually by changing the current or voltage of a component in a circuit, such as a transformer or amplifier.

[0094] Stroboscopic phenomenon: The interaction between the frequency of the light source and the exposure time of the image sensor, the lights in the scene produce streaks in the captured image.

[0095] The overall process framework of image acquisition and processing: refer to Figure 2 As shown. Among them, the image acquisition unit can collect light signals, convert them into image signals, and output the first image signal to the image processing unit. The image processing unit inputs the first image signal, processes the first image signal according to application requirements, and outputs the first output image; outputs the first statistical image and the second statistical image to the statistical unit according to statistical requirements. The statistical unit inputs the first statistical image and the second statistical image, performs dynamic range statistics and brightness statistics respectively, and outputs statistical information to the exposure control unit. The input first statistical image and the second statistical image can be the same image or different images. The exposure control unit inputs statistical information and outputs the Kth frame exposure control parameter and the Kth frame processing control parameter. The cache unit outputs the KNth (N≥1)th frame exposure control parameter to the image acquisition unit for the Kth frame image exposure; outputs the KNth frame processing control parameter to the image processing unit for the Kth frame image processing. At the same time, the input Kth frame exposure control parameter and the Kth frame processing control parameter are cached.

[0096] The specific composition of the image acquisition unit is as follows: Figure 3 As shown, the image acquisition unit includes a lens that can receive light and focus the image, and the amount of light entering can be controlled by the aperture. The image acquisition unit includes a filter module that controls the spectral range received by the image sensor, and has a switching device that can switch to a first state that reduces the pass rate of incident light. The filter module can be switched to a second state that only allows visible light to pass. The filter module can be switched to a third state that allows visible light and infrared light to pass. The filter module can be switched to a combination of the first state and the second state. The filter module can be switched to a combination of the first state and the third state. The optical signal is converted into a first image signal and transmitted to the image processing unit. Each pixel in the image sensor can sense at least one of the red, green, and blue visible lights, or can sense multiple visible lights mentioned above at the same time.

[0097] The specific composition of the image processing unit is as follows Figure 4As shown, the image processing unit includes a gain processing module and a data compression module. The data maximum value B2 of the second image (output image of the gain processing module) is not less than the data maximum value IB1 of the first image signal. The data maximum value OB1 of the first output image (output image of the data compression module) is not greater than the data maximum value B2 of the second image. When the gain value of the gain processing module is too large, in order to avoid the data bit width of the intermediate processing module being too high, the gain can be distributed. At this time, the image processing unit needs to add a second gain processing module and a second data compression module. The data maximum value B2 of the second image is not less than the data maximum value IB1 of the first image signal. The gain processing module can be combined with the data compression module, such as realizing the gain and data compression of the image data simultaneously through nonlinear compression. Optionally, a conventional image processing module is included as an intermediate processing module, such as white balance, interpolation, contrast enhancement, etc., which can be selected according to the resources or application requirements of the hardware platform. Optionally, a pre-processing module is added before the gain processing module, which can include but is not limited to one or more of noise reduction, white balance, deblurring, etc. Optionally, a post-processing module is added after the data compression module, which can include but is not limited to one or more of noise reduction, interpolation, enhancement, deblurring, etc. The image not processed by the gain processing module is output as a first statistical image to the statistical unit. The first statistical image may be the first image signal output by the image acquisition unit or the pre-processed image processed by the pre-processing module. The image processed by the gain processing module may be output as a second statistical image to the statistical unit. The image processed by the data compression module may be output as a second statistical image to the statistical unit. The post-processed image processed by the post-processing module may be output as a second statistical image to the statistical unit. Further, the gain processing module performs gain processing on the input first image signal and outputs the processed second image. Gain processing refers to multiplying the input first image signal by a certain digital gain dg. The digital gain dg is provided by the exposure control unit. After the gain processing, no data truncation processing is performed on the data. The maximum value B2 of the second image output after the gain processing is not less than the maximum value IB1 of the input first image signal. When the digital gain dg is greater than the preset gain threshold dg_max, part of the digital gain needs to be allocated to the second gain processing module. At this time, the digital gain of the gain processing module is dg1=dg_max, and the digital gain of the second gain processing module is dg2=dg / dg_max. The data compression module is used to compress the data of the second image and output the processed first output image. The data maximum value OB1 of the first output image is not greater than the data maximum value B2 of the second image. The data compression can be performed by mapping the second image using a preset nonlinear mapping curve to obtain the mapped first output image. The nonlinear mapping curve is related to the digital gain dg of the gain processing module.Correlation means that different digital gains dg generate different data maximum values ​​B2 of the second image, and the nonlinear mapping curve needs to uniformly compress high dynamic range images with different value ranges into the same value range.

[0098] The specific composition of the statistical unit is as follows: Figure 5 As shown, the statistical unit includes a dynamic range statistics module and a brightness statistics module, which output dynamic range extension values ​​and statistical brightness values ​​to the exposure control unit. The dynamic range statistics module performs dynamic range statistics on the first statistical image to obtain a dynamic range extension initial value. The dynamic range extension initial value is related to the brightness distribution of the highlight area in the first statistical image. When the dynamic range extension initial value is greater than the preset dynamic range extension threshold, the dynamic range extension value dr_rat takes the smaller value between the dynamic range extension initial value and the dynamic range extension threshold. The preset dynamic range extension threshold can control the degree of noise amplification caused by the digital gain within a certain range. The preset dynamic range extension threshold can be set according to the computing power of the logic platform, the level of noise reduction processing, etc. The dynamic range extension value is not less than 1. The dynamic range extension value determines the maximum value range that the acquired high dynamic range image can obtain. The brightness statistics module performs brightness statistics on the second statistical image to obtain a statistical brightness value. The statistical brightness value is related to the brightness distribution of each area in the second statistical image

[0099] The specific composition of the exposure control unit is as follows: Figure 6 As shown, the exposure control unit includes a first exposure control module and a second exposure control module. The first exposure control module compares the input statistical brightness value with the preset target brightness, and based on the frame exposure control parameter EPO used when collecting and processing the current frame image K-N and frame processing control parameters PRO K-N (K represents the frame number of the current frame image, N ≥ 1, KN represents the frame number of the historical frame image) perform the first adjustment process to obtain the initial value EPO of the exposure control parameter of the Kth frame Kini and the initial value PRO of the processing control parameter of the Kth frame Kini The preset target brightness refers to a brightness value that makes the image more suitable for subsequent applications. The second exposure control module, based on the input dynamic range extension value and the input initial value EPO of the exposure control parameter of the Kth frame Kini and the initial value PRO of the control parameter for the Kth frame processing Kini Perform the second adjustment process to obtain the exposure control parameter EPO of the Kth frame K and the Kth frame processing control parameter PRO K The adjustment process includes two aspects: adjustment direction and adjustment step size. When the first exposure control module performs the first adjustment process, its adjustment direction includes the following aspects: K-N Increase or decrease to obtain the initial value EPO of the exposure control parameter of the Kth frameKini When the first exposure control module performs the first adjustment, its adjustment direction includes the following: K-N Increase or decrease to obtain the initial value PRO of the Kth frame processing control parameter Kini When the first exposure control module performs the first adjustment, its adjustment step size refers to the change amount used when adjusting the direction, which can be set as a fixed step size or a dynamic change step size. The fixed step size can be set according to application requirements. The dynamic change step size can be set according to the difference between the statistical brightness value and the preset target brightness. The larger the difference, the larger the dynamic change step size. Initial value EPO of exposure control parameter of frame K Kini Including but not limited to the initial value of the sensor gain parameter sg Kini , initial value of aperture parameter lr Kini , initial value of exposure time parameter t Kini When the first exposure control module performs the first adjustment process, the filter switching signal is in the second state or the third state, and the switching is adjusted according to the application requirements. The initial value PRO of the control parameter for the Kth frame processing Kini Including but not limited to the initial value dg of the digital gain parameter of the gain processing module Kini When the statistical brightness value is less than the preset target brightness, based on EPO K-N and PRO K-N Increase to obtain EPO Kini and PRO Kini , so that the statistical brightness value after the first adjustment is close to the preset target brightness. When the statistical brightness value is less than the preset target brightness, the preferred parameter adjustment order is exposure time, aperture, sensor gain, and digital gain. When the statistical brightness value is greater than the preset target brightness, based on EPO K-N and PRO K-N Reduce to obtain EPO Kini and PRO Kini , so that the statistical brightness value after the first adjustment is close to the preset target brightness. When the statistical brightness value is greater than the preset target brightness, the preferred parameter adjustment order is digital gain, sensor gain, aperture, and exposure time. The statistical brightness value after the first adjustment refers to the EPO Kini With EPO K-N Changes between PRO Kini With PRO K-N The changes between the two act together on the statistical brightness value to obtain the brightness value. When the statistical brightness value is equal to the preset target brightness, no parameter adjustment is required, and EPO Kini =EPO K-N 、PRO Kini =PRO K-N .

[0100] Second exposure control module, Kth frame exposure control parameter EPO K Including but not limited to sensor gain parameter sg K , aperture parameter lr K , exposure time parameter t K , filter switching signal, etc. Kth frame processing control parameter PRO K Including but not limited to the digital gain parameter dg of the gain processing module K When the second exposure control module performs the second adjustment process, EPO K =EPO Kini , priority based on PRO Kini The initial value of the digital gain parameter dg in Kini Make adjustments, get PRO K The digital gain parameter dg in K The digital gain parameter dg K The dynamic range extension value dr_rat and the initial value dg of the digital gain parameter are input. Kini Take the larger one, that is, dg K =max(dr_rat,dg Kini ).dg K Greater than dg Kini When EPO is adjusted, the statistical brightness value after the second adjustment is greater than the statistical brightness value after the first adjustment. K With EPO Kini Changes between PRO K With PRO Kini The brightness value obtained by the changes between the two together acts on the statistical brightness value after the first adjustment. To ensure that the statistical brightness value after the second adjustment is equal to the statistical brightness value after the first adjustment, it is necessary to reduce EPO K The preferred parameter adjustment order is sensor gain, aperture, exposure time, and filter switching. The adjustment method is as follows: Greater than or equal to the preset sensor gain lower limit threshold sg min When the sensor gain is adjusted to Aperture parameter lr K =lr Kini , exposure time parameter t K =t Kini , so that the statistical brightness value after the second adjustment is equal to the statistical brightness value after the first adjustment. Less than the preset sensor gain lower limit threshold sg min When the sensor gain is adjusted to sg K =sg min , and then continue to reduce the aperture parameter lr K <lr Kini,like

[0101] Aperture parameter lr K When it is greater than or equal to the preset aperture threshold, the condition that the statistical brightness value after the second adjustment is equal to the statistical brightness value after the first adjustment is satisfied, and there is no need to continue adjusting the exposure time parameter, that is, t K =t Kini Otherwise, the exposure time t needs to be further reduced. K <t Kini , so that the statistical brightness value after the second adjustment is equal to the statistical brightness value after the first adjustment. If the exposure time parameter t K When the exposure time is greater than or equal to the preset lower limit threshold, the condition that the statistical brightness value after the second adjustment is equal to the statistical brightness value after the first adjustment is satisfied, and there is no need to adjust the filter switching device. Otherwise, the filter switching device needs to be switched to the first state with a lower light pass rate to meet the above condition. The filter switching can also be a combination of the first state and the second state, or a combination of the first state and the third state. The preset lower limit threshold of the exposure time can avoid the occurrence of stroboscopic phenomenon in the collected image frames. dg K When it is equal to dgKini, the statistical brightness value after the second adjustment is equal to the statistical brightness value after the first adjustment, and there is no need to adjust EPO K . The exposure control parameter EPO of the Kth frame K and the Kth frame processing control parameter PRO K Output to the cache unit.

[0102] The buffer unit is used to buffer the exposure control parameters and processing control parameters of each frame output by the exposure control unit. Before the exposure of the Kth frame begins, the exposure control parameter EPO of the KNth (N≥1) frame is buffered. K-N The KNth processing control parameter PRO is transmitted to the sensor to control the exposure of the Kth frame image. When the image processing unit starts to process the Kth frame image data, the KNth processing control parameter PRO K-N The image processing unit is passed to make the parameters effective for the K-th frame image data. The cache unit, the exposure control parameter EPO of the K-th frame K and the processing control parameter PRO of the Kth frame K When caching, the exposure control parameter EPO of the KNth frame that has been passed to the image acquisition unit and the image processing unit can be replaced K-N and the KNth frame processing control parameter PRO K-N , reducing storage space resource consumption.

[0103] The embodiment of the present invention provides an image generation method, referring to Figure 7 , Figure 7 FIG. 4 is a flow chart of a first embodiment of an image generating method according to the present invention.

[0104] In this embodiment, the image generation method includes the following steps:

[0105] Step S10: adjusting the control parameters used by the current frame image according to the statistical brightness information corresponding to the statistical image contained in the current frame image to obtain the target control parameters, and obtaining the adjusted statistical brightness information according to the target control parameters.

[0106] It should be noted that the executor of this embodiment is an image generating device, wherein the image generating device has functions such as data processing, data communication and program running. The image generating device can be a terminal device such as a computer, and of course it can also be other devices with similar functions, and this embodiment does not impose any restrictions on this.

[0107] It should be noted that the current image processing method is to obtain a first image; determine whether the current scene captured by the shooting device is a high dynamic range scene based on the first image; when it is determined that the current scene is a high dynamic range scene, reduce the exposure of the shooting device when the current scene is a high dynamic range scene; and perform local correction on the brightness of the reference image obtained after reducing the exposure. This method can directly use the pixel statistical data of the shooting device, and there is no need to use long and short frame exposure fusion. In comparison, the amount of calculation is small, CPU computing power is saved, and there is no need to rely on high dynamic range photosensitive components to prevent or reduce overexposure, saving costs. However, the problem with this method is that the brightness of the captured image is reduced by reducing the exposure of the shooting device, and the stroboscopic phenomenon cannot be avoided. It is difficult to ensure the relative brightness and darkness relationship of different parts of the same scene by performing brightness correction on the part of the reference image obtained after reducing the exposure. In addition, the relationship between brightness adjustment and dynamic range adjustment is not established, and it is difficult to ensure the brightness stability of the resulting image and the adaptability of the dynamic range.

[0108] In order to solve the above technical problems, this embodiment adjusts the control parameters used by the current frame image to the target control parameters according to the statistical brightness information corresponding to the statistical image contained in the current frame image, and adjusts the state of the filter component when the adjusted statistical brightness information does not meet the preset conditions, and generates a preset number of frame image signals after the current frame based on the light signal collected according to the target control parameters and the state of the filter component, performs digital gain processing and compression processing on the preset number of frame image signals after the current frame based on the target control parameters to obtain the target image, uses a filtering device that can reduce the amount of incoming light to avoid the stroboscopic phenomenon caused by the reduction of exposure time, and uses the statistical brightness information of the image to adjust the control parameters of image acquisition and processing, so as to obtain a result image with good quality, appropriate brightness and appropriate dynamic range in different scenes.

[0109] In a specific implementation, in this embodiment, it is necessary to first collect light signals, obtain the current frame image signal, and then obtain the statistical brightness information corresponding to the statistical image contained in the current frame image. The statistical image can be obtained from any image processing process, wherein the control parameters are used to control the acquisition and processing of the image. In this embodiment, the control parameters used for the current frame image are calculated from a preset number of frame images before the current frame. The adjusted control parameters are the target control parameters. The target control parameters can be used as control parameters corresponding to a preset number of frame images after the current frame, and are used for the acquisition and processing of a preset number of frame images after the current frame.

[0110] Step S20: If the adjusted statistical brightness information does not meet the preset condition, the state of the filter component is adjusted until the adjusted statistical brightness information meets the preset condition.

[0111] In a specific implementation, after adjusting the target control parameters corresponding to a preset number of frame images before the current frame adopted by the current frame image, the corresponding statistical brightness information will undergo a corresponding change. In this embodiment, it is necessary to further determine whether the adjusted statistical brightness information meets the preset conditions. If the statistical brightness information cannot meet the preset conditions, the state of the filter component is further adjusted in this embodiment. The state of the filter component will affect the amount of light entering during image acquisition, and will ultimately affect the statistical brightness information of the image.

[0112] Step S30: collecting light signals based on the target control parameters and the state of the filter component, and generating a preset number of image signal frames after the current frame according to the light signals.

[0113] In a specific implementation, the target control parameters include exposure control parameters and image processing control parameters. The exposure control parameters and the state of the filter component are used to control the acquisition of the image. The light signal is acquired by using the exposure control parameters and the state of the filter component, and the light signal is converted into an image signal.

[0114] Step S40: performing digital gain processing and compression processing on the image signals of a preset number of frames after the current frame based on the target control parameters to obtain target images of a preset number of frames after the current frame.

[0115] In a specific implementation, the target control parameters are used to further process the image signals of a preset number of frames after the current frame, such as digital gain processing and compression processing, so as to obtain a target image, which is a result image whose brightness and dynamic range meet the requirements in different scenes. The gain processing in this embodiment does not perform bit width truncation or the gain processing is truncated to a preset brightness value range. The preset brightness value range is not less than the brightness value range of the image signals of a preset number of frames after the current frame. The compression parameters of the data compression are related to the gain of the gain processing.

[0116] It should be noted that gain processing refers to increasing the brightness value range of the image signal to perform brightness compensation on the image. Specifically, the brightness value range of the image signal can be adjusted according to the gain value, wherein the gain value can be pre-set according to actual needs or calculated based on the image signal, and this embodiment does not impose any restrictions on this.

[0117] It should be understood that compared with the existing brightness compensation method, in which the data whose brightness exceeds the bit width is truncated during the gain processing of the image, resulting in information loss in the image, especially for images with a high dynamic range, the loss will be more obvious. Since the bit width is not truncated during the gain processing in this embodiment, the image can maintain a larger dynamic range, retain more brightness information, better maintain the brightness details and contrast in the image, and make the processed image closer to the real scene, thereby improving the visual effect of the image.

[0118] Alternatively, compared to the prior art in which the bit width is truncated to truncate the gain-processed image to the brightness value range of the image signal, since the gain processing in this embodiment is truncated to a preset brightness value range, and the preset brightness value range is larger than the brightness value range of the image signal, the loss of brightness information can be reduced, more brightness information can be retained, and the visual effect of the image can be improved.

[0119] In a specific implementation, the brightness value range of the image signal is [IB', IB], the preset brightness value range is [PB', PB], and the preset brightness value range is greater than the brightness value range of the image signal, which may refer to PB-PB'>IB-IB'. For example, the brightness value range of the image signal is [0,1023], and the preset brightness value range is [0,4095]; of course, the preset brightness value is greater than the brightness value range of the image signal, which may refer to PB>IB, and PB>IB'; of course, in actual applications, since the lower limit value in the brightness value range is fixed to 0, the preset brightness value range is greater than the brightness value range of the image signal, which may refer to PB>IB, and this embodiment does not impose any limitation on this.

[0120] This embodiment adjusts the control parameters used for the current frame image to the target control parameters according to the statistical brightness information corresponding to the statistical image contained in the current frame image, and adjusts the state of the filter component when the adjusted statistical brightness information does not meet the preset conditions, generates a preset number of frame image signals after the current frame according to the light signal collected according to the target control parameters and the state of the filter component, performs digital gain processing and compression processing on the preset number of frame image signals after the current frame based on the target control parameters, and obtains the target image of the preset number of frames after the current frame, uses a filter device capable of reducing the amount of incoming light to avoid the stroboscopic phenomenon caused by the reduction of exposure time, and uses the statistical brightness information of the image to adjust the control parameters of image collection and processing, so as to obtain a result image with better quality, appropriate brightness and appropriate dynamic range in different scenes.

[0121] refer to Figure 8 , Figure 8 FIG. 4 is a flow chart of a second embodiment of an image generating method according to the present invention.

[0122] Based on the first embodiment, in the image generating method of this embodiment, step S40 specifically includes:

[0123] Step S401: pre-processing a preset number of image signals after the current frame to obtain a pre-processed image.

[0124] Step S402: Perform a gain process on the pre-processed image based on the target processing control parameter to obtain a reference image.

[0125] In a specific implementation, a pre-processing module is added before the gain processing module, for example Fig. 9 As shown, it is used to process the image signal. The pre-processing in this embodiment includes but is not limited to one or more of noise reduction, white balance, deblurring, etc., and then the pre-processed image is gained to obtain a second image. The bit width is not truncated or is truncated to a preset brightness value range in the gain processing. The preset brightness value range is larger than the brightness value range of the image signal, and the statistical brightness of the second image reaches the target brightness.

[0126] Step S403: compressing the reference image to obtain a target image of a preset number of frames after the current frame.

[0127] In a specific implementation, after the gain is completed, the reference image is finally compressed to obtain a preset number of frames of images after the final current frame. It should be emphasized that the compression parameters of the data compression in this embodiment are related to the gain of the gain processing. The reference image in this embodiment is also Fig. 9 The second image shown in FIG. 1 and the target image of the preset number of frames after the current frame are also Fig. 9The first output image is shown in .

[0128] In an optional embodiment, a post-processing module may be added after the data compression module. The post-processing in this embodiment includes but is not limited to one or more of noise reduction, enhancement, defogging, deblurring, sharpening, etc. First, the image signal gain is processed in the above manner to obtain a first reference image, and then the first reference image is data compressed to obtain a second reference image. Finally, the second reference image is post-processed to obtain a preset number of frames of images after the current frame, for example Fig.10 As shown, the first reference image in this embodiment is Fig.10 The second image in the second reference image is Fig.10 Post-processed images in .

[0129] In an optional embodiment, a pre-processing module and a post-processing module may be added at the same time, for example Fig.11 As shown, the pre-processing is before gain is performed, and the post-processing is after compression, which is similar to the above process and will not be described again here.

[0130] In an optional embodiment, an intermediate processing module may also be added, such as Fig.12 As shown, an intermediate processing module is added to the image processing unit, and the intermediate processing includes but is not limited to one or more of noise reduction, white balance, deblurring, etc. In order to avoid the increase of resources in the intermediate processing module due to the excessive digital gain of the gain processing module and the excessive data bit width, the digital gain can be divided into two parts for processing, and a second gain processing module is added to the image processing unit. In addition, a second data compression module needs to be added accordingly. The compression parameter when compressing the second image is related to the first gain value, and specifically, the brightness value range of the second image generated by different first gain values ​​is different. The compression parameter of the compression processing is adjusted according to the different brightness value ranges, so that the compressed third image has the same brightness value range to reduce the data bit width. The gain processing is performed on the fourth image according to the second gain value, and the fifth image is obtained by multiplying the fourth image by the second gain value to obtain the fifth image. The compression parameter when compressing the fifth image is related to the second gain value, and specifically, the brightness value range of the fifth image generated by different second gain values ​​is different. The compression parameter of the compression processing is adjusted according to the different brightness value ranges, so that the compressed first output image has the same brightness value range. Furthermore, the brightness range of the third image is not greater than the brightness range of the second image, the brightness range of the fourth image is equal to the brightness range of the third image, the brightness range of the fifth image is not less than the brightness range of the fourth image, and the brightness range of the first output image is not greater than the brightness range of the fifth image. The first reference image in this embodiment is Fig.12The second image in the second reference image is Fig.12 The third image in the third reference image is Fig.12 The fourth image in the fourth reference image is Fig.12 The fifth image in the image, the target image of the preset number of frames after the current frame is Fig.12 The first output image in .

[0131] It should be understood that in this embodiment, by limiting the brightness value range of the third image to be no greater than the brightness value range of the second image, the bit width of the image before intermediate processing can be reduced, thereby reducing resource occupation; in this embodiment, by limiting the brightness value range of the fourth image to be equal to the brightness value range of the third image, it is possible to ensure that the brightness value range of the image before and after intermediate processing does not change, so as to maintain the stability of the image brightness value range. In this embodiment, by limiting the brightness value range of the fifth image to be no less than the brightness value range of the fourth image, it is possible to ensure that the image after the secondary gain processing has a higher brightness range than the image signal after the first gain processing, and ensure that the gain effect of the gain processing after the split is the same as that of the gain processing before the split; in this embodiment, by limiting the brightness value range of the first output image to be no greater than the brightness value range of the fifth image, it is possible to ensure that the image after compression processing can meet the bit width requirements and meet the brightness value range requirements of subsequent applications.

[0132] In a specific implementation, the brightness value range of the second image is [B2', B2], the brightness value range of the image signal is [IB', IB], B2-B2'≥IB-IB'; the brightness value range of the third image is [B3', B3], B3-B3'≤B2-B2'; the brightness value range of the fourth image is [B4', B4], B4-B4'=B3-B3', the brightness value range of the fifth image is [B5', B5], B5-B5'≥B4-B4', and the brightness value range of the first output image is [OB1', OB1], OB1-OB1'≤B5-B5'. The above method can be used to compress high dynamic images with different data ranges into a uniform data range. Compared with the first gain, the product of the digital gain values ​​corresponding to each gain processing in multiple gain processing is equal to the digital gain value corresponding to the first gain processing. For example, assuming that the digital gain value of the first gain processing is DG, the digital gain value of the first gain processing is DG1, and the digital gain value of the second gain processing is DG2, then DG=DG1*DG2.

[0133] This embodiment obtains a high dynamic range image by performing non-truncated digital gain on a single frame image through gain processing, can relatively simply cope with wide dynamic scenes, obtain high dynamic range image effects, has no special requirements for hardware, thereby reducing costs, and can also enable the collected images of different brightness to reach a unified target brightness, thereby making the output high dynamic range image effect more stable, and can achieve unified processing of high dynamic range images with different pixel value ranges, so that the output image has a unified pixel value range, making subsequent processing schemes simpler, and through data compression, the output image has a unified data range, which enables the image processing unit to easily access different high bit width data generation schemes, such as multi-frame wide dynamic data, the scheme is simple, the effect is stable, and when the gain is too large, the gain can be decomposed, and part of the gain is performed in the second gain processing module, so that the intermediate processing maintains a limited bit width, achieving a better balance between resources and effects.

[0134] refer to Fig.13 , Fig.13 FIG. 4 is a flow chart of a third embodiment of an image generating method according to the present invention.

[0135] Based on the first embodiment above, in the image generating method of this embodiment, step S10 specifically includes:

[0136] Step S101: adjusting the control parameters used by the current frame image according to the statistical brightness value and the dynamic range extension value to obtain target control parameters.

[0137] In this embodiment, the statistical brightness information in this embodiment includes a statistical brightness value and a dynamic range expansion value. Specifically, the target control parameters corresponding to a preset number of frames of images before the current frame can be adjusted according to the statistical brightness value and the dynamic range expansion value, so as to obtain the target control parameters corresponding to the current frame.

[0138] In an optional embodiment, the target control parameters corresponding to a preset number of frame images before the current frame adopted by the current frame image can be adjusted according to the statistical brightness value to obtain the initial control parameters, and then the initial control parameters can be adjusted according to the dynamic range expansion value to obtain the target control parameters corresponding to the current frame.

[0139] In a specific implementation, the target control parameter corresponding to the preset number of frame images before the current frame adopted by the current frame image is adjusted according to the statistical brightness value, and the process of obtaining the initial control parameter is to compare the statistical brightness value with the preset brightness value, and then determine the parameter adjustment direction based on the comparison result, and then adjust the control parameter according to the parameter adjustment direction. There are three situations in the size relationship between the statistical brightness value and the preset brightness value. When the statistical brightness value is less than the preset brightness value, it can be determined that the parameter adjustment direction is to increase the parameter value. When the statistical brightness value is greater than the preset brightness value, it can be determined that the parameter adjustment direction is to reduce the parameter value. When the statistical brightness value is equal to the preset brightness value, there is no need to adjust the control parameter. The preset brightness value can be set accordingly according to actual needs, and this is not limited in this embodiment.

[0140] Further, after determining the parameter adjustment direction, in this embodiment, the target control parameter corresponding to the preset number of frame images before the current frame adopted by the current frame image is adjusted according to the parameter adjustment direction. If the adjusted control parameter is greater than the corresponding parameter threshold, then in this embodiment, the adjusted control parameter is first corrected to the corresponding parameter threshold, and then the next control parameter is adjusted according to the parameter adjustment direction. The above process is repeated until the adjustment of all control parameters is completed. In this embodiment, the parameter adjustment order is related to the parameter adjustment direction, that is, the size relationship between the statistical brightness value and the preset brightness value. For example, when the statistical brightness value is less than the preset brightness value, the parameter adjustment order is exposure time, aperture, sensor gain and digital gain. When the statistical brightness value is greater than the preset brightness value, the parameter adjustment order is digital gain, sensor gain, aperture and exposure time. Of course, it can also be adjusted according to actual conditions, which is not limited in this embodiment.

[0141] It should be emphasized that when the statistical brightness value is less than the preset brightness value, the parameter adjustment direction is parameter increase. In this case, the corresponding first parameter threshold is the upper limit of the parameter. When the statistical brightness value is greater than the preset brightness value, the parameter adjustment direction is parameter decrease. In this case, the corresponding second parameter threshold is the lower limit of the parameter. Therefore, the first parameter threshold is greater than the second parameter threshold, and the parameter adjustment order is also related to the parameter direction. When the parameter adjustment direction is parameter increase, the corresponding parameter adjustment order is the first parameter adjustment order. When the parameter adjustment direction is parameter decrease, the corresponding parameter adjustment order is the second parameter adjustment order. The first parameter adjustment order is opposite to the second parameter adjustment order. For example, the first parameter adjustment order is exposure time, aperture, sensor gain, digital gain, and the second parameter adjustment order is digital gain, sensor gain, aperture, and exposure time. For example, when the statistical brightness value is less than the preset target brightness, first increase the exposure time t k =t k-1*y_dst / y_sta, where k represents the frame number, t k-1 represents the target exposure time control parameter corresponding to the K-1th frame, t k Indicates the adjusted exposure time parameter. Increasing the exposure time will result in the adjusted statistical brightness value. = equal to the preset target brightness, and the adjusted exposure time is taken as the smaller of the preset exposure time upper limit threshold t_max. The preset exposure time upper limit threshold can avoid the excessive increase of exposure time causing the moving objects in the captured image to have tails, and also avoid the image frame number captured by the image sensor per unit time not meeting the application requirements. k ≤t_max, no further adjustment is required, and the aperture, sensor gain, and digital gain remain unchanged, i.e. lr k =lr k-1 ,sg k =sg k-1 、dg k =dg k-1 If t k >t_max, then t k = t_max, and other parameters need to be adjusted. If further adjustment is needed, first increase the aperture lr k >lr k-1 , increase the amount of light entering so that the adjusted statistical brightness value is equal to the preset target brightness, and take the smaller of the adjusted aperture parameter and the preset aperture upper limit threshold lr_max. k ≤lr_max, then no further adjustment is required, the sensor gain and digital gain remain unchanged, that is, sg k =sg k-1 、dg k =dg k-1 If lr k >lr_max, then lr k =lr_max, and other parameters need to be adjusted. If further adjustment is required, first increase the sensor gain sg k >sg k-1 , further increase the adjusted statistical brightness value to make it equal to the preset target brightness, and take the smaller of the adjusted sensor gain parameter and the preset sensor gain upper limit threshold sg_max. k ≤sg_max, no further adjustment is required, and the digital gain remains unchanged dg k =dg k-1 If sg k >sg_max, then sg k =sg_max, and other parameters need to be adjusted. Finally, if further adjustment is required, increase the digital gain dg k >dg k-1, further increase the adjusted statistical brightness value to make it equal to the preset target brightness. For another example, when the statistical brightness value is greater than the preset target brightness, first reduce the digital gain to Reduce the digital magnification factor so that the adjusted statistical brightness value is equal to the preset target brightness, and take the larger value between the adjusted digital gain parameter and the preset digital gain lower threshold dg_min. If dg k ≥dg_min, there is no need to continue adjustment, and the sensor gain, aperture, and exposure time remain unchanged, that is, sg k = sg k-1 、lr k = lr k-1 、t k = t k-1 。 If dg k <dg_min, then dg k = dg_min, and other parameters need to be continuously adjusted. When further adjustment is required, first reduce the sensor gain to Reduce the sensor magnification factor so that the adjusted statistical brightness is equal to the preset target brightness, and take the larger value between the adjusted sensor gain parameter and the preset sensor gain lower threshold sg_min. If sg k ≥sg_min, there is no need to continue adjustment, and the aperture and exposure time remain unchanged, that is, lr k = lr k-1 、t k = t k-1 。 If sg k <sg_min, then sg k = sg_min, and other parameters need to be continuously adjusted. When further adjustment is required, first reduce the aperture lr k <lr k-1 , if the adjusted statistical brightness value can be made equal to the preset target brightness, there is no need to continue adjustment, and the exposure time remains unchanged, that is, t k = t k-1 。 If the adjusted statistical brightness value is still greater than the preset target brightness when the aperture is reduced to the lower limit of the preset aperture parameter, other parameters need to be continuously adjusted. When further adjustment is finally required, reduce the exposure time t k <t k-1 , so that the further adjusted statistical brightness value is equal to the preset target brightness.

[0146] In an optional embodiment, the process of adjusting the initial control parameter according to the dynamic range extension value to obtain the target control parameter is to obtain the initial digital gain parameter according to the initial control parameter, and then compare the initial digital gain parameter with the dynamic range extension value, and when the initial digital gain parameter is less than the dynamic range extension value, the initial control parameter is adjusted to obtain the target control parameter. If the initial digital gain parameter is greater than or equal to the dynamic range extension value, the initial control parameter does not need to be adjusted.

[0147] In a specific implementation, when the initial digital gain parameter is less than the dynamic range expansion value, the process of adjusting the initial digital gain parameter is to use the dynamic range expansion value as the target digital gain parameter, thereby obtaining the target digital gain parameter. After adjustment in this way, the adjusted statistical brightness value will be greater than the preset target brightness. In order to make the adjusted statistical brightness value equal to the preset target brightness, the exposure control parameter needs to be adjusted down. The order of parameter adjustment is sensor gain, aperture, exposure time and filter state switching. If the other initial control parameters after reduction are less than the corresponding parameter threshold, the adjusted control parameters are adjusted to the corresponding parameter threshold, and the next other initial control parameters corresponding to the current other initial control parameters are continuously reduced, where the parameter threshold is the parameter lower limit. For example, when When it is greater than or equal to the preset sensor gain lower limit threshold, the sensor gain is adjusted to The aperture parameter and exposure time parameter use the initial values ​​given by the first exposure control module, so that the adjusted statistical brightness is equal to the preset target brightness. When it is less than the preset sensor gain lower limit threshold, further adjustment is required, and the sensor gain is adjusted to sg first. k '=sg_min, sg_min represents the preset sensor gain lower limit threshold, and then reduces the aperture parameter lr k ' <lr k , reduce the amount of light entering. If the adjusted statistical brightness value can be equal to the preset target brightness, there is no need to continue adjusting, and the exposure time parameter uses the initial value given by the first exposure control module. If the aperture is reduced to the preset aperture parameter lower limit, the adjusted statistical brightness value is still greater than the preset target brightness, then it is necessary to further adjust the exposure time parameter and reduce the exposure time t k ' <t k , so that the statistical brightness value after further adjustment is equal to the preset target brightness.

[0150] Furthermore, if the adjusted statistical brightness value is still greater than the preset brightness value, the filter component is adjusted to a target state until the adjusted statistical brightness value reaches the preset brightness value. The target state in this embodiment is a first state, a combination of the first state and the second state, or a combination of the first state and the third state. The first state is a low light pass rate state, the second state is a state allowing visible light to pass, and the third state is a state allowing visible light and infrared light to pass. For example, if the exposure time is reduced to a preset exposure time lower limit threshold, the adjusted statistical brightness value is still greater than the preset target brightness, it is necessary to switch the filter component, add the first state based on the existing state (such as the second state or the third state), reduce the amount of light entering, so that the further adjusted statistical brightness value is equal to the preset target brightness.

[0151] In this embodiment, the target control parameters corresponding to the preset number of frame images before the current frame adopted by the current frame image are adjusted according to the statistical brightness value to obtain the initial control parameters; the initial control parameters are adjusted according to the dynamic range expansion value to obtain the target control parameters, and the control parameters are adjusted according to different parameter adjustment directions and parameter adjustment sequences to obtain the final target control parameters corresponding to the current frame. The target control parameters obtained by the above-mentioned method can reduce noise amplification and avoid flickering, and at the same time, the subsequent output images have a stable effect and an adaptive high dynamic range.

[0152] In addition, an embodiment of the present invention further provides a storage medium, on which an image generation program is stored. When the image generation program is executed by a processor, the steps of the image generation method described above are implemented.

[0153] Reference Fig.14 , Fig.14 It is a structural block diagram of the first embodiment of the image generating device of the present invention.

[0154] like Fig.14 As shown, the image generating device proposed in the embodiment of the present invention includes:

[0155] The adjustment module 10 is used to adjust the control parameters used in the current frame image according to the statistical brightness information corresponding to the statistical image contained in the current frame image, obtain the target control parameters, and obtain the adjusted statistical brightness information according to the target control parameters. The control parameters are calculated from a preset number of frame images before the current frame, and the target control parameters are used to control the acquisition and processing of a preset number of frame images after the current frame.

[0156] The adjustment module 10 is also used to adjust the state of the filter component if the adjusted statistical brightness information does not meet the preset conditions until the adjusted statistical brightness information meets the preset conditions. The filter component is used to adjust the amount of light entering during image acquisition.

[0157] The processing module 20 is used to collect the optical signal based on the target control parameter and the state of the filter component, and generate a preset number of image signal frames after the current frame according to the optical signal.

[0158] The processing module 20 is further used to perform digital gain processing and compression processing on a preset number of frames of image signals after the current frame based on the target control parameters to obtain a target image of a preset number of frames after the current frame, wherein the pixel value range of the target image is a target pixel value range, the pixel value range of the image after digital gain processing is not less than the pixel value range of the image before digital gain processing, and the target pixel value range is pre-set based on the application requirements of the current frame image.

[0159] This embodiment adjusts the control parameters used for the current frame image to the target control parameters according to the statistical brightness information corresponding to the statistical image contained in the current frame image, and adjusts the state of the filter component when the adjusted statistical brightness information does not meet the preset conditions, generates a preset number of frame image signals after the current frame according to the light signal collected according to the target control parameters and the state of the filter component, performs digital gain processing and compression processing on the preset number of frame image signals after the current frame based on the target control parameters, and obtains the target image of the preset number of frames after the current frame, uses a filter device capable of reducing the amount of incoming light to avoid the stroboscopic phenomenon caused by the reduction of exposure time, and uses the statistical brightness information of the image to adjust the control parameters of image collection and processing, so as to obtain a result image with better quality, appropriate brightness and appropriate dynamic range in different scenes.

[0160] In one embodiment, the processing module 20 is further used to pre-process the image signal of a preset number of frames after the current frame to obtain a pre-processed image; perform a gain process on the pre-processed image based on the target processing control parameter to obtain a reference image; and perform data compression on the reference image to obtain a target image of a preset number of frames after the current frame.

[0161] In one embodiment, the processing module 20 is further used to perform a gain processing on the image signal of a preset number of frames after the current frame based on the target processing control parameters to obtain a first reference image; perform data compression on the first reference image to obtain a second reference image; and perform post-processing on the second reference image to obtain a target image of a preset number of frames after the current frame.

[0162] In one embodiment, the processing module 20 is further used to pre-process the image signal of a preset number of frames after the current frame to obtain a pre-processed image; perform a gain process on the pre-processed image according to the target processing control parameter to obtain a first reference image; perform data compression on the first reference image to obtain a second reference image; and perform post-processing on the second reference image to obtain a target image of a preset number of frames after the current frame.

[0163] In one embodiment, the processing module 20 is further used to determine a first gain processing control parameter and a second gain processing control parameter according to the target processing control parameter, the product of the first gain processing control parameter and the second gain processing control parameter being equal to the target processing control parameter; performing a first gain processing on the image signal of a preset number of frames after the current frame according to the first gain processing control parameter to obtain a first reference image; performing data compression on the first reference image to obtain a second reference image; performing intermediate processing on the second reference image to obtain a third reference image; performing a second gain processing on the third reference image according to the second gain processing control parameter to obtain a fourth reference image; performing data compression on the fourth reference image to obtain a target image of a preset number of frames after the current frame, wherein the compressed images have the same brightness value range.

[0164] In one embodiment, the bit width is not truncate in the gain processing or is truncated to a preset brightness value range in the gain processing, and the preset brightness value range is not less than the brightness value range of a preset number of frames of image signals after the current frame, and the compression parameters of the data compression are related to the gain of the gain processing.

[0165] In one embodiment, the statistical brightness information includes a statistical brightness value and a dynamic range extension value, and the adjustment module 10 is further used to adjust the control parameters used by the current frame image according to the statistical brightness value and the dynamic range extension value to obtain target control parameters.

[0166] In one embodiment, the adjustment module 10 is further used to adjust the control parameters used by the current frame image according to the statistical brightness value to obtain initial control parameters; and adjust the initial control parameters according to the dynamic range extension value to obtain target control parameters.

[0167] In one embodiment, the adjustment module 10 is further used to compare the statistical brightness value with a preset brightness value; determine a parameter adjustment direction based on the comparison result; and adjust the control parameters used in the current frame image according to the parameter adjustment direction to obtain initial control parameters.

[0168] In one embodiment, the adjustment module 10 is also used for, when the parameter adjustment direction is parameter increase, if the adjusted control parameter is greater than the corresponding first parameter threshold, then the first parameter threshold is used as the adjusted control parameter, and the next control parameter is continuously adjusted according to the parameter adjustment direction; return to execute the step of, if the adjusted control parameter is greater than the corresponding first parameter threshold, then the first parameter threshold is used as the adjusted control parameter, and the next control parameter is continuously adjusted according to the parameter adjustment direction to obtain the initial control parameter; when the parameter adjustment direction is parameter decrease, if the adjusted control parameter is less than the corresponding second parameter threshold, then the second parameter threshold is used as the adjusted control parameter, and the next control parameter is continuously adjusted according to the parameter adjustment direction; return to execute the step of, if the adjusted control parameter is less than the corresponding second parameter threshold, then the second parameter threshold is used as the adjusted control parameter, and the next control parameter is continuously adjusted according to the parameter adjustment direction to obtain the initial control parameter, and the first parameter threshold is greater than the second parameter threshold.

[0169] In one embodiment, when the parameter adjustment direction is parameter increase, the next control parameter is determined by a first parameter adjustment sequence, and when the parameter adjustment direction is parameter decrease, the next control parameter is determined by a second parameter adjustment sequence, and the first parameter adjustment sequence is opposite to the second parameter adjustment sequence.

[0170] In one embodiment, the adjustment module 10 is further used to obtain an initial digital gain parameter according to the initial control parameter; when the initial digital gain parameter is less than the dynamic range extension value, the initial digital gain parameter is adjusted based on the dynamic range extension value to obtain a target digital gain parameter, and the current other initial control parameters except the initial digital gain parameter are reduced; if the other initial control parameters after reduction are less than the corresponding parameter threshold, the parameter threshold is used as the adjusted control parameter, and the next other initial control parameter corresponding to the current other initial control parameter is continuously reduced; return to execute the step of continuing to reduce the next other initial control parameter corresponding to the current other initial control parameter if the other initial control parameters after reduction are less than the corresponding parameter threshold, so as to obtain the target control parameters corresponding to the other initial control parameters, wherein the target control parameters include the target digital gain parameter and the target control parameters corresponding to the other initial control parameters.

[0171] In one embodiment, the adjustment module 10 is also used to adjust the filter component to a target state if the adjusted statistical brightness value is still greater than the preset brightness value, until the adjusted statistical brightness value reaches the preset brightness value, and the target state is a first state, a combination of the first state and the second state, or a combination of the first state and the third state, the first state is a low light pass rate state, the second state is a state allowing visible light to pass, and the third state is a state allowing visible light and infrared light to pass.

[0172] It should be understood that the above is only an example and does not constitute any limitation on the technical solution of the present invention. In specific applications, technicians in this field can make settings as needed, and the present invention does not limit this.

[0173] It should be understood that, although the various steps in the flowchart in the embodiment of the present application are displayed in sequence according to the indication of the arrows, these steps are not necessarily performed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and it can be performed in other orders. Moreover, at least a portion of the steps in the figure may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and their execution order is not necessarily performed in sequence, but can be performed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.

[0174] It should be noted that the workflow described above is merely illustrative and does not limit the scope of protection of the present invention. In practical applications, technicians in this field can select part or all of them according to actual needs to achieve the purpose of the present embodiment, and no limitation is made here.

[0175] In addition, it should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.

[0176] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0177] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as a read-only memory (ROM) / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present invention.

[0178] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. An image generation method, characterized in that: The image generation method comprises: According to the statistical brightness information corresponding to the statistical image contained in the current frame image, the control parameter adopted by the current frame image is adjusted to obtain the target control parameter, and the adjusted statistical brightness information is obtained according to the target control parameter, wherein the control parameter is calculated by a preset number of frame images before the current frame, and the target control parameter is used to control the acquisition and processing of a preset number of frame images after the current frame; If the adjusted statistical brightness information does not meet the preset condition, the state of the filter component is adjusted until the adjusted statistical brightness information meets the preset condition, and the filter component is used to adjust the amount of light entering during image acquisition; Collecting a light signal based on the target control parameter and the state of the filter component, and generating a preset number of image signal frames after the current frame according to the light signal; Based on the target control parameters, digital gain processing and compression processing are performed on a preset number of frame image signals after the current frame to obtain a target image of the preset number of frames after the current frame, wherein a pixel value range of the target image is a target pixel value range, a pixel value range of the image after the digital gain processing is not less than a pixel value range of the image before the digital gain processing, and the target pixel value range is pre-set based on application requirements of the current frame image.

2. The image generation method according to claim 1, characterized in that: The step of performing digital gain processing and compression processing on the image signals of a preset number of frames after the current frame based on the target control parameter to obtain target images of a preset number of frames after the current frame includes: Pre-processing a preset number of image signals after the current frame to obtain a pre-processed image; Performing a gain process on the pre-processed image based on the target processing control parameter to obtain a reference image; The reference image is compressed to obtain a target image of a preset number of frames after the current frame.

3. The image generation method according to claim 1, wherein: The step of performing digital gain processing and compression processing on the image signals of a preset number of frames after the current frame based on the target control parameter to obtain target images of a preset number of frames after the current frame includes: Performing a gain process on a preset number of frames of image signals after the current frame based on the target processing control parameter to obtain a first reference image; performing data compression on the first reference image to obtain a second reference image; The second reference image is post-processed to obtain a target image of a preset number of frames after the current frame.

4. The image generation method according to claim 1, wherein: The step of performing digital gain processing and compression processing on the image signals of a preset number of frames after the current frame based on the target control parameter to obtain target images of a preset number of frames after the current frame includes: Pre-processing a preset number of image signals after the current frame to obtain a pre-processed image; Performing a gain process on the pre-processed image according to the target processing control parameter to obtain a first reference image; performing data compression on the first reference image to obtain a second reference image; The second reference image is post-processed to obtain a target image of a preset number of frames after the current frame.

5. The image generation method according to claim 1, characterized in that: The step of performing digital gain processing and compression processing on the image signals of a preset number of frames after the current frame based on the target control parameter to obtain target images of a preset number of frames after the current frame includes: Determine a first gain processing control parameter and a second gain processing control parameter according to the target processing control parameter, wherein a product of the first gain processing control parameter and the second gain processing control parameter is equal to the target processing control parameter; Performing a first gain processing on a preset number of frames of image signals after the current frame according to the first gain processing control parameter to obtain a first reference image; performing data compression on the first reference image to obtain a second reference image; performing intermediate processing on the second reference image to obtain a third reference image; performing a second gain processing on the third reference image according to the second gain processing control parameter to obtain a fourth reference image; Data compression is performed on the fourth reference image to obtain a target image of a preset number of frames after the current frame, wherein the compressed images have the same brightness value range.

6. The image generation method according to any one of claims 1 to 5, characterized in that: The gain processing does not perform bit width truncation or the gain processing is truncated to a preset brightness value range, the preset brightness value range is not less than the brightness value range of a preset number of frames of image signals after the current frame, and the compression parameters of the data compression are related to the gain of the gain processing.

7. The image generation method according to claim 1, characterized in that: The statistical brightness information includes a statistical brightness value and a dynamic range extension value, and the control parameters used by the current frame image are adjusted according to the statistical brightness information corresponding to the statistical image contained in the current frame image to obtain the target control parameters, including: The control parameters used by the current frame image are adjusted according to the statistical brightness value and the dynamic range extension value to obtain target control parameters.

8. The image generation method according to claim 7, characterized in that: The step of adjusting the control parameters used by the current frame image according to the statistical brightness value and the dynamic range extension value to obtain target control parameters includes: Adjust the control parameters used by the current frame image according to the statistical brightness value to obtain initial control parameters; The initial control parameter is adjusted according to the dynamic range extension value to obtain the target control parameter.

9. The image generation method according to claim 8, characterized in that: The step of adjusting the control parameters used by the current frame image according to the statistical brightness value to obtain the initial control parameters includes: Comparing the statistical brightness value with a preset brightness value; Determine the parameter adjustment direction based on the comparison result; The control parameters used by the current frame image are adjusted according to the parameter adjustment direction to obtain initial control parameters.

10. The image generation method according to claim 9, characterized in that: The step of adjusting the control parameters used by the current frame image according to the parameter adjustment direction to obtain initial control parameters includes: When the parameter adjustment direction is parameter upward adjustment, if the adjusted control parameter is greater than the corresponding first parameter threshold, the first parameter threshold is used as the adjusted control parameter, and the next control parameter is adjusted according to the parameter adjustment direction; Returning to the step of: if the adjusted control parameter is greater than the corresponding first parameter threshold, taking the first parameter threshold as the adjusted control parameter, and continuing to adjust the next control parameter according to the parameter adjustment direction to obtain the initial control parameter; When the parameter adjustment direction is parameter downward adjustment, if the adjusted control parameter is less than the corresponding second parameter threshold, the second parameter threshold is used as the adjusted control parameter, and the next control parameter is adjusted according to the parameter adjustment direction; Return to the step of using the second parameter threshold as the adjusted control parameter if the adjusted control parameter is less than the corresponding second parameter threshold, and continue to adjust the next control parameter according to the parameter adjustment direction to obtain the initial control parameter, and the first parameter threshold is greater than the second parameter threshold.

11. The image generation method according to claim 10, characterized in that: When the parameter adjustment direction is parameter increase, the next control parameter is determined by the first parameter adjustment sequence, and when the parameter adjustment direction is parameter decrease, the next control parameter is determined by the second parameter adjustment sequence, and the first parameter adjustment sequence is opposite to the second parameter adjustment sequence.

12. The image generation method according to claim 8, characterized in that: The adjusting the initial control parameter according to the dynamic range extension value to obtain the target control parameter includes: Obtaining an initial digital gain parameter according to the initial control parameter; When the initial digital gain parameter is less than the dynamic range extension value, adjusting the initial digital gain parameter based on the dynamic range extension value to obtain a target digital gain parameter, and reducing other current initial control parameters except the initial digital gain parameter; If the other initial control parameter after reduction is less than the corresponding parameter threshold, the parameter threshold is used as the adjusted control parameter, and the next other initial control parameter corresponding to the current other initial control parameter is further reduced; Return to the step of continuing to reduce the next other initial control parameter corresponding to the current other initial control parameter if the other initial control parameter after reduction is less than the corresponding parameter threshold, so as to obtain the target control parameter corresponding to the other initial control parameter, wherein the target control parameter includes the target digital gain parameter and the target control parameter corresponding to the other initial control parameter.

13. The image generation method according to claim 12, characterized in that: If the adjusted statistical brightness information does not meet the preset condition, adjusting the state of the filter component until the adjusted statistical brightness information meets the preset condition, includes: If the adjusted statistical brightness value is still greater than the preset brightness value, the filter component is adjusted to a target state until the adjusted statistical brightness value reaches the preset brightness value, wherein the target state is a first state, a combination of the first state and the second state, or a combination of the first state and the third state, wherein the first state is a low light pass rate state, the second state is a state allowing visible light to pass, and the third state is a state allowing visible light and infrared light to pass.

14. An image generating device, characterized in that: The image generating device comprises: An adjustment module, used to adjust the control parameters used by the current frame image according to the statistical brightness information corresponding to the statistical image contained in the current frame image, obtain a target control parameter, and obtain the adjusted statistical brightness information according to the target control parameter, wherein the control parameter is calculated by a preset number of frame images before the current frame, and the target control parameter is used to control the acquisition and processing of a preset number of frame images after the current frame; The adjustment module is further used to adjust the state of the filter component if the adjusted statistical brightness information does not meet the preset condition, until the adjusted statistical brightness information meets the preset condition, and the filter component is used to adjust the amount of light entering during image acquisition; A processing module, configured to collect light signals based on the target control parameter and the state of the filter component, and generate a preset number of image signal frames after the current frame according to the light signals; The processing module is further used to perform digital gain processing and compression processing on a preset number of frames of image signals after the current frame based on the target control parameters to obtain a target image of a preset number of frames after the current frame, wherein the pixel value range of the target image is a target pixel value range, the pixel value range of the image after the digital gain processing is not less than the pixel value range of the image before the digital gain processing, and the target pixel value range is pre-set based on the application requirements of the current frame image.

15. An image generating device, characterized in that: The image generating device comprises: a memory, a processor, and an image generating program stored in the memory and running on the processor, wherein the image generating program is configured to implement the image generating method according to any one of claims 1 to 13.

16. A storage medium, characterized in that: The storage medium stores an image generation program, and when the image generation program is executed by the processor, the image generation method according to any one of claims 1 to 13 is implemented.

Images