Image generation method and device, medium and equipment

Abstract

The embodiment of the invention discloses an image generation method and device, a medium and equipment, and the method comprises the steps: determining a current adjustment parameter corresponding to a first image sensor in a current environment in response to the starting of the first image sensor; the current adjustment parameter comprises at least one of a current exposure parameter and a current white balance gain; and controlling the first image sensor to generate the current frame image according to the current adjustment parameter. According to the embodiment of the invention, the quality of the image initially acquired after the first image sensor is started can be effectively improved. And in addition, subsequent acquired images can be quickly recovered to the optimal effect, and the overall image quality of the image sensor within an initial period of time after starting is greatly improved.

Description

Technical Field

[0001] The present disclosure relates to image sensor technology, and in particular to an image generation method, device, medium and equipment. Background Art

[0002] In the fields of smart driving and smart cockpits, the corresponding functions are usually realized by relying on the images provided by the camera. For example, the Advanced Driving Assistance System (ADAS) relies on the images provided by the camera to realize the corresponding advanced driving assistance functions. If the image quality is poor, it may limit the ADAS function and the smart cockpit function and affect the user's driving experience. In the related technology, after the perception path where the camera is located is started, the image quality collected by the camera's image sensor in the initial period of time is poor, which is easy to affect the ADAS function and the smart cockpit function as well as the user's driving experience. Summary of the invention

[0003] The embodiments of the present disclosure provide an image generation method, apparatus, medium and device, which can control an image sensor to generate an image according to adjustment parameters corresponding to a real-time environment in the initial stage of image sensor startup, thereby improving the image quality collected in the initial stage.

[0004] A first aspect of an embodiment of the present disclosure provides an image generating method, comprising: in response to starting a first image sensor, determining current adjustment parameters corresponding to the first image sensor in a current environment; the current adjustment parameters include at least one of a current exposure parameter and a current white balance gain; and according to the current adjustment parameters, controlling the first image sensor to generate a current frame image.

[0005] According to a second aspect of an embodiment of the present disclosure, an image generating device is provided, comprising: a first processing module, for determining, in response to the start-up of a first image sensor, current adjustment parameters corresponding to the first image sensor in a current environment; the current adjustment parameters include at least one of a current exposure parameter and a current white balance gain; and a second processing module, for controlling the first image sensor to generate a current frame image according to the current adjustment parameters.

[0006] According to a third aspect of the embodiments of the present disclosure, a computer-readable storage medium is provided, wherein the storage medium stores a computer program, and the computer program is used to execute the image generation method described in any of the above embodiments of the present disclosure.

[0007] According to a fourth aspect of the embodiments of the present disclosure, an electronic device is provided, comprising: a processor; a memory for storing executable instructions of the processor; the processor is used to read the executable instructions from the memory and execute the instructions to implement the image generation method described in any of the above embodiments of the present disclosure.

[0008] A fifth aspect of the embodiments of the present disclosure provides a computer program product. When instructions in the computer program product are executed by a processor, the image generation method provided by any of the above embodiments of the present disclosure is executed.

[0009] Based on the image generation method, device, medium and equipment provided by the above-mentioned embodiments of the present disclosure, in response to the startup of the first image sensor, the current adjustment parameters corresponding to the first image sensor in the current environment can be determined, and then the first image sensor can be controlled to generate the current frame image according to the current adjustment parameters. Since the first image sensor is controlled according to the current adjustment parameters corresponding to the current environment, the current adjustment parameters are more in line with the parameter requirements of the current environment, so that the current frame image can have a better quality effect, and the quality of the image initially collected by the first image sensor is effectively improved. In addition, in the image acquisition of subsequent frames, the adjustment parameters of subsequent frames are often determined based on the current adjustment parameters. When the current adjustment parameters are relatively accurate, it helps the subsequently collected images to quickly restore to the best effect, greatly improving the overall image quality of the image sensor in the initial period after startup. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 This is an exemplary application scenario of the image generation method provided by the present disclosure;

[0011] Figure 2 is a flowchart of an image generating method provided by an exemplary embodiment of the present disclosure;

[0012] Figure 3 is a flowchart of an image generating method provided by another exemplary embodiment of the present disclosure;

[0013] Figure 4 is a flowchart of an image generating method provided by yet another exemplary embodiment of the present disclosure;

[0014] Figure 5 is a flowchart of an image generating method provided by another exemplary embodiment of the present disclosure;

[0015] Figure 6 is a flowchart of an image generating method provided by yet another exemplary embodiment of the present disclosure;

[0016] Figure 7 is a flowchart of an image generating method provided by another exemplary embodiment of the present disclosure;

[0017] Figure 8 is a flowchart of an image generation method provided by an exemplary embodiment of the present disclosure;

[0018] Fig. 9 is a structural schematic diagram of an image generating device provided by an exemplary embodiment of the present disclosure;

[0019] Fig.10 is a structural schematic diagram of an image generating device provided by another exemplary embodiment of the present disclosure;

[0020] Fig.11 is a structural schematic diagram of an image generating device provided by yet another exemplary embodiment of the present disclosure;

[0021] Fig.12 is a structural schematic diagram of an image generating device provided by another exemplary embodiment of the present disclosure;

[0022] Fig.13 is a structural schematic diagram of an image generating device provided by yet another exemplary embodiment of the present disclosure;

[0023] Fig.14 is a structural schematic diagram of an image generating device provided by another exemplary embodiment of the present disclosure;

[0024] Fig.15 It is a structural diagram of an electronic device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0025] To explain the present disclosure, example embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all of the embodiments. It should be understood that the present disclosure is not limited to the example embodiments.

[0026] It should be noted that the relative arrangement of components and steps, the numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present disclosure unless specifically stated otherwise.

[0027] SUMMARY OF THE DISCLOSURE

[0028] In the process of realizing the present disclosure, the inventors found that in the fields of intelligent driving, smart cockpit, etc., the corresponding functions are usually realized by relying on the images provided by the camera. For example, the Advanced Driving Assistance System (ADAS) relies on the images provided by the camera to realize the corresponding advanced driving assistance functions. If the image quality is poor, it may limit the ADAS function and the smart cockpit function, affecting the user's driving experience. In the related art, after the perception path where the camera is located is started, the image quality collected by the camera's image sensor (Image Sensor) in the initial period of time is poor, which is easy to affect the ADAS function and the smart cockpit function and the user's driving experience.

[0029] Exemplary Overview

[0030] Figure 1 This is an exemplary application scenario of the image generation method provided by the present disclosure. Figure 1 As shown, in scenarios such as smart driving and smart cockpits, the external environment and / or cockpit environment are perceived through cameras on mobile devices (such as vehicles, drones, robots, etc.). The number of cameras can be set according to actual needs, such as Figure 1The middle camera includes a front camera 111, a left camera 112, a right camera 113 and a rear camera 114 for external environment perception, and an in-cabin camera 12 for cabin environment perception. This is only an exemplary camera setting method, and other settings can also be used in actual applications. The perception system 13 executes instructions of various perception algorithms or models to realize the perception of the external environment or the cabin environment, and obtains corresponding perception results. The perception results may include external road information, obstacle information, etc., as well as the number of users in the cabin, user status, etc., which are not specifically limited. After each camera is started, it is necessary to convert the optical image into an electronic signal based on the image sensor of the camera, generate an image, and provide it to the perception system 13. For the image sensor of each camera (which can be called the first image sensor), the image generation method disclosed in the present invention can be used to realize image generation. Specifically, in response to the start-up of the first image sensor, the current adjustment parameter corresponding to the first image sensor in the current environment can be determined; the current adjustment parameter may include at least one of the current exposure parameter and the current white balance gain. Then, according to the current adjustment parameter, the first image sensor can be controlled to generate the current frame image. Since the first image sensor is controlled according to the current adjustment parameters corresponding to the current environment, the current adjustment parameters are more in line with the parameter requirements of the current environment, so that the current frame image can have a better quality effect, effectively improving the quality of the image initially collected by the first image sensor. In addition, in the image collection of subsequent frames, the adjustment parameters of subsequent frames are often determined based on the current adjustment parameters. When the current adjustment parameters are relatively accurate, it helps the subsequently collected images to quickly restore to the best effect, greatly improving the overall image quality of the image sensor in the initial period after startup.

[0031] The image generation method of the embodiment of the present disclosure is not limited to the fields of intelligent driving and intelligent cockpit, but can also be applied to any other scene or field that requires image acquisition, for example, security monitoring scene.

[0032] Exemplary Methods

[0033] Figure 2 is a flowchart of an image generation method provided by an exemplary embodiment of the present disclosure. This embodiment can be applied to electronic devices, such as a vehicle-mounted computing platform, such as Figure 2 As shown, the method of the embodiment of the present disclosure may include the following steps:

[0034] Step 210 : in response to the first image sensor being started, determining a current adjustment parameter of the first image sensor corresponding to the current environment.

[0035] Among them, the current adjustment parameter includes at least one of the current exposure parameter and the current white balance gain. The exposure parameter is an important adjustment parameter of the image sensor, which directly affects the brightness and contrast of the image. The exposure parameter may include exposure time and gain. Gain refers to the magnification of the image brightness. The longer the exposure time, the more light the image sensor receives and the brighter the image. When the exposure time is fixed, the brightness of the image can be improved by increasing the gain. However, long-term exposure may cause image blur. The larger the gain, the more noise in the image. Therefore, it is necessary to control the appropriate exposure parameter to ensure image quality. The white balance gain refers to the color channel gain, which may include the red channel gain (Rgain) and the blue channel gain (Bgain). The white balance gain is used to control the white balance of the image. The first image sensor may be an image sensor of any camera in the application scenario. For example, a sensor of a camera of any perspective in an intelligent driving scenario. The current environment is the environment in which the first image sensor is currently located. In practical applications, the image sensor of each camera in the application scenario can be used as the first image sensor, and when the first image sensor is started, the current adjustment parameter corresponding to the first image sensor in the current environment is determined. The current adjustment parameters are parameters adapted to the current environment, that is, the current adjustment parameters meet the adjustment parameter requirements of the first image sensor in the current environment, so that the first image sensor can have a better imaging effect and ensure the quality of the generated image.

[0036] In some optional embodiments, the current adjustment parameters corresponding to the first image sensor in the current environment can be obtained in one or more ways. For example, when a corresponding sensor (such as an illumination sensor, a color temperature sensor, etc.) is provided on the movable device, the current adjustment parameters can be determined based on the data collected by the sensor. For another example, the adjustment parameters corresponding to different environments can be pre-configured, and the adjustment parameters corresponding to the current environment can be determined by identifying the type of the current environment. For another example, when there are other image sensors that are already in working state, the current adjustment parameters of the first image sensor can be determined from the adjustment parameters of other sensors, and so on. The specific method of determining the current adjustment parameters corresponding to the first image sensor in the current environment is not limited.

[0037] Step 220: Control the first image sensor to generate a current frame image according to the current adjustment parameters.

[0038] Among them, the current frame image may refer to the first frame image after the first image sensor is started. After determining the current adjustment parameters of the first image sensor, the first image sensor can be controlled to collect images according to the current adjustment parameters to obtain the current frame image. Since the adjustment parameters used to generate the first frame image are current adjustment parameters adapted to the current environment determined in real time based on the current environment, the quality of the first frame image can be ensured. The adjustment parameters of the second frame need to be updated according to the actual effect of the first frame image. The quality of the first frame image is good, which can further ensure the accuracy of the adjustment parameters of the second frame, thereby enabling the first image sensor to quickly recover to the best imaging effect. In the related art, after the image sensor is started, the preset adjustment parameters are usually used as the adjustment parameters of the first frame, and the preset adjustment parameters are often unable to adapt to the current environment of the image sensor, resulting in poor quality of the first frame image. In the initial stage after the image sensor is started, the image sensor needs a long time to recover to the best imaging effect. Compared with the related art, the embodiment of the present disclosure can greatly improve the image quality of the image sensor in the initial stage, and can enable the image sensor to quickly recover to the best imaging effect.

[0039] The image generation method provided in this embodiment can determine the current adjustment parameters corresponding to the first image sensor in the current environment in response to the startup of the first image sensor, and then control the first image sensor to generate the current frame image according to the current adjustment parameters. Since the first image sensor is controlled according to the current adjustment parameters corresponding to the current environment, the current adjustment parameters are more in line with the parameter requirements of the current environment, so that the current frame image can have a better quality effect, and the quality of the image initially collected by the first image sensor is effectively improved. In addition, in the image acquisition of subsequent frames, the adjustment parameters of subsequent frames are often determined based on the current adjustment parameters and the initially collected image. When the current adjustment parameters are more accurate and the quality of the current frame image is higher, it helps the subsequently collected image to quickly restore to the best effect, greatly improving the overall image quality of the image sensor in the initial period after startup.

[0040] Figure 3 It is a flowchart of an image generating method provided by another exemplary embodiment of the present disclosure.

[0041] In some optional embodiments, in the above Figure 2 Based on the embodiment shown, Figure 3 As shown, step 210 of determining the current adjustment parameters corresponding to the first image sensor in the current environment may specifically include the following steps:

[0042] Step 2110, determining at least one of current illumination information and current color temperature information corresponding to the current environment.

[0043] Among them, illumination information is a physical quantity that measures the intensity of light. In the application of image sensors, illumination information, exposure time, and exposure gain can jointly affect the clarity and quality of the image. Illuminance information may include the magnitude of light illumination. The magnitude of light illumination determines the amount of light that the image sensor can capture, and can also affect the brightness and contrast of the image. For example, in a well-lit environment, the image sensor can capture more light to generate a clearer image. In an environment with insufficient light, the image may become dim and details may be lost. The current illumination information corresponding to the current environment may include the magnitude of the light illumination in the current environment. Color temperature information is an important indicator for measuring the color of the light source, and the color temperature directly affects the color performance of the generated image. The current color temperature information may include the color temperature in the current environment.

[0044] In some optional embodiments, the current illumination information may be obtained in any manner, such as obtaining the current illumination information through an illumination sensor, or determining the current illumination information through illumination information of other image sensors that are already in operation.

[0045] In some optional embodiments, the current color temperature information may be obtained in any manner, such as by obtaining the current color temperature information through a color temperature sensor, or determining the current color temperature information through color temperature information of other image sensors that are already in operation.

[0046] Step 2120: Determine a current adjustment parameter based on at least one of the current illumination information and the current color temperature information.

[0047] The current illumination information determines the current exposure parameter in the current adjustment parameters, and the current color temperature information determines the current white balance gain in the current adjustment parameters.

[0048] In some optional embodiments, the current adjustment parameters may be determined based on the current illumination information, the association between the illumination information and the exposure parameters, the current color temperature information, and the association between the color temperature information and the white balance gain.

[0049] In some optional embodiments, the current adjustment parameters may be determined according to the current illumination information. In this case, the current adjustment parameters include the current exposure parameters.

[0050] In some optional embodiments, the current adjustment parameter may be determined according to the current color temperature information. In this case, the current adjustment parameter includes the current white balance gain.

[0051] In some optional embodiments, the current adjustment parameters may be determined according to the current illumination information and the current color temperature information. In this case, the current adjustment parameters include the current exposure parameters and the current white balance gain.

[0052] The embodiments of the present disclosure are used to determine the current adjustment parameters by determining at least one of the current illuminance information and the current color temperature information corresponding to the current environment. The current illuminance information represents the light intensity in the current environment and can affect the brightness and contrast of the generated image. The current color temperature information represents the color of the light source in the current environment and can directly affect the color performance of the generated image. The current adjustment parameters can be effectively determined based on the real-time illuminance information and color temperature information of the current environment, which can improve the accuracy of the current adjustment parameters and ensure the quality of the current frame image collected.

[0053] In some optional embodiments, determining at least one of the current illuminance information and the current color temperature information corresponding to the current environment in step 2110 may include: determining the current illuminance information based on an illuminance sensor; and / or determining the current color temperature information based on a color temperature sensor.

[0054] Among them, the illuminance sensor is an electronic device used to measure light intensity or illumination. It obtains the illumination information of the environment by converting the light intensity in the environment into an electrical signal. The color temperature sensor is a special instrument used to measure the color temperature of the ambient light source. It can determine the color temperature value (i.e., color temperature information) of the light source by comparing the color of the light emitted by the light source with the standard color temperature value. The illuminance sensor and the color temperature sensor can be set on the camera where the first image sensor is located or on a movable device, and the specific setting position is not limited.

[0055] In some optional embodiments, determining at least one of current illuminance information and current color temperature information corresponding to the current environment in step 2110 may include: determining the current illuminance information based on an illuminance sensor.

[0056] In some optional embodiments, determining at least one of current illumination information and current color temperature information corresponding to the current environment in step 2110 may include: determining the current color temperature information based on a color temperature sensor.

[0057] In some optional embodiments, determining at least one of current illuminance information and current color temperature information corresponding to the current environment in step 2110 may include: determining the current illuminance information based on an illuminance sensor; determining the current color temperature information based on a color temperature sensor.

[0058] The embodiments of the present disclosure, when equipped with an illuminance sensor and a color temperature sensor, can determine the actual illuminance information and color temperature information of the current environment based on the illuminance sensor and the color temperature sensor, thereby improving the accuracy of the current illuminance information and the current color temperature information, thereby improving the accuracy of the current adjustment parameters and improving the quality of the generated current frame image.

[0059] In some optional embodiments, determining at least one of current illumination information and current color temperature information corresponding to the current environment in step 2110 may include:

[0060] In response to the existence of at least one second image sensor in a working state, illuminance information and / or color temperature information corresponding to any second image sensor is obtained; the second image sensor is an image sensor other than the first image sensor; the illuminance information corresponding to the second image sensor is determined as the current illuminance information, and / or the color temperature information corresponding to the second image sensor is determined as the current color temperature information.

[0061] In which, when there are at least two image sensors in an actual scene, for any one of the image sensors (i.e., the first image sensor), when it is necessary to determine at least one of the current illumination information and the current color temperature information of the first image sensor, the current illumination information and / or the current color temperature information of the first image sensor can be determined based on relevant information of any other image sensor (i.e., the second image sensor) that is in a working state except the first image sensor.

[0062] In some optional embodiments, the illumination information and color temperature information corresponding to the second image sensor can be determined based on the image captured by the second image sensor, and used to determine the current illumination information and / or current color temperature information corresponding to the first image sensor. For example, the brightness information of the image captured by the second image sensor can reflect the illumination situation. Through certain algorithm processing, the color temperature information can be extracted from the image, and then the illumination information can be calculated, thereby obtaining the illumination information and color temperature information corresponding to the second image sensor. In practical applications, the illumination information and color temperature information corresponding to the second image sensor can also be obtained by other means.

[0063] In some optional embodiments, determining at least one of current illuminance information and current color temperature information corresponding to the current environment in step 2110 may include: in response to the presence of at least one second image sensor in a working state, obtaining illuminance information corresponding to any second image sensor; and determining the illuminance information corresponding to the second image sensor as the current illuminance information.

[0064] In some optional embodiments, determining at least one of current illumination information and current color temperature information corresponding to the current environment in step 2110 may include: in response to the presence of at least one second image sensor in a working state, obtaining color temperature information corresponding to any second image sensor; and determining the color temperature information corresponding to the second image sensor as the current color temperature information.

[0065] In some optional embodiments, determining at least one of current illuminance information and current color temperature information corresponding to the current environment in step 2110 may include: in response to the presence of at least one second image sensor in a working state, obtaining illuminance information and color temperature information corresponding to any second image sensor; determining the illuminance information corresponding to the second image sensor as the current illuminance information, and determining the color temperature information corresponding to the second image sensor as the current color temperature information.

[0066] In the embodiments of the present disclosure, current illuminance information and / or current color temperature information corresponding to the first image sensor is determined by using illuminance information and / or color temperature information corresponding to the second image sensor in a working state, thereby effectively realizing the determination of the current illuminance information and the current color temperature information. Even in the case where the illuminance sensor and the color temperature sensor are not installed, accurate and effective current illuminance information and current color temperature information may be obtained to improve the accuracy of the current adjustment parameters.

[0067] In some optional embodiments, determining the current adjustment parameter according to at least one of the current illumination information and the current color temperature information in step 2120 may include:

[0068] Determine the current exposure parameter based on the current illumination information and a first correspondence between different pre-calibrated illuminations and exposure parameters; and / or determine the current white balance gain based on the current color temperature information and a second correspondence between different pre-calibrated color temperatures and white balance gains; determine the current adjustment parameter based on at least one of the current exposure parameter and the current white balance gain.

[0069] Among them, the first correspondence relationship between different pre-calibrated illuminations and exposure parameters may include exposure parameters corresponding to a first preset number of illumination information that are pre-calibrated. For example, the first correspondence relationship may include: illumination information 1-exposure parameter 1, illumination information 2-exposure parameter 2, illumination information 3-exposure parameter 3, ... The first correspondence relationship may be obtained by pre-calibrating the exposure parameters of the image sensor of the mobile device under different illumination information in the real environment. The second correspondence relationship between different pre-calibrated color temperatures and white balance gains may include white balance gains corresponding to a second preset number of color temperature information that are pre-calibrated. According to the current illumination information and the first correspondence relationship, the current exposure parameters can be effectively obtained. According to the current color temperature information and the second correspondence relationship, the current white balance gain can be effectively obtained.

[0070] In some optional embodiments, the pre-calibrated first correspondence between different illuminances and exposure parameters may be expressed as a first curve function of the exposure parameters with respect to illuminance, and the current exposure parameters may be obtained by substituting the current illuminance information into the first curve function.

[0071] In some optional embodiments, the pre-calibrated second correspondence between different color temperatures and white balance gains can be expressed as a second curve function of white balance gain with respect to color temperature. The current white balance gain is obtained by substituting the current color temperature information into the second curve function.

[0072] In some optional embodiments, determining the current adjustment parameter based on at least one of the current illuminance information and the current color temperature information in step 2120 may include: determining the current exposure parameter based on the current illuminance information and a first correspondence between different illuminances and exposure parameters that are pre-calibrated; and determining the current adjustment parameter based on the current exposure parameter.

[0073] In some optional embodiments, step 2120 of determining the current adjustment parameter based on at least one of the current illuminance information and the current color temperature information may include: determining the current white balance gain based on the current color temperature information and a pre-calibrated second correspondence between different color temperatures and white balance gains; and determining the current adjustment parameter based on the current white balance gain.

[0074] In some optional embodiments, step 2120 of determining the current adjustment parameter based on at least one of the current illuminance information and the current color temperature information may include: determining the current exposure parameter based on the current illuminance information and a first correspondence between different illuminances and exposure parameters that are pre-calibrated; determining the current white balance gain based on the current color temperature information and a second correspondence between different color temperatures and white balance gains that are pre-calibrated; and determining the current adjustment parameter based on the current exposure parameter and the current white balance gain.

[0075] The embodiment of the present disclosure, by pre-calibrating a first correspondence between different illuminances and exposure parameters and a second correspondence between different color temperatures and white balance gains, can accurately determine the current adjustment parameters based on current illuminance information and current color temperature information in combination with the first correspondence and the second correspondence, thereby improving the accuracy of the current adjustment parameters and ensuring the quality of the image generated by the first image sensor.

[0076] In some optional embodiments, determining the current exposure parameter based on the current illumination information and a first correspondence between different pre-calibrated illuminations and exposure parameters may include: determining, from the first correspondence, based on the current illumination information, first illumination information and second illumination information that have a preset size relationship with the current illumination information, as well as a first exposure parameter corresponding to the first illumination information and a second exposure parameter corresponding to the second illumination information; and determining the current exposure parameter corresponding to the current illumination information by interpolation based on the current illumination information, the first illumination information, the second illumination information, the first exposure parameter, and the second exposure parameter.

[0077] Among them, the preset size relationship can be the minimum illumination information greater than the current illumination information and the maximum illumination information less than the current illumination information in the first corresponding relationship. The minimum illumination information greater than the current illumination information refers to the smallest illumination information among all illumination information greater than the current illumination information in the first corresponding relationship, which is used as the second illumination information. The maximum illumination information less than the current illumination information refers to the largest illumination information among all illumination information less than the current illumination information in the first corresponding relationship, which is used as the first illumination information. For example, the first corresponding relationship includes exposure parameters corresponding to a first preset number of illumination information arranged in a specified order, and the preset size relationship can refer to two adjacent illumination information closest to the current illumination information in the first corresponding relationship, which are used as the first illumination information and the second illumination information, respectively. For example, if the current illumination information falls between illumination information i (i=1,2,…n-1, n is the first preset number) and illumination information i+1, illumination information i can be used as the first illumination information, and illumination information i+1 can be used as the second illumination information. The exposure parameter corresponding to the first illumination information in the first corresponding relationship is called the first exposure parameter, and the exposure parameter corresponding to the second illumination information is called the second exposure parameter. Based on the current illumination information, the first illumination information, the second illumination information, the first reported amount and the second exposure parameter, the current exposure parameter corresponding to the current illumination information is determined by interpolation. The interpolation method can be linear interpolation. That is, the first illumination information and the first exposure parameter are represented as one point, the second illumination information and the second exposure parameter are represented as another point, and a linear fit is performed between the two points. On the fitting line segment, the exposure parameter corresponding to the current illumination information is determined. The details are not described in detail. It should be noted that if the current illumination information is any illumination information in the first corresponding relationship, the exposure parameter corresponding to the illumination information in the first corresponding relationship can be directly used as the current exposure parameter corresponding to the current illumination information without the need for interpolation.

[0078] In the embodiments of the present disclosure, based on a pre-calibrated first correspondence between different illuminances and exposure parameters, the current exposure parameters corresponding to the current illuminance information can be obtained by interpolating the exposure parameters respectively corresponding to the first illuminance information and the second illuminance information adjacent to the current illuminance information on the left and right in the first correspondence, thereby achieving accurate determination of the current exposure parameters and improving the accuracy of the current adjustment parameters.

[0079] In some optional embodiments, determining the current white balance gain based on the current color temperature information and a pre-calibrated second correspondence between different color temperatures and white balance gains may include: determining, from the second correspondence based on the current color temperature information, first color temperature information and second color temperature information that have a preset size relationship with the current color temperature information, as well as a first white balance gain corresponding to the first color temperature information and a second white balance gain corresponding to the second color temperature information; and determining the current white balance gain corresponding to the current color temperature information by interpolation based on the current color temperature information, the first color temperature information, the second color temperature information, the first white balance gain and the second white balance gain.

[0080] The preset size relationship may be the minimum color temperature information greater than the current color temperature information and the maximum color temperature information less than the current color temperature information in the second corresponding relationship. The principle of determining the current white balance gain is similar to the current exposure parameter, which will not be described in detail here.

[0081] In the embodiments of the present disclosure, based on a pre-calibrated second correspondence between different color temperatures and white balance gains, the current white balance gain corresponding to the current color temperature information can be obtained by interpolating the white balance gains respectively corresponding to the first color temperature information and the second color temperature information adjacent to the current color temperature information on the left and right in the second correspondence, thereby achieving accurate determination of the current white balance gain and improving the accuracy of the current adjustment parameters.

[0082] Figure 4 It is a flowchart of an image generating method provided by yet another exemplary embodiment of the present disclosure.

[0083] In some optional embodiments, in the above Figure 2 Based on the embodiment shown, Figure 4 As shown, step 210 of determining the current adjustment parameters corresponding to the first image sensor in the current environment may include:

[0084] Step 21a0, determining the target time period corresponding to the current environment.

[0085] The time period may include a daytime time period and a nighttime time period, and the target time period may be a daytime time period or a nighttime time period.

[0086] In some optional embodiments, the target time period corresponding to the current environment can be determined by current time information. The current time information can be real-time absolute time. The current time information can be obtained by the device time of the mobile device.

[0087] In some optional embodiments, the time period may include a time period of a day, for example, 0:00 to 6:00, 6:00 to 10:00, 10:00 to 14:00, 14:00 to 18:00, and 18:00 to 24:00. This is just an exemplary way of dividing the time period. In actual applications, the time period may also be divided in any other way of equal interval or unequal interval, which is not limited in the embodiments of the present disclosure. The target time period is one of the divided time periods.

[0088] Step 21b0, determining the current adjustment parameters according to the target time period and the preset adjustment parameters corresponding to the different pre-configured time periods.

[0089] Among them, preset adjustment parameters corresponding to different time periods can be pre-configured according to the influence of different time periods on the adjustment parameters. In actual application scenarios, the preset adjustment parameters corresponding to the target time period can be determined as the current adjustment parameters from the pre-configured preset adjustment parameters according to the real-time target time period.

[0090] In the disclosed embodiment, different preset adjustment parameters can be configured for different time periods. After the image sensor is started, the preset adjustment parameters that meet the corresponding time period can be determined as the current adjustment parameters according to the real-time target time period to ensure the image quality of the image sensor.

[0091] In some optional embodiments, when weather information can be obtained, different preset adjustment parameters can be configured in advance according to different weather types. When the image sensor is started, more accurate current adjustment parameters can be determined according to the real-time weather type and the preset adjustment parameters corresponding to the different pre-configured weather types, thereby further improving the accuracy of the current adjustment parameters. For example, the preset adjustment parameters for sunny days and cloudy days are different.

[0092] In some optional embodiments, different preset adjustment parameters may be configured in advance according to different time periods and different weather types. When the image sensor is started, more accurate current adjustment parameters may be determined according to the real-time time period and weather type, and the pre-configured preset adjustment parameters corresponding to different time periods and different weather types, thereby further improving the accuracy of the current adjustment parameters. For example, in the daytime time period, the preset adjustment parameters for sunny days and cloudy days are different, and in the night time period, the preset adjustment parameters for sunny days and cloudy days are different, and so on.

[0093] In some optional embodiments, the weather type may be obtained through an application providing weather services on a mobile device.

[0094] Figure 5 It is a flowchart of an image generating method provided by yet another exemplary embodiment of the present disclosure.

[0095] In some optional embodiments, based on any of the above embodiments, Figure 5 As shown, after controlling the first image sensor to generate the current frame image according to the current adjustment parameters, the method of the embodiment of the present disclosure may further include:

[0096] Step 230: Determine the first brightness information and the third white balance gain of the current frame image.

[0097] Among them, the first brightness information of the current frame image can be obtained according to the color value of the green (Green, abbreviated as: G) channel in the current frame image. For example, the average value of the G channel in the current frame image can be calculated to obtain the first brightness information of the current frame image. The third white balance gain of the current frame image may include the white balance gain corresponding to at least one image block (or sub-image) in the current frame image. That is, the current frame image can be divided into one or more image blocks. The white balance gain of each image block is counted. The white balance gain of each image block may include a red channel gain and a blue channel gain. The red channel gain can be expressed as the ratio R / G of the color value of the red (Red, abbreviated as: R) channel to the color value of the green channel, and the blue channel gain can be expressed as the ratio B / G of the color value of the blue (Blue, abbreviated as: B) channel to the color value of the green channel. The white balance gain of each image block is determined as the third white balance gain of the current frame image. For each image block, the color values ​​of the R channel and the G channel in the image block can be accumulated, and the ratio of the accumulated sum of the R channel and the accumulated sum of the G channel can be used as the red channel gain of the image block. Similarly, the blue channel gain of the image block can be obtained.

[0098] Step 240: Determine third illumination information according to the current adjustment parameter and the first brightness information of the current frame image.

[0099] The third illumination information may be determined according to the mapping relationship between the current adjustment parameter, the image brightness and the illumination information. Specifically, the third illumination information is determined according to the current exposure parameter in the current adjustment parameter and the first brightness information.

[0100] Exemplarily, the current exposure parameter is represented by A, the first brightness information is represented by B, and the third illumination information C can be determined by the following mapping relationship:

[0101] C=B / (β*A)

[0102] Wherein, β represents the pre-calibrated sensitivity of the image sensor.

[0103] Step 250: Determine a fourth white balance gain according to the current adjustment parameter and the third white balance gain of the current frame image.

[0104] The fourth white balance gain is determined according to the current white balance gain in the current adjustment parameters and the third white balance gain of the current frame image.

[0105] In some optional embodiments, the current white balance gain can be adjusted according to the third white balance gain to obtain the adjusted white balance gain as the fourth white balance gain. The principle of adjustment is to enable the current frame image to meet the white balance condition. That is, the values ​​of the white balance gains R / G and B / G of the current frame image are close to 1, so that the color value R=G=B, to achieve the effect of white balance.

[0106] It should be noted that step 240 and step 250 may be performed in any order.

[0107] Step 260: Determine a third exposure parameter according to the third illumination information and a pre-calibrated first correspondence between different illuminations and exposure parameters.

[0108] Among them, the specific operation of determining the third exposure parameter corresponding to the third illumination information according to the third illumination information and the first corresponding relationship can refer to the operation of determining the current exposure parameter according to the current illumination information and the first corresponding relationship in the aforementioned embodiment, which will not be repeated here.

[0109] It should be noted that step 260 and step 250 may be performed in any order.

[0110] Step 270: Determine new adjustment parameters of the first image sensor based on the third exposure parameter and the fourth white balance gain.

[0111] The third exposure parameter and the fourth white balance gain may be determined as new adjustment parameters of the first image sensor, and used to control the first image sensor to capture the next frame of image (ie, the second frame of image).

[0112] Step 280: Control the first image sensor to generate a next frame of image according to the new adjustment parameters. The next frame of image is a frame of image after the current frame of image.

[0113] The specific operation of controlling the first image sensor to generate the next frame image according to the new adjustment parameters is similar to the specific operation of generating the current frame image, which will not be described in detail here.

[0114] It can be understood that after generating the next frame image, the next frame image can be used as the current frame image, and the new adjustment parameters can be used as the current adjustment parameters. The image can continue to be generated according to the process from step 230 to step 280, and so on, to achieve continuous updating of the adjustment parameters and continuous acquisition of images, so that the quality of the acquired images can be rapidly improved and the optimal imaging effect can be quickly achieved.

[0115] Figure 6It is a flowchart of an image generating method provided by yet another exemplary embodiment of the present disclosure.

[0116] In some optional embodiments, in the above Figure 2 Based on the embodiment shown, Figure 6 As shown, step 210 of determining the current adjustment parameters corresponding to the first image sensor in the current environment may include:

[0117] Step 21A0 , determining the type of current activation of the first image sensor.

[0118] Among them, the startup type may include two types: hot start (which may be referred to as the first type) and cold start (which may be referred to as the second type). Cold start refers to starting from a state that has not worked for a long time to a working state. Hot start refers to restarting after a flow interruption during the operation of the image sensor. Flow interruption means that the image sensor does not generate an image due to a fault or other reasons, that is, the video stream of the image sensor is interrupted. For example, during the operation of the ADAS system, the video stream of a camera at a certain angle is interrupted and needs to be restarted. The current startup type of the first image sensor is one of a cold start and a hot start.

[0119] In some optional embodiments, the type of the first image sensor currently activated may be determined by maintaining the state of each image sensor.

[0120] Step 21B0: In response to the current startup type being the first type, determining the duration of stopping the operation of the first image sensor.

[0121] The first type is a hot start type. If the current start type is a hot start, it means that the first image sensor was in a working state before the current start, and has a historical adjustment parameter that can be referenced. In order to ensure the timeliness of the adjustment parameter, the length of time that the first image sensor stops working can be determined.

[0122] Step 21C0 , in response to the duration of the stop working satisfying the first duration condition, determining the current adjustment parameter based on the historical adjustment parameter before the first image sensor stops working.

[0123] Among them, the first duration condition may be that the duration of stopping working is less than a preset duration threshold. The preset duration threshold can be set to any duration according to actual needs. For example, the preset duration threshold can be 5 seconds, 10 seconds, 30 seconds, 40 seconds, and so on. If the duration of stopping working of the first image sensor meets the first duration condition, it can be determined that the historical adjustment parameters of the first image sensor have a certain timeliness, that is, the environmental changes will not be too large in a short time. Therefore, the current adjustment parameters can be determined based on the historical adjustment parameters before the first image sensor stops working. For example, the historical adjustment parameters used in the last frame image before the first image sensor stops working can be used as the current adjustment parameters. Or the current adjustment parameters are determined in combination with the historical adjustment parameters used in the last frame image before stopping working and the last frame image. The determination principle is consistent with the above-mentioned process of determining new adjustment parameters based on the current adjustment parameters and the current frame image, which will not be repeated here.

[0124] In some optional embodiments, based on the brightness information and color temperature information of the last frame of image before the first image sensor stops working, combined with the adjustment parameters used to generate the last frame of image, the updated adjustment parameters can be determined as the historical adjustment parameters corresponding to the last frame of image. The historical adjustment parameters can be stored to determine the current adjustment parameters when the first image sensor is restarted.

[0125] In the embodiment of the present disclosure, when the first image sensor is hot started, the current adjustment parameters after the current startup can be determined based on the historical adjustment parameters of the first image sensor before it last stopped working. Since the environment will not change too much in a short period of time, the accuracy of the current adjustment parameters can be ensured, thereby improving image quality.

[0126] In some optional embodiments, such as Figure 6 As shown, the method of the embodiment of the present disclosure may also include:

[0127] Step 21D0, in response to the duration of the shutdown not satisfying the first duration condition, determining at least one of current illumination information and current color temperature information corresponding to the current environment.

[0128] Among them, if the duration of the first image sensor stopping working does not meet the first duration condition, it means that the duration of the first image sensor stopping working is long, so that the timeliness of the historical adjustment parameters of the first image sensor is poor, and it may not be adapted to the current environment. Therefore, at least one of the current illumination information and the current color temperature information corresponding to the current environment can be determined to determine the current adjustment parameters. The method of determining the current illumination information and the current color temperature information can refer to the aforementioned embodiment, for example, refer to the aforementioned step 2110 and its expanded embodiment, which will not be repeated here.

[0129] Step 21E0, determining a current adjustment parameter according to at least one of the current illumination information and the current color temperature information.

[0130] The specific operation of step 21E0 can be found in step 2120 and its expanded implementation example, which will not be described in detail here.

[0131] In the embodiment of the present disclosure, when the duration for which the first image sensor stops working does not meet the first duration condition, the current adjustment parameter can be determined according to the current illumination information and the current color temperature information to ensure the real-time and accuracy of the current adjustment parameter.

[0132] Figure 7 It is a flowchart of an image generating method provided by yet another exemplary embodiment of the present disclosure.

[0133] In some optional embodiments, based on any of the above embodiments, the method of the embodiment of the present disclosure may further include:

[0134] Step 310 : In response to detecting that the first image sensor stops working, storing brightness information and color temperature information of the last frame of image before the first image sensor stops working.

[0135] The first image sensor stopping working may mean that the first image sensor cannot generate an image due to a fault or other reasons, resulting in the interruption of the video stream of the channel. In this case, the first image sensor can be restored to a normal working state by restarting the first image sensor. When it is detected that the first image sensor stops working, the brightness information and color temperature information of the last frame of image before the first image sensor stops working can be stored. After the first image sensor is restarted, the historical adjustment parameters before the first image sensor stops working can be determined based on the brightness information and color temperature information of the last frame of image, combined with the adjustment parameters used to generate the last frame of image.

[0136] In some optional embodiments, when it is detected that the first image sensor stops working, based on the brightness information and color temperature information of the last frame image before the first image sensor stops working and the adjustment parameters used in the last frame image, updated new adjustment parameters are determined and stored. After the first image sensor is restarted, the stored new adjustment parameters are used as the historical adjustment parameters before the first image sensor stops working to determine the current adjustment parameters.

[0137] In the disclosed embodiment, after the first image sensor stops working, the brightness information and color temperature information of the last frame image before the first image sensor stops working are stored, so as to facilitate the determination of the historical adjustment parameters before the first image sensor stops working. In the case where the first image sensor is hot started and the duration of stopping working is less than a preset duration threshold, the current adjustment parameters can be quickly obtained based on the historical adjustment parameters to ensure the accuracy of the current adjustment parameters.

[0138] The above-mentioned embodiments of the present disclosure may be implemented separately or in any combination without conflict. The specific configuration may be based on actual needs and the present disclosure does not limit this.

[0139] In some optional embodiments, Figure 8 FIG. 1 is a flowchart of an image generation method provided by an exemplary embodiment of the present disclosure. Figure 8 As shown, the process of the method may include the following steps:

[0140] Step 4110, start the first image sensor.

[0141] Step 4120 , determining the type of the current activation of the first image sensor. If the type of the current activation is the first type, go to step 4130 ; otherwise, go to step 420 .

[0142] Step 4130, determining the duration for which the first image sensor stops working.

[0143] Step 4140 , whether the duration of the stop working meets the first duration condition. If yes, go to step 4150 , if not, go to step 420 .

[0144] Step 4150 : Determine the current adjustment parameter based on the historical adjustment parameter before the first image sensor stops working. Then go to step 460 .

[0145] Step 420, determine whether an illumination sensor and a temperature sensor are installed. If not, go to step 4310, if yes, go to step 4410.

[0146] Step 4310 : Determine the current illumination information corresponding to the current environment based on the illumination sensor, and determine the current color temperature information corresponding to the current environment based on the color temperature sensor. Then go to step 450 .

[0147] Step 4410 , determine whether there is at least one second image sensor in working state. If not, go to step 4420 ; if yes, go to step 4440 .

[0148] Step 4420, determine the target time period corresponding to the current environment.

[0149] Step 4430 , determining the current adjustment parameter according to the target time period and the preset adjustment parameters corresponding to the different pre-configured time periods.

[0150] Step 4440: Obtain illumination information and color temperature information corresponding to any second image sensor.

[0151] Step 4450 , determine the illumination information corresponding to the second image sensor as the current illumination information, and determine the color temperature information corresponding to the second image sensor as the current color temperature information. Go to step 450 .

[0152] Step 450 : Determine a current adjustment parameter according to at least one of the current illumination information and the current color temperature information. Then proceed to step 460 .

[0153] Step 460: Control the first image sensor to generate a current frame image according to the current adjustment parameters.

[0154] Step 470: Detect whether the first image sensor stops working.

[0155] Step 480: If it is detected that the first image sensor stops working, the brightness information and color temperature information of the last frame of the image before the first image sensor stops working are stored, so that when the first image sensor is started again in a short time, the current adjustment parameters can be determined according to the above step 4150.

[0156] It should be noted that steps 470 to 480 can be performed in real time or at a fixed time after the first image sensor is started, and are not affected by other steps. The specific operations of the above steps 4110 to 480 can refer to the above embodiments, and are not described here in detail.

[0157] The above steps 4110 to 480 are only an exemplary combination implementation of the embodiments of the present disclosure, and are not intended to limit the embodiments of the present disclosure. In practical applications, any other combination may be combined and implemented. For example, in the case where an illumination sensor and a temperature sensor are pre-installed, step 4310 and its subsequent steps may be directly executed after step 4120, without executing step 4410 and its subsequent steps. No further description will be given here.

[0158] The image generation method provided by the embodiment of the present disclosure can determine the current adjustment parameters that meet the current environment requirements corresponding to the current environment through various methods after starting the image sensor, and is used to control the image sensor to generate images. Since the current adjustment parameters are determined according to the actual situation of the current environment, the current adjustment parameters have high accuracy, thereby ensuring that the initial adjustment parameters used after the image sensor is started are highly accurate, ensuring the quality of the first frame of image generated, and thus speeding up the speed at which subsequent images are restored to the best effect, achieving rapid restoration of the best imaging effect after the image sensor is started, improving the overall stability of the quality of the video stream provided by the image sensor, and improving the image effect recovery speed without additional hardware costs. In scenarios such as smart driving and smart cockpits, better perception results can be obtained at the initial start of the corresponding function, ensuring that users have a better driving experience.

[0159] Any image generation method provided in the embodiments of the present disclosure may be executed by any appropriate electronic device with data processing capabilities, including but not limited to: electronic devices such as terminal devices and servers. Alternatively, any image generation method provided in the embodiments of the present disclosure may be executed by a processor, such as a processor executing any image generation method mentioned in the embodiments of the present disclosure by calling corresponding instructions stored in a memory. This will not be described in detail below.

[0160] Exemplary Devices

[0161] Fig. 9 is a schematic diagram of the structure of an image generating device provided by an exemplary embodiment of the present disclosure. The device of this embodiment can be used to implement the corresponding method embodiment of the present disclosure, such as Fig. 9 The device shown may include: a first processing module 510 and a second processing module 520 .

[0162] The first processing module 510 is used to determine the current adjustment parameters of the first image sensor corresponding to the current environment in response to the first image sensor being started; the current adjustment parameters include at least one of the current exposure parameters and the current white balance gain.

[0163] The second processing module 520 is used to control the first image sensor to generate a current frame image according to the current adjustment parameters.

[0164] Fig.10 It is a structural schematic diagram of an image generating device provided by another exemplary embodiment of the present disclosure.

[0165] In some optional embodiments, in the above Fig. 9 Based on the embodiment shown, Fig.10 As shown, the first processing module 510 may include: a first processing unit 5110 and a second processing unit 5120 .

[0166] The first processing unit 5110 may be configured to determine at least one of current illumination information and current color temperature information corresponding to the current environment.

[0167] The second processing unit 5120 may be configured to determine a current adjustment parameter according to at least one of current illumination information and current color temperature information.

[0168] In some optional embodiments, the first processing unit 5110 may be specifically configured to: determine current illumination information based on an illumination sensor; and / or determine current color temperature information based on a color temperature sensor.

[0169] In some optional embodiments, the first processing unit 5110 may be specifically configured to: determine current illumination information based on an illumination sensor.

[0170] In some optional embodiments, the first processing unit 5110 may be specifically configured to: determine current color temperature information based on a color temperature sensor.

[0171] In some optional embodiments, the first processing unit 5110 may be specifically configured to: determine current illumination information based on an illumination sensor; and determine current color temperature information based on a color temperature sensor.

[0172] In some optional embodiments, the first processing unit 5110 can be specifically used to: in response to the existence of at least one second image sensor in a working state, obtain the illumination information and / or color temperature information corresponding to any second image sensor; the second image sensor is an image sensor other than the first image sensor; determine the illumination information corresponding to the second image sensor as the current illumination information, and / or, determine the color temperature information corresponding to the second image sensor as the current color temperature information.

[0173] In some optional embodiments, the first processing unit 5110 can be specifically used to: in response to the existence of at least one second image sensor in a working state, obtain illumination information corresponding to any second image sensor; and determine the illumination information corresponding to the second image sensor as current illumination information.

[0174] In some optional embodiments, the first processing unit 5110 can be specifically used to: in response to the existence of at least one second image sensor in a working state, obtain color temperature information corresponding to any second image sensor; and determine the color temperature information corresponding to the second image sensor as the current color temperature information.

[0175] In some optional embodiments, the first processing unit 5110 can be specifically used to: in response to the presence of at least one second image sensor in a working state, obtain the illuminance information and color temperature information corresponding to any second image sensor; determine the illuminance information corresponding to the second image sensor as the current illuminance information, and determine the color temperature information corresponding to the second image sensor as the current color temperature information.

[0176] In some optional embodiments, the second processing unit 5120 can be specifically used to: determine the current exposure parameter based on the current illumination information and a first correspondence between different illuminations and exposure parameters that are pre-calibrated; and / or determine the current white balance gain based on the current color temperature information and a second correspondence between different color temperatures and white balance gains that are pre-calibrated; determine the current adjustment parameter based on at least one of the current exposure parameter and the current white balance gain.

[0177] In some optional embodiments, the second processing unit 5120 can be specifically used to: determine the current exposure parameter according to the current illumination information and the first correspondence between different illuminations and exposure parameters calibrated in advance; determine the current adjustment parameter based on the current exposure parameter.

[0178] In some optional embodiments, the second processing unit 5120 can be specifically used to: determine the current white balance gain based on the current color temperature information and a pre-calibrated second correspondence between different color temperatures and white balance gains; and determine the current adjustment parameter based on the current white balance gain.

[0179] In some optional embodiments, the second processing unit 5120 can be specifically used to: determine the current exposure parameters based on the current illumination information and a first correspondence between different illuminations and exposure parameters that are pre-calibrated; determine the current white balance gain based on the current color temperature information and a second correspondence between different color temperatures and white balance gains that are pre-calibrated; and determine the current adjustment parameters based on the current exposure parameters and the current white balance gain.

[0180] In some optional embodiments, the second processing unit 5120 can be specifically used to: determine, from a first corresponding relationship, first illumination information and second illumination information that have a preset size relationship with the current illumination information, as well as a first exposure parameter corresponding to the first illumination information and a second exposure parameter corresponding to the second illumination information according to the current illumination information; and determine the current exposure parameter corresponding to the current illumination information by interpolation based on the current illumination information, the first illumination information, the second illumination information, the first exposure parameter and the second exposure parameter.

[0181] In some optional embodiments, the second processing unit 5120 can be specifically used to: determine, from a second corresponding relationship, first color temperature information and second color temperature information that have a preset size relationship with the current color temperature information, as well as a first white balance gain corresponding to the first color temperature information and a second white balance gain corresponding to the second color temperature information based on the current color temperature information; and determine the current white balance gain corresponding to the current color temperature information by interpolation based on the current color temperature information, the first color temperature information, the second color temperature information, the first white balance gain and the second white balance gain.

[0182] Fig.11 It is a structural schematic diagram of an image generating device provided by yet another exemplary embodiment of the present disclosure.

[0183] In some optional embodiments, in the above Fig. 9 Based on the embodiment shown, Fig.11 As shown, the first processing module 510 may include: a first determining unit 51a0 and a second determining unit 51b0.

[0184] The first determining unit 51a0 may be configured to determine a target time period corresponding to the current environment.

[0185] The second determining unit 51b0 may be configured to determine the current adjustment parameter according to the target time period and the preset adjustment parameters corresponding to the different pre-configured time periods.

[0186] In some optional embodiments, the first processing module 510 may include the above-mentioned first processing unit 5110, the second processing unit 5120, the first determining unit 51a0 and the second determining unit 51b0.

[0187] Fig.12 It is a structural schematic diagram of an image generating device provided by yet another exemplary embodiment of the present disclosure.

[0188] In some optional embodiments, based on any of the above embodiments, Fig.12 As shown, the device of the embodiment of the present disclosure may further include: a third processing module 610 , a fourth processing module 620 , a fifth processing module 630 , a sixth processing module 640 , a seventh processing module 650 and an eighth processing module 660 .

[0189] The third processing module 610 may be used to determine first brightness information and a third white balance gain of a current frame image.

[0190] The fourth processing module 620 may be configured to determine third illumination information according to the current adjustment parameter and the first brightness information of the current frame image.

[0191] The fifth processing module 630 may be configured to determine a fourth white balance gain according to the current adjustment parameter and the third white balance gain of the current frame image.

[0192] The sixth processing module 640 may be configured to determine a third exposure parameter according to the third illumination information and a pre-calibrated first correspondence between different illuminations and exposure parameters.

[0193] The seventh processing module 650 may be configured to determine new adjustment parameters of the first image sensor based on the third exposure parameter and the fourth white balance gain.

[0194] The eighth processing module 660 may be used to control the first image sensor to generate a next frame of image according to the new adjustment parameters, where the next frame of image is a frame of image after the current frame of image.

[0195] Fig.13 It is a structural schematic diagram of an image generating device provided by yet another exemplary embodiment of the present disclosure.

[0196] In some optional embodiments, in the above Fig. 9 Based on the embodiment shown, Fig.13 As shown, the first processing module 510 may include: a third determining unit 51A0 , a fourth determining unit 51B0 , and a fifth determining unit 51C0 .

[0197] The third determining unit 51A0 may be configured to determine a type of current activation of the first image sensor.

[0198] The fourth determining unit 51B0 may be configured to determine a duration for which the first image sensor stops working in response to the current startup type being the first type.

[0199] The fifth determining unit 51C0 may be configured to determine the current adjustment parameter based on the historical adjustment parameter before the first image sensor stops working in response to the duration of the stop working satisfying the first duration condition.

[0200] In some optional embodiments, such as Fig.13 As shown, the first processing module 510 may further include: a sixth determining unit 51D0 and a seventh determining unit 51E0.

[0201] The sixth determination unit 51D0 may be configured to determine at least one of current illumination information and current color temperature information corresponding to the current environment in response to the duration of the shutdown not satisfying the first duration condition.

[0202] The seventh determination unit 51E0 may be configured to determine a current adjustment parameter according to at least one of current illumination information and current color temperature information.

[0203] In some optional embodiments, the first processing module 510 may include at least one of the following combinations: a first processing unit 5110 and a second processing unit 5120; a first determination unit 51a0 and a second determination unit 51b0; a third determination unit 51A0, a fourth determination unit 51B0 and a fifth determination unit 51C0; a sixth determination unit 51D0 and a seventh determination unit 51E0.

[0204] Fig.14 It is a structural schematic diagram of an image generating device provided by yet another exemplary embodiment of the present disclosure.

[0205] In some optional embodiments, based on any of the above embodiments, the device of the embodiment of the present disclosure may also include: a ninth processing module 710, which can be used to store the brightness information and color temperature information of the last frame image before the first image sensor stops working in response to detecting that the first image sensor stops working.

[0206] The beneficial technical effects corresponding to the exemplary embodiment of the present device can be found in the corresponding beneficial technical effects of the above exemplary method section, which will not be repeated here.

[0207] Exemplary Electronic Devices

[0208] Fig.15 It is a structural diagram of an electronic device provided by an embodiment of the present disclosure, including at least one processor 91 and a memory 92.

[0209] The processor 91 may be a central processing unit (CPU) or other forms of processing units having data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device 90 to perform desired functions.

[0210] The memory 92 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. Volatile memory may include, for example, random access memory (RAM) and / or cache memory (cache), etc. Non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 91 may execute one or more computer program instructions to implement the methods and / or other desired functions of the various embodiments of the present disclosure described above.

[0211] In one example, the electronic device 90 may further include: an input device 93 and an output device 94 , and these components are interconnected via a bus system and / or other forms of connection mechanisms (not shown).

[0212] The input device 93 may also include, for example, a touch screen, a microphone, various sensors, and the like. Sensors may include, for example, image sensors (such as cameras, cameras, etc.), laser radars, millimeter-wave radars, ultrasonic radars, positioning sensors, pressure sensors, air quality sensors, temperature sensors, and the like. Image sensors, laser radars, millimeter-wave radars, ultrasonic radars, and the like may be used to sense the surrounding environment, that is, to detect dynamic and static objects in the surrounding environment. Dynamic and static objects may include, for example, static objects such as lane lines, curbs, arrows, signs, trees, and buildings, as well as dynamic objects such as surrounding vehicles, pedestrians, and cyclists. Positioning sensors are used to realize the positioning of movable devices (such as self-vehicles, robots, etc.) where electronic devices are located. Positioning sensors may include, for example, inertial measurement units (Inertial Measurement Unit, referred to as: IMU), global positioning systems (Global Positioning System, referred to as: GPS), and the like. Pressure sensors may be used to detect seat pressure. Temperature sensors may be used to detect the temperature in the vehicle cabin. Air quality sensors may be used to detect the air quality in the vehicle cabin.

[0213] The output device 94 can output various information to the outside, and may include, for example, a display, a speaker, a communication network and a remote output device connected thereto, and the like.

[0214] Of course, to simplify, Fig.15 Only some of the components related to the present disclosure in the electronic device 90 are shown, and components such as a bus, an input / output interface, etc. are omitted. In addition, according to specific application situations, the electronic device 90 may also include any other appropriate components.

[0215] Exemplary computer program products and computer-readable storage media

[0216] In addition to the above methods and devices, embodiments of the present disclosure may also provide a computer program product, including computer program instructions, which, when executed by a processor, enable the processor to execute the steps of the methods of various embodiments of the present disclosure described in the above “Exemplary Methods” section.

[0217] The computer program product may be written in any combination of one or more programming languages ​​to write program code for performing the operations of the disclosed embodiments, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0218] In addition, an embodiment of the present disclosure may also be a computer-readable storage medium having computer program instructions stored thereon, which, when executed by a processor, enables the processor to execute the steps in the method of various embodiments of the present disclosure described in the above “Exemplary Method” section.

[0219] Computer readable storage media can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium is, for example, but not limited to, a system, device or device including electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0220] The basic principles of the present disclosure are described above in conjunction with specific embodiments. However, the advantages, strengths, effects, etc. mentioned in the present disclosure are only examples and not limitations, and cannot be considered as necessary for each embodiment of the present disclosure. In addition, the specific details disclosed above are only for the purpose of illustration and ease of understanding, rather than limitation, and the above details do not limit the present disclosure to being implemented by adopting the above specific details.

[0221] Those skilled in the art may make various changes and modifications to the present disclosure without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the present disclosure claims and their equivalents, the present disclosure is also intended to include these modifications and variations.

Claims

1. A method for generating an image, comprising: In response to the first image sensor being started, determining a current adjustment parameter of the first image sensor corresponding to a current environment; The current adjustment parameter includes at least one of a current exposure parameter and a current white balance gain; According to the current adjustment parameters, the first image sensor is controlled to generate a current frame image.

2. The method according to claim 1, wherein: The determining of the current adjustment parameters corresponding to the first image sensor in the current environment includes: Determine at least one of current illumination information and current color temperature information corresponding to the current environment; The current adjustment parameter is determined according to at least one of the current illumination information and the current color temperature information.

3. The method according to claim 2, wherein: The determining at least one of current illumination information and current color temperature information corresponding to the current environment includes: Determining the current illumination information based on an illumination sensor; and / or, Based on the color temperature sensor, the current color temperature information is determined.

4. The method according to claim 2, wherein: The determining at least one of current illumination information and current color temperature information corresponding to the current environment includes: In response to at least one second image sensor being in a working state, acquiring illumination information and / or color temperature information corresponding to any second image sensor; the second image sensor is an image sensor other than the first image sensor; The illumination information corresponding to the second image sensor is determined as the current illumination information, and / or the color temperature information corresponding to the second image sensor is determined as the current color temperature information.

5. The method according to claim 2, wherein: The determining the current adjustment parameter according to at least one of the current illumination information and the current color temperature information includes: Determining the current exposure parameter according to the current illumination information and a pre-calibrated first correspondence between different illuminations and exposure parameters; and / or, Determining the current white balance gain according to the current color temperature information and a pre-calibrated second correspondence relationship between different color temperatures and white balance gains; The current adjustment parameter is determined based on at least one of the current exposure parameter and the current white balance gain.

6. The method according to claim 5, wherein: The determining the current exposure parameter according to the current illumination information and a pre-calibrated first correspondence between different illuminations and exposure parameters includes: Determining, from the first corresponding relationship, according to the current illumination information, first illumination information and second illumination information having a preset magnitude relationship with the current illumination information, as well as a first exposure parameter corresponding to the first illumination information and a second exposure parameter corresponding to the second illumination information; Based on the current illumination information, the first illumination information, the second illumination information, the first exposure parameter, and the second exposure parameter, the current exposure parameter corresponding to the current illumination information is determined by interpolation.

7. The method according to claim 5, wherein: The determining the current white balance gain according to the current color temperature information and a pre-calibrated second correspondence between different color temperatures and white balance gains includes: Determining, from the second corresponding relationship, according to the current color temperature information, first color temperature information and second color temperature information having a preset magnitude relationship with the current color temperature information, as well as a first white balance gain corresponding to the first color temperature information and a second white balance gain corresponding to the second color temperature information; Based on the current color temperature information, the first color temperature information, the second color temperature information, the first white balance gain, and the second white balance gain, the current white balance gain corresponding to the current color temperature information is determined by interpolation.

8. The method according to claim 1, wherein: The determining of the current adjustment parameters corresponding to the first image sensor in the current environment includes: Determine the target time period corresponding to the current environment; The current adjustment parameter is determined according to the target time period and the preset adjustment parameters corresponding to the different pre-configured time periods.

9. The method according to claim 8, wherein: After controlling the first image sensor to generate a current frame image according to the current adjustment parameter, the method further includes: Determining first brightness information and a third white balance gain of the current frame image; Determining third illumination information according to the current adjustment parameter and the first brightness information of the current frame image; Determining a fourth white balance gain according to the current adjustment parameter and the third white balance gain of the current frame image; Determining a third exposure parameter according to the third illumination information and a pre-calibrated first correspondence between different illuminations and exposure parameters; determining a new adjustment parameter of the first image sensor based on the third exposure parameter and the fourth white balance gain; According to the new adjustment parameters, the first image sensor is controlled to generate a next frame image, where the next frame image is a frame image after the current frame image.

10. The method according to claim 1, wherein: The determining of the current adjustment parameters corresponding to the first image sensor in the current environment includes: determining a type of current activation of the first image sensor; In response to the type of the current startup being the first type, determining a duration for which the first image sensor stops working; In response to the duration of the stop working satisfying a first duration condition, the current adjustment parameter is determined based on a historical adjustment parameter before the first image sensor stops working.

11. The method according to claim 10, wherein: The method further comprises: In response to the duration of the work stoppage not satisfying the first duration condition, determining at least one of current illumination information and current color temperature information corresponding to the current environment; The current adjustment parameter is determined according to at least one of the current illumination information and the current color temperature information.

12. The method according to any one of claims 1 to 11, wherein: Also includes: In response to detecting that the first image sensor stops working, brightness information and color temperature information of the last frame of image before the first image sensor stops working are stored.

13. An image generating device, comprising: A first processing module, configured to determine, in response to the first image sensor being started, a current adjustment parameter corresponding to the first image sensor in a current environment; The current adjustment parameter includes at least one of a current exposure parameter and a current white balance gain; The second processing module is used to control the first image sensor to generate a current frame image according to the current adjustment parameters.

14. A computer-readable storage medium storing a computer program, wherein the computer program is used to execute the method according to any one of claims 1 to 12.

15. An electronic device, comprising: processor; a memory for storing instructions executable by the processor; The processor is used to read the executable instructions from the memory and execute the instructions to implement the method described in any one of claims 1-12.

Images