Image processing method and device, electronic equipment and computer readable storage medium

Abstract

The invention discloses an image processing method and device, electronic equipment and a computer readable storage medium. The method comprises the following steps: acquiring an original image corresponding to a first moment; determining an initial illumination intensity factor corresponding to the first moment based on the original image; based on the initial illumination intensity factor corresponding to the first moment, performing fusion processing on a preset first local tone mapping curve, a preset second local tone mapping curve and a preset first global tone mapping curve to obtain a fused tone mapping curve corresponding to the first moment; wherein the first local tone mapping curve is used for carrying out image processing in a high-illumination-intensity scene, and the second local tone mapping curve and the first global tone mapping curve are used for carrying out image processing in a low-illumination-intensity scene; and performing image processing on the original image based on the fused tone mapping curve. According to the invention, the image quality of the image data can be improved.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of image processing, and particularly relates to an image processing method and device, an electronic device and a computer readable storage medium. BACKGROUND

[0002] In a vision-based intelligent driving system, the image quality of image data directly affects the accuracy and reliability of key functions such as target detection, lane recognition, and obstacle avoidance. Therefore, the intelligent driving system needs to perform image processing on the original image collected by the image sensor through an image signal processor (ISP) to improve the image quality of the image data.

[0003] At present, local tone mapping (LTM) and global tone mapping (GTM) are two commonly used image processing methods. The image signal processor usually adopts a combination of local tone mapping and global tone mapping with fixed parameters to perform image processing on the original image collected by the image sensor.

[0004] However, in actual driving scenarios, the lighting conditions change dynamically, and the combination of local tone mapping and global tone mapping with fixed parameters is prone to result in poor image quality of the image data after image processing, which cannot meet the requirements of the intelligent driving system on image quality. SUMMARY

[0005] To solve the above technical problems, the present disclosure provides an image processing method, device, electronic device and computer readable storage medium to improve the image quality of image data.

[0006] In a first aspect of the present disclosure, an image processing method is provided, comprising:

[0007] obtaining an original image corresponding to a first time point;

[0008] determining an initial lighting intensity factor corresponding to the first time point based on the original image;

[0009] performing fusion processing on a first local tone mapping curve, a second local tone mapping curve and a first global tone mapping curve pre-set based on the initial lighting intensity factor corresponding to the first time point to obtain a fusion tone mapping curve corresponding to the first time point; wherein the first local tone mapping curve is used for image processing in a high-lighting-intensity scene, and the second local tone mapping curve and the first global tone mapping curve are used for image processing in a low-lighting-intensity scene;

[0010] The original image is processed based on the fusion tone mapping curve.

[0011] A second aspect embodiment of the present disclosure provides an image processing device, comprising:

[0012] An original image acquisition module is configured to acquire an original image corresponding to a first time point.

[0013] An illumination intensity factor determination module is configured to determine an initial illumination intensity factor corresponding to the first time point based on the original image.

[0014] A fusion processing module is configured to perform fusion processing on a preset first local tone mapping curve, a second local tone mapping curve and a first global tone mapping curve based on the initial illumination intensity factor corresponding to the first time point, to obtain a fusion tone mapping curve corresponding to the first time point, wherein the first local tone mapping curve is used for image processing in a high-illumination-intensity scene, and the second local tone mapping curve and the first global tone mapping curve are used for image processing in a low-illumination-intensity scene.

[0015] An image processing module is configured to perform image processing on the original image based on the fusion tone mapping curve.

[0016] A third aspect embodiment of the present disclosure provides a computer-readable storage medium, which stores a computer program, and the computer program is executed by a processor to perform the image processing method provided in the first aspect.

[0017] A fourth aspect embodiment of the present disclosure provides an electronic device, which comprises a processor, a memory for storing executable instructions of the processor, and the processor is configured to read the executable instructions from the memory and execute the instructions to implement the image processing method provided in the first aspect.

[0018] A fifth aspect embodiment of the present disclosure provides a computer program product, which, when executed by an instruction processor, performs the image processing method provided in the first aspect.

[0019] An embodiment of the present application provides an image processing method, device, electronic equipment and computer readable storage medium. The electronic equipment acquires an original image corresponding to a first time. Then, the electronic equipment determines an initial light intensity factor corresponding to the first time based on the original image. After that, the electronic equipment fuses a first local tone mapping curve, a second local tone mapping curve and a first global tone mapping curve based on the initial light intensity factor corresponding to the first time, to obtain a fused tone mapping curve corresponding to the first time. The first local tone mapping curve is used for image processing in a high light intensity scene, and the second local tone mapping curve and the first global tone mapping curve are used for image processing in a low light intensity scene. Finally, the electronic equipment performs image processing on the original image based on the fused tone mapping curve. The initial light intensity factor determined by the electronic equipment is different under different light intensities. Therefore, the electronic equipment fuses the first local tone mapping curve, the second local tone mapping curve and the first global tone mapping curve based on the initial light intensity factor, and obtains different fused tone mapping curves. In this way, as the light intensity dynamically changes, the electronic equipment can use the dynamically changed fused tone mapping curve to perform image processing on the original image, thereby improving the image quality. BRIEF DESCRIPTION OF DRAWINGS

[0020] Figure 1 FIG. 1 is a flowchart of an image processing method according to an example embodiment of the present disclosure.

[0021] Figure 2 FIG. 2 is a flowchart of an image processing method according to another example embodiment of the present disclosure.

[0022] Figure 3 FIG. 3 is a flowchart of an image processing method according to another example embodiment of the present disclosure.

[0023] Figure 4 FIG. 4 is a flowchart of an image processing method according to another example embodiment of the present disclosure.

[0024] Figure 5 FIG. 5 is a flowchart of an image processing method according to another example embodiment of the present disclosure.

[0025] Figure 6 FIG. 6 is a flowchart of an image processing method according to another example embodiment of the present disclosure.

[0026] Figure 7 FIG. 7 is a flowchart of an image processing method according to another example embodiment of the present disclosure.

[0027] Figure 8 FIG. 8 is a flowchart of an example of an image processing method according to an example embodiment of the present disclosure.

[0028] Figure 9 FIG. 1 is a structural schematic diagram of an image processing device provided by an example embodiment of the present disclosure.

[0029] Figure 10 FIG. 2 is a structural diagram of an electronic device provided by an example embodiment of the present disclosure. DETAILED DESCRIPTION

[0030] In order to explain the present disclosure, the example embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. It should be apparent that the described embodiments are only a part of the embodiments of the present disclosure, and not all the embodiments. It should be understood that the present disclosure is not limited by the example embodiments.

[0031] It should be noted that: unless otherwise specified, the relative arrangement, numerical expression and numerical value of the components and steps set forth in these embodiments do not limit the scope of the present disclosure.

[0032] SUMMARY

[0033] In a vision-based intelligent driving system, the image quality of image data directly affects the accuracy and reliability of key functions such as target detection, lane recognition, obstacle avoidance, etc. Therefore, the intelligent driving system needs to perform image processing on the original image collected by the image sensor through the image signal processor to improve the image quality of the image data.

[0034] In the related art, local tone mapping and global tone mapping are two commonly used image processing methods. The image signal processor usually adopts a combination of local tone mapping and global tone mapping with fixed parameters to perform image processing on the original image collected by the image sensor. However, in actual driving scenarios, the lighting conditions change dynamically, and the combination of local tone mapping and global tone mapping with fixed parameters is prone to result in poor image quality of the image data after image processing, which cannot meet the requirements of the intelligent driving system on image quality.

[0035] In the embodiments of the present disclosure, the electronic device obtains an original image corresponding to a first time. Then, the electronic device determines an initial light intensity factor corresponding to the first time based on the original image. After that, the electronic device fuses a first local tone mapping curve, a second local tone mapping curve and a first global tone mapping curve based on the initial light intensity factor corresponding to the first time, to obtain a fused tone mapping curve corresponding to the first time. The first local tone mapping curve is used for image processing in a high light intensity scene, and the second local tone mapping curve and the first global tone mapping curve are used for image processing in a low light intensity scene. Finally, the electronic device performs image processing on the original image based on the fused tone mapping curve. Under different light intensities, the initial light intensity factor determined by the electronic device is different. Therefore, the electronic device fuses the first local tone mapping curve, the second local tone mapping curve and the first global tone mapping curve based on the initial light intensity factor, and obtains a fused tone mapping curve. In this way, as the light intensity dynamically changes, the electronic device can use a dynamically changing fused tone mapping curve to perform image processing on the original image, thereby improving the image quality.

[0036] The electronic device described in the embodiments of the present disclosure can be a smart terminal, a vehicle-mounted terminal, a smart driving domain controller, a central computing platform, etc. Specifically, the electronic device can integrate at least one processor. The processor can be a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU), a digital signal processor (DSP), an image signal processor (ISP), etc.

[0037] Exemplary method

[0038] Figure 1 is a flowchart of an image processing method provided by an exemplary embodiment of the present disclosure. The present embodiment can be applied to an electronic device, such as a smart terminal, a vehicle-mounted terminal, a smart driving domain controller, a central computing platform, etc. Figure 1 As shown in the figure, the method comprises the following steps:

[0039] Step 101: Obtain an original image corresponding to a first time.

[0040] Exemplarily, the image sensor arranged on the autonomous vehicle periodically collects original images, and transmits the collected original images to the electronic device. The original image refers to an image which has not been processed by an image signal processor. When the electronic device needs to process the original image corresponding to a first time, the electronic device can obtain the original image corresponding to the first time. The first time can be the current time or a historical time, which is not limited in the embodiments of the present disclosure.

[0041] In step 102, based on the original image, an initial illumination intensity factor corresponding to the first time is determined.

[0042] Exemplarily, affected by the illumination intensity of the sun and artificial light source, the illumination intensity of the environment where the autonomous vehicle is located is different under different environments. For example, during the day, the illumination intensity of the environment where the autonomous vehicle is located is strong, while at night, the illumination intensity of the environment where the autonomous vehicle is located is weak. For another example, on a night without street lamps, the illumination intensity of the environment where the autonomous vehicle is located is weak, while on a night with street lamps, the illumination intensity of the environment where the autonomous vehicle is located is strong.

[0043] Under different illumination intensities, the brightness distribution of the original image is different, the noise level is different, and the dynamic range coverage is also different. If a local tone mapping curve and / or a global tone mapping curve with fixed parameters are used, it is easy to cause the image quality of the image data after image processing to be poor. In order to be able to dynamically adjust the tone mapping curve for image processing of the original image with the dynamic change of the illumination intensity, the electronic device. Therefore, the electronic device can determine an initial illumination intensity factor corresponding to the first time based on the original image corresponding to the first time. The initial illumination intensity factor is used to represent the degree of strength of the illumination intensity of the environment where the autonomous vehicle is located. The value range of the initial illumination intensity factor is [0, 1]. The greater the initial illumination intensity factor, the stronger the illumination intensity of the environment where the autonomous vehicle is located. The smaller the initial illumination intensity factor, the weaker the illumination intensity of the environment where the autonomous vehicle is located. The process of determining the initial illumination intensity factor corresponding to the first time based on the original image by the electronic device will be described in detail later, and will not be described here.

[0044] In step 103, based on the initial illumination intensity factor corresponding to the first time, a first local tone mapping curve, a second local tone mapping curve and a first global tone mapping curve are fused to obtain a fusion tone mapping curve corresponding to the first time. The first local tone mapping curve is used for image processing in a high-illumination-intensity scene, and the second local tone mapping curve and the first global tone mapping curve are used for image processing in a low-illumination-intensity scene.

[0045] For example, the electronic device can pre-store a first local tone mapping curve for image processing of the original image in a high light intensity scene. The first local tone mapping curve can be obtained by calibrating an initial local tone mapping curve in the high light intensity scene. The high light intensity scene refers to a light intensity scene where the light intensity is greater than or equal to a first preset light intensity (e.g., 10000 Lux). For example, the high light intensity scene refers to daytime. The electronic device can also pre-store a second local tone mapping curve and a first global tone mapping curve for image processing of the original image in a low light intensity scene. The second local tone mapping curve can be obtained by calibrating an initial local tone mapping curve in the low light intensity scene, and the first global tone mapping curve can be obtained by calibrating an initial global tone mapping curve in the low light intensity scene. The low light intensity scene refers to a light intensity scene where the light intensity is less than or equal to a second preset light intensity (e.g., 1 Lux). For example, the low light intensity scene refers to nighttime.

[0046] After the electronic device obtains the initial light intensity factor corresponding to the first time, the electronic device can perform a weighted fusion processing on the first local tone mapping curve, the second local tone mapping curve, and the first global tone mapping curve based on the initial light intensity factor corresponding to the first time, to obtain a fusion tone mapping curve corresponding to the first time. In the high light intensity scene, the initial light intensity factor corresponding to the first time is equal to 1, and the fusion tone mapping curve is the first local tone mapping curve. In the low light intensity scene, the initial light intensity factor corresponding to the first time is equal to 0, and the fusion tone mapping curve is a combination curve of the second local tone mapping curve and the first global tone mapping curve. In the transition scene between the high light intensity scene and the low light intensity scene, the initial light intensity factor corresponding to the first time is between 0 and 1, and the fusion tone mapping curve is a weighted fusion curve of the first local tone mapping curve, the second local tone mapping curve, and the first global tone mapping curve.

[0047] In step 104, the original image is processed based on the fusion tone mapping curve.

[0048] For example, after the electronic device obtains the fusion tone mapping curve corresponding to the first time, the electronic device can further process the original image at the first time based on the fusion tone mapping curve at the first time.

[0049] In the embodiments of the present disclosure, the electronic device obtains an original image corresponding to a first time. Then, the electronic device determines an initial light intensity factor corresponding to the first time based on the original image. After that, the electronic device fuses a first local tone mapping curve, a second local tone mapping curve and a first global tone mapping curve based on the initial light intensity factor corresponding to the first time, to obtain a fused tone mapping curve corresponding to the first time. The first local tone mapping curve is used for image processing in a high light intensity scene, and the second local tone mapping curve and the first global tone mapping curve are used for image processing in a low light intensity scene. Finally, the electronic device performs image processing on the original image based on the fused tone mapping curve. The initial light intensity factor determined by the electronic device is different under different light intensities. Therefore, the electronic device fuses the first local tone mapping curve, the second local tone mapping curve and the first global tone mapping curve based on the initial light intensity factor, and obtains different fused tone mapping curves. In this way, as the light intensity dynamically changes, the electronic device can use the dynamically changing fused tone mapping curve to perform image processing on the original image, thereby improving the image quality.

[0050] As shown in the above Figure 2 based on the embodiments shown in the above Figure 1 The step 102 can include the following steps based on the embodiments shown in the above

[0051] Step 201, determining an ambient light intensity corresponding to a first time based on an original image.

[0052] For example, in order to dynamically adjust the tone mapping curve for image processing on the original image as the light intensity dynamically changes, the electronic device needs to determine the ambient light intensity corresponding to the first time. Under different light intensities, the brightness values of the pixel points in the original image are different. Therefore, the electronic device can determine the ambient light intensity corresponding to the first time based on the original image at the first time. The ambient light intensity is a real physical quantity of the light intensity of the environment in which the autonomous vehicle is located, and the unit of the ambient light intensity is lux. Specifically, first, the electronic device can obtain the brightness values of the pixel points in the green channel from the original image. Then, the electronic device converts the brightness values of the pixel points into photon numbers based on the sensor parameters of the image sensor, including full well capacity, sensitivity and quantum efficiency, etc. After that, the electronic device can determine the ambient light intensity corresponding to the first time based on the exposure parameters (exposure time, aperture value and sensitivity gain, etc.) and the photon numbers of the pixel points.

[0053] Step 202, determining an initial light intensity factor corresponding to the first time based on the ambient light intensity, a preset reference light intensity and a light intensity change factor.

[0054] Exemplarily, the electronic device can pre-store a reference light intensity and a light intensity change factor. The reference light intensity is the light intensity in a critical state between a high light intensity scene and a low light intensity scene. The unit of the reference light intensity is lux. The reference light intensity can be set by a technician according to actual conditions. For example, the high light intensity scene is daytime, the low light intensity scene is night, and the critical state between the high light intensity scene and the low light intensity scene is sunset / sunrise. Correspondingly, the light intensity in daytime is greater than or equal to 10,000 lux, the light intensity in night is less than or equal to 1 lux, and the light intensity in sunset / sunrise is 300 lux. The reference light intensity and the initial light intensity factor are in an inverse correlation. That is, the greater the reference light intensity is set, the smaller the initial light intensity factor determined is, and the smaller the reference light intensity is set, the greater the initial light intensity factor determined is. The light intensity change factor is used to control the change range of the initial light intensity factor. The light intensity change factor can be set by a technician according to actual conditions. The light intensity change factor and the initial light intensity factor are in a positive correlation. That is, the greater the light intensity change factor is set, the greater the change range of the initial light intensity factor determined is, and the smaller the light intensity change factor is set, the smaller the change range of the initial light intensity factor determined is.

[0055] After the electronic device determines the environmental light intensity corresponding to the first time, the electronic device can further determine an initial light intensity factor corresponding to the first time based on the environmental light intensity, the preset reference light intensity, and the light intensity change factor. The initial light intensity factor is used to represent the intensity of the light intensity of the environment in which the autonomous vehicle is located, and the value range of the initial light intensity factor is [0, 1]. The greater the initial light intensity factor is, the stronger the light intensity of the environment in which the autonomous vehicle is located is, and the smaller the initial light intensity factor is, the weaker the light intensity of the environment in which the autonomous vehicle is located is. The process of determining the initial light intensity factor corresponding to the first time based on the environmental light intensity, the preset reference light intensity, and the light intensity change factor will be described in detail later, and will not be described here.

[0056] In the embodiments of the present disclosure, the electronic device determines the environmental light intensity corresponding to the first time based on the original image of the first time. Then, the electronic device determines the initial light intensity factor corresponding to the first time based on the environmental light intensity, the preset reference light intensity, and the light intensity change factor. In this way, the electronic device can map the environmental light intensity to the initial light intensity factor, thereby providing a basis for subsequent weighted fusion of the tone mapping curve.

[0057] As shown in FIG. 2, the electronic device can determine the initial light intensity factor corresponding to the first time based on the environmental light intensity, the preset reference light intensity, and the light intensity change factor. Figure 3 ​Figure 2 Based on the illustrated embodiment, step 1022 may include the following steps:

[0058] Step 301: Calculate the difference between ambient light intensity and reference light intensity.

[0059] Step 302: Calculate the product of the difference and the light intensity change factor.

[0060] Step 303: Normalize the product to obtain the initial illumination intensity factor corresponding to the first moment.

[0061] For example, after determining the ambient light intensity at the first moment, the electronic device can calculate the difference between the ambient light intensity and the reference light intensity. Then, the electronic device can further calculate the product of this difference and a light intensity variation factor. Afterward, the electronic device can normalize this product to obtain the initial light intensity factor corresponding to the first moment. The electronic device can use the sigmoid function for normalization, or other algorithms; this embodiment is not limited to these methods.

[0062] Taking the sigmoid function as an example, the processing steps 301 to 302 above can be expressed as the following formula (1):

[0063] a = sigmoid(b(T0-T')) Formula (1)

[0064] Where a represents the initial light intensity factor, b represents the light intensity variation factor, T0 represents the ambient light intensity, and T' represents the reference light intensity.

[0065] Formula (1) expands to the following formula (2):

[0066]

[0067] Where a represents the initial light intensity factor, b represents the light intensity variation factor, T0 represents the ambient light intensity, and T' represents the reference light intensity.

[0068] In this embodiment, the electronic device calculates the difference between ambient light intensity and reference light intensity, and then calculates the product of the difference and a light intensity variation factor. The electronic device then normalizes the product to obtain the initial light intensity factor corresponding to the first moment. In this way, the electronic device can map ambient light intensity to the initial light intensity factor, thereby providing a basis for subsequent weighted fusion of the tone mapping curve.

[0069] like Figure 4 As shown above, in the above Figure 1 Based on the illustrated embodiment, step 103 may include the following steps:

[0070] Step 401: Smooth the initial illumination intensity factor corresponding to the first moment to obtain the target illumination intensity factor corresponding to the first moment.

[0071] For example, in certain situations, the light intensity of the environment in which the autonomous vehicle is located may change abruptly. For instance, when the autonomous vehicle enters a tunnel, the light intensity of its surroundings decreases rapidly. Or, on the other hand, an oncoming vehicle suddenly turns on its high beams, causing the light intensity to increase rapidly. To avoid significant fluctuations in the determined initial light intensity factor due to abrupt changes in the light intensity of the autonomous vehicle's environment, the electronic device can smooth the initial light intensity factor at the first moment to obtain the target light intensity factor at the first moment. The target light intensity factor at the first moment is the smoothed initial light intensity factor at the first moment. The process of smoothing the initial light intensity factor at the first moment to obtain the target light intensity factor at the first moment will be described in detail later and will not be repeated here.

[0072] Step 402: Based on the target illumination intensity factor corresponding to the first moment, perform a fusion process on the preset first local tone mapping curve, second local tone mapping curve and first global tone mapping curve to obtain the fused tone mapping curve corresponding to the first moment.

[0073] For example, after obtaining the target illumination intensity factor corresponding to the first moment, the electronic device can perform weighted fusion processing on the preset first local tone mapping curve, second local tone mapping curve and first global tone mapping curve based on the target illumination intensity factor corresponding to the first moment to obtain the fused tone mapping curve corresponding to the first moment.

[0074] In this embodiment, the electronic device smooths the initial illumination intensity factor corresponding to the first moment to obtain the target illumination intensity factor corresponding to the first moment. Then, based on the target illumination intensity factor corresponding to the first moment, the electronic device fuses a preset first local tone mapping curve, a second local tone mapping curve, and a first global tone mapping curve to obtain the fused tone mapping curve corresponding to the first moment. In this way, by smoothing the initial illumination intensity factor corresponding to the first moment, the electronic device can avoid abrupt changes in the illumination intensity of the environment in which the autonomous vehicle is located, which could cause large fluctuations in the illumination intensity factor and adversely affect subsequent image processing.

[0075] like Figure 5 As shown above, in the above Figure 4 Based on the illustrated embodiment, step 401 may include the following steps:

[0076] In step 501, the average illumination intensity factor is determined based on the initial illumination intensity factor corresponding to the first time and the initial illumination intensity factor corresponding to the second time. The second time is at least one time before the first time.

[0077] For example, in a very short time window, the illumination intensity of the environment in which the autonomous vehicle is located usually does not change greatly. Even if the illumination intensity of the environment in which the autonomous vehicle is located changes, the change is a small gradual change. Therefore, in a very short time window, the illumination intensity factor of the environment in which the autonomous vehicle is located usually does not change greatly. Even if the illumination intensity factor of the environment in which the autonomous vehicle is located changes, the change is a small gradual change. In order to avoid the illumination intensity of the environment in which the autonomous vehicle is located changing greatly, resulting in the determined illumination intensity factor fluctuating greatly, the electronic device can determine the first time and one or more times before the first time (i.e., one or more second times) as a time window. The length of the time window can be optionally set to milliseconds. Then, the electronic device can further calculate the average illumination intensity factor at each time in the time window. That is, the electronic device performs an average operation on the initial illumination intensity factor corresponding to the first time and the initial illumination intensity factor corresponding to the second time to obtain the average illumination intensity factor. The initial illumination intensity factor corresponding to the second time is determined based on the original image corresponding to the second time. The electronic device determines the initial illumination intensity factor corresponding to the second time based on the original image corresponding to the second time, and the process is similar to steps 201 to 202 described above, which will not be described here. For example, the first time is the current time T n . The second times are five times before the first time, i.e., T n-1 , T n-2 , T n-3 , T n-4 , and T n-5 . The initial illumination intensity factors corresponding to T n to T n-5 are a n =0.41, a n-1 =0.39, a n-2 =0.38, a n-3 =0.35, a n-4 =0.37, and a n-5 =0.38. The average illumination intensity factor a n corresponding to T n-5 to T 平均

[0078] =(a n +a n-1 +an-2 +a n-3 +a n-4 +a n-5 ) / 6≈0.38.

[0079] Step 502: In response to the absolute value of the difference between the average illumination intensity factor and the target illumination intensity factor corresponding to the third time moment being less than or equal to a preset difference threshold, the target illumination intensity factor corresponding to the third time moment is determined as the target illumination intensity factor corresponding to the first time moment. Here, the third time moment is the time moment preceding the first time moment, and the target illumination intensity factor corresponding to the third time moment is obtained after smoothing the initial illumination intensity factor corresponding to the third time moment.

[0080] For example, after obtaining the average illuminance factor, the electronic device can calculate the average illuminance factor and the previous time (i.e., the third time, T) of the first time point. n-1 The absolute value of the difference between the target illuminance factor at the third time point and the target illuminance factor at the third time point. The target illuminance factor at the third time point is obtained by smoothing the initial illuminance factor at the third time point. The electronic device can then further determine whether the absolute value of this difference is less than or equal to a preset difference threshold. This preset difference threshold can be set by a technician based on experience, and is not limited in this embodiment. If the absolute value of the difference is less than or equal to the preset difference threshold, it indicates that the initial illuminance factor at the first time point has not experienced significant fluctuations. Accordingly, to ensure the smoothness of the illuminance factor, the electronic device can determine the target illuminance factor at the third time point as the target illuminance factor at the first time point. For example, the preset difference threshold theh = 0.02, and the average illuminance factor a... 平均 =0.38, T n-1 Target illumination intensity factor a' at time n-1 =0.36, |a 平均 -a' n-1 |≤theh,T n Target illumination intensity factor a' at time n =a' n-1 =0.36.

[0081] Step 503: In response to the absolute value of the difference between the average illumination intensity factor and the target illumination intensity factor corresponding to the third time being greater than the difference threshold, the target illumination intensity factor corresponding to the first time is determined based on the preset adjustment step size, the difference, and the target illumination intensity factor corresponding to the third time.

[0082] For example, in response to the absolute value of the difference being greater than a preset difference threshold, it is indicated that the initial illumination intensity factor corresponding to the first time point has a large fluctuation. Correspondingly, in order to ensure the smoothness of the illumination intensity factor, the electronic device can determine the target illumination intensity factor corresponding to the first time point based on a preset adjustment step, the difference (i.e., the difference between the average illumination intensity factor and the target illumination intensity factor corresponding to the third time point), and the target illumination intensity factor corresponding to the third time point. The absolute value of the difference between the determined target illumination intensity factor corresponding to the first time point and the target illumination intensity factor corresponding to the third time point is less than or equal to the preset adjustment step, which can be set by the technician according to experience, and the embodiment of the present disclosure is not limited. The processing process of determining the target illumination intensity factor corresponding to the first time point based on the preset adjustment step, the difference, and the target illumination intensity factor corresponding to the third time point will be described in detail later, and will not be described here.

[0083] In the embodiment of the present disclosure, the electronic device determines the average illumination intensity factor based on the initial illumination intensity factor corresponding to the first time point and the initial illumination intensity factor corresponding to the second time point. Then, in response to the absolute value of the difference between the average illumination intensity factor and the target illumination intensity factor corresponding to the third time point being less than or equal to a preset difference threshold, the electronic device determines the target illumination intensity factor corresponding to the third time point as the target illumination intensity factor corresponding to the first time point. Subsequently, in response to the absolute value of the difference between the average illumination intensity factor and the target illumination intensity factor corresponding to the third time point being greater than the difference threshold, the electronic device determines the target illumination intensity factor corresponding to the first time point based on a preset adjustment step, the difference, and the target illumination intensity factor corresponding to the third time point. In this way, whether the initial illumination intensity factor of the first time point has a large fluctuation or not, the change amplitude of the determined target illumination intensity factor of the first time point can be controlled within a certain range, thereby improving the smoothness of the illumination intensity factor.

[0084] As shown in FIG. 6, the embodiment shown in FIG. 5 can be based on the following steps: Figure 6 As shown in FIG. 6, the embodiment shown in FIG. 5 can be based on the following steps: Figure 5 As shown in FIG. 6, the embodiment shown in FIG. 5 can be based on the following steps:

[0085] Step 601, in response to the absolute value of the difference being less than or equal to the adjustment step, the sum of the target illumination intensity factor corresponding to the third time point and the difference is determined as the target illumination intensity factor corresponding to the first time point.

[0086] For example, in response to the absolute value of the difference between the average illumination intensity factor and the target illumination intensity factor corresponding to the third time being greater than the preset difference threshold, the electronic device can further determine whether the absolute value of the difference is less than or equal to the adjustment step. In response to the absolute value of the difference being less than or equal to the adjustment step, it indicates that the change of the initial illumination intensity factor at the first time is a small-amplitude gradual change. Accordingly, the electronic device can calculate the sum of the target illumination intensity factor corresponding to the third time and the difference, and determine the calculated sum as the target illumination intensity factor corresponding to the first time. The difference can be a positive number or a negative number. For example, the preset difference threshold theh=0.02, the adjustment step step=0.04, the average illumination intensity factor a 平均 =0.39, the target illumination intensity factor a n-1 ' at the third time a n-1 '=0.36, theh≤|a 平均 -a n-1 '|≤step, the target illumination intensity factor a n ' at the third time a n '=a n-1 '+(a n-1 -average-a 平均 ')=0.39.

[0087] In step 602, in response to the absolute value of the difference being greater than the adjustment step and the difference being a negative number, the difference between the target illumination intensity factor corresponding to the third time and the adjustment step is determined as the target illumination intensity factor corresponding to the first time.

[0088] For example, in response to the absolute value of the difference being greater than the adjustment step and the difference being a negative number, it indicates that the change of the initial illumination intensity factor at the first time is a large-amplitude non-gradual change. In order to ensure the smoothness of the illumination intensity factor, the electronic device calculates the difference between the target illumination intensity factor corresponding to the third time and the adjustment step, and determines the calculated difference as the target illumination intensity factor corresponding to the first time, thereby avoiding large-amplitude fluctuations of the illumination intensity factor and improving the smoothness of the illumination intensity factor. For example, the preset difference threshold theh=0.02, the adjustment step step=0.04, the average illumination intensity factor a 平均 =0.29, the target illumination intensity factor a n-1 ' at the third time a n-1 '=0.36, |a 平均 -a n-1 '|>theh, and |a 平均 -a n-1 '|>step, a 平均 -a n-1 '=-0.07, the target illumination intensity factor a n ' at the third time a n '=an-1 -step = 0.32.

[0089] Step 603: In response to the absolute value of the difference being greater than the adjustment step size and the difference being positive, the sum of the target illumination intensity factor corresponding to the third time step and the adjustment step size is determined as the target illumination intensity factor corresponding to the first time step.

[0090] For example, if the absolute value of the difference is greater than the adjustment step size and the difference is positive, it indicates that the change in the initial illuminance factor at the first moment is a large, non-gradual change. To ensure the smoothness of the illuminance factor, the electronic device calculates the sum of the target illuminance factor at the third moment and the adjustment step size, and determines the calculated sum as the target illuminance factor at the first moment, thereby avoiding large fluctuations in the illuminance factor and improving its smoothness. For example, the preset difference threshold theh = 0.02, the adjustment step size step = 0.04, and the average illuminance factor a... 平均 =0.43, T n-1 Target illumination intensity factor a' at time n-1 =0.36, then |a 平均 -a' n-1 |>theh, and |a 平均 -a' n-1 |>step,a 平均 -a' n-1 =0.07, T n Target illumination intensity factor a' at time n =a' n-1 +step = 0.34.

[0091] In this embodiment, in response to the absolute value of the difference being less than or equal to the adjustment step size, the electronic device determines the sum of the target illumination intensity factor at the third time point and the difference as the target illumination intensity factor at the first time point. In response to the absolute value of the difference being greater than the adjustment step size and the difference being negative, the electronic device determines the difference between the target illumination intensity factor at the third time point and the adjustment step size as the target illumination intensity factor at the first time point. In response to the absolute value of the difference being greater than the adjustment step size and the difference being positive, the electronic device determines the sum of the target illumination intensity factor at the third time point and the adjustment step size as the target illumination intensity factor at the first time point. In this way, the change range of the target illumination intensity factor at the first time point determined by the electronic device is controlled within the adjustment step size, thereby avoiding large fluctuations in the illumination intensity factor and improving the smoothness of the illumination intensity factor.

[0092] like Figure 7 As shown above, in the above Figure 4 Based on the illustrated embodiment, step 402 may include the following steps:

[0093] Step 701, multiplying the first local tone mapping curve and the target light intensity factor corresponding to the first time to obtain a third local tone mapping curve.

[0094] Step 702, multiplying the second local tone mapping curve and the complement of the target light intensity factor corresponding to the first time to obtain a fourth local tone mapping curve.

[0095] Step 703, multiplying the first global tone mapping curve and the complement of the target light intensity factor corresponding to the first time to obtain a second global tone mapping curve.

[0096] Step 704, summing the third local tone mapping curve, the fourth local tone mapping curve and the second global tone mapping curve to obtain a fusion tone mapping curve corresponding to the first time.

[0097] For example, after the electronic device determines the target light intensity factor corresponding to the first time, the electronic device can multiply the first local tone mapping curve and the target light intensity factor corresponding to the first time to obtain a third local tone mapping curve. At the same time, the electronic device can also multiply the second local tone mapping curve and the complement of the target light intensity factor corresponding to the first time to obtain a fourth local tone mapping curve. And the electronic device can also multiply the first global tone mapping curve and the complement of the target light intensity factor corresponding to the first time to obtain a second global tone mapping curve. Then, the electronic device can sum the third local tone mapping curve, the fourth local tone mapping curve and the second global tone mapping curve to obtain a fusion tone mapping curve corresponding to the first time. Wherein, in the high light intensity scene, the target light intensity factor corresponding to the first time = 1, and the fusion tone mapping curve is the first local tone mapping curve. In the low light intensity scene, the target light intensity factor corresponding to the first time = 0, and the fusion tone mapping curve is the combination curve of the second local tone mapping curve and the first global tone mapping curve. In the transition scene between the high light intensity scene and the low light intensity scene, the target light intensity factor corresponding to the first time is between 0 and 1, and the fusion tone mapping curve is the weighted fusion curve of the first local tone mapping curve, the second local tone mapping curve and the first global tone mapping curve.

[0098] The processing process of the above steps 701 to 704 can be represented as the following formula (3):

[0099] F = a' * LTM_light + (1-a') * (LTM_dark + GTM_dark) Formula (3)

[0100] Wherein, F represents a fusion tone mapping curve, a' represents a target light intensity factor, LTM light represents a first local tone mapping curve, LTM dark represents a second local tone mapping curve, and GTM dark represents a first global tone mapping curve.

[0101] In the embodiments of the present disclosure, the target light intensity factor determined by the electronic device is different under different light intensities. Therefore, the electronic device performs fusion processing on the first local tone mapping curve, the second local tone mapping curve, and the first global tone mapping curve based on the target light intensity factor, and the obtained fusion tone mapping curve is also different. In this way, as the light intensity dynamically changes, the electronic device can use the dynamically changing fusion tone mapping curve to perform image processing on the original image, thereby improving the image quality.

[0102] Figure 8 FIG. 1 is a flowchart of an example of an image processing method provided by an example embodiment of the present disclosure. As shown in FIG. 1, the processing process is as follows: Figure 8

[0103] Step 801: Obtain an original image corresponding to a first time.

[0104] Step 802: Determine an ambient light intensity corresponding to the first time based on the original image.

[0105] Step 803: Determine an initial light intensity factor corresponding to the first time based on the ambient light intensity, a preset reference light intensity, and a light intensity change factor.

[0106] Step 804: Determine an average light intensity factor based on the initial light intensity factor corresponding to the first time and an initial light intensity factor corresponding to a second time. The second time is at least one time point before the first time.

[0107] Step 805: Determine whether the absolute value of the difference between the average light intensity factor and a target light intensity factor corresponding to a third time is less than or equal to a preset difference threshold value. The third time is a time point before the first time, and the target light intensity factor corresponding to the third time is obtained by smoothing the initial light intensity factor corresponding to the third time. If yes, execute step 806 and then execute step 811. If no, execute step 807.

[0108] Step 806: Determine the target light intensity factor corresponding to the third time as the target light intensity factor corresponding to the first time.

[0109] ​Step 807, judge whether the absolute value of the difference is less than or equal to the adjustment step. If yes, execute step 808 and then execute step 811. If no, and the difference is negative, execute step 809. If no, and the difference is positive, execute step 810.

[0110] Step 808, determine the sum of the target light intensity factor corresponding to the third moment and the difference as the target light intensity factor corresponding to the first moment.

[0111] Step 809, determine the difference between the target light intensity factor corresponding to the third moment and the adjustment step as the target light intensity factor corresponding to the first moment.

[0112] Step 810, determine the sum of the target light intensity factor corresponding to the third moment and the adjustment step as the target light intensity factor corresponding to the first moment.

[0113] Step 811, based on the target light intensity factor corresponding to the first moment, fuse the preset first local tone mapping curve, second local tone mapping curve and first global tone mapping curve to obtain the fusion tone mapping curve corresponding to the first moment. The first local tone mapping curve is used for image processing in a high light intensity scene, and the second local tone mapping curve and the first global tone mapping curve are used for image processing in a low light intensity scene.

[0114] Step 812, based on the fusion tone mapping curve, perform image processing on the original image.

[0115] The processing procedures of steps 801 to 812 are similar to those of the steps in the foregoing exemplary method, and will not be described here.

[0116] Exemplary device

[0117] Figure 9 is a structural schematic diagram of an image processing device provided by an exemplary embodiment of the present disclosure. The image processing device 900 comprises an original image acquisition module 910, a light intensity factor determination module 920, a fusion processing module 930 and an image processing module 940.

[0118] The original image acquisition module 910 is configured to acquire an original image corresponding to a first moment.

[0119] The light intensity factor determination module 920 is configured to determine an initial light intensity factor corresponding to the first moment based on the original image.

[0120] The fusion processing module 930 is configured to perform fusion processing on the preset first local tone mapping curve, the second local tone mapping curve and the first global tone mapping curve based on the initial illumination intensity factor corresponding to the first time, to obtain a fusion tone mapping curve corresponding to the first time, wherein the first local tone mapping curve is used for image processing in a high-illumination-intensity scene, and the second local tone mapping curve and the first global tone mapping curve are used for image processing in a low-illumination-intensity scene.

[0121] The image processing module 940 is configured to perform image processing on the original image based on the fusion tone mapping curve.

[0122] In some embodiments, the illumination intensity factor determination module 920 includes:

[0123] The ambient illumination intensity determination unit is configured to determine the ambient illumination intensity corresponding to the first time based on the original image.

[0124] The initial illumination intensity factor determination unit is configured to determine the initial illumination intensity factor corresponding to the first time based on the ambient illumination intensity, a preset reference illumination intensity and an illumination intensity change factor.

[0125] In some embodiments, the initial illumination intensity factor determination unit is specifically configured to:

[0126] Calculate a difference between the ambient illumination intensity and the reference illumination intensity.

[0127] Calculate a product of the difference and the illumination intensity change factor.

[0128] Perform normalization processing on the product to obtain the initial illumination intensity factor corresponding to the first time.

[0129] In some embodiments, the fusion processing module 930 includes:

[0130] The target illumination intensity factor determination unit is configured to perform smoothing processing on the initial illumination intensity factor corresponding to the first time to obtain a target illumination intensity factor corresponding to the first time.

[0131] The fusion processing unit is configured to perform fusion processing on the preset first local tone mapping curve, the second local tone mapping curve and the first global tone mapping curve based on the target illumination intensity factor corresponding to the first time, to obtain a fusion tone mapping curve corresponding to the first time.

[0132] In some embodiments, the target illumination intensity factor determination unit is specifically configured to:

[0133] determine an average illumination intensity factor based on the initial illumination intensity factor corresponding to the first time and the initial illumination intensity factor corresponding to the second time, wherein the second time is at least one time point before the first time;

[0134] determine the target illumination intensity factor corresponding to the third time as the target illumination intensity factor corresponding to the first time in response to an absolute value of a difference between the average illumination intensity factor and the target illumination intensity factor corresponding to the third time being less than or equal to a preset difference threshold value, wherein the third time is a time point before the first time, and the target illumination intensity factor corresponding to the third time is obtained by smoothing the initial illumination intensity factor corresponding to the third time;

[0135] determine the target illumination intensity factor corresponding to the first time based on a preset adjustment step, the difference, and the target illumination intensity factor corresponding to the third time in response to the absolute value of the difference between the average illumination intensity factor and the target illumination intensity factor corresponding to the third time being greater than the difference threshold value.

[0136] In some embodiments, the target illumination intensity factor determination unit is specifically configured to:

[0137] determine the target illumination intensity factor corresponding to the first time as a sum of the target illumination intensity factor corresponding to the third time and the difference in response to the absolute value of the difference being less than or equal to the adjustment step;

[0138] determine the target illumination intensity factor corresponding to the first time as a difference between the target illumination intensity factor corresponding to the third time and the adjustment step in response to the absolute value of the difference being greater than the adjustment step and the difference being a negative number;

[0139] determine the target illumination intensity factor corresponding to the first time as a sum of the target illumination intensity factor corresponding to the third time and the adjustment step in response to the absolute value of the difference being greater than the adjustment step and the difference being a positive number.

[0140] In some embodiments, the fusion processing unit is specifically configured to:

[0141] multiply the first local tone mapping curve and the target illumination intensity factor corresponding to the first time to obtain a third local tone mapping curve;

[0142] multiply the second local tone mapping curve and a complement of the target illumination intensity factor corresponding to the first time to obtain a fourth local tone mapping curve;

[0143] The first global tone mapping curve is multiplied by a complement of the target light intensity factor corresponding to the first time point, to obtain a second global tone mapping curve.

[0144] The third local tone mapping curve, the fourth local tone mapping curve and the second global tone mapping curve are summed, to obtain a fusion tone mapping curve corresponding to the first time point.

[0145] The beneficial technical effects corresponding to the exemplary embodiments of the device can be referred to the corresponding beneficial technical effects of the exemplary method described above, which will not be repeated here.

[0146] An exemplary electronic device

[0147] Figure 10 The structural diagram of an electronic device provided by the embodiments of the present disclosure includes at least one processor 11 and a memory 12.

[0148] The processor 11 can be a central processing unit (CPU) or other forms of processing units having data processing and / or instruction execution capabilities, and can control other components in the electronic device 10 to perform desired functions.

[0149] The memory 12 can include one or more computer program products, which can include various forms of computer readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may, for example, include random access memory (RAM), cache memory, and the like. The non-volatile memory may, for example, include read-only memory (ROM), hard disk, flash memory, and the like. One or more computer program instructions can be stored on the computer readable storage medium, and the processor 11 can run the one or more computer program instructions to implement the image processing method of various embodiments of the present disclosure and / or other desired functions.

[0150] In one example, the electronic device 10 can further include an input device 13 and an output device 14, which are interconnected through a bus system and / or other forms of connection mechanism (not shown).

[0151] The input device 13 can further include, for example, a keyboard, a mouse, and the like.

[0152] The output device 14 can output various information to the outside, which can include, for example, a display, a speaker, a printer, a communication network and a remote output device connected thereto, and the like.

[0153] Of course, in order to simplify, Figure 10Only some of the components of the electronic device 10 related to the present disclosure are shown, and components such as a bus, an input / output interface, and the like are omitted. In addition to this, the electronic device 10 can include any other appropriate components according to the specific application.

[0154] Exemplary computer program product and computer readable storage medium

[0155] In addition to the methods and devices described above, embodiments of the present disclosure can also provide a computer program product including computer program instructions, which, when executed by a processor, cause the processor to perform the steps of the image processing method of various embodiments of the present disclosure described in the "Exemplary Methods" section above.

[0156] The computer program product can be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C++, etc., and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device or entirely on the remote computing device or server.

[0157] In addition, embodiments of the present disclosure can also be a computer readable storage medium having stored thereon computer program instructions, which, when executed by a processor, cause the processor to perform the steps of the image processing method of various embodiments of the present disclosure described in the "Exemplary Methods" section above.

[0158] The computer readable storage medium can be any combination of one or more computer readable media. The computer readable medium can be a computer readable signal medium, or a computer readable storage medium. A computer readable storage medium, for example but not limited to, includes an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or apparatus, or any suitable combination of the above. More specific examples (a non-exhaustive list) of the computer readable storage medium include an electrical connection having one or more wires, a portable disc, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0159] The basic principles of the present disclosure are described above with reference to specific embodiments, but the advantages, benefits, effects, and the like mentioned in the present disclosure are only examples and are not considered to be essential to each embodiment of the present disclosure. In addition, the specific details of the above disclosure are only for the purpose of illustration and understanding, and are not considered to limit the present disclosure to the above specific details. It is understood that the present disclosure can be implemented without the above specific details.

[0160] Various modifications and changes can be made to the present disclosure by those skilled in the art without departing from the spirit and scope of the present disclosure. Thus, it is intended that the present disclosure include all such modifications and changes as fall within the scope of the claims of the present disclosure and their equivalents.

Claims

1. An image processing method comprising: obtaining an original image corresponding to a first time point; determining an initial illumination intensity factor corresponding to the first time point based on the original image; fusing a first local tone mapping curve, a second local tone mapping curve and a first global tone mapping curve pre-set based on the initial illumination intensity factor corresponding to the first time point to obtain a fused tone mapping curve corresponding to the first time point, wherein the first local tone mapping curve is used for image processing in a high-illumination-intensity scene, and the second local tone mapping curve and the first global tone mapping curve are used for image processing in a low-illumination-intensity scene; performing image processing on the original image based on the fused tone mapping curve.

2. The method of claim 1, wherein, The determining of the initial illumination intensity factor corresponding to the first time point based on the original image comprises: determining an ambient illumination intensity corresponding to the first time point based on the original image; determining the initial illumination intensity factor corresponding to the first time point based on the ambient illumination intensity, a pre-set reference illumination intensity and an illumination intensity variation factor.

3. The method of claim 2, wherein, The determining of the initial illumination intensity factor corresponding to the first time point based on the ambient illumination intensity, the pre-set reference illumination intensity and the illumination intensity variation factor comprises: calculating a difference between the ambient illumination intensity and the reference illumination intensity; calculating a product of the difference and the illumination intensity variation factor; performing normalization processing on the product to obtain the initial illumination intensity factor corresponding to the first time point.

4. The method of claim 1, wherein, The fusing of the first local tone mapping curve, the second local tone mapping curve and the first global tone mapping curve pre-set based on the initial illumination intensity factor corresponding to the first time point to obtain the fused tone mapping curve corresponding to the first time point comprises: performing smoothing processing on the initial illumination intensity factor corresponding to the first time point to obtain a target illumination intensity factor corresponding to the first time point; fusing the first local tone mapping curve, the second local tone mapping curve and the first global tone mapping curve pre-set based on the target illumination intensity factor corresponding to the first time point to obtain the fused tone mapping curve corresponding to the first time point.

5. The method of claim 4, wherein, The performing of the smoothing processing on the initial illumination intensity factor corresponding to the first time point to obtain the target illumination intensity factor corresponding to the first time point comprises: determining an average illumination intensity factor based on the initial illumination intensity factor corresponding to the first time point and an initial illumination intensity factor corresponding to a second time point, wherein the second time point is at least one time point preceding the first time point; in response to an absolute value of a difference between the average illumination intensity factor and a target illumination intensity factor corresponding to a third time point being less than or equal to a pre-set difference threshold value, determining the target illumination intensity factor corresponding to the third time point as the target illumination intensity factor corresponding to the first time point, wherein the third time point is a time point preceding the first time point, and the target illumination intensity factor corresponding to the third time point is obtained by performing smoothing processing on an initial illumination intensity factor corresponding to the third time point. In response to an absolute value of a difference between the average illumination intensity factor and the target illumination intensity factor corresponding to the third time being greater than the difference threshold, a target illumination intensity factor corresponding to the first time is determined based on a preset adjustment step, the difference, and the target illumination intensity factor corresponding to the third time.

6. The method of claim 5, wherein, The determination of the target illumination intensity factor corresponding to the first time based on the preset adjustment step, the difference, and the target illumination intensity factor corresponding to the third time includes: In response to the absolute value of the difference being less than or equal to the adjustment step, a sum of the target illumination intensity factor corresponding to the third time and the difference is determined as the target illumination intensity factor corresponding to the first time; In response to the absolute value of the difference being greater than the adjustment step and the difference being negative, a difference between the target illumination intensity factor corresponding to the third time and the adjustment step is determined as the target illumination intensity factor corresponding to the first time; In response to the absolute value of the difference being greater than the adjustment step and the difference being positive, a sum of the target illumination intensity factor corresponding to the third time and the adjustment step is determined as the target illumination intensity factor corresponding to the first time.

7. The method of claim 4, wherein, The fusion processing of the first local tone mapping curve, the second local tone mapping curve, and the first global tone mapping curve based on the target illumination intensity factor corresponding to the first time to obtain the fusion tone mapping curve corresponding to the first time includes: multiplying the first local tone mapping curve by the target illumination intensity factor corresponding to the first time to obtain a third local tone mapping curve; multiplying the second local tone mapping curve by a complement of the target illumination intensity factor corresponding to the first time to obtain a fourth local tone mapping curve; multiplying the first global tone mapping curve by the complement of the target illumination intensity factor corresponding to the first time to obtain a second global tone mapping curve; performing summation operation on the third local tone mapping curve, the fourth local tone mapping curve, and the second global tone mapping curve to obtain the fusion tone mapping curve corresponding to the first time.

8. An image processing apparatus, comprising: an original image acquisition module configured to acquire an original image corresponding to a first time; an illumination intensity factor determination module configured to determine an initial illumination intensity factor corresponding to the first time based on the original image; a fusion processing module configured to perform fusion processing on a first local tone mapping curve, a second local tone mapping curve, and a first global tone mapping curve based on the initial illumination intensity factor corresponding to the first time to obtain a fusion tone mapping curve corresponding to the first time, wherein the first local tone mapping curve is used for image processing in a high-illumination-intensity scene, and the second local tone mapping curve and the first global tone mapping curve are used for image processing in a low-illumination-intensity scene; an image processing module configured to perform image processing on the original image based on the fusion tone mapping curve.

9. A computer readable storage medium, the storage medium having stored thereon a computer program, the computer program being executable by a processor for performing the image processing method of any one of claims 1-7.

10. An electronic device, the electronic device comprising: a processor; a memory for storing instructions executable by the processor; the processor, for reading the executable instructions from the memory and executing the instructions to implement the image processing method of any one of claims 1-7.

Images