Image processing method and projection system

By using image processing methods in HDR display devices, combining the ambient light brightness and the contrast of the source image, and selecting an appropriate tone mapping algorithm, the problem of difficult to take into account the details of the bright and dark parts when HDR content is displayed on SDR/LDR devices. Achieve better visual perception and brightness distribution optimization.

CN113573032BActive Publication Date: 2024-11-08APPOTRONICS CORP LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202010348014.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-04-28
Publication Date
2024-11-08
Estimated Expiration
2040-04-28

AI Technical Summary

Technical Problem

There are few existing HDR display devices, and when displaying HDR content on SDR/LDR devices, the tone mapping algorithm is difficult to take into account the display details of the bright and dark parts of the image, especially under the influence of ambient light, the dark details are seriously lost.

Method used

Provide an image processing method, by obtaining the contrast and ambient light brightness of the dark field area of ​​the source image, calculating the brightness threshold of the target image, selecting an appropriate tone mapping algorithm, processing the source image, and forming the target image to optimize the picture brightness distribution. In addition, the ambient light detection module, image processing module and image projection module are integrated in the projection system to adjust the displayed image in real time.

Benefits of technology

The visual visual effect of projection display is improved, ensuring full display of dark details and optimizing the brightness distribution to adapt to different ambient light conditions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113573032B_ABST
    Figure CN113573032B_ABST
Patent Text Reader

Abstract

The present application discloses an image processing method, which is used to process a source image to obtain a target image, and the target image is outputted as a display image after superimposing ambient light; it includes: obtaining the contrast of the dark field area of ​​the source image; determining the contrast of the dark field area of ​​the display image according to the contrast of the dark field area of ​​the source image; obtaining the ambient light brightness in the display area; calculating the brightness threshold of the dark field area of ​​the target image according to the contrast of the dark field area of ​​the display image and the ambient light brightness; selecting a tone mapping algorithm by a table lookup method according to the brightness threshold of the dark field area of ​​the target image and the brightness threshold of the dark field area of ​​the source image; performing image processing on the source image according to the selected tone mapping algorithm. The image processing method provided by the present application can automatically optimize the image brightness distribution according to the ambient light field, thereby improving the visual perception of the projected image.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of projection technology, and in particular to an image processing method and a projection system. Background Art

[0002] High dynamic range (HDR) display images and videos have higher contrast and peak brightness, and both dark and bright areas of the image contain rich grayscale information, which can greatly improve the display effect of the picture and bring a better viewing experience to the audience.

[0003] However, there are relatively few HDR display devices at present, and they are only used in specific scenarios, such as theaters. More scenarios require HDR display content to be displayed on SDR or even LDR devices. In order to improve the display effect of HDR display content on SDR / LDR devices, the display content will be Tone Mapping. The Tone Mapping algorithm (i.e., the tone mapping algorithm, for the convenience of description, hereinafter referred to as the TM algorithm) is a mapping relationship acting on the source image, and the color space of the image is mapped accordingly, thereby mapping the source image with high dynamic contrast to the target image with low dynamic contrast.

[0004] In the prior art, only one TM algorithm is usually used for image mapping processing for the source image, which often fails to take into account the display details of the bright and dark parts of the image. Moreover, the impact of ambient light on image processing is not considered. When the ambient light is strong, the dark details of the projected image are seriously lost. When the ambient light is weak, the bright area of ​​the projected image may be dazzling when the dark details are fully displayed. Summary of the invention

[0005] This application mainly provides an image processing method, which can automatically optimize the brightness distribution of the picture according to the ambient light field to improve the visual perception of the projected picture.

[0006] To solve the above technical problems, on the one hand, the present application provides an image processing method for processing a source image to obtain a target image, wherein the target image is superimposed with ambient light and then outputs a display image; the method comprises: obtaining the contrast of a dark field area of ​​a source image; determining the contrast of a dark field area of ​​a display image according to the contrast of the dark field area of ​​the source image; obtaining the brightness of the ambient light in the display area; calculating the brightness threshold of the dark field area of ​​the target image according to the contrast of the dark field area of ​​the display image and the brightness of the ambient light; selecting a tone mapping algorithm by a table lookup method according to the brightness threshold of the dark field area of ​​the target image and the brightness threshold of the dark field area of ​​the source image; and performing image processing on the source image according to the selected tone mapping algorithm.

[0007] On the other hand, the present application provides a projection system, including an ambient light detection module, an image processing module, and an image projection module; the ambient light detection module is arranged next to the image projection module, and is used to detect the ambient light brightness in the display area; the image processing module processes the source image according to the ambient light brightness detected by the ambient light detection module and adopts the above-mentioned image processing method to form a target image; the image projection module is used to project the target image processed and output by the image processing module into the display area.

[0008] The beneficial effect of the present application is that the image processing method and projection system in the embodiments of the present application can select a suitable TM algorithm to process the image according to the ambient light brightness of the display area, thereby improving the dark field contrast of the displayed image projected to the display area after processing, optimizing the picture brightness distribution of the displayed image, and improving the visual perception effect of the projection display. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the prior art descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work, among which:

[0010] Figure 1 is a block diagram of the image processing method in this application;

[0011] Figure 2 is a flowchart of the image processing method in Embodiment 1 of the present application;

[0012] Figure 3a is a schematic diagram of the distribution of the target image and the ambient light in the third embodiment of the present application;

[0013] Figure 3b is a schematic diagram of target image brightness distribution before and after image brightness subtraction in Example 3 of the present application;

[0014] Figure 4 is the voltage-brightness curve of the desired output, system and projector display;

[0015] Figure 5 It is the voltage-brightness curve of the expected output, system and projector display under the influence of ambient light. DETAILED DESCRIPTION

[0016] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0017] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0018] Please refer to Figure 1 , which shows the relationship between the source image, target image, and display image of the present application. In order to facilitate the subsequent description of the image processing method, the relationship between the three involved in the method is first explained clearly. Specifically, the source image is processed by the TM algorithm to obtain the target image, and the target image is superimposed with the ambient light of the display area to form a display image. The display image is displayed in the display area, that is, the image viewed by the human eye is the display image.

[0019] Embodiment 1

[0020] Please refer to Figure 2 , which is a flowchart of the image processing method in Example 1 of the present application.

[0021] The image processing method comprises:

[0022] S1: Get the contrast C of the dark field area of ​​the source image 0 ;

[0023] It should be noted that in this step, the contrast of the dark field area of ​​the source image can be directly carried in the source image data information, and the step of obtaining the contrast of the dark field area of ​​the source image is to directly read the information. 0 There is a certain proportional relationship for the global contrast of the source image. When the global contrast of the source image is known, the contrast C of the dark field area of ​​the source image can be obtained according to the determined proportional relationship. 0 .

[0024] Alternatively, the contrast C of the dark field area of ​​the source image needs to be obtained by specific calculation 0 , assuming that the brightness of the dark field area of ​​the source image is distributed in the interval (I min , I t ), the dark field contrast C 0=I t / I min In one embodiment, 20% of the light source brightness is used as the brightness threshold I of the dark field area of ​​the source image. t , the minimum brightness of the dark field area I min is the minimum brightness value of the source image, or an appropriate value can be selected as the minimum brightness value I of the dark field area according to the actual situation. min .

[0025] S2: According to the contrast C of the dark field area of ​​the source image 0 Determine the contrast C of the dark field area of ​​the displayed image 2 ;

[0026] In one embodiment, the contrast C of the dark field area of ​​the displayed image 2 Equal to the contrast C of the dark field area of ​​the source image 0 , that is, to ensure that the contrast of the dark field area of ​​the source image will not be reduced after being processed by the TM algorithm and superimposed with ambient light.

[0027] In another embodiment, the contrast C of the dark field area of ​​the displayed image 2 It is equal to the contrast of the dark field area of ​​the source image after being processed by the preset TM algorithm, that is, it is ensured that the contrast of the dark field area of ​​the image processed by the preset TM algorithm will not be reduced after the ambient light is superimposed. The specific parameters of the preset TM algorithm can be determined according to actual conditions.

[0028] In another embodiment, the source image dark field area contrast C 0 After comprehensively considering the global contrast of the displayed image, the contrast C of the dark field area of ​​the displayed image is reasonably determined. 2 , that is, the contrast C of the dark field area of ​​the displayed image 2 Contrast C with the dark area of ​​the source image 0 and the global contrast of the displayed image.

[0029] In other embodiments, the contrast ratio C of the dark field area of ​​the displayed image is 2 Contrast C with the dark area of ​​the source image 0 The ratio is a preset value, which can be equal to 1, or a value less than 1 or greater than 1, and can be set according to actual needs.

[0030] In summary, in this step, the contrast C of the dark field area of ​​the displayed image is determined according to the contrast of the dark field area of ​​the source image and the preset conditions. 2 .

[0031] S3: Obtain the ambient light brightness in the display area;

[0032] The ambient light brightness in the display area includes brightness distribution information of the ambient light in the display area.

[0033] It should be noted that in this embodiment, when the brightness of the ambient light in the display area is non-uniform, the minimum brightness value of the ambient light in the display area can be selected as the ambient light brightness, or the average brightness value of the ambient light in the display area can be selected as the ambient light brightness.

[0034] In addition, since the external ambient light may change over time, the ambient light added to different frames of images may be different when the image is displayed. Therefore, the ambient light brightness can be obtained separately when each frame of the image is displayed. This approach obtains the most accurate ambient light brightness and the best image processing effect. However, because the ambient light brightness is obtained for each frame of the image, the performance requirements of the device are also high.

[0035] In another implementation, the ambient light brightness may be acquired once at intervals of a certain number of image frames, or may be acquired at a key frame of image display, which may be selected as required.

[0036] Specifically, in one implementation, the ambient light white field is photographed by a camera to obtain a digital image, and then corresponding calculations are performed based on the RGB values ​​of the digital image to obtain the ambient light brightness.

[0037] S4: According to the contrast C of the dark field area of ​​the displayed image 2 And the ambient light brightness calculates the brightness threshold I of the dark field area of ​​the target image t1 ;

[0038] Assume that the brightness threshold of the dark field area of ​​the target image is I t1 , the minimum brightness of the dark field area is I t1min , the brightness threshold of the dark field area of ​​the image is I t2 , the minimum brightness of the dark field area is I t2min According to step S2, the contrast of the dark field area of ​​the displayed image has been known to be C2 = I t2 / I t2min .

[0039] According to step S3, the ambient light brightness in the display area has been obtained, and a preset method can be used to determine that the ambient light brightness in the display area is 1. B .

[0040] Since the displayed image is formed by superimposing the target image with the ambient light, and I min1 < B , so we have:

[0041]

[0042] In this formula, C​2 and I B are all known, so the brightness threshold I of the dark field area of ​​the target image can be calculated t1 .

[0043] S5: selecting a tone mapping algorithm by a table lookup method according to the brightness threshold of the dark field area of ​​the target image and the brightness threshold of the dark field area of ​​the source image;

[0044] Since the brightness threshold I of the dark field area of ​​the target image has been calculated in step S4 t1 , and the brightness threshold of the dark field area of ​​the source image is I t It is also known that in one embodiment, 20% of the brightness of the light source is used as the brightness threshold of the dark field area of ​​the source image, so the corresponding TM algorithm can be selected by a table lookup method.

[0045] Specifically, a table corresponding to the source image, the target image dark field area brightness threshold and the TM algorithm is pre-stored, and the brightness threshold I of the target image dark field area is calculated. t1 Then, according to the brightness threshold I of the dark field area of ​​the source image t The corresponding TM algorithm can be determined according to the pre-established table.

[0046] It should be noted that selecting a TM algorithm includes selecting different TM algorithms, or selecting different parameters in a certain TM algorithm.

[0047] Different TM algorithms actually use different mapping relationships. TM algorithms include global methods and local methods. The global method uniformly maps all pixels of the image. Commonly used methods include logarithmic processing, exponential processing, statistical processing, histogram processing, etc. The local method uses different strategies to process each pixel according to the neighborhood information of the pixel point, which can more effectively process the details of different brightness areas. However, compared with the global method, the local method has more parameters and faces more calculation options. For example, based on different pixels, it is necessary to analyze the pixel neighborhood in a targeted manner. The image processing effect is improved but the calculation efficiency is sacrificed. The main local methods are spatial non-uniform transformation and photographic tone reconstruction.

[0048] S6: Perform image processing on the source image according to the selected TM algorithm.

[0049] It should be noted that, in this embodiment, the above steps S1-S5 can be applied to each image frame, that is, a corresponding TM algorithm is selected for each image frame, and then image processing is performed on each image frame according to the selected TM algorithm.

[0050] The above steps S1-S5 of this embodiment can also be applied to key frames in the image, that is, frames that have a greater effect on image display. The TM algorithm is selected only for the key frames, and then the TM algorithm is applied to other frames near the key frames, to ensure that all frames in the image can be displayed on non-HDR devices after being processed by the TM algorithm.

[0051] The inventive concept of the embodiment of the present application is: first determine the contrast of the dark field area of ​​the display image that needs to be reached, then combine the contrast of the dark field area of ​​the display image with the ambient light brightness to reversely calculate the brightness threshold of the dark field area of ​​the corresponding target image, and finally determine the TM algorithm for processing the source image into the target image through a table lookup method based on the brightness threshold of the dark field area of ​​the target image and the brightness threshold of the dark field area of ​​the source image, so that using the determined TM algorithm to process the source image under the specific ambient light can ensure that the image processed by the TM algorithm can not only be displayed on a low-contrast device, but also can ensure that there will be no significant loss of details in the dark part of the displayed image.

[0052] The ultimate goal of the image processing method provided in the embodiment of the present application is to make the contrast of the dark field area of ​​the displayed image reach a preset value, so as to avoid the problem of serious loss of dark details caused by excessive reduction in the dark field contrast of the displayed image superimposed with ambient light after the TM algorithm.

[0053] The image processing method of the embodiment of the present application can improve the contrast of the dark field area of ​​the displayed image, so that the dark details can be displayed more fully. Although some global contrast is sacrificed, the displayed image after superimposing ambient light can obtain a better image display effect.

[0054] Embodiment 2

[0055] When the ambient light is uneven, the first embodiment only simulates uniform ambient light through a reasonable method to determine the ambient light intensity. Therefore, the first embodiment has a better technical effect when applied to a scene with uniform ambient light than when applied to a scene with uneven ambient light.

[0056] In view of the problem that the first embodiment cannot be well applied to scenes with uneven ambient light, this embodiment provides an image processing method when the ambient light is unevenly distributed in the display area.

[0057] The image processing method further includes, based on the first embodiment, determining whether the ambient light is unevenly distributed in the display area. When the ambient light is unevenly distributed in the display area, the display area is partitioned according to the brightness of the ambient light, and then a corresponding TM algorithm is selected for each partition to perform image processing on the image of each partition respectively.

[0058] It should be noted that the ambient light brightness of each partition is a unique value, and the TM algorithm of the partition can be determined according to the unique value.

[0059] In addition, when the difference between the maximum value and the minimum value of the brightness of the ambient light in the display area exceeds a preset value, it is determined that the ambient light is unevenly distributed in the display area.

[0060] Since the change in ambient light brightness is not a discrete brightness distribution, when the display area is partitioned according to the ambient light brightness distribution, the display area where the ambient light brightness changes within the preset brightness range can be regarded as the partition where the ambient light brightness remains unchanged, and the TM algorithm can be selected separately to process the image. At this time, the minimum value of the ambient light brightness in the partition can be used as the ambient light brightness of the partition, the maximum value of the ambient light brightness in the partition can be used as the ambient light brightness of the partition, or the average value of the ambient light brightness in the partition can be used as the ambient light brightness of the partition. Since the entire display area has been partitioned according to the ambient light brightness distribution, when a sufficiently small preset brightness range is set, there is not much difference in selecting the minimum value, maximum value or average value of the ambient light brightness as the ambient light brightness of the partition.

[0061] In addition, the image processing method in the second embodiment can be applied to each frame in the source image, that is, when displaying each frame of the image, the display area is partitioned according to the brightness distribution of the ambient light. In order to speed up the operation rate, the image processing method in the second embodiment can also be applied to the key frames in the source image, that is, when displaying the key frames, the display area is partitioned according to the brightness distribution of the ambient light, and when displaying other frames, the ambient light brightness is simulated as a uniform distribution for image processing. Based on the same logic, one or several frames can be selected at intervals of a certain number of frames to adopt the image processing method in the second embodiment.

[0062] Compared with the first embodiment, the present embodiment identifies and partitions the brightness distribution of the ambient light, can obtain the information of the ambient light more accurately, and process the image more finely, thereby obtaining a display image with a better display effect.

[0063] Embodiment 3

[0064] This embodiment, based on the first or second embodiment, further includes determining whether the target image formed after the TM algorithm processing has a brightness lower than the ambient light brightness. Figure 3a The figure shows that the brightness of some areas in the target image is lower than the brightness of the ambient light. Figure 3b , where curve ① is Figure 3a The brightness distribution of the displayed image formed by superimposing the target image in the image with the ambient light brightness, where curve ② is Figure 3a The target image in is processed by the image processing algorithm in this embodiment to form the display image brightness distribution.

[0065] Specifically, the image processing algorithm in this embodiment includes: determining whether there is a situation in which the brightness of the target image formed after the TM algorithm processing is less than the brightness of the ambient light; if so, subtracting the brightness of the target image as a whole from the minimum brightness of the target image, such as Figure 3a As shown in , the brightness subtraction amount is the minimum brightness of the target image. After brightness subtraction, the influence of ambient light on the target image is reduced without affecting the normal display of the original image, thereby improving the contrast of the dark field area of ​​the displayed image (the image after the target image after brightness subtraction and the ambient light are superimposed) and improving the display effect of the displayed image.

[0066] Furthermore, in this embodiment, if it is determined that there is no situation where the brightness of the target image is less than the brightness of the ambient light, that is, the brightness of the target image is greater than the brightness of the ambient light, then in order to reduce the influence of the ambient light on the image display effect, the brightness of the target image can be subtracted from the brightness of the ambient light, that is, the influence of the ambient light on the image display can be eliminated. Of course, this is an ideal situation, and generally, there will not be an image where the minimum brightness of the target image is greater than the brightness of the ambient light.

[0067] It should be noted that Figure 3a The above text descriptions are all explained by taking the case where the ambient light brightness is evenly distributed as an example. Of course, the ambient light brightness distribution may also be uneven. At this time, in order to ensure that the image display is not distorted, the minimum brightness value of the ambient light in the display area can be obtained and compared with the minimum brightness value of the target image. If the minimum brightness value of the target image is less than the minimum brightness value of the ambient light, the brightness of the target image is subtracted from the minimum brightness value of the target image. If the minimum brightness value of the target image is greater than the minimum brightness value of the ambient light, the brightness of the target image is subtracted from the minimum brightness value of the ambient light. In summary, when the ambient light brightness is unevenly distributed, the brightness of the target image is subtracted from the smaller of the minimum brightness value of the ambient light and the minimum brightness value of the target image.

[0068] In this embodiment, before subtracting the minimum brightness value of the target image or the ambient light brightness, the brightness distribution of the target image is calculated based on the RGB value of the target image, and then the minimum brightness of the target image is determined based on the brightness distribution of the target image; and after subtracting the minimum brightness value of the target image or the ambient light brightness, the new RGB value of the image is calculated based on the current brightness of the target image to ensure that the target image is displayed without distortion after subtracting the corresponding brightness.

[0069] In this embodiment, a corresponding brightness subtraction process is performed on the target image according to the brightness distribution of the ambient light, so as to obtain a better image display effect.

[0070] Since the embodiments of the present application all involve the problem of brightness calculation, the following briefly describes a method for calculating image brightness based on RGB values ​​and a method for inferring RGB values ​​based on the changed brightness:

[0071] Generally, images are represented by three-channel RGB values. The color gamut standard of general display devices is sRGB. By calculating the XYZ value corresponding to the RGB image, the brightness distribution of the image, that is, the distribution of Y, can be obtained. The conversion relationship between RGB space and XYZ space is shown in (2) below. The common DCI-P3 color gamut conversion relationship is shown in formula (3). Y calculated according to the conversion relationship is the brightness information, and x and y obtained according to (4) represent the chromaticity and saturation, forming the color coordinates. For the processing of image brightness, it is only necessary to convert the color coordinates, subtract the Y component, and then output the processed RGB value through the inverse operation of the matrix in (2).

[0072]

[0073]

[0074]

[0075] The image processing methods involved in Embodiments 1 to 3 are all applicable to a projector whose processor is equipped with an intelligent chip and can perform intelligent processing on images.

[0076] Although a projector whose processor is not equipped with a smart chip cannot directly process images, the inventive concept in the above-mentioned embodiments of the present application can be used to adjust the system gamma correction curve of the projector without a smart chip, thereby achieving better image display effects.

[0077] This section is described below:

[0078] Due to its image output characteristics, the projector has a relationship curve between input voltage and output brightness. Figure 4 As shown. Since the input image undergoes analog-to-digital conversion by the camera, the distribution of brightness is linear, while the voltage-brightness output curve of a general projector is not linearly distributed, and is displayed as display curve 1 by the projector. In order to ensure that the image can output the desired image brightness distribution curve 2 through the projector, reverse gamma correction is often required. Therefore, a gamma correction curve 3 is generally provided in the projector system. The display curve 1 is corrected by the gamma correction curve 3, so as to obtain the desired image brightness distribution curve 2.

[0079] There are many solutions in the prior art for setting the gamma correction curve 3. The embodiment of the present application mainly describes how to set the gamma correction curve under the effect of ambient light.

[0080] like Figure 5 As shown, assuming that the desired output image brightness distribution is curve 2, and due to the effect of ambient light, the actual output brightness will be raised to form curve 21, so it is necessary to establish a specific optimization strategy to process the raised curve 21. There are many forms of optimization strategies, and a common method is to optimize the problem by minimizing the mean square error.

[0081] In order to achieve the output image brightness distribution of curve 2, the gamma correction curve 3 of the projector corrects the input image, but due to the effect of ambient light, the final output image brightness distribution is curve 21. Therefore, it is necessary to set a new gamma correction curve 3 according to the ambient light brightness and projector parameters, so that the gamma correction curve 3 can also correct the input image to curve 2 under the effect of ambient light.

[0082] The corresponding gamma correction curve 3 can be obtained by looking up the table according to the input image signal. Figure 5 As shown, the brightness of the image actually output under ambient light is somewhat higher than that of the display curve 2. The embodiment of the present application calculates the corresponding parameters between the actual output image curve 21 and the display curve 2, thereby making corresponding corrections to the gamma correction curve 3, thereby obtaining the desired display image curve 2.

[0083] Specifically, in this embodiment, a corresponding tone mapping algorithm is first obtained according to the ambient light information and the source image information, and then the gamma correction curve 3 is obtained according to the tone mapping algorithm. Specifically, a correspondence table between the tone mapping algorithm and the gamma correction curve is pre-established. After the tone mapping algorithm is selected by the method of the above-mentioned embodiments 1 to 3, the corresponding gamma correction curve is obtained by a table lookup method, and the input image is corrected by the gamma correction curve.

[0084] The solution in this embodiment is applied to projection scenes with ambient light. When the ambient light field is uniform or approximately uniform, image correction can be performed by obtaining a new gamma correction curve. This can be applied to projectors that cannot perform image processing in real time to obtain better image display effects.

[0085] It should be noted that the present embodiment has better technical effects under uniform ambient light fields, but under non-uniform light fields, it is necessary to first obtain a simulated uniform ambient light field brightness value through calculation, and then make corresponding corrections to the gamma correction curve 3 according to the ambient light field brightness value. Although it is not possible to obtain the same good technical effects as under uniform ambient light, it is still possible to improve the image display effect to a certain extent.

[0086] The present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the above-mentioned image processing method is implemented.

[0087] The present application also provides a projection device, including a memory and a processor; the memory is used to store a computer program; the processor is used to implement the above-mentioned image processing method when executing the computer program.

[0088] The present application also provides a projection system, comprising the above-mentioned projection device and an ambient light detection module; the projection device also includes an image projection module; the ambient light detection module is arranged next to the image projection module, and is used to detect the ambient light brightness in the display area; the processor processes the source image according to the ambient light brightness detected by the ambient light detection module and adopts the above-mentioned image processing method to form a target image; the image projection module is used to project the target image processed and output by the image processing module into the display area.

[0089] In one implementation, the ambient light detection module is a camera.

[0090] It should be noted that the ambient light detection module may be arranged on the projection device, or may be arranged at other locations, or may adopt an existing camera of a mobile terminal such as a mobile phone.

[0091] The above descriptions are merely embodiments of the present application and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. An image processing method, for processing a source image to obtain a target image, wherein the target image is superimposed with ambient light to output a display image; characterized in that: include: Obtain the contrast of the dark field area of ​​the source image; Determining the contrast of the dark field area of ​​the displayed image according to the contrast of the dark field area of ​​the source image; Get the ambient light brightness in the display area; Calculating a brightness threshold of the dark field area of ​​the target image according to the contrast of the dark field area of ​​the displayed image and the brightness of the ambient light; Selecting a tone mapping algorithm by looking up a table according to the brightness threshold of the dark field area of ​​the target image and the brightness threshold of the dark field area of ​​the source image; The source image is processed according to the selected tone mapping algorithm.

2. The image processing method according to claim 1, characterized in that: After obtaining the ambient light brightness in the display area, the method further includes: When the ambient light brightness is unevenly distributed in the display area, partitioning the display area according to the ambient light brightness; Select a corresponding tone mapping algorithm for each partition; The image of the corresponding partition is processed according to the selected tone mapping algorithm.

3. The image processing method according to claim 2, characterized in that: The partitioning of the display area according to the ambient light brightness includes: taking the display area where the ambient light brightness changes within a preset brightness range as a partition.

4. The image processing method according to claim 3, characterized in that: The partitioning of the display area according to the brightness of the ambient light includes: partitioning the display area according to the brightness of the ambient light when displaying key frames; or partitioning the display area according to the brightness of the ambient light at intervals of a preset number of frames.

5. The image processing method according to claim 1, wherein: When the distribution of the ambient light brightness is uniform, the image processing method further includes determining whether the minimum brightness of the target image is less than the ambient light brightness; if so, subtracting the minimum brightness value of the target image from the overall brightness of the target image.

6. The image processing method according to claim 5, characterized in that: If the minimum brightness of the target image is greater than the ambient light brightness, the ambient light brightness is subtracted from the target image brightness as a whole.

7. The image processing method according to claim 1, characterized in that: When the ambient light brightness distribution is uneven, the image processing method further includes subtracting the smaller of the minimum brightness value of the ambient light and the minimum brightness value of the target image from the overall brightness of the target image.

8. The image processing method according to claim 1, characterized in that: The calculating the contrast of the dark field area of ​​the source image includes: taking 20% ​​of the brightness of the light source as a brightness threshold of the dark field area of ​​the source image to calculate the contrast of the dark field area of ​​the source image.

9. The image processing method according to claim 1, characterized in that: The obtaining of the ambient light information in the display area includes photographing the ambient white field with a camera to obtain a digital image, and obtaining the ambient light information according to the RGB value of the digital image.

10. The image processing method according to any one of claims 1 to 9, characterized in that: The step of processing the source image according to the selected tone mapping algorithm comprises: For each frame or key frame of the source image, a corresponding tone mapping algorithm is selected; Perform image processing on the image frame according to the selected tone mapping algorithm.

11. The image processing method according to claim 1, wherein: The step of processing the source image according to the selected tone mapping algorithm comprises: Obtaining a gamma correction curve by a table lookup method according to the selected tone mapping algorithm; Image processing is performed on the source image according to the Gamma correction curve.

12. A computer-readable storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is executed by a processor, the image processing method according to any one of claims 1 to 11 is implemented.

13. A projection device, characterized in that: The invention comprises a memory and a processor; the memory is used to store a computer program; the processor is used to implement the image processing method according to any one of claims 1 to 11 when executing the computer program.

14. A projection system, characterized in that: It comprises an ambient light detection module and the projection device as claimed in claim 13; the projection device further comprises an image projection module; The ambient light detection module is arranged beside the image projection module, and is used to detect the brightness of the ambient light in the display area; The processor processes the source image according to the ambient light brightness detected by the ambient light detection module and adopts the image processing method according to any one of claims 1 to 11 to form a target image; The image projection module is used to project the target image processed and output by the processor into a display area.