Image processing method and image processing device thereof

Abstract

The invention discloses an image processing method. The method comprises the following steps: acquiring ambient light; adjusting a plurality of pre-stored standard mapping curves according to the acquired ambient light data to obtain a plurality of adjusted mapping curves; an image to be displayed is acquired, and for any target pixel in the image to be displayed, two target mapping curves are determined from the adjusted multiple mapping curves according to the Y component of the pixel area where the target pixel is located; interpolation processing is carried out on the pixel features of the target pixels and / or the pixel features of the pixel areas where the target pixels are located through the two target mapping curves, and the adjusted pixel features of the target pixels are obtained; and displaying the adjusted target pixel. According to the method and the device, a plurality of pre-stored mapping curves are creatively provided, the real-time ambient light data are acquired, the mapping curves are adjusted according to the real-time ambient light data, and the Y component of the image to be displayed is adjusted by using the adjusted mapping curves, so that the readability of the adjusted image under the current light is enhanced.

Description

Technical Field

[0001] The present invention relates to the field of image processing Background Art

[0002] With the widespread popularity of portable devices such as smart phones, tablets, and laptops, display devices have also been widely used. Image displays are everywhere in people's daily lives. In modern life, more and more LCD screens are used outdoors. The outdoor environment is generally under strong light. The light is relatively strong, and the display screen cannot see the picture clearly. This is because the outdoor light forms a reflection on the surface of the screen. If the brightness of the display is lower than the brightness of the reflected light, the reflected light will cover the color of the screen light, resulting in us not being able to see the picture clearly and reducing the readability of the screen. Summary of the invention

[0003] In view of the above problems, the present invention increases the readability of information displayed under strong light by changing image data.

[0004] The present invention provides an image processing method, comprising: acquiring ambient light; adjusting a plurality of pre-stored standard mapping curves according to the acquired ambient light data to obtain a plurality of adjusted mapping curves; acquiring an image to be displayed, and for any target pixel in the image to be displayed, determining two target mapping curves from the plurality of adjusted mapping curves according to the Y component of a pixel region where the target pixel is located; interpolating pixel features of the target pixel and / or pixel features of the pixel region where the target pixel is located through the two target mapping curves to obtain adjusted pixel features of the target pixel; and displaying the adjusted target pixel.

[0005] In some embodiments, the adjusted plurality of mapping curves include at least a plurality of curves capable of upwardly adjusting the target pixel value and a plurality of curves capable of downwardly adjusting the target pixel value.

[0006] In some embodiments, before determining two target mapping curves from the adjusted multiple mapping curves according to the Y component of the pixel area where the target pixel is located, the method further includes: converting the image to be displayed from the RGB color domain to the YUV domain.

[0007] In some embodiments, adjusting the pre-stored multiple standard mapping curves according to the acquired ambient light data to obtain the adjusted multiple mapping curves includes: obtaining a normalized proportionality coefficient from the acquired ambient light data; applying the proportionality coefficient to the multiple standard mapping curves to obtain the adjusted multiple mapping curves, wherein the multiple standard mapping curves are:

[0008] S1=(S1-X)*Ratio+X

[0009] S2=(S2-X)*Ratio+X

[0010] S3=(S3-X)*Ratio+X

[0011] …

[0012] Sn=(Sn-X)*Ratio+X

[0013] Where X is the discrete grayscale point of the pixel.

[0014] In some embodiments, the acquiring of the image to be displayed, for any target pixel in the image to be displayed, determines two target mapping curves from the adjusted multiple mapping curves according to the Y component of the pixel area where the target pixel is located, including: determining two target mapping curves from the adjusted multiple mapping curves according to the mean value meanY of the Y component of the pixel area where the target pixel is located.

[0015] In some embodiments, two target mapping curves are determined from the adjusted multiple mapping curves based on the mean value meanY of the Y component of the pixel area where the target pixel is located, including: the first mapping curve of the two target mapping curves is determined by the value obtained by taking the ratio of the mean value meanY of the Y component and a preset value downward; the second curve of the two target mapping curves is the next curve adjacent to the first mapping curve.

[0016] In some embodiments, the pixel features of the target pixel and / or the pixel features of the pixel area where the target pixel is located are interpolated through the two target mapping curves to obtain an adjusted target pixel, including: linearly interpolating the Y component of the current pixel with the two target mapping curves respectively to obtain a first interpolation result; and performing a second interpolation of the first interpolation result with the Y component of the current pixel to obtain an adjusted Y component of the target pixel.

[0017] In a second aspect, the present application also provides an image processing device, comprising: an ambient light sensor, a transmission module and a processor, wherein the ambient light sensor is used to collect ambient light data, the transmission module is used to transmit the ambient light data to the processor, and the processor is used to adaptively generate a mapping curve based on the ambient light data. When image data needs to be displayed, the processor obtains modified image data based on the mapping curve and displays the modified image data, wherein different ambient light data corresponds to different mapping curves, and the adjustment range of the image data to be displayed is different.

[0018] In some embodiments, the processor adaptively generates a mapping curve based on ambient light data, including: adjusting multiple pre-stored standard mapping curves based on the acquired ambient light data to obtain multiple adjusted mapping curves, and acquiring an image to be displayed, and for any target pixel in the image to be displayed, determining two target mapping curves from the multiple adjusted mapping curves based on the Y component of the pixel area where the target pixel is located.

[0019] In some embodiments, the processor obtains modified image data according to the mapping curve, including: interpolating the pixel characteristics of the target pixel and / or the pixel characteristics of the pixel area where the target pixel is located through the two target mapping curves to obtain adjusted pixel characteristics of the target pixel.

[0020] The technical solution of the embodiment of the present invention ingeniously proposes pre-storing multiple mapping curves, obtaining real-time ambient light data, and adjusting the mapping curves according to the real-time ambient light data, and adjusting the Y component of the image to be displayed using the adjusted mapping curves so that the adjusted image can be viewed under the current light.

[0021] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present invention. Moreover, the same reference numerals are used throughout the drawings to represent the same components. In the drawings:

[0023] Figure 1 is a schematic diagram of the structure of an image processing device in some embodiments;

[0024] Figure 2 is a flowchart of an image processing method in some embodiments;

[0025] Figure 3 is a schematic diagram of a mapping curve in some embodiments;

[0026] Figure 4 A schematic diagram of the first interpolation in some embodiments;

[0027] Figure 5 Schematic diagram of the second interpolation in some embodiments. DETAILED DESCRIPTION

[0028] The following embodiments of the technical solution of the present invention are described in detail in conjunction with the accompanying drawings. The following embodiments are only used to more clearly illustrate the technical solution of the present invention, and are therefore only used as examples, and cannot be used to limit the protection scope of the present invention.

[0029] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by technicians in the technical field to which the present invention belongs; the terms used herein are only for the purpose of describing specific embodiments and are not intended to limit the present invention; the terms "including" and "having" in the specification and claims of the present invention and the above-mentioned drawings and any variations thereof are intended to cover non-exclusive inclusions.

[0030] In the description of the embodiments of the present invention, the technical terms "first", "second", etc. are only used to distinguish different objects, and cannot be understood as indicating or implying relative importance or implicitly indicating the number, specific order or primary and secondary relationship of the indicated technical features. In the description of the embodiments of the present invention, the meaning of "multiple" is more than two, unless otherwise clearly and specifically defined.

[0031] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present invention. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive of other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments. In the description of the embodiments of the present invention, the term "multiple" refers to more than two (including two)

[0032] The present invention provides an image processing device, comprising: an ambient light sensor 16, a first transmission module 15 and a processor Driver IC, such as Figure 1 As shown. The processor Driver IC includes: a register storage module 13, a second transmission module 14, an algorithm module 12 and a driving module 11, and the processor Driver IC is also connected to the display module 10. The present application collects the ambient light intensity through the ambient light sensor 16, and writes the ambient light intensity into the corresponding register storage module 13. The processor Driver IC reads the ambient light intensity in the register storage module 13. The algorithm module 12 pre-stores a plurality of standard mapping curves, and the algorithm module 12 adaptively generates a mapping curve according to the ambient light intensity. The processor Driver IC calculates the image data that currently needs to be displayed on the display module 12, such as an LCD screen, according to the mapping curve to obtain the modified image data, and displays the modified data on the LCD display screen. The modified data can enhance the readability of the image in sunlight.

[0033] The present invention also provides an image processing method, such as Figure 2 As shown, the following steps are included:

[0034] Step 100: Acquire ambient light.

[0035] The light sensor collects ambient light, especially the intensity of ambient light. In some embodiments, the light intensity is written into a register. The processor reads the light intensity data in the register.

[0036] Step 200: adjusting a plurality of pre-stored standard mapping curves according to the acquired ambient light data to obtain a plurality of adjusted mapping curves.

[0037] In some embodiments, multiple pre-stored standard mapping curves are adjusted according to the acquired ambient light data to obtain multiple adjusted mapping curves, including: obtaining a normalized proportionality coefficient from the acquired ambient light data; and applying the proportionality coefficient to the multiple standard mapping curves to obtain multiple adjusted mapping curves.

[0038] A plurality of standard mapping curves are pre-stored in the processor, each of which has a proportional coefficient. The ambient light data is mapped to the proportional coefficient, and the proportional coefficient is applied to the pre-stored standard mapping curve to obtain a plurality of adjusted mapping curves.

[0039] In some embodiments, Figure 3 As shown, the adjusted multiple mapping curves include at least multiple curves capable of adjusting the target pixel value upward and multiple curves capable of adjusting the target pixel value downward.

[0040] By determining a mapping curve that matches the ambient light data and using the matching mapping curve to adjust the pixels of the image to be displayed, the adjusted pixels can be made compatible with the current ambient light data so that the user can clearly see the displayed image or data under the current ambient light.

[0041] Specifically, in order to cope with different ambient light intensities, the LookupTable corresponding to the above-mentioned multiple standard mapping curves is transformed according to the following ratio, where the ratio coefficient is normalized according to the ambient light sensor value of the host computer, and the converted curve is used for subsequent processes. The conversion method is shown in the following calculation formula (1):

[0042]

[0043] Where X is the discrete grayscale point of the pixel.

[0044] Step 300: Acquire an image to be displayed, and for any target pixel in the image to be displayed, determine two target mapping curves from the adjusted multiple mapping curves according to the Y component of the pixel area where the target pixel is located.

[0045] In some embodiments, before determining two target mapping curves from the adjusted multiple mapping curves according to the Y component of the pixel area where the target pixel is located, the method further includes: converting the image to be displayed from the RGB color domain to the YUV domain.

[0046] In some embodiments, two target mapping curves are determined from the adjusted multiple mapping curves based on the mean value meanY of the Y component of the pixel area where the target pixel is located, including: the first mapping curve of the two target mapping curves is determined by the value obtained by taking the ratio of the mean value meanY of the Y component and a preset value downward; the second curve of the two target mapping curves is the next curve adjacent to the first mapping curve.

[0047] Specifically, the image data sent from the host is sent row by row, and the processor Driver IC only needs part of the data in the current row of the memory. The RGB color domain is transformed into the YUV domain, and the average value meanY of the Y component of the pixel area where the current pixel is located is calculated according to the order of the image pixels, and the corresponding Lookup Table is found according to the size of the average value meanY. The calculation formula (2) is as follows:

[0048]

[0049] IndS in the formula is the first curve and IndE is the second curve.

[0050] In some embodiments, the pixel area where the target pixel is located is a 1X9 area where the target pixel is located.

[0051] In this embodiment, two target mapping curves adapted to the target pixel to be displayed are selected from multiple adjusted mapping curves by taking the average value meanY of the Y component of the area where the target pixel to be displayed is located. The two target mapping curves are curves adapted to the current ambient light intensity and are also curves adapted to the current pixel. The current pixel is processed by these two target mapping curves to further improve the readability of the displayed image or data in sunlight.

[0052] Step 400: interpolating the pixel characteristics of the target pixel and / or the pixel characteristics of the pixel area where the target pixel is located through the two target mapping curves to obtain adjusted pixel characteristics of the target pixel.

[0053] In some embodiments, the pixel features of the target pixel and / or the pixel features of the pixel area where the target pixel is located are interpolated through the two target mapping curves to obtain an adjusted target pixel, including: linearly interpolating the Y component of the current pixel with the two target mapping curves respectively to obtain a first interpolation result; and performing a second interpolation of the first interpolation result with the Y component of the current pixel to obtain an adjusted Y component of the target pixel.

[0054] Specifically, refer to Figure 4 , the calculation formula for the first interpolation is as follows:

[0055] Y=(Y i+1 *(XX i )+Y i *(X i+1 -X)) / (X i+1 -X i ) (3)

[0056] Among them, the value of X is between [X i , X i+1 ], X i , X i+1 The corresponding values ​​on the curve are Y i , Y i+1 , Y is the interpolation result, the interpolation result of the Y component of the current pixel and the first curve is named YS, and the interpolation result of the Y component of the current pixel and the first curve is named YE.

[0057] refer to Figure 5 , the calculation formula for the second interpolation is as follows:

[0058] Y=(YS*(ME-MY)+YE*(MY-MS)) / (ME-MS) (4)

[0059] In the above formula, the interpolation result Y is the Y component of the adjusted target pixel, MY is the value of the Y component of the current pixel, MS and ME are the values ​​corresponding to the two curves, that is, the value corresponding to IndS is The value corresponding to IndE is

[0060] Step 500: Display the adjusted target pixel.

[0061] Specifically, the modified Y component and U, V components are inversely transformed from the YUV domain to the RGB domain to obtain the modified R, G, B values ​​of the current pixel. The driving module 11 drives the LCD screen to light up with the modified pixel value.

[0062] The technical solution of the embodiment of the present invention ingeniously proposes pre-storing multiple mapping curves, obtaining real-time ambient light data, and adjusting the mapping curves according to the real-time ambient light data, and adjusting the Y component of the image to be displayed using the adjusted mapping curves so that the adjusted image can be viewed under the current light.

[0063] The present invention uses simple linear interpolation for calculation, has no complex operations, does not require the storage of a large amount of image data, and occupies relatively few resources. The present invention uses an adaptive method for ambient light, takes into account the overall contrast, uses multiple mapping curves in the calculation, and takes into account the local contrast. The mapping curve of the present invention is stored in a register and can be updated according to actual conditions, thereby ensuring the flexibility of application.

[0064] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit them; although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein by equivalents; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present invention, and they should all be included in the scope of the claims and specification of the present invention. In particular, as long as there is no structural conflict, the various technical features mentioned in each embodiment can be combined in any way. The present invention is not limited to the specific embodiments disclosed herein, but includes all technical solutions that fall within the scope of the claims.

Claims

1. An image processing method, characterized in that: include: Get ambient light; Adjusting the pre-stored multiple standard mapping curves according to the acquired ambient light data to obtain the adjusted multiple mapping curves; Acquire an image to be displayed, and for any target pixel in the image to be displayed, determine two target mapping curves from the adjusted multiple mapping curves according to a Y component of a pixel area where the target pixel is located; Interpolating the pixel characteristics of the target pixel and / or the pixel characteristics of the pixel area where the target pixel is located through the two target mapping curves to obtain adjusted pixel characteristics of the target pixel; Displays the adjusted target pixels.

2. The image processing method according to claim 1, characterized in that: The adjusted mapping curves include at least a plurality of curves capable of upwardly adjusting the target pixel value and a plurality of curves capable of downwardly adjusting the target pixel value.

3. The image processing method according to claim 1, characterized in that: Before determining two target mapping curves from the adjusted multiple mapping curves according to the Y component of the pixel area where the target pixel is located, the method further includes: converting the image to be displayed from the RGB color domain to the YUV domain.

4. The image processing method according to claim 3, characterized in that: The pre-stored multiple standard mapping curves are adjusted according to the acquired ambient light data to obtain multiple adjusted mapping curves, including: Obtain a normalized proportionality coefficient from the acquired ambient light data; The proportional coefficient is applied to the plurality of standard mapping curves to obtain a plurality of adjusted mapping curves, wherein the plurality of standard mapping curves are: S1=(S1-X)*Ratio+X S2=(S2-X)*Ratio+X S3=(S3-X)*Ratio+X …… Sn=(Sn-X)*Ratio+X Where X is the discrete grayscale point of the pixel.

5. The image processing method according to claim 4, characterized in that: The acquiring of the image to be displayed, for any target pixel in the image to be displayed, determining two target mapping curves from the adjusted multiple mapping curves according to the Y component of the pixel area where the target pixel is located, includes: Two target mapping curves are determined from the adjusted multiple mapping curves according to a mean value meanY of the Y component of the pixel area where the target pixel is located.

6. The image processing method according to claim 5, characterized in that: Determining two target mapping curves from the adjusted multiple mapping curves according to the mean value meanY of the Y component of the pixel area where the target pixel is located, including: The first mapping curve of the two target mapping curves is determined by taking a value obtained by dividing the mean value meanY of the Y component by a ratio of a preset value downward; The second curve of the two target mapping curves is an adjacent next curve of the first mapping curve.

7. The image processing method according to claim 6, characterized in that: The pixel characteristics of the target pixel and / or the pixel characteristics of the pixel area where the target pixel is located are interpolated by the two target mapping curves to obtain an adjusted target pixel, including: Linearly interpolate the Y component of the current pixel with the two target mapping curves to obtain the first interpolation result; The first interpolation result and the Y component of the current pixel are interpolated twice to obtain the adjusted Y component of the target pixel.

8. An image processing device, characterized in that: include: An ambient light sensor, a transmission module and a processor, wherein the ambient light sensor is used to collect ambient light data, the transmission module is used to transmit the ambient light data to the processor, and the processor is used to adaptively generate a mapping curve based on the ambient light data. When image data needs to be displayed, the processor obtains modified image data based on the mapping curve and displays the modified image data, wherein different ambient light data corresponds to different mapping curves, and the adjustment range of the image data to be displayed is different.

9. The image processing device according to claim 8, characterized in that: The processor adaptively generates a mapping curve according to the ambient light data, including: adjusting a plurality of pre-stored standard mapping curves according to the acquired ambient light data to obtain a plurality of adjusted mapping curves, and acquiring an image to be displayed, and for any target pixel in the image to be displayed, determining two target mapping curves from the plurality of adjusted mapping curves according to the Y component of a pixel area where the target pixel is located.

10. The image processing device according to claim 9, characterized in that: The processor obtains the modified image data according to the mapping curve, including: interpolating the pixel characteristics of the target pixel and / or the pixel characteristics of the pixel area where the target pixel is located through the two target mapping curves to obtain the adjusted pixel characteristics of the target pixel.

Images