Image display method and device for color vision defect compensation

By obtaining the abnormal spectral band of the color vision defect population and adjusting the luminous spectrum of the display device, the problem of image color distortion in the prior art is solved, and the effect of effectively perceiving and distinguishing image colors at the same time for normal color vision and color vision defect populations.

CN116153273BActive Publication Date: 2025-02-07FUDAN UNIVERSITY
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202111392984.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-11-23
Publication Date
2025-02-07
Estimated Expiration
2041-11-23

AI Technical Summary

Technical Problem

When the prior art provides color compensation for people with color vision defects, the image color distortion is caused, and the visual needs of people with color vision normal and color vision defects are not met at the same time.

Method used

By acquiring the color vision defect characteristics of the end user, obtaining its corresponding abnormal spectrum band, and presetting the luminescence spectrum of the light source so that it has the first band of the first intensity and the second band of the second intensity, with the second intensity being less than the first intensity The intensity is 50%, and the second band includes the abnormal spectral band of the end user. Based on this luminescence spectrum, terminal display data of the image to be output is obtained and image display is performed.

Benefits of technology

On the basis of ensuring the authenticity of the image color, the recognizable image color is improved, allowing end users of color vision defects to effectively perceive and distinguish image color, while ensuring normal color vision terminal users' normal perception and resolution of images, optimizing two types of people visual experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116153273B_ABST
    Figure CN116153273B_ABST
Patent Text Reader

Abstract

The present invention belongs to the technical field of color vision deficiency compensation, and specifically is an image display method and device for color vision deficiency compensation. The image display method of the present invention comprises: obtaining an abnormal spectral band corresponding to the terminal user according to the color vision deficiency characteristics of the terminal user; presetting the luminous spectrum of the light source, the luminous spectrum is configured as a first band with a first intensity and a second band with a second intensity, the second intensity is smaller than the first intensity, and the second band includes an abnormal spectral band corresponding to the terminal user; based on the luminous spectrum, obtaining the terminal display data of the image to be output for image display. On the basis of ensuring the authenticity of the image color, the present invention improves the recognizability of the image color, so that terminal users with color vision deficiency and normal color vision can effectively perceive and distinguish the image color at the same time, and can also expand the color gamut of the display system.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of color vision deficiency compensation, and in particular relates to an image display method and device for color vision deficiency compensation. Background Art

[0002] People with color vision deficiency perceive colors differently from ordinary people. They cannot perceive and distinguish various colors or some colors. People with color vision deficiency are usually divided into monochromatic, dichromatic and abnormal trichromatic. Monochromatic is also called total color blindness. People with this type of color vision deficiency can only distinguish between light and dark. Dichromatic is commonly known as color blindness, including red blindness, green blindness and blue-yellow color blindness. Abnormal trichromatic is also known as color weakness, including red blindness, green blindness and blue-yellow color weakness. Color vision deficiency is mostly acquired at birth. These people suffer from the inconvenience caused by abnormal color perception in their life, work, physical and mental health, etc.

[0003] Although it is currently impossible to fundamentally solve the problem of color vision deficiency from a scientific medical technology perspective, there are already products designed for people with color vision deficiency to assist them in distinguishing color information. For example, in the display field, most products have color weakness or color blindness modes, and different people need to switch to different modes to view the displayed image to obtain the color information of the displayed image. The color weakness or color blindness mode is mainly based on image processing technology to process the colors in the image that cannot be distinguished by people with color vision deficiency into distinguishable colors, so that people with color vision deficiency can distinguish the color information in the image. However, the image processed by this technology has color distortion compared to the original image, that is, people with color vision deficiency still cannot perceive the original color of the image, and it will also affect normal people's perception of the original color information of the image, making it impossible to achieve screen sharing between people with normal color vision and people with color vision deficiency. Summary of the invention

[0004] The purpose of the present invention is to provide an image display method and device for color vision deficiency compensation, which can enable both color vision-deficient and normal color vision terminal users to effectively perceive and distinguish image colors at the same time, thereby improving the recognizability of image colors while ensuring the authenticity of image colors.

[0005] The image display method for color vision deficiency compensation provided by the present invention comprises the following specific steps:

[0006] (1) Obtaining the abnormal spectral band corresponding to the terminal user according to the color vision deficiency characteristics of the terminal user;

[0007] (2) a light spectrum of a preset light source, wherein the light spectrum is configured as a first band having a first intensity and a second band having a second intensity, wherein the second intensity is smaller than the first intensity (at least 50%), and the second band includes an abnormal spectrum band corresponding to a terminal user;

[0008] (3) Based on the luminescence spectrum, terminal display data of the image to be output is obtained, and the image is displayed.

[0009] In step (1) of the present invention, the color vision deficiency characteristic of the terminal user refers to the color vision deficiency type of the terminal user; or, more specifically, refers to the color vision deficiency type and the degree of the color vision deficiency.

[0010] The terminal user's color vision deficiency types include two types: dichromats and abnormal trichromats. Dichromats include red-green color blindness, green-green color blindness, and blue-yellow color blindness; abnormal trichromats include red-green weakness, green-green weakness, and blue-yellow weakness.

[0011] The type and degree of the color vision deficiency of the terminal user are described by dividing the degree of the color vision deficiency into three types: mild, moderate and severe; or, described by numerical segmentation in the range of 0 to 1 (for example, divided into 3 segments).

[0012] The step (1) of obtaining the abnormal spectral band corresponding to the terminal user according to the color vision defect characteristics of the terminal user includes: obtaining the spectral sensitivity response curve of the photoreceptor cells corresponding to the terminal user according to the color vision defect characteristics of the terminal user; and obtaining the spectral band corresponding to the color perception abnormality based on the spectral sensitivity response curve of the terminal user and comparing it with the spectral sensitivity response curve of a person with normal color vision.

[0013] In step (2) of the present invention, the light source is a combination of monochromatic light sources emitting different colors; or a white light source. Wherein: the combination of monochromatic light sources includes a red light source, a green light source, and a blue light source.

[0014] In the present invention, the luminescence spectrum is realized by:

[0015] (1) When the light source is a combination of monochromatic light sources emitting different colors, the luminous spectrum is achieved by adjusting the chip of the monochromatic light source; or, by adjusting the phosphor of the monochromatic light source;

[0016] (2) When the light source is a white light source, the luminous spectrum is achieved by adjusting the chip of the white light source; or, by adjusting the phosphor of the white light source.

[0017] In step (3) of the present invention, the terminal display data is the pixel value corresponding to the image to be output.

[0018] The image display is performed by using a plurality of pixel units, wherein the pixel units include multi-color sub-pixels;

[0019] The terminal display data is the brightness feature quantity corresponding to each sub-pixel;

[0020] The multi-color sub-pixel includes: a blue sub-pixel, a green sub-pixel and a red sub-pixel; or, the multi-color sub-pixel includes: a blue sub-pixel, a green sub-pixel, a red sub-pixel and a white sub-pixel.

[0021] In the present invention, the image display may be performed by a liquid crystal display; the terminal display data is electrical signal data for changing the deflection direction of liquid crystal molecules.

[0022] In the present invention, the image display may be performed by self-luminescence; the terminal display data is electrical drive data corresponding to the self-luminescence intensity.

[0023] In step (3) of the present invention, the step of obtaining the terminal display data of the image to be output based on the luminescence spectrum also includes gamma correction.

[0024] At this time, when the terminal display data is a pixel value corresponding to the image to be output; the step of obtaining the terminal display data of the image to be output also includes:

[0025] Obtaining a mapping relationship between a gamma-corrected brightness signal and a pixel value;

[0026] According to the mapping relationship, terminal display data corresponding to the brightness signal is obtained.

[0027] Accordingly, the present invention also provides a display module based on the above method, comprising:

[0028] An abnormal spectral band acquisition unit, which acquires an abnormal spectral band corresponding to the terminal user according to the color vision defect characteristics of the terminal user;

[0029] A light source configuration unit, used for presetting a light emission spectrum of the light source, wherein the light emission spectrum is configured as a first band having a first intensity and a second band having a second intensity, wherein the second intensity is smaller than the first intensity, and the second band includes an abnormal spectrum band corresponding to a terminal user;

[0030] A terminal display data unit, which obtains terminal display data of an image to be output based on the luminescence spectrum and performs image display;

[0031] That is, these three unit modules respectively execute the contents of the three steps in the image display method.

[0032] In the present invention, the configuration and control of each unit in the display module form a software system; and are deployed in a computing system through a storage medium.

[0033] Accordingly, the present invention also provides an image display device for color vision defect compensation based on the above method, comprising: a backlight module and an image display module; wherein:

[0034] The backlight module is used to provide the light source obtained by the image display method of the present invention;

[0035] The image display module is used to provide terminal display data for image display.

[0036] The present invention also provides an electronic device, which comprises the image display device.

[0037] The electronic device may be a computer, a virtual reality display device, a mobile phone, a camera or a camcorder, etc.

[0038] In the present invention, the luminous spectrum of the designed light source includes a first band and a second band, and has a relatively large light intensity in the first band and a relatively small light intensity in the second band, that is, the light intensity of the second band is less than the light intensity of the first band. Since the second band includes an abnormal spectral band corresponding to the terminal user, when displaying an image, the abnormal spectral band corresponding to the terminal user with color vision deficiency has a smaller light stimulation intensity, so that the terminal user with color vision deficiency avoids the spectral range in which the color cannot be perceived and distinguished, and then the spectral band with a large light intensity in the luminous spectrum is located within the identifiable range of the terminal user with color vision deficiency; then, according to the luminous spectrum, the terminal display data of the image to be output is obtained, and the display device uses the luminous spectrum and the terminal display data to make the image display the real color; thus, for the terminal user with color vision deficiency, the luminous spectrum is within its identifiable range, and the image displays the real color information, that is, on the basis of ensuring the authenticity of the image color, the recognizability of the image color is improved, so that the terminal user with color vision deficiency can effectively perceive and distinguish the image color, and at the same time, the normal perception and distinction of the displayed image by the terminal user with normal color vision is also guaranteed, thereby optimizing the visual experience of the two groups of people. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 It is a flow chart of a display method according to an embodiment of the present invention.

[0040] Figure 2 It is a schematic diagram of the spectral sensitivity response curve of cone cells of a dichromat when executing step S1.

[0041] Figure 3 It is a schematic diagram of the spectral sensitivity response curve of cone cells of an abnormal trichromat when executing step S1.

[0042] Figure 4 yes Figure 1 Schematic diagram of a method for obtaining abnormal spectral bands by taking a red weak terminal user as an example in step S1.

[0043] Figure 5 is a schematic diagram of the degree of color vision deficiency when executing step S1.

[0044] Figure 6 yes Figure 1 Schematic diagram of abnormal spectral bands in step S1 taking a moderately red weak terminal user as an example.

[0045] Figure 7 is a schematic diagram of the light spectrum of the light source of the display device when executing step S2.

[0046] Figure 8 yes Figure 1 Schematic diagram of displaying image pixels in step S3.

[0047] Fig. 9 yes Figure 1 Schematic diagram of the structure of the liquid crystal display device in step S3.

[0048] Fig.10 yes Figure 1 Schematic diagram of light mixing using the three primary colors RGB in step S3.

[0049] Fig.11 is a schematic diagram of gamma correction when executing step S3.

[0050] Fig.12 It is a functional block diagram of a display module according to an embodiment of the present invention.

[0051] Fig.13 It is a schematic structural diagram of a display device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0052] As described in the background technology, the color weakness and color blindness modes in display products use image processing technology to process colors that color-deficient people cannot distinguish into colors they can distinguish. Although this technology can help color-deficient terminal users distinguish color information in images, it will cause the colors in the image to be distorted, which makes it impossible for color-deficient terminal users to perceive the original colors of the image, and it cannot guarantee the normal perception of colors by terminal users with normal color vision.

[0053] In order to solve the technical problem, an embodiment of the present invention provides a display method, including: obtaining an abnormal spectral band corresponding to the terminal user according to the color vision defect characteristics of the terminal user; presetting the light spectrum of the light source of the display device, the light spectrum is configured as a first band with a first intensity and a second band with a second intensity, the second intensity is 50% less than the first intensity, and the second band includes the abnormal spectral band corresponding to the terminal user; based on the light spectrum, obtaining terminal display data of the image to be output, and displaying the image.

[0054] It should be noted that the luminous spectrum of the light source of the display device includes a first band and a second band. The first band has a relatively large light intensity, and the second band has a relatively small light intensity, that is, the light intensity of the second band is smaller than the light intensity of the first band. The second band in the above-mentioned luminous spectrum includes the abnormal spectral band. Therefore, when displaying an image, the abnormal spectral band corresponding to the terminal user with color vision deficiency has a smaller light stimulation intensity, so that the terminal user with color vision deficiency can avoid the spectral range where the color cannot be perceived and distinguished, and thus the spectral band with a larger light intensity in the luminous spectrum is located within the recognizable range of the terminal user with color vision deficiency; then based on the luminous spectrum, the terminal display data of the image to be output is obtained, and the display device uses the luminous spectrum and the terminal display data to make the image display the real color; thus, for the terminal user with color vision deficiency, the luminous spectrum is within its recognizable range, and the image displays the real color information, that is, on the basis of ensuring the authenticity of the image color, the recognizability of the image color is improved, so that the terminal user with color vision deficiency can effectively perceive and distinguish the image color, thereby also ensuring the normal perception and distinction of the displayed image by the terminal users with normal color vision, and optimizing the visual experience of the two groups of people.

[0055] In order to make the above-mentioned purposes, features and advantages of the embodiments of the present invention more obvious and understandable, specific embodiments of the present invention are described in detail below with reference to the accompanying drawings.

[0056] refer to Figure 1 , shows a flow chart of a display method according to an embodiment of the present invention. Specifically, the method includes:

[0057] Step S1, obtaining an abnormal spectral band corresponding to the terminal user according to the color vision deficiency characteristics of the terminal user;

[0058] Step S2, presetting the light spectrum of the light source of the display device, wherein the light spectrum is configured as a first band having a first intensity and a second band having a second intensity, wherein the second intensity is 50% less than the first intensity, and the second band includes an abnormal spectrum band corresponding to the terminal user;

[0059] Step S3, based on the luminescence spectrum, obtaining terminal display data of the image to be output, and performing image display.

[0060] Execute step S1 to obtain an abnormal spectral band corresponding to the terminal user according to the color vision deficiency characteristics of the terminal user.

[0061] The color vision defect characteristics of the terminal user include the color vision defect type of the terminal user. There are three types of cone cells on the retina of a normal human eye: S-type, M-type and L-type. Their spectral sensitivity response curves are sensitive to short-wave bands (blue light), medium-wave bands (green light) and long-wave bands (red light), respectively. Unlike normal people, some or all of the cone cells of people with color vision defects are abnormal or missing. According to the physiological characteristics of cone cells, color vision defective terminal users can be divided into two-color vision and abnormal three-color vision types.

[0062] The color vision deficiency type of the terminal user is dichromatism, including red color blindness, green color blindness, and blue-yellow color blindness. Figure 2 , the color vision of dichromats (color blind) is abnormal due to the lack of one of the three types of cone cells, while the other two types of cone cells are no different from those of normal people. The spectral sensitivity response curve of the L-type cone cells on the retina of red-blind people is missing, and there are only spectral sensitivity response curves of the M and S-type cone cells; the spectral sensitivity response curve of the M-type cone cells on the retina of green-blind people is missing, and there are only spectral sensitivity response curves of the L and S-type cone cells; the spectral sensitivity response curve of the S-type cone cells on the retina of blue-yellow blind people is missing, and there are only spectral sensitivity response curves of the M and L-type cone cells. Therefore, compared with normal people, red-green color blind people cannot perceive and distinguish red and green, and blue-yellow color blind people cannot perceive and distinguish yellow and blue, thus showing defects in color vision.

[0063] The color vision deficiency type of the terminal user is an abnormal trichromatism, including red deficiency, green deficiency and blue-yellow deficiency. Figure 3 People with abnormal trichromacy (color deficiency) have all three types of cone cells, but one of them has abnormal function, which makes the spectral sensitivity response curve of cone cells in people with color deficiency different from that of ordinary people. For red deficiency, the L-type cone cells on the retina have abnormal function, and their spectral sensitivity response curve will shift to the short-wave band. For green deficiency, the spectral sensitivity response curve of M-type cone cells shifts to the long-wave band. For blue-yellow deficiency, the spectral sensitivity response curve of S-type cone cells shifts to the long-wave band. Therefore, compared with normal people, people with red-green deficiency cannot distinguish red and green well, and people with blue-yellow deficiency cannot distinguish blue and yellow well, thus showing color deficiency.

[0064] Based on the difference in the spectral sensitivity response of cone cells on the retina of people with normal color vision and those with color vision deficiency, each type of color vision deficiency has a corresponding abnormal spectral band. Within this spectral band, people with color vision deficiency do not have normal color vision ability. For example, people with color vision deficiency cannot normally perceive and distinguish the corresponding colors within this spectral band, or people with color vision deficiency have difficulty distinguishing unsaturated colors within this spectral band. Figure 4, shows the basic method of obtaining abnormal spectral bands by taking red-weak terminal users as an example: Taking red-weak terminal users as an example, according to the spectral sensitivity response curve of red-weak photoreceptor cells, the spectral sensitivity response curve of L-type cone cells is shifted to the short-wave band. Compared with the spectral sensitivity response curve of people with normal color vision, at a wavelength of 500-600 nm, the spectral sensitivity of M-type cone cells of people with normal color vision is greatly different from that of L-type cone cells, so people with normal color vision can distinguish red from green. In contrast, for red weakness, since the spectral sensitivity curves of M-type cone cells and L-type cone cells are extremely close, at a wavelength of 500-600 nm, the response levels of M-type cone cells and L-type cone cells are close. At this time, people with color vision deficiency cannot distinguish red from green well, thus showing red weakness. Therefore, red-weak terminal users cannot distinguish the colors corresponding to the spectral band of 500-600 nm well, and this spectral range is defined as an abnormal spectral band. Correspondingly, it can be obtained that the abnormal spectral band of green-weak terminal users is 500-600 nm; the abnormal spectral band of blue-yellow-weak terminal users is 400-480 nm; the abnormal spectral band of red-blind terminal users is 500-650 nm; the abnormal spectral band of green-blind terminal users is 500-650 nm; the abnormal spectral band of blue-yellow-blind terminal users is 400-500 nm. It should be noted that the abnormal spectral bands corresponding to the color vision defect types obtained here may vary from person to person, and there will be a certain deviation in the actual operation process.

[0065] In practical applications, it is easy to diagnose the type of color vision deficiency of the end user, and the corresponding abnormal spectral band can be set according to the type of color vision deficiency, so as to design a display device that the color vision-deficient end user can perceive and distinguish colors.

[0066] It should be noted that, in other embodiments, the color vision deficiency feature of the terminal user may be the color vision deficiency type of the terminal user and the degree of the color vision deficiency of the type.

[0067] People with different degrees of color vision deficiency mainly refer to people with color vision deficiency whose cone spectral sensitivity response curves have different degrees of shift. Compared with people with normal color vision, the L-type cone response curve in the red-weak spectral sensitivity response curve has moved toward the short-wave band, the M-type cone response curve in the green-weak spectral sensitivity response curve has moved toward the long-wave band, and the S-type cone response curve in the blue-yellow-weak spectral sensitivity response curve has moved toward the long-wave band. Different degrees of shift in the cone spectral sensitivity response curve correspond to different degrees of color vision deficiency. When the cone spectral sensitivity response curve has a slight shift, the color vision ability of people with color vision deficiency is close to normal. When the cone spectral sensitivity response curve has the most serious shift, the color vision ability of people with color vision deficiency is no different from that of color blindness.

[0068] The degree of color vision deficiency of the end user is obtained based on the color vision deficiency characteristics, and is described by mild, moderate, and severe text. The spectral sensitivity response curve corresponding to mild color vision deficiency moves 2 to 8 nm; the spectral sensitivity response curve corresponding to moderate color vision deficiency moves 8 to 14 nm; the spectral sensitivity response curve corresponding to severe color vision deficiency moves 14 to 20 nm, refer to Figure 5 , shows a schematic diagram of the red weak spectral sensitivity response curve for mild, moderate and severe. When the color vision defect is very serious, the color vision defective people are no different from color blindness, and when the color vision defect is very mild, the color vision defective people are close to normal color vision. Therefore, compared with normal people, people with different degrees of color vision defects have different difficulties in distinguishing colors. People with lower degrees of color vision defects can perceive colors and it is relatively easy to distinguish colors. People with more severe color vision defects cannot perceive colors well and it is relatively difficult to distinguish colors, thus showing different degrees of color weakness.

[0069] It should be noted that the degree of color vision deficiency of the terminal user is obtained based on the color vision deficiency characteristics. The degree of color vision deficiency can also be described by a numerical segment in the range of 0 to 1. The numerical values ​​in the range of 0 to 1 correspond to different degrees of deviation of the spectral sensitivity response curve of the cone cells, thereby representing different degrees of color vision deficiency.

[0070] End users with different degrees of color vision deficiency also have corresponding abnormal spectral bands. Figure 6 , shows a schematic diagram of abnormal spectral bands for moderate protanomaly terminal users as an example. The spectral sensitivity response curve of L-type cone cells is shifted to the short-wave band by 8 to 14 nm. Compared with terminal users with normal color vision, moderate protanomaly terminal users cannot distinguish the colors corresponding to the spectral band of 540 to 580 nm well, or it is difficult to distinguish unsaturated colors within the spectral band of 540 to 580 nm. Therefore, for moderate protanomaly terminal users, 540 to 580 nm is the corresponding abnormal spectral band. Correspondingly, it can be obtained that the abnormal spectral band of mild red weakness is 500-540 nm, and the abnormal spectral band of severe red weakness is 580-650 nm; similarly, it can be obtained that the abnormal spectral band of mild green weakness is 500-540 nm, the abnormal spectral band of moderate green weakness is 540-580 nm, and the abnormal spectral band of severe green weakness is 580-650 nm; the abnormal spectral band of mild blue-yellow weakness is 400-440 nm, the abnormal spectral band of moderate blue-yellow weakness is 440-470 nm, and the abnormal spectral band of severe blue-yellow weakness is 470-500 nm. It should be noted that the abnormal spectral bands corresponding to the types of color vision defects and the degree of color vision defects obtained here may vary from person to person, and there will be a certain deviation in the actual operation process.

[0071] In practical applications, the abnormal spectral band set according to the degree of color vision deficiency of the end user is more accurate than the type of color vision deficiency of the end user, so that the designed display device is more targeted, enabling end users with different degrees of color vision deficiency to perceive and distinguish color information.

[0072] Execute step S2 to preset the luminous spectrum of the light source of the display device, wherein the luminous spectrum is configured as a first band having a first intensity and a second band having a second intensity, wherein the second intensity is 50% less than the first intensity, and the second band includes an abnormal spectral band corresponding to the terminal user.

[0073] In order to enable people with color vision deficiency to avoid the spectral range where they cannot perceive and distinguish colors, the luminous spectrum of the light source is used for image display. Specifically, in the luminous spectrum, the abnormal spectral band has a smaller light stimulation intensity, and the part with a larger light intensity is located in the non-abnormal spectral band, that is, in the range that people with color vision deficiency can perceive and distinguish.

[0074] Whether it is a liquid crystal display or a self-luminous display, it is necessary to use a light source to display images. The light source can be a combination of monochromatic light sources emitting different colors, or the light source can be a white light source. In practical applications, the light source of the display device can be composed of a combination of three or more monochromatic light sources. Compared with a white light source, a monochromatic light source can take into account both rich colors and high light efficiency. For example, the monochromatic light source includes a red light source, a green light source, and a blue light source.

[0075] In order to further explain the implementation of the light emitting spectrum in the display method of the present invention, the following is understood in conjunction with a liquid crystal display device. Figure 7 , shows a schematic diagram of the light source emission spectrum when the liquid crystal display device is used to perform step S2, spectrum a is a light emitting diode (LED) with phosphor to generate white light emission spectrum, the horizontal axis is wavelength, the vertical axis is intensity. Figure 6 It can be seen that for moderately red-weak terminal users, the spectral range of 540-580 nm is the corresponding abnormal spectral band. Figure 7 It can be seen that the light stimulation intensity of spectrum a in the range of 540-580 nm is significantly greater. Therefore, spectrum a does not avoid the abnormal spectral band corresponding to color vision deficiency, and cannot improve the perception and resolution ability of color vision deficient end users on the displayed image color.

[0076] In order to make the luminous spectrum of the light source avoid the abnormal spectral band corresponding to the color vision defect, the luminous spectrum can be achieved by adjusting the chip of the monochromatic light source; or, the luminous spectrum can also be achieved by adjusting the phosphor of the monochromatic light source. Figure 7, spectrum b shows a luminous spectrum of an embodiment of the present invention. Spectrum b is different from spectrum a. By reducing the light intensity in the abnormal spectral band in the luminous spectrum, the abnormal spectral band corresponding to the color vision defective population is avoided. Specifically, the luminous spectrum of the embodiment of the present invention uses RGB monochromatic LED as a light source, and by configuring the chips used for R and G, or by adjusting the phosphor, the light source spectra of red light and green light are respectively kept away from the abnormal spectral band. Specifically, taking a moderate red weak terminal user as an example, the R chip or phosphor is a narrow-band light source with a peak wavelength greater than 600 nm, the G chip or phosphor is a narrow-band light source with a peak wavelength less than 520 nm, and the B chip or phosphor is a narrow-band light source with a peak wavelength of 440 to 490 nm. The luminous spectrum of the display device light source composed of RGBLED has a relatively small light intensity in the range of 540 to 580 nm, avoiding the abnormal spectral band corresponding to the color vision defective users. In this way, there is no spectral band in the luminous spectrum that the color vision defective population cannot recognize the color, so that the luminous spectrum is within the range that the color vision defective population can recognize.

[0077] It should be noted that the luminous spectrum b of the light source of the display device in the embodiment of the present invention is narrower than the luminous spectrum a of the light source of the liquid crystal display device, wherein the luminous spectrum of the R and G chips or phosphors is narrowed. In this way, when the display device displays images through the luminous spectrum b of the embodiment of the present invention, the color gamut range can be expanded and the richness of colors can be improved.

[0078] In other embodiments, the luminous spectrum can also be achieved by adjusting the chip of the white light source; or, the luminous spectrum can also be achieved by adjusting the phosphor of the white light source. For example, when a white light LED is used as a light source for image display, according to the color vision defect characteristics of the end user, the luminous spectrum can be achieved by adjusting the phosphor or chip of the white light LED light source to avoid the abnormal spectral band corresponding to the color vision defect end user.

[0079] Step S3, based on the luminescence spectrum, obtaining terminal display data of the image to be output, and performing image display.

[0080] In a display device, image display is achieved through multiple pixels arranged in an array, such as Figure 8 As shown, each pixel p includes multi-color sub-pixels: red sub-pixel R, green sub-pixel G and blue sub-pixel B. When displaying an image, each sub-pixel has a specific position and is assigned a corresponding pixel value. Different pixel values ​​represent the mixing ratio of the corresponding color, so that a color block of a specific color is output at a specific position, and then an image is formed by different color blocks to realize image display in the display device.

[0081] In other embodiments, a pixel may further include four sub-pixels: R (red sub-pixel), G (green sub-pixel), B (blue sub-pixel), and W (white sub-pixel) to obtain richer colors.

[0082] by Figure 8 Take the pixel p shown as an example, where the pixel p is mixed by the three primary colors RGB to obtain the color of the pixel unit p. The sub-pixels R, G, and B of the pixel p are assigned different pixel values, each pixel value represents the brightness of the corresponding color, and the three primary colors RGB with different brightness are mixed to obtain the color information of the pixel p. Therefore, the color information of the pixel p can be quantified as a pixel value. Specifically, take R (101) G (200) B (50) as an example, where 101, 200, and 50 are terminal display data, and the color of the pixel unit p is obtained after the three primary colors RGB are mixed according to the terminal display data. Accordingly, the display of other parts of the image to be output is realized, because different parts in the puppy image have different colors, so different parts have different display data. Therefore, the terminal display data is data corresponding to the image to be output, for example, the terminal display data is the pixel value corresponding to the image to be output.

[0083] Display devices display images through multiple pixel units, which include multi-color sub-pixels (for example, RGB or RGBW). The terminal display data provided by the display device is the brightness feature corresponding to each sub-pixel (for example, the brightness feature reflecting the pixel values ​​of 101, 200, and 50), thereby achieving different proportions of color mixing of each color sub-pixel to obtain different colors. The brightness feature here is a value that can characterize the color mixing ratio of each color sub-pixel.

[0084] For further understanding, the relationship between the terminal display data and the image display to be output is explained below in conjunction with the liquid crystal display device. The liquid crystal display device is mainly composed of two parts: a liquid crystal panel and a backlight module.

[0085] like Fig. 9 As shown, the liquid crystal panel mainly includes an array substrate 17, a color filter substrate 12, and a liquid crystal layer 15 located between the array substrate 17 and the color filter substrate 12. The gate lines and data lines on the array substrate 17 define the area of ​​each sub-pixel and connect the pixel electrodes. The color filter substrate 12 is arranged opposite to the array substrate 17. The B photoresist, R photoresist, and G photoresist on the color filter substrate 12 correspond to the sub-pixels on the array substrate 17 one by one, and are used to transmit the blue light, red light, and green light in the backlight, respectively, so as to realize the image display of the three primary colors of RGB. In addition, there is a transparent conductive layer on the color filter substrate 12, which forms a sub-pixel unit with the pixel electrode on the array substrate 17, and the three RGB sub-pixels form a pixel unit 100.

[0086] The main component of the backlight module is the backlight source 10. When displaying an image, a common voltage is loaded on the transparent conductive layer, and a pixel voltage is loaded on the pixel electrode of each sub-pixel unit. The two opposite electrodes can control the deflection direction of the liquid crystal molecules, thereby controlling the light transmittance through the sub-pixel unit, and then controlling the R, G or B sub-pixels to have different brightness and correspondingly have different pixel values, thereby achieving the purpose of image display.

[0087] Therefore, in Fig. 9 In the liquid crystal display device shown, the driving circuit 13 provides a pixel voltage corresponding to the brightness characteristic quantity (i.e., the pixel value) to each sub-pixel, and at the same time cooperates with the color of the color filter, so as to achieve light mixing at the final output end of the display device and obtain the color of the pixel unit. Accordingly, for the liquid crystal display, the terminal display data is the electrical signal data that changes the deflection direction of the liquid crystal molecules. For example, the terminal display data can be the pixel voltage provided by the driving circuit 13.

[0088] In other embodiments, the terminal display data may also be brightness feature quantities corresponding to other sub-pixels. For example, when the image is displayed in a self-luminous manner, the terminal display data may be electrical drive data corresponding to the self-luminous intensity.

[0089] In addition to corresponding to the image to be output, the terminal display data may also be related to the display device, that is, in order to display the same color of the same image to be output, different display devices have different terminal display data. Even if the display device is a liquid crystal display, different liquid crystal displays have different configurations, and when the same image to be output is displayed on different liquid crystal displays, the terminal display data is also different. It can be seen that the terminal display data corresponds to the image to be output, and when the image to be output is displayed on different display devices, the terminal display data must also match the display device.

[0090] When the image to be output is displayed based on the luminous spectrum of the light source of the display device, the terminal display data not only corresponds to the image to be output, but also is related to the luminous spectrum. Specifically, in the display device, after the backlight source 10 passes through the color filter substrate 12, it can be equivalent to three R, G, and B light sources with specific wavelengths and brightness, that is, the three primary colors of the display system, and its color coordinates in the CIE1931 XYZ colorimetry system are expressed as , and .

[0091] refer to Fig. 9, R, G, B light sources can achieve different colors within the triangle range (∆RGB) composed of the three primary color coordinates according to different color mixing ratios. Here, the color mixing ratio is the brightness signals r, g, b of the R, G, B light sources. Therefore, the R, G, B light sources can achieve different colors according to different brightness signals r, g, b. The color coordinates of different colors in the CIE1931 XYZ colorimetry system are expressed as (x, y, Y): x, y represent color information, and Y represents brightness information. The process is as follows:

[0092]

[0093] in:

[0094] .

[0095] Thus, the relationship between the brightness signal and the color can be obtained based on the light source emission spectrum, and different brightness signals r, g, and b represent different colors. Fig.10 , the color coordinates for ∆RGB are The color A can be realized by the R, G, B light sources according to the brightness signals r', g', b', that is, the brightness signals r', g', b' can represent the color A. When displaying an image, the R, G, B light sources configure different brightness signals for each pixel unit according to the color of each pixel unit of the image, thereby accurately displaying the true color of the image.

[0096] It should be noted that, in practical applications, in order to ensure that the brightness change of the image conforms to the visual characteristics of the human eye, gamma correction is usually used to establish a mapping relationship between the brightness signals r, g, b and the pixel values ​​RGB, so that different colors can be achieved according to different pixel values ​​RGB at the display device terminal. Therefore, based on the luminous spectrum, the step of obtaining the terminal display data of the image to be output also includes gamma correction.

[0097] Specifically, step S3 at least includes the following sub-steps: obtaining a mapping relationship between a gamma-corrected brightness signal and a pixel value; obtaining terminal display data corresponding to the brightness signal according to the mapping relationship, and displaying the image to be output through the terminal display data.

[0098] like Fig.11 As shown, it is a schematic diagram of gamma correction in step S3, the horizontal axis is the pixel value RGB, the vertical axis is the brightness signal r, g, b, and the curve in the figure is the mapping relationship between the pixel value and the brightness signal. The specific mapping relationship is determined according to the specific display device. In addition, this mapping relationship can also be expressed in the form of a formula or a lookup table.

[0099] When using terminal display data to display images, for people with color vision deficiencies, the luminous spectrum of the display device's light source is within their recognizable range, so the color of the image can be identified, improving the recognizability of the image color, allowing terminal users with color vision deficiencies and normal color vision to effectively perceive and distinguish the image color at the same time, thereby optimizing the visual experience of both groups of people.

[0100] It should also be noted that in the above embodiments, the terminal display data is an electrical signal for controlling the deflection direction of the liquid crystal molecules. In other embodiments, the image display may be performed in a self-luminous manner, and the terminal display data may also be electrical drive data corresponding to the self-luminous intensity. For example, by driving with current or voltage, the self-luminous sub-pixel unit emits light of three colors of RGB. By changing the electrical drive data such as current or voltage, different color mixing ratios of each sub-pixel can be obtained, thereby realizing image display.

[0101] In order to solve the technical problem, the embodiment of the present invention further provides a display module, referring to Fig.12 , shows a functional block diagram of a display module according to an embodiment of the present invention. The display module comprises:

[0102] The abnormal spectrum band acquisition unit 201 acquires the abnormal spectrum band corresponding to the terminal user according to the color vision deficiency characteristics of the terminal user;

[0103] A light source configuration unit 202 is configured to preset a light spectrum of a light source of a display device, wherein the light spectrum is configured as a first band having a first intensity and a second band having a second intensity, wherein the second intensity is smaller than the first intensity, and the second band includes an abnormal spectrum band corresponding to a terminal user;

[0104] The terminal display data unit 203 acquires the terminal display data of the image to be output based on the light emission spectrum, and performs image display.

[0105] The embodiment of the present invention shows that the module can be implemented by various means such as hardware, firmware, software or a combination thereof. In a hardware configuration, the method according to the exemplary embodiment of the present invention can be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, etc.

[0106] Correspondingly, an embodiment of the present invention further provides a medium, wherein the medium stores one or more computer instructions, and the one or more computer instructions are used to implement the display method provided by the embodiment of the present invention.

[0107] The medium is a computer-readable medium, and the medium may be a read-only memory (ROM), a random access memory (RAM), a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk, or any other medium that can store program codes.

[0108] Accordingly, an embodiment of the present invention further provides a display device, referring to Fig.13 , shows a schematic diagram of the structure of a display device according to an embodiment of the present invention. The display device comprises:

[0109] A backlight module 301 is used to provide a light source obtained by the display method of an embodiment of the present invention;

[0110] The image display module 302 is used to provide the terminal with display data for image display.

[0111] Specifically, the light emission spectrum of the backlight module 301 may be as follows: Figure 6 The spectral distribution is similar to spectrum b, by making the luminous spectrum have low intensity within the spectral range including the abnormal spectral band, avoiding the wavelength range where people with color vision deficiency cannot identify colors. In practical applications, the central wavelength and width of the low-intensity band of the luminous spectrum can be configured according to the type and degree of color vision deficiency. The terminal display data of the image display module 302 is generally set at the factory where the display device leaves the factory. In practical applications, the display device configures different terminal display data for it according to the pixel unit color of the image to be output. Fig.13 In the illustrated embodiment, the backlight module 301 provides a light source, and the image display module 302 provides terminal display data, thereby ultimately achieving the purpose of image display.

[0112] In the embodiment of the present invention, the display of the image to be output is achieved by changing the light spectrum of the light source of the display device and obtaining the corresponding terminal display data. For the production line that needs to manufacture the display device of the embodiment of the present invention, during the manufacturing process of the display device, only the light source needs to be changed, and the rest of the parts remain consistent with the original device production line and process technology. In order to obtain the corresponding terminal display data, it is only necessary to perform color correction on the display device with the light source based on the same production line and process technology, and configure the relevant color management file into the display device. Therefore, this method can reduce the changes to the existing display device manufacturing production line and has good compatibility.

[0113] In this embodiment, the image display module 302 is a liquid crystal display module, and the display data is an electrical signal for controlling the deflection direction of liquid crystal molecules.

[0114] The display device of the embodiment of the present invention can improve the color perception and discrimination ability of people with color vision deficiency; in addition, it also ensures the viewing experience of people with normal color vision for displayed images, and improves the universal applicability of the display device. For the embodiment of expanding the luminous spectrum of the display color gamut, the richness of the color of the display device can also be improved.

[0115] In other embodiments, the display device may also be a self-luminous display device, such as an organic light emitting diode display device, a quantum dot light emitting diode, or a micro light emitting diode display.

[0116] The present invention further provides an electronic device, comprising the display device provided by the embodiment of the present invention.

[0117] The electronic device can be a computer, a virtual display device, a mobile phone, a camera or a video camera, etc., which can realize image display. On the basis of ensuring the authenticity of the image color of the electronic device, the recognizability of the image color is improved, and the color vision perception ability of people with color vision deficiency is improved when using the electronic device. In addition, people with color vision deficiency and people with normal color vision can use the electronic device at the same time, realizing visual sharing of the two groups of people.

[0118] Although the present invention is disclosed as above, the present invention is not limited thereto. Any person skilled in the art can make various changes and modifications without departing from the spirit and scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the scope defined by the claims.

Claims

1. An image display method for color vision deficiency compensation, characterized in that: The specific steps are: (1) obtaining an abnormal spectral band corresponding to the terminal user according to the color vision defect characteristics of the terminal user; specifically, obtaining a spectral sensitivity response curve of a photoreceptor cell corresponding to the terminal user according to the color vision defect characteristics of the terminal user; comparing the spectral sensitivity response curve of the terminal user with the spectral sensitivity response curve of a person with normal color vision to obtain a spectral band corresponding to abnormal color perception; the color vision defect characteristics of the terminal user refer to the color vision defect type of the terminal user; or, refer to the color vision defect type and the degree of the color vision defect type; Here, the color vision deficiency types of the terminal user include two types: dichromats and abnormal trichromats; dichromats include red-green color blindness, green-green color blindness, and blue-yellow color blindness; abnormal trichromats include red-green color weakness, green-green color weakness, and blue-yellow color weakness; The color vision deficiency type of the terminal user and the degree of the color vision deficiency of the type are described by classifying the degree of the color vision deficiency of the type into three types: mild, moderate and severe; or described by numerical segmentation in the range of 0 to 1; (2) a light spectrum of a preset light source, wherein the light spectrum is configured as a first band having a first intensity and a second band having a second intensity, wherein the second intensity is at least 50% less than the first intensity, and the second band includes an abnormal spectrum band corresponding to a terminal user; Here, the light source is a combination of monochromatic light sources emitting different colors, or a white light source; wherein the combination of monochromatic light sources includes a red light source, a green light source, and a blue light source; The luminescence spectrum is realized as follows: (2.1) When the light source is a combination of monochromatic light sources emitting different colors, the luminous spectrum is achieved by adjusting the chip of the monochromatic light source; or, by adjusting the phosphor of the monochromatic light source; (2.2) When the light source is a white light source, the luminous spectrum is achieved by adjusting the chip of the white light source; or, by adjusting the phosphor of the white light source; (3) based on the luminescence spectrum, obtaining terminal display data of the image to be output and performing image display; Here, the terminal display data is a pixel value corresponding to the image to be output; the image display is performed by using a plurality of pixel units; The pixel unit includes multi-color sub-pixels; the terminal display data is the brightness feature value corresponding to each sub-pixel; The multi-color sub-pixel includes: a blue sub-pixel, a green sub-pixel and a red sub-pixel; or, the multi-color sub-pixel includes: a blue sub-pixel, a green sub-pixel, a red sub-pixel and a white sub-pixel.

2. The image display method according to claim 1, characterized in that: The image display is performed by using a liquid crystal display; the terminal display data is the electrical signal data for changing the deflection direction of the liquid crystal molecules.

3. The image display method according to claim 1, characterized in that: The image display is performed by self-luminescence; the terminal display data is electrical drive data corresponding to the self-luminescence intensity.

4. The image display method according to any one of claims 1 to 3, characterized in that: In step (3), the step of acquiring the terminal display data of the image to be output based on the luminescence spectrum also includes gamma correction; At this time, when the terminal display data is a pixel value corresponding to the image to be output; the step of obtaining the terminal display data of the image to be output also includes: Obtaining a mapping relationship between a gamma-corrected brightness signal and a pixel value; According to the mapping relationship, terminal display data corresponding to the brightness signal is obtained.

5. A display module based on the image display method according to any one of claims 1 to 4, characterized in that: include: An abnormal spectral band acquisition unit, which acquires an abnormal spectral band corresponding to the terminal user according to the color vision defect characteristics of the terminal user; A light source configuration unit, used for presetting a light emission spectrum of the light source, wherein the light emission spectrum is configured as a first band having a first intensity and a second band having a second intensity, wherein the second intensity is smaller than the first intensity, and the second band includes an abnormal spectrum band corresponding to a terminal user; A terminal display data unit, which obtains terminal display data of an image to be output based on the luminescence spectrum and performs image display; That is, these three unit modules respectively execute the contents of the three steps in the image display method.

6. The display module according to claim 5, characterized in that: The configuration and control of each unit in the display module form a software system; and it is deployed in a computing system through a storage medium.

7. An image display device for color vision defect compensation based on the image display method according to any one of claims 1 to 4, characterized in that: include: Backlight module and image display module; wherein: The backlight module is used to provide the light source obtained by the image display method; The image display module is used to provide terminal display data and perform image display.

Citation Information

Patent Citations

  • Display control method and electronic equipment

    CN106097990A