Determining method, determining apparatus, driving apparatus, display device and computer medium

Abstract

The application discloses a determination method, a determination device, a driving device, a display device and a computer readable storage medium. The determination method is used for a display device capable of field sequential display, and comprises the following steps: acquiring an eye image; determining eye movement information according to the eye image, wherein the eye movement information comprises an eye movement direction and an eye movement speed; determining a pixel offset of a sub-frame according to the eye movement information; determining a color separation picture according to the pixel offset; and determining a color separation degree of the display device when displaying a current picture according to the color separation picture and the current picture. According to the determination method, the eye movement information is determined according to the captured eye image, the pixel offset of the sub-frame is determined according to the eye movement information, the color separation picture representing the color separation phenomenon is determined according to the pixel offset, and the color separation degree when displaying the current picture is determined according to the color separation picture and the current picture, so that the color separation value is calculated in combination with the eye movement capturing technology, and the accurate calculation of the color separation value is realized.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of display devices, and more particularly, to a determination method, a determination apparatus, a driving apparatus, a display device, and a computer readable storage medium. BACKGROUND

[0002] Using LCD display technology combined with field sequential display technology, color display can be performed without color filters. However, because the RGB three subframes of the field sequential display technology are given by time-sharing backlight, when the eyeball of a user rotates, the imaging positions of the RGB three subframes of the same target on the retina are inconsistent, the human eye vision cannot mix the colors of the RGB three channels, and color separation (CBU) is generated. In related technologies, the RGB three channels of an image are respectively offset by a fixed pixel along a horizontal direction to simulate the severity of color separation generated by the image, and the calculation of the color separation degree is not accurate enough. SUMMARY

[0003] The present application provides a determination method, a determination apparatus, a driving apparatus, a display device, and a computer readable storage medium.

[0004] The present application provides a determination method for a display device for performing field sequential display to display a plurality of subframes, the determination method comprising: acquiring an eye image; determining eye movement information according to the eye image, the eye movement information comprising an eye movement direction and an eye movement speed; determining a pixel offset amount of the subframe according to the eye movement information; determining a color separation picture according to the pixel offset amount, the color separation picture being used to represent a color separation phenomenon of the display device when displaying a current picture; and determining a color separation degree of the display device when displaying the current picture according to the color separation picture and the current picture.

[0005] In this way, the eye movement information is determined according to the captured eye image, the pixel offset amount of the subframe is determined according to the eye movement information, the color separation picture representing the color separation phenomenon is determined according to the pixel offset amount, and the color separation degree of the display device when displaying the current picture is determined according to the color separation picture and the current picture, so that the color separation value is calculated in combination with the eye movement capture technology, and accurate calculation of the color separation value is realized.

[0006] In some embodiments, the eye image comprises gray scale information, and the determination of the eye movement information according to the eye image comprises: determining a pupil region according to the eye image; determining a visual axis direction vector according to the pupil region; determining the eye movement direction and an eye movement angle according to the visual axis direction vector at a first time and the visual axis direction vector at a second time, the first time and the second time being different; and determining the eye movement speed according to the eye movement angle, the first time, and the second time.

[0007] Thus, the visual axis direction vector of the pupil at the first time and the visual axis direction vector of the pupil at the second time can be determined according to the eye tracking technology, the eye movement direction and the eye movement angle can be determined according to the two visual axis direction vectors, and the eye movement speed can be determined according to the eye movement angle, so that the direction change value of the user's eye at the two different times can be determined.

[0008] In some embodiments, the pixel offset amount includes a subframe offset direction and a subframe offset distance, and the determining the pixel offset amount of the subframe according to the eye movement information includes: determining a conversion relationship between an eye coordinate system and a display coordinate system, the display coordinate system being determined according to the display device; determining the subframe offset direction according to the eye movement direction and the conversion relationship; and determining the subframe offset distance according to the eye movement speed and the conversion relationship.

[0009] Thus, the subframe offset direction is determined according to the eye movement direction and the conversion relationship between the eye coordinate system and the display coordinate system, and the subframe offset distance is determined according to the eye movement speed and the conversion relationship, so that the determination of the subframe offset direction and the subframe offset distance is realized.

[0010] In some embodiments, the display device includes a display screen, and the determining the subframe offset direction according to the eye movement direction and the conversion relationship includes: converting the eye movement direction from the eye coordinate system to the display coordinate system to obtain a display eye movement direction; projecting the display eye movement direction to a screen plane to obtain a projection vector, the screen plane being used to represent a plane corresponding to the display screen in the display coordinate system; and determining a direction vector of a perpendicular direction of the projection vector as the subframe offset direction.

[0011] Thus, by converting the eye movement direction to the display coordinate system and projecting the eye movement direction to the screen plane corresponding to the display screen in the display coordinate system to obtain a projection vector, and determining a unit direction vector of a perpendicular direction of the projection vector, the subframe offset direction can be obtained.

[0012] In some embodiments, the display device displays two adjacent subframes at a set period respectively, and the determining the subframe offset distance according to the eye movement speed and the conversion relationship includes: calculating an eye movement angle according to the eye movement speed and the set period; and converting the eye movement angle from the eye coordinate system to the display coordinate system to obtain the subframe offset distance.

[0013] Thus, the eye movement angle is calculated according to the eye movement speed and the time of the two adjacent subframes, and the eye movement angle is converted from the eye coordinate system to the display coordinate system, so that the subframe offset distance is determined.

[0014] In some embodiments, the pixel offset includes a sub-frame offset direction, and the determining the color separation picture according to the pixel offset includes: determining an offset size of the pixel offset; decomposing the sub-frame offset direction into a horizontal offset direction and a vertical offset direction; and determining the color separation picture according to the current picture, the offset size, the horizontal offset direction and the vertical offset direction.

[0015] In this way, by determining the offset size, the horizontal offset direction and the vertical offset direction according to the pixel offset, the sub-frames of the current picture can be offset according to the pixel offset to determine the color separation picture, and the accurate CBU value can be calculated according to the color separation picture and the current picture, and the color separation degree can be determined for subsequent color separation suppression processing.

[0016] In some embodiments, the determining method further includes: suppressing the color separation phenomenon generated by the display device when displaying the current picture according to the color separation degree to obtain a processed picture; and driving the display device to display the processed picture.

[0017] In this way, the color separation can be suppressed by combining the CBU value determined by the eye tracking technology, and better suppression effect can be obtained to improve the effect of field sequential display.

[0018] In some embodiments, the suppressing the color separation phenomenon generated by the display device when displaying the current picture according to the color separation degree includes: determining a color gamut compression ratio according to the color separation degree; and performing color gamut compression on the current picture according to the color gamut compression ratio to suppress the color separation phenomenon generated by the display device when displaying the current picture.

[0019] In this way, the color gamut compression ratio can be determined according to the color separation degree, the dynamic adjustment of the color gamut compression ratio can be realized according to the eye movement speed and the content of the current picture, the accuracy of the color gamut compression result can be improved, and better color separation suppression effect can be achieved.

[0020] An embodiment of the present application provides a determination apparatus for a display device, the display device being used to display a plurality of sub-frames, any two adjacent sub-frames being used to display different colors, the determination apparatus including an acquisition module and a processing module, the acquisition module being used to acquire an eye image, and the processing module being used to: determine eye movement information according to the eye image, the eye movement information including an eye movement direction and an eye movement speed; determine a pixel offset of the sub-frames according to the eye movement information; determine a color separation picture according to the pixel offset; and determine a color separation degree of the display device when displaying a current picture according to the color separation picture and the current picture.

[0021] Thus, the eye movement information is determined based on the captured eye image, the pixel offset of the sub-frame is determined based on the eye movement information, the color separation picture representing the color separation phenomenon is determined based on the pixel offset, the color separation degree of the display device when displaying the current picture is determined based on the color separation picture and the current picture, and thus the color separation value is calculated in combination with the eye movement capturing technology, and accurate calculation of the color separation value is realized.

[0022] The embodiment of the present application provides a driving device for a display device, the driving device comprising a rendering module and a driving module, the rendering module is used for processing a current picture based on the color separation degree to obtain a processed picture, so as to suppress the color separation phenomenon generated by the display device when displaying the current picture, the color separation degree is determined based on a color separation picture and the current picture, the color separation picture can be determined based on a pixel offset of a sub-frame, the pixel offset is determined based on eye movement information of an eye image, and the eye movement information comprises an eye movement direction and an eye movement speed; and the driving module is used for driving the display device to display the processed picture.

[0023] Thus, the color separation phenomenon generated by the display device when displaying the current picture can be suppressed by processing the current picture based on the color separation degree to obtain a processed picture and driving the display device to display the processed picture.

[0024] In some embodiments, the driving device is further used for determining a color gamut compression ratio based on the color separation degree, and performing color gamut compression on the current picture based on the color gamut compression ratio to obtain the processed picture.

[0025] Thus, the color gamut compression ratio is determined based on the color separation degree, and the dynamic adjustment of the color gamut compression ratio can be realized based on the eye movement speed and the content of the current picture, so as to improve the accuracy of the color gamut compression result and achieve better color separation suppression effect.

[0026] The embodiment of the present application provides a display device, the display device comprising one or more processors and a memory, the memory storing a computer program, and the computer program is executed by the processor to realize the steps of the determination method in any of the above-mentioned embodiments.

[0027] Thus, the eye movement information is determined based on the captured eye image, the pixel offset of the sub-frame is determined based on the eye movement information, the color separation picture representing the color separation phenomenon is determined based on the pixel offset, the color separation degree of the display device when displaying the current picture is determined based on the color separation picture and the current picture, and thus the color separation value is calculated in combination with the eye movement capturing technology, and accurate calculation of the color separation value is realized.

[0028] The embodiment of the present application provides a computer readable storage medium, which stores a computer program, and the program is executed by a processor to realize the steps of the determination method of any one of the above embodiments.

[0029] Thus, the eye movement information is determined according to the captured eye image, the pixel offset of the sub-frame is determined according to the eye movement information, the color separation picture representing the color separation phenomenon is determined according to the pixel offset, the color separation degree of the display device when displaying the current picture is determined according to the color separation picture and the current picture, and thus the color separation value is calculated by combining the eye movement capture technology, and the accurate calculation of the color separation value is realized.

[0030] Additional aspects and advantages of the present application will be described in the following description and part will become apparent from the following description or will be learned by practice of the present application. BRIEF DESCRIPTION OF DRAWINGS

[0031] The above and / or additional aspects and advantages of the present application will become apparent and be readily understood from the following description, taken in conjunction with the accompanying drawings, in which:

[0032] Figure 1 is a flowchart of the determination method of the embodiment of the present application;

[0033] Figure 2 is a schematic diagram of the determination device of the embodiment of the present application;

[0034] Figure 3 is a schematic diagram of the color separation picture of different offset distances and directions of the related art;

[0035] Figure 4 is a flowchart of the determination method of the embodiment of the present application;

[0036] Figure 5 is a schematic diagram of the visual axis direction vector of the embodiment of the present application;

[0037] Figure 6 is a flowchart of the determination method of the embodiment of the present application;

[0038] Figure 7 is a flowchart of the determination method of the embodiment of the present application;

[0039] Figure 8 is a flowchart of the determination method of the embodiment of the present application;

[0040] Figure 9 is a flowchart of the determination method of the embodiment of the present application;

[0041] Figure 10 is a flowchart of the determination method of the embodiment of the present application;

[0042] Figure 11 is a schematic diagram of a driving device of an embodiment of the present application;

[0043] Figure 12 is a flowchart of a determination method of an embodiment of the present application. DETAILED DESCRIPTION

[0044] Embodiments of the present application are described in detail below with reference to the accompanying drawings, in which the same or similar components have the same or similar reference numerals throughout the drawings and a description thereof is not repeated. Embodiments described below with reference to the accompanying drawings are exemplary and are for explanation of the present application only and should not be construed as limiting the present application.

[0045] Using LCD display technology combined with field sequential display technology, color filters can be omitted for color display. However, since the RGB three subframes of the field sequential display technology are given by backlight time-sharing, when the eyeball of the user rotates, the imaging positions of the RGB three subframes of the same target on the retina are inconsistent, so that the human eye vision cannot mix the colors of the RGB three channels, and further, color separation phenomenon (CBU) is generated. The degree of color separation can be calculated, the movement of the eyeball is simulated through the offset of the subframes, the color separation effect seen by the human eye is explicitly characterized in an image, and the color separation phenomenon is inhibited through the technology of color gamut compression or color gamut inhibition. In the related art, the RGB three channels of the image are respectively offset by a fixed pixel along the horizontal direction to simulate the severity of the color separation generated by the image, and the calculation of the degree of color separation is not accurate enough.

[0046] Referring to Figure 1 , an embodiment of the present application provides a determination method for a display device for performing field sequential display to display a plurality of subframes, the determination method comprising:

[0047] 01: acquiring an eye image;

[0048] 02: determining eye movement information according to the eye image, the eye movement information comprising eye movement direction and eye movement speed;

[0049] 03: determining a pixel offset amount of the subframes according to the eye movement information;

[0050] 04: determining a color separation picture according to the pixel offset amount, the color separation picture being used to characterize a color separation phenomenon of the display device when displaying a current picture;

[0051] 05: determining a color separation degree of the display device when displaying the current picture according to the color separation picture and the current picture.

[0052] Specifically, referring to Figure 2The determination method of the embodiment of the present application can be implemented by the determination device 100 of the embodiment of the present application, which comprises a collection module 10 and a processing module 20. The collection module 10 is used to acquire an eye image. The processing module 20 is used to: determine eye movement information according to the eye image, wherein the eye movement information comprises eye movement direction and eye movement speed; determine a pixel offset of a sub-frame according to the eye movement information; determine a color separation picture according to the pixel offset, wherein the color separation picture is used to represent color separation phenomenon of a display device when displaying a current picture; and determine a color separation degree of the display device when displaying the current picture according to the color separation picture and the current picture.

[0053] In the related art, the RGB three channels of the image are respectively offset by a fixed pixel along the horizontal direction for calculation, but different offset directions or offset distances have a relatively large influence on the calculation result of the color separation degree (CBU). For example, referring to Figure 3 For the same image, different offsets are made: the RGB three sub-frames are upwardly offset by 5 pixels, and the CBU calculated is 12; the RGB three sub-frames are leftwardly offset by 5 pixels, and the CBU calculated is 19; the RGB three sub-frames are rightwardly and downwardly offset by 10 pixels, and the CBU calculated is 27. From the results, it can be seen that, for the same image, different offset directions or offset distances have a relatively large influence on the calculation result of the color separation degree, and therefore the color separation degree calculation process of the related art is not accurate enough. Because the movement of the human eye is complex and diverse, and has different eye movement directions and eye movement speeds. A user corresponds to an eye movement state when watching an image, and corresponds to another eye movement state when watching another image, so the calculation result of the color separation degree is related to not only the image content but also the eye movement state.

[0054] The embodiment of the present application combines the eyeball tracking technology into the calculation of the color separation degree, combines the image content information with the eye movement state information to accurately calculate the color separation degree in real time. The display device can display different subframes in time to perform field sequential display, and any two adjacent subframes can display different colors or the same color. The eye image is an image of the eye part of the user, and the acquisition module can be a camera or other types of sensors. Since the eye image of the user captured by the acquisition module usually has irrelevant information such as noise, the determination method can further include filtering the eye image to remove irrelevant noise. The noise of the eye image can be removed by image filtering and other methods, the quality of the eye image is improved, and the subsequent processing task is facilitated. The eye movement information determined according to the eye image includes an eye movement direction and an eye movement speed. The eye movement direction is the direction of the change of the user's eyes at any two times, and the eye movement speed is the speed of the change of the eye direction. The pixel offset of the subframe is determined according to the eye movement direction and the eye movement speed. The pixel offset is the number of pixels of the subframe offset relative to the same subframe displaying the current picture. The pixel offset includes a subframe offset distance and a subframe offset direction. The color separation picture is determined according to the pixel offset of the subframe and the current picture to represent the color separation phenomenon when the human eye sees the current picture. The color separation picture and the current picture are converted to the Lab space (color opposite space) to calculate the color difference and the color separation (CBU) value to determine the color separation degree of the display device when displaying the current picture. The color separation degree determined by combining the eyeball tracking technology is more consistent with the color separation phenomenon seen by the human eye, and the color separation value calculated is more accurate. In addition, the pixel offset determined according to the eye movement information can also be used to suppress the color separation phenomenon. The pixel offset can be compensated when displaying the current picture to suppress the color separation phenomenon and obtain better display effect.

[0055] In this way, the eye movement information is determined according to the captured eye image, the pixel offset of the subframe is determined according to the eye movement information, the color separation picture representing the color separation phenomenon is determined according to the pixel offset, and the color separation degree of the display device when displaying the current picture is determined according to the color separation picture and the current picture. Thus, the color separation value is calculated by combining the eye movement capture technology, and the accurate calculation of the color separation value is realized.

[0056] Please refer to Figure 4 In some embodiments, the eye image includes gray scale information, and step 02 (determining eye movement information according to eye image) includes:

[0057] 021: determining a pupil region according to the eye image;

[0058] 022: determining a visual axis direction vector according to the pupil region;

[0059] 023: determining the eye movement direction and the eye movement angle according to the visual axis direction vector at the first time and the visual axis direction vector at the second time, the first time and the second time being different;

[0060] 024: determining the eye movement speed according to the eye movement angle, the first time and the second time.

[0061] Specifically, the steps 021 to 024 can be implemented by the processing module 20 of the embodiment of the present application, that is, the processing module 20 can be used to: determine the pupil region according to the eye image; determine the visual axis direction vector according to the pupil region; determine the eye movement direction according to the visual axis direction vector at the first time and the visual axis direction vector at the second time, the first time and the second time being different; and determine the eye movement speed according to the eye movement angle, the first time and the second time.

[0062] Wherein, please refer to Figure 5 The eye region can be extracted using the eye feature information, and the eye region is taken as a region of interest for subsequent processing, and other regions outside the region of interest are not processed subsequently; the eye feature edge information including the eyelid and sclera edge, the sclera and iris edge, the iris and pupil edge, etc. is extracted in combination with the eye feature, the eye regions are segmented according to the eye feature edge information and the gray scale information of the image, so as to obtain the pupil region; and the image coordinates of the pupil center are located, and the visual axis direction vector can be estimated in combination with the eyeball model, the direction of the visual axis direction vector being from the pupil center to the outside of the eyeball. The visual axis direction vector can be a unit vector, that is, the length of the visual axis direction vector is 1. At the first time T1, the visual axis direction vector is a first vector P1; at the second time T2, the visual axis direction vector is a second vector P2; the eye movement direction can be determined according to the cross product of the visual axis direction vector at the first time and the visual axis direction vector at the second time, and the eye movement direction can also be a direction vector n, and the eye movement direction vector n can be a unit vector, that is, the length of n is 1. The included angle θ of the first vector P1 and the second vector P2 is the eye movement angle, and the eye movement direction change from the first time T1 to the second time T2 can be described as: the first vector P1 rotates the eye movement angle θ along the eye movement direction vector n to the second vector P2. The eye movement angle θ and the difference between the first time and the second time are differentiated to obtain the eye movement speed.

[0063] In this way, the visual axis direction vector of the pupil at the first time and the visual axis direction vector of the pupil at the second time can be determined according to the eyeball tracking technology, the eye movement direction and the eye movement angle can be determined according to the two visual axis direction vectors, the eye movement speed can be determined according to the eye movement angle, and thus the direction change value of the user's eye at the two different times can be determined.

[0064] Please refer to Figure 6In some embodiments, the pixel offset amount includes a subframe offset direction and a subframe offset distance, and step 03 (determining the pixel offset amount of the subframe according to the eye movement information) includes:

[0065] 031: determining a conversion relationship between the eye coordinate system and the display coordinate system, the display coordinate system being determined according to the display device;

[0066] 032: determining the subframe offset direction according to the eye movement direction and the conversion relationship;

[0067] 033: determining the subframe offset distance according to the eye movement speed and the conversion relationship.

[0068] Specifically, steps 031 to 033 can be implemented by the processing module 20 of the embodiments of the present application, that is, the processing module 20 can be used to: determine a conversion relationship between the eye coordinate system and the display coordinate system, the display coordinate system being determined according to the display device; determine the subframe offset direction according to the eye movement direction and the conversion relationship; and determine the subframe offset distance according to the eye movement speed and the conversion relationship.

[0069] In this way, the conversion relationship between the eye coordinate system and the display coordinate system is determined by establishing mathematical models of the eye, the acquisition module, and the display device to determine the pose relationship of the three, the pose relationship being the coordinate system conversion relationship; determining the eye coordinate system according to the position of the eye, determining the acquisition coordinate system according to the position of the acquisition module, and determining the display coordinate system according to the position of the display device; determining the conversion relationship between the eye coordinate system and the acquisition module coordinate system, and then determining the conversion relationship between the acquisition module and the display device, so as to determine the conversion relationship between the eye coordinate system and the display coordinate system. The acquisition module coordinate system can be a camera-based coordinate system, and the display coordinate system can be a display device-based coordinate system. The pose relationship of the eye and the acquisition module can be calculated by a pose conversion algorithm, and the pose relationship of the acquisition module and the display device can be obtained through structural design parameters. Therefore, the pose relationship of the eye and the display device can be calculated, that is, the conversion relationship between the eye coordinate system and the display coordinate system is obtained. The eye movement direction is converted to the display coordinate system based on the conversion relationship between the eye coordinate system and the display coordinate system to determine the subframe offset direction, which is the direction of the subframe offset when color separation occurs compared to the normal display of the current picture. Then, the subframe offset distance is determined according to the eye movement speed and the conversion relationship between the eye coordinate system and the display coordinate system, so as to determine the pixel offset amount of the subframe, which is the distance of the subframe offset when color separation occurs compared to the normal display of the current picture.

[0070] In this way, the subframe offset direction is determined according to the eye movement direction and the conversion relationship between the eye coordinate system and the display coordinate system, and the subframe offset distance is determined according to the eye movement speed and the conversion relationship, so as to determine the subframe offset direction and the subframe offset distance.

[0071] Please refer toFigure 7 In some embodiments, the display device comprises a display screen, and step 032 (determining the sub-frame offset direction according to the eye movement direction and the conversion relationship) comprises:

[0072] 0321: converting the eye movement direction from the eye coordinate system to the display coordinate system to obtain a display eye movement direction;

[0073] 0322: projecting the display eye movement direction to a screen plane to obtain a projection vector, the screen plane being used to represent a corresponding plane of the display screen in the display coordinate system;

[0074] 0323: determining a unit directional vector of a perpendicular direction of the projection vector as the sub-frame offset direction.

[0075] Specifically, steps 0321 to 0323 can be implemented by the processing module 20 of the embodiments of the present application, that is, the processing module 20 can be used to: convert the eye movement direction from the eye coordinate system to the display coordinate system to obtain a display eye movement direction; project the display eye movement direction to a screen plane to obtain a projection vector, the screen plane being used to represent a corresponding plane of the display screen in the display coordinate system; and determine a unit directional vector of a perpendicular direction of the projection vector as the sub-frame offset direction. Wherein, the eye movement direction is converted from the eye coordinate system to the display coordinate system to obtain the display eye movement direction, and the display eye movement direction is projected on the screen plane to obtain the projection vector, and a unit directional vector of a perpendicular direction of the projection vector is taken as the sub-frame offset direction, and the screen plane is the plane corresponding to z=0 in the display coordinate system.

[0076] In this way, by converting the eye movement direction to the display coordinate system, projecting it to the screen plane corresponding to the display screen in the display coordinate system to obtain the projection vector, and determining the unit directional vector of the perpendicular direction of the projection vector, the sub-frame offset direction can be obtained.

[0077] Referring to Figure 8 In some embodiments, the display device displays two adjacent sub-frames at a set period respectively, and step 033 (determining the sub-frame offset distance according to the eye movement speed and the conversion relationship) comprises:

[0078] 0331: calculating an eye movement angle according to the eye movement speed and the set period;

[0079] 0332: converting the eye movement angle from the eye coordinate system to the display coordinate system to obtain a sub-frame offset distance.

[0080] Specifically, the step 0331 and the step 0332 can be implemented by the processing module 20 of the embodiment of the present application, that is, the processing module 20 can be used to calculate the eye movement angle according to the eye movement speed and the set period; and convert the eye movement angle from the eye coordinate system to the display coordinate system to obtain the sub-frame offset distance. Wherein, the eye movement angle in the set period can be calculated according to the eye movement speed and the set period of displaying the adjacent two sub-frames, and then the eye movement angle can be converted to the display coordinate system according to the conversion relationship between the eye coordinate system and the display coordinate system, that is, the sub-frame offset distance can be obtained. According to the conversion relationship, the distance from the eyeball to the display screen can be determined, and according to the distance from the eyeball to the display screen and the eye movement angle, the change value of the sub-frame offset distance with the rotation of the eyeball can be determined.

[0081] In this way, the eye movement angle is calculated according to the eye movement speed and the time of the adjacent two sub-frames, and the eye movement angle is converted from the eye coordinate system to the display coordinate system to determine the sub-frame offset distance.

[0082] Please refer to Figure 9 In some embodiments, the pixel offset amount includes a sub-frame offset direction, and the step 04 (determining the color separation picture according to the pixel offset amount) includes:

[0083] 041: determining an offset size of the pixel offset amount;

[0084] 042: decomposing the sub-frame offset direction into a horizontal offset direction and a vertical offset direction;

[0085] 043: determining the color separation picture according to the current picture, the offset size, the horizontal offset direction and the vertical offset direction.

[0086] Specifically, the steps 041 to 043 can be implemented by the processing module 20 of the embodiment of the present application, that is, the processing module 20 can be used to: determine the offset size of the pixel offset amount according to the color separation picture and the current picture; decompose the sub-frame offset direction into a horizontal offset direction and a vertical offset direction; and determine the color separation degree according to the offset size, the horizontal offset direction and the vertical offset direction.

[0087] The pixel offset distance according to the pixel offset of the subframe can determine the offset size of the pixel offset, and the subframe offset direction is decomposed into a horizontal offset direction and a numerical offset direction. The current subframe for display is offset according to the determined offset size and the horizontal offset direction and the numerical offset direction to display the color separation picture. The offset size can be the offset of the subframe of RGB (red, green and blue) three colors relative to the previous subframe. For example, if the order of the subframes is in the RGB order, the offset size can be the number of pixels of the G subframe displaying green relative to the R subframe displaying red, the number of pixels of the B subframe displaying blue relative to the G subframe displaying green, and the number of pixels of the R subframe displaying red relative to the B subframe displaying blue. The color separation picture can be obtained by calculating the size of the pixel offset, decomposing the pixel offset into a horizontal direction and a vertical direction, and offsetting the subframe as required according to the determined subframe offset. The color difference and the CBU value are calculated according to the color separation picture and the current picture.

[0088] In this way, by determining the offset size, the horizontal offset direction and the vertical offset direction according to the pixel offset, the subframe of the current picture can be offset to determine the color separation picture, and the accurate CBU value can be calculated according to the color separation picture and the current picture. The color separation degree can be determined for subsequent color separation suppression processing.

[0089] Referring to Figure 10 In some embodiments, the determination method further comprises:

[0090] 06: suppressing the color separation phenomenon generated by the display device when displaying the current picture according to the color separation degree to obtain a processed picture;

[0091] 07: driving the display device to display the processed picture.

[0092] Specifically, referring to Figure 11 Step 06 can be implemented by the rendering module 30 of the driving device 200 of the embodiment of the present application, and step 07 can be implemented by the driving module 40 of the driving device 200 of the embodiment of the present application, that is, the rendering module 30 can be used to suppress the color separation phenomenon generated by the display device when displaying the current picture according to the color separation degree to obtain a processed picture; and the driving module 40 can be used to drive the display device to display the processed picture.

[0093] The processing method can be color gamut compression or color gamut fitting. The color gamut compression refers to taking a line segment formed by a color gamut vertex and a white point as a saturation adjustment range of the three color subframes, i.e., a compression ratio. After saturation adjustment of the subfields, a smaller color gamut triangle is obtained, and then each color point in the image is mapped from the original color gamut to the compressed new color gamut, so as to complete the color gamut compression. The color gamut fitting refers to fitting a smallest color gamut triangle, which can envelop all color points in the image. The color gamut vertex of the smallest color gamut triangle is the maximum saturation of the three color subframes. The color gamut triangle can be fitted according to the color separation degree to determine the most accurate color gamut triangle, thereby suppressing the color separation phenomenon to the greatest extent. The rendering module can process the current picture by color gamut compression or color gamut fitting to obtain a processed picture. The driving module can include a backlight driving module and a panel driving module. The backlight driving module and the panel driving module drive the display device to display according to the processed picture. The CBU value determined according to the eye tracking technology guides the degree of suppression of color separation, which can achieve better suppression effect. At the same time, under the premise of suppressing color separation, more color information is preserved as much as possible, and the effect of field sequential display is improved.

[0094] In this way, the CBU value determined in combination with the eye tracking technology suppresses color separation, which can achieve better suppression effect, thereby improving the effect of field sequential display.

[0095] Referring to Figure 12 In some embodiments, step 06 (suppressing color separation phenomenon generated by the display device when displaying the current picture according to the color separation degree) includes:

[0096] 061: determining a color gamut compression ratio according to the color separation degree;

[0097] 062: performing color gamut compression on the current picture according to the color gamut compression ratio, so as to suppress the color separation phenomenon generated by the display device when displaying the current picture.

[0098] Specifically, steps 061 and 062 can be implemented by the rendering module 30 of the driving device 200, that is, the rendering module 30 can be configured to: determine a color gamut compression ratio according to the color separation degree; and perform color gamut compression on the current picture according to the color gamut compression ratio, so as to suppress the color separation phenomenon generated by the display device when displaying the current picture.

[0099] Wherein, the color gamut compression ratio can be determined according to the determined CBU value, the current picture color gamut compression ratio can be determined in combination with the eyeball tracking technology, and the color gamut compression is performed on the current picture to suppress the color separation phenomenon of the display device due to the rotation of the eyeball of the user when displaying the current picture. When the color separation degree is more serious, that is, the CBU value is larger, the color gamut compression ratio can be increased; when the color separation is slight, the color gamut compression ratio can be reduced, so that the dynamic adjustment of the color gamut compression ratio can be realized according to the eye movement speed and the content of the current picture, to improve the accuracy of the color gamut compression result, and achieve a better color separation suppression effect.

[0100] In this way, the color gamut compression ratio is determined according to the color separation degree, the dynamic adjustment of the color gamut compression ratio can be realized according to the eye movement speed and the content of the current picture, to improve the accuracy of the color gamut compression result, and achieve a better color separation suppression effect.

[0101] The display device provided by the embodiment of the present application comprises one or more processors and a memory, and the memory stores a computer program.

[0102] In this way, the eye movement information is determined through the captured eye image, the pixel offset of the sub-frame is determined according to the eye movement information, the color separation picture representing the color separation phenomenon is determined according to the pixel offset, and the color separation degree of the display device when displaying the current picture is determined according to the color separation picture and the current picture, so that the color separation value is calculated in combination with the eye movement capture technology, and the accurate calculation of the color separation value is realized.

[0103] The computer readable storage medium provided by the embodiment of the present application stores a computer program, and the program is executed by the processor to realize the steps of the determination method of any one of the above embodiments.

[0104] In this way, the eye movement information is determined through the captured eye image, the pixel offset of the sub-frame is determined according to the eye movement information, the color separation picture representing the color separation phenomenon is determined according to the pixel offset, and the color separation degree of the display device when displaying the current picture is determined according to the color separation picture and the current picture, so that the color separation value is calculated in combination with the eye movement capture technology, and the accurate calculation of the color separation value is realized.

[0105] In the description of the specification, the description of the terms "one embodiment", "some embodiments", "exemplary embodiment", "example", "specific example" or "some examples" etc. means that the specific features, structures, materials or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present application. In the description of the specification, the exemplary description of the above terms does not necessarily refer to the same embodiment or example. In addition, the person skilled in the art can combine and combine the different embodiments or examples described in the specification and the features of the different embodiments or examples without contradiction.

[0106] In addition, the term "connection" should be understood broadly, for example, it can include fixed connection, or detachable connection, or integral connection; it can include direct connection, or indirect connection through intermediate medium, or it can include the communication inside two elements. For the person skilled in the art, the specific meaning of the above terms in the present application can be understood according to the specific circumstances.

[0107] In addition, the terms "first", "second" are only for the purpose of description, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined with "first", "second" can explicitly or implicitly include at least one of the features. In the description of the present application, the meaning of "multiple" is at least two, for example, two, three, etc., unless otherwise specifically limited.

[0108] Any process or method descriptions in flow charts or described herein otherwise can be understood as representing code modules, segments, or portions of code that include one or more executable instructions for implementing specific logic functions or other processes. The various embodiments of the present application can include additional or fewer steps or processes, in some embodiments, the steps or processes can be performed in the order shown or discussed, including substantially concurrently or in reverse order, as will be apparent to those having ordinary skill in the art having the benefit of this description.

[0109] Although the embodiments of the present application have been shown and described above, it can be understood that the above-described embodiments are exemplary and cannot be understood as limiting the present application, and the person skilled in the art can make changes, modifications, replacements and variations to the above-described embodiments within the scope of the present application.

Claims

1. A determination method characterized by, The display device is used for field sequential display to display a plurality of subframes, and the determination method comprises: obtaining an eye image; determining eye movement information according to the eye image, the eye movement information comprising eye movement direction and eye movement speed; determining pixel offset of the subframe according to the eye movement information; determining color separation picture according to the pixel offset, the color separation picture being used to represent color separation phenomenon of the display device when displaying current picture; determining color separation degree of the display device when displaying the current picture according to the color separation picture and the current picture; suppressing color separation phenomenon generated by the display device when displaying the current picture according to the color separation degree to obtain processed picture; driving the display device to display the processed picture; the suppressing color separation phenomenon generated by the display device when displaying the current picture according to the color separation degree, comprising: determining color gamut compression ratio according to the color separation degree; performing color gamut compression on the current picture according to the color gamut compression ratio to suppress color separation phenomenon generated by the display device when displaying the current picture.

2. The determination method according to claim 1, characterized in that, The eye image comprises gray scale information, and the determining eye movement information according to the eye image comprises: determining pupil region according to the eye image; determining visual axis direction vector according to the pupil region; determining the eye movement direction and eye movement angle according to the visual axis direction vector at the first time and the visual axis direction vector at the second time, the first time and the second time being different; determining the eye movement speed according to the eye movement angle, the first time and the second time.

3. The determination method according to claim 1, characterized in that, The pixel offset comprises subframe offset direction and subframe offset distance, and the determining pixel offset of the subframe according to the eye movement information comprises: determining conversion relationship between eye coordinate system and display coordinate system, the display coordinate system being determined according to the display device; determining the subframe offset direction according to the eye movement direction and the conversion relationship; determining the subframe offset distance according to the eye movement speed and the conversion relationship.

4. The determination method according to claim 3, characterized in that, The display device comprises display screen, and the determining the subframe offset direction according to the eye movement direction and the conversion relationship comprises: converting the eye movement direction from the eye coordinate system to the display coordinate system to obtain display eye movement direction; projecting the display eye movement direction to screen plane to obtain projection vector, the screen plane being used to represent corresponding plane of the display screen in the display coordinate system; determining direction vector of vertical direction of the projection vector as the subframe offset direction.

5. The determination method according to claim 3, characterized in that, The display device displays two adjacent subframes at a set period, and the determining the subframe offset distance according to the eye movement speed and the conversion relationship comprises: calculating eye movement angle according to the eye movement speed and the set period; converting the eye movement angle from the eye coordinate system to the display coordinate system to obtain the subframe offset distance.

6. The determination method of claim 1, wherein, The pixel offset comprises subframe offset direction, and the determining color separation picture according to the pixel offset comprises: determining offset size of the pixel offset; The sub-frame offset direction is decomposed into a horizontal offset direction and a vertical offset direction; The color separation picture is determined according to the current picture, the offset size, the horizontal offset direction and the vertical offset direction.

7. A determining device for a display device, the display device being configured to display a plurality of sub-frames in time division for field sequential display, any two adjacent sub-frames being configured to display different colors, characterized in that, The determining device comprises: The acquisition module is configured to acquire an eye image; The processing module is configured to determine eye movement information according to the eye image, the eye movement information comprising an eye movement direction and an eye movement speed; determine a pixel offset amount of the sub-frame according to the eye movement information; determine a color separation picture according to the pixel offset amount; and determine a color separation degree of the display device when displaying the current picture according to the color separation picture and the current picture. The color separation degree is used to suppress color separation phenomena generated by the display device when displaying the current picture, to obtain a processed picture; and the display device is driven to display the processed picture; wherein a color gamut compression ratio is determined according to the color separation degree; and the current picture is subjected to color gamut compression according to the color gamut compression ratio, to suppress color separation phenomena generated by the display device when displaying the current picture.

8. A driving device for a display device, characterized in that, The driving device comprises: The rendering module is configured to process the current picture according to a color separation degree, to obtain a processed picture, to suppress color separation phenomena generated by the display device when displaying the current picture, the color separation degree being determined according to a color separation picture and the current picture, the color separation picture being determined according to a pixel offset amount of a sub-frame, the pixel offset amount being determined according to eye movement information of an eye image, the eye movement information comprising an eye movement direction and an eye movement speed; The driving module is configured to drive the display device to display the processed picture. The rendering module is further configured to determine a color gamut compression ratio according to the color separation degree, and to subject the current picture to color gamut compression according to the color gamut compression ratio, to obtain the processed picture.

9. A display device, characterized by The display device comprises one or more processors and a memory, the memory storing a computer program, the computer program being executed by the processor to implement the steps of the determining method of any one of claims 1 to 6.

10. A computer-readable storage medium having stored thereon a computer program, characterized in that, The program is executed by the processor to implement the steps of the determining method of any one of claims 1 to 6.

Images