Display device, grayscale control method and apparatus, and storage medium
By adjusting the grayscale values of multiple gaze areas in the display device according to the user's gaze point position, the problems of high crosstalk rate and image distortion in traditional naked-eye 3D technology are solved, achieving a better 3D viewing experience and picture quality.
Patent Information
- Application Number
- PCT/CN2024/135910
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-04-16
- Filing Date
- 2024-11-29
- Publication Date
- 2025-10-23
AI Technical Summary
In traditional naked-eye 3D technology, a single black or white interpolation process is performed on sub-pixels, which increases the crosstalk rate and causes image distortion, affecting the viewing effect of naked-eye 3D.
The processor in the display device determines multiple gaze areas based on the target user's gaze point position, and adopts different grayscale control strategies for different gaze areas, adjusting the grayscale value of the sub-pixel to reduce the grayscale value of the transition area and increase the grayscale value of the non-transition area, thereby optimizing the placement of the prism.
Effectively reduce the crosstalk rate, improve the naked-eye 3D viewing effect, expand the user's visual range, and improve picture quality and viewing experience.
Smart Images

Figure CN2024135910_23102025_PF_FP_ABST
Abstract
Description
Display device, gray scale control method, device and storage medium
[0001] The present application claims priority to the Chinese patent application No. PCT / CN2024 / 088125, filed on April 16, 2024, and entitled "Electronic device, gray scale compensation method, device and storage medium", the whole content of which is incorporated herein by reference. TECHNICAL FIELD
[0002] The present disclosure relates to the field of image technology, and in particular to a display device, a gray scale control method, a device and a storage medium. BACKGROUND
[0003] In terms of reducing crosstalk rate, the naked-eye 3D technology can optimize the design of prism and other light splitting components to improve the light splitting effect. In the traditional picture arrangement algorithm of naked-eye 3D technology, the sub-pixels in the transition area are generally handled by black insertion or white insertion to reduce crosstalk problems. However, the current single black insertion or white insertion of sub-pixels will lead to image distortion or increased crosstalk effect. Therefore, how to reduce the crosstalk rate has become a key technical problem to be solved in the field of naked-eye 3D display. SUMMARY
[0004] In one aspect, a display device, a gray scale control method, a device and a storage medium are provided, which can effectively reduce the crosstalk rate and improve the viewing effect of naked-eye 3D.
[0005] The display device includes a display panel and a processor; the processor is configured to determine a plurality of gaze areas corresponding to the display panel based on a gaze point position of a target user in the display panel; and the processor is further configured to control the gray scale value of the sub-pixels in each gaze area of the plurality of gaze areas based on a control strategy corresponding to the gaze area.
[0006] In some embodiments, the control strategies corresponding to at least two gaze areas of the plurality of gaze areas are different.
[0007] In some embodiments, the display panel corresponds to a plurality of gaze points, and one gaze point corresponds to one area. The area corresponding to each gaze point includes a transition area and a non-transition area.
[0008] In some embodiments, the plurality of gaze points are the gaze points of the target user viewing the display panel at different angles; the transition area is the area between the critical lines of the areas corresponding to any two gaze points; and the non-transition area is the area other than the transition area.
[0009] In some embodiments, the processor is further configured to determine a target gaze point region based on the gaze point position, the target gaze point region being a region of the plurality of gaze point regions that is affected by the gray scale value of the sub-pixel, and the target gaze point region including the first gaze point region and the second gaze point region, one of the first gaze point region and the second gaze point region being a region corresponding to the gaze point position and the other being a region adjacent to the region corresponding to the gaze point position.
[0010] In some embodiments, the plurality of gaze regions includes a center region, the center region being a region of a center of the gaze point position, and the processor is specifically configured to, for the plurality of sub-pixels in the center region, reduce the gray scale value of the sub-pixel in the transition region among the plurality of sub-pixels and / or increase the gray scale value of the sub-pixel in the non-transition region among the plurality of sub-pixels.
[0011] In some embodiments, the processor is specifically configured to determine a gray scale coefficient of the first sub-pixel based on a position of a center point of the first sub-pixel in the target gaze point region and a width of the first region, and reduce the gray scale value of the first sub-pixel based on the gray scale coefficient of the first sub-pixel and a first image gray scale value of the first sub-pixel in the target gaze point region.
[0012] wherein the first sub-pixel is any one of the plurality of sub-pixels in the center region in the transition region, the first region is a partial region in the target gaze point region, and the first image gray scale value is used to represent a gray scale value of the first sub-pixel in the first gaze point region or a gray scale value of the first sub-pixel in the second gaze point region.
[0013] In some embodiments, the processor is specifically configured to perform black taking processing on the gray scale value of the first sub-pixel to reduce the gray scale value of the first sub-pixel.
[0014] wherein the first sub-pixel is any one of the plurality of sub-pixels in the center region in the transition region.
[0015] In some embodiments, the processor is further configured to increase the gray scale value of the second sub-pixel based on a position of a center point of the second sub-pixel in the target gaze point region and a width of the target gaze point region.
[0016] wherein the second sub-pixel is any one of the plurality of sub-pixels in the center region in the non-transition region.
[0017] In some embodiments, the processor is specifically configured to: determine a gray scale coefficient of the second sub-pixel based on a position of a center point of the second sub-pixel in the target gaze point region and a width of the target gaze point region, and determine a gray scale value of the second sub-pixel based on the gray scale coefficient of the second sub-pixel and an image gray scale value of the second sub-pixel in the target gaze point region, and then take a minimum value between the gray scale value of the second sub-pixel and a gray scale threshold value as an increased gray scale value of the second sub-pixel.
[0018] The second image gray scale value is used to represent a gray scale value of the second sub-pixel in the first gaze point region, or is used to represent a gray scale value of the second sub-pixel in the second gaze point region.
[0019] In some embodiments, the plurality of gaze regions includes an edge region, the edge region being a region adjacent to a center region, the center region being a region of a center of the gaze point position; and the processor is specifically configured to: for a plurality of sub-pixels in the edge region, reduce a gray scale value of a sub-pixel in the plurality of sub-pixels that is in a transition region.
[0020] reduce the gray scale value of the third sub-pixel based on a region proportion of the third sub-pixel and a third image gray scale value of the third sub-pixel; the third image gray scale value is used to represent an image gray scale value of the third sub-pixel in the first gaze point region, or is used to represent an image gray scale value of the third sub-pixel in the second gaze point region.
[0021] In some embodiments, the processor is further configured to: determine the region proportion of the third sub-pixel based on a position of a center point of the third sub-pixel in the target gaze point region and a width of the third sub-pixel.
[0022] The third sub-pixel is any one of the plurality of sub-pixels in the edge region that is in the transition region; and the region proportion of the third sub-pixel is used to represent a proportion of the third sub-pixel in the first gaze point region, or is used to represent a proportion of the third sub-pixel in the second gaze point region.
[0023] In some embodiments, the processor is specifically configured to:
[0024] reduce the gray scale value of the third sub-pixel based on the proportion of the third sub-pixel in the first gaze point region, the proportion of the third sub-pixel in the second gaze point region, and a gray scale value of the third sub-pixel in the first gaze point region; or
[0025] reduce the gray scale value of the third sub-pixel based on the proportion of the third sub-pixel in the first gaze point region, the proportion of the third sub-pixel in the second gaze point region, and a gray scale value of the third sub-pixel in the second gaze point region.
[0026] In some embodiments, the processor is specifically configured to:
[0027] The gray scale value of the third sub-pixel is reduced based on a first gray scale value of the third sub-pixel in the first gaze point region and a second gray scale value of the third sub-pixel in the second gaze point region.
[0028] The first gray scale value is determined based on a proportion of the third sub-pixel in the first gaze point region and an image gray scale value of the first gaze point region; and the second gray scale value is determined based on a proportion of the third sub-pixel in the second gaze point region and an image gray scale value of the second gaze point region.
[0029] In some embodiments, the processor is further configured to perform black taking processing on the gray scale value of the sub-pixel to reduce the gray scale value of the sub-pixel.
[0030] The sub-pixel is the first sub-pixel or the third sub-pixel, and the first sub-pixel is any one of the plurality of sub-pixels in the center region and located in the transition region; and the third sub-pixel is any one of the plurality of sub-pixels in the edge region and located in the transition region.
[0031] In some embodiments, the processor is further configured to increase the coverage range of the transition region and / or reduce the coverage range of the non-transition region.
[0032] In some embodiments, the position of the center point of the target sub-pixel in the target gaze point region can be determined by: determining the target gaze point region according to the gaze point position; and determining the position of the center point of the target sub-pixel in the target gaze point region based on the position of the center sub-pixel in the row where the target sub-pixel is located.
[0033] The target sub-pixel is any one of the first sub-pixel, the second sub-pixel, and the third sub-pixel; the first sub-pixel is any one of the plurality of sub-pixels in the center region and located in the transition region; the second sub-pixel is any one of the plurality of sub-pixels in the center region and located in the non-transition region; and the third sub-pixel is any one of the plurality of sub-pixels in the edge region and located in the transition region.
[0034] In some embodiments, the processor is specifically configured to: obtain the width of the target gaze point region; determine the width of the second region in the row where the target sub-pixel is located based on the width of the target gaze point region and the position of the center sub-pixel; and then determine the position of the center point of the target sub-pixel in the target gaze point region according to the width of the second region.
[0035] The second region is an incomplete region on the left side of the row where the target sub-pixel is located.
[0036] In some embodiments, the processor is further configured to: obtain an offset between the center sub-pixel in the row where the target sub-pixel is located and the center point of the display panel; and determine the position of the center sub-pixel in the row where the target sub-pixel is located based on the offset and the pixel width.
[0037] In some embodiments, the plurality of gaze regions comprises a peripheral region, the peripheral region being a region other than the central region and the edge region; the central region being a region of a center of the gaze point position, and the edge region being a region adjacent to the central region; and the processor is specifically configured to: for a plurality of sub-pixels in the peripheral region, not performing the adjustment control.
[0038] In some embodiments, the display device further comprises a prism disposed above the display panel; and the processor is further configured to: determine a placement position of the prism based on a device parameter of the display device.
[0039] In some embodiments, the device parameter of the display device comprises at least two of: a horizontal aperture of the prism; a camber height of the prism; a distance between the prism and the display panel; a number of sub-pixels of the display panel covered by the prism; and a width of the sub-pixels of the display panel.
[0040] In another aspect, a gray scale control method is provided, applied to a display device, the display device comprising a display panel and a processor; the method comprising: determining a plurality of gaze regions corresponding to the display panel based on a gaze point position of a target user in the display panel, and for each gaze region in the plurality of gaze regions, controlling a gray scale value of a sub-pixel in the gaze region based on a control strategy corresponding to the gaze region.
[0041] In some embodiments, the control strategy corresponding to at least two gaze regions in the plurality of gaze regions is different.
[0042] In some embodiments, the display panel corresponds to a plurality of gaze points, and one gaze point corresponds to one region, and each gaze point corresponds to a region comprising a transition region and a non-transition region.
[0043] In some embodiments, the plurality of gaze points are viewpoints of the target user gazing at the display panel through different angles; the transition region is a region between critical lines of regions corresponding to any two gaze points, and the non-transition region is a region other than the transition region.
[0044] In some embodiments, based on the gaze point position, a target gaze point region is determined, the target gaze point region being a region in the plurality of gaze point regions that has an influence on the gray scale value of the sub-pixel; the target gaze point region comprises a first gaze point region and a second gaze point region, one of the first gaze point region and the second gaze point region being a region corresponding to the gaze point position, and the other being a region adjacent to the region corresponding to the gaze point position.
[0045] In some embodiments, the plurality of gaze regions comprises a center region, the center region being a region centered on the gaze point position; and the controlling, for each gaze region of the plurality of gaze regions, the gray scale values of the sub-pixels in the gaze region based on the control strategy corresponding to the gaze region comprises: for the plurality of sub-pixels in the center region, reducing the gray scale values of the sub-pixels in the transition region among the plurality of sub-pixels, and / or increasing the gray scale values of the sub-pixels in the non-transition region among the plurality of sub-pixels.
[0046] In some embodiments, the reducing, for the plurality of sub-pixels in the center region, the gray scale values of the sub-pixels in the transition region among the plurality of sub-pixels comprises: determining a gray scale coefficient of a first sub-pixel based on a position of a center point of the first sub-pixel in the target gaze point region and a width of the first region, and reducing a gray scale value of the first sub-pixel based on the gray scale coefficient of the first sub-pixel and a first image gray scale value of the first sub-pixel in the target gaze point region.
[0047] wherein the first image gray scale value is used to represent a gray scale value of the first sub-pixel in the first gaze point region, or is used to represent a gray scale value of the first sub-pixel in the second gaze point region; the first sub-pixel is any one of the plurality of sub-pixels in the center region in the transition region; and the first region is a partial region in the target gaze point region.
[0048] In some embodiments, the reducing, for the plurality of sub-pixels in the center region, the gray scale values of the sub-pixels in the transition region among the plurality of sub-pixels comprises: performing black processing on a gray scale value of a first sub-pixel to reduce the gray scale value of the first sub-pixel.
[0049] wherein the first sub-pixel is any one of the plurality of sub-pixels in the center region in the transition region.
[0050] In some embodiments, the increasing, for the plurality of sub-pixels in the center region, the gray scale values of the sub-pixels in the non-transition region among the plurality of sub-pixels comprises: increasing a gray scale value of a second sub-pixel based on a position of a center point of the second sub-pixel in the target gaze point region and a width of the target gaze point region;
[0051] wherein the second sub-pixel is any one of the plurality of sub-pixels in the center region in the non-transition region.
[0052] In some embodiments, the adjusting the gray scale value of the second sub-pixel, and increasing the gray scale value of the second sub-pixel, based on the position of the center point of the second sub-pixel in the target gaze point region and the width of the target gaze point region, comprises: determining a gray scale coefficient of the second sub-pixel based on the position of the center point of the second sub-pixel in the target gaze point region and the width of the target gaze point region; determining the gray scale value of the second sub-pixel based on the gray scale coefficient of the second sub-pixel and the second image gray scale value of the second sub-pixel in the target gaze point region; and taking the minimum value between the gray scale value of the second sub-pixel and the gray scale threshold of the plurality of sub-pixels as the increased gray scale value of the second sub-pixel.
[0053] The second image gray scale value is used to represent the gray scale value of the second sub-pixel in the first gaze point region, or is used to represent the gray scale value of the second sub-pixel in the second gaze point region.
[0054] In some embodiments, the plurality of gaze regions comprises an edge region, the edge region being a region adjacent to a center region; the center region being a region of the center of the gaze point position; and for each gaze region in the plurality of gaze regions, the gray scale value of the sub-pixel in the gaze region is controlled based on the control strategy corresponding to the gaze region, comprising: for the plurality of sub-pixels in the edge region, reducing the gray scale value of the sub-pixel in the transition region in the plurality of sub-pixels.
[0055] In some embodiments, for the plurality of sub-pixels in the edge region, the gray scale value of the sub-pixel in the transition region in the plurality of sub-pixels is reduced, comprising: reducing the gray scale value of the third sub-pixel based on the area proportion of the third sub-pixel and the third image gray scale value of the third sub-pixel.
[0056] The third image gray scale value is used to represent the image gray scale value of the third sub-pixel in the first gaze point region, or is used to represent the image gray scale value of the third sub-pixel in the second gaze point region.
[0057] In some embodiments, the area proportion of the third sub-pixel is determined based on the position of the center point of the third sub-pixel in the target gaze point region and the width of the third sub-pixel.
[0058] The third sub-pixel is any one of the plurality of sub-pixels in the edge region in the transition region; and the area proportion of the third sub-pixel is used to represent the proportion of the third sub-pixel in the first gaze point region, or is used to represent the proportion of the third sub-pixel in the second gaze point region.
[0059] In some embodiments, determining the gray scale value of the third sub-pixel after reduction based on the area proportion of the third sub-pixel and the image gray scale value of the third sub-pixel comprises: reducing the gray scale value of the third sub-pixel based on the proportion of the third sub-pixel in the first gaze point region, the proportion of the third sub-pixel in the second gaze point region, and the gray scale value of the third sub-pixel in the first gaze point region; or,
[0060] reducing the gray scale value of the third sub-pixel based on the proportion of the third sub-pixel in the first gaze point region, the proportion of the third sub-pixel in the second gaze point region, and the gray scale value of the third sub-pixel in the second gaze point region.
[0061] In some embodiments, determining the gray scale value of the third sub-pixel after reduction based on the area proportion of the third sub-pixel and the image gray scale value of the third sub-pixel comprises: reducing the gray scale value of the third sub-pixel based on the first gray scale value of the third sub-pixel in the first gaze point region and the second gray scale value of the third sub-pixel in the second gaze point region.
[0062] wherein the first gray scale value is determined based on the proportion of the third sub-pixel in the first gaze point region and the image gray scale value of the third sub-pixel in the first gaze point region; and the second gray scale value is determined based on the proportion of the third sub-pixel in the second gaze point region and the image gray scale value of the third sub-pixel in the second gaze point region.
[0063] In some embodiments, for the plurality of sub-pixels in the edge region, reducing the gray scale value of the sub-pixel in the transition region among the plurality of sub-pixels comprises: performing black processing on the gray scale value of the third sub-pixel to reduce the gray scale value of the third sub-pixel; the third sub-pixel is any one of the plurality of sub-pixels in the edge region that is in the transition region.
[0064] In some embodiments, the method further comprises: increasing the coverage range of the transition region, and / or, reducing the coverage range of the non-transition region.
[0065] In some embodiments, the position of the center point of the sub-pixel in the target gaze point region can be determined by: determining the target gaze point region according to the gaze point position; and determining the position of the center point of the target sub-pixel in the target gaze point region based on the position of the center sub-pixel of the row in which the target sub-pixel is located.
[0066] wherein the target sub-pixel is any one of the first sub-pixel, the second sub-pixel, and the third sub-pixel; the first sub-pixel is any one of the plurality of sub-pixels in the center region that is in the transition region; the second sub-pixel is any one of the plurality of sub-pixels in the center region that is in the non-transition region; and the third sub-pixel is any one of the plurality of sub-pixels in the edge region that is in the transition region.
[0067] In some embodiments, the determining the position of the center point of the target sub-pixel in the target gaze point region based on the position of the center sub-pixel in the row in which the target sub-pixel is located comprises: obtaining a width of the target gaze point region, and determining a width of a second region of the row in which the target sub-pixel is located based on the width of the target gaze point region and the position of the center sub-pixel; and then determining the position of the center point of the target sub-pixel in the target gaze point region according to the width of the second region.
[0068] The second region is an incomplete region on the left side of the row in which the target sub-pixel is located.
[0069] In some embodiments, the method further comprises: obtaining an offset between the center sub-pixel in the row in which the target sub-pixel is located and the center point of the display panel; and determining the position of the center sub-pixel in the row in which the target sub-pixel is located based on the offset and the width of the sub-pixel.
[0070] In some embodiments, the plurality of gaze regions comprises a peripheral region, the peripheral region being a region other than the center region and the edge region; the center region being a region at the center of the position of the gaze point; and the edge region being a region adjacent to the center region; and the controlling the gray scale value of the sub-pixel in each gaze region of the plurality of gaze regions based on the control strategy corresponding to the gaze region comprises: for the plurality of sub-pixels in the peripheral region, no adjustment control is performed.
[0071] In some embodiments, the display device further comprises a prism disposed above the display panel; and the method further comprises: determining a placement position of the prism based on a device parameter of the display device.
[0072] In some embodiments, the device parameter of the display device comprises at least two of the following: a horizontal aperture of the prism; a camber height of the prism; a distance between the prism and the display panel; a number of sub-pixels of the display panel covered by the prism; and a width of the sub-pixel of the display panel.
[0073] In another aspect, a gray scale control device is provided, comprising a processor and a communication interface. The communication interface and the processor are coupled. The processor is configured to run a computer program or instructions to implement the gray scale control method of the first aspect or any of the embodiments of the first aspect.
[0074] In yet another aspect, a computer readable storage medium is provided. The computer readable storage medium stores computer program instructions, which, when executed on a computer (e.g., a receiving node), cause the computer to perform the gray scale control method of any of the above embodiments.
[0075] In yet another aspect, a computer program product is provided. The computer program product comprises computer program instructions, which, when executed on a computer (e.g., a receiving node), cause the computer to perform the gray scale control method of any of the above embodiments.
[0076] In yet another aspect, a computer program is provided. When the computer program is executed on a computer (e.g., a receiving node), the computer program causes the computer to perform the gray scale control method of any of the above embodiments.
[0077] Based on the above technical solution, the processor in the display device can determine a plurality of different gaze areas corresponding to the display panel in real time for the gaze point position of the target user, and flexibly adjust and control the gray scale values of the sub-pixels in different gaze areas. That is, different control strategies are adopted for different gaze areas, effectively solving the problem of limited visual range of naked-eye 3D viewers, while reducing crosstalk to a certain extent and improving 3D viewing effect, wherein the different control strategies affect the overall effect of the picture, thereby improving the user's perception. BRIEF DESCRIPTION OF DRAWINGS
[0078] In order to more clearly illustrate the technical solutions in the present disclosure, the following will briefly introduce the drawings needed to be used in some embodiments of the present disclosure. Obviously, the drawings described in the following description are only some of the drawings of the present disclosure, and other drawings can also be obtained by those skilled in the art according to these drawings. In addition, the drawings in the following description can be regarded as schematic diagrams, and are not limited to the actual size, actual process, actual timing of signals, etc. of the products involved in the embodiments of the present disclosure.
[0079] FIG. 1 is a schematic diagram of actual scene 3D effect generation according to some embodiments;
[0080] FIG. 2 is a schematic diagram of the synthesis of left and right views according to some embodiments;
[0081] FIG. 3 is a schematic diagram of image ghosting phenomenon according to some embodiments;
[0082] FIG. 4 is a structural diagram of a display device according to some embodiments;
[0083] FIG. 5 is a structural diagram of a display device according to some other embodiments;
[0084] FIG. 6 is a flowchart of a gray scale control method according to some embodiments;
[0085] FIG. 7 is a schematic diagram of a plurality of gaze areas according to some embodiments;
[0086] FIG. 8 is a schematic diagram of a region corresponding to a gaze point according to some embodiments;
[0087] FIG. 9a is a schematic diagram of a plurality of gaze areas combined with a region corresponding to a gaze point according to some embodiments;
[0088] FIG. 9b is a schematic diagram of a plurality of gaze regions in combination with regions corresponding to gaze points according to some embodiments;
[0089] FIG. 10 is a schematic diagram of a target gaze point region according to some embodiments;
[0090] FIG. 11 is a schematic diagram of a gray scale coefficient curve according to some embodiments;
[0091] FIG. 12 is a scenario diagram of a gray scale control method according to some embodiments;
[0092] FIG. 13 is a scenario diagram of a gray scale control method according to some embodiments;
[0093] FIG. 14 is a scenario diagram of a gray scale control method according to some embodiments;
[0094] FIG. 15 is a schematic diagram of a target gaze point region according to some embodiments;
[0095] FIG. 16 is a scenario diagram of a gray scale control method according to some embodiments;
[0096] FIG. 17 is a schematic diagram of regions according to some embodiments;
[0097] FIG. 18 is a schematic diagram of a target gaze point region according to some embodiments;
[0098] FIG. 19 is a schematic diagram of a target gaze point region according to some embodiments;
[0099] FIG. 20 is a scenario diagram of a prism according to some embodiments;
[0100] FIG. 21 is a scenario diagram of a rastering algorithm according to some embodiments;
[0101] FIG. 22 is a schematic diagram of a target gaze point region according to some embodiments;
[0102] FIG. 23 is a scenario diagram of a prism according to some embodiments;
[0103] FIG. 24 is a scenario diagram of a prism according to some embodiments;
[0104] FIG. 25 is a flowchart of a gray scale control method according to some embodiments;
[0105] FIG. 26 is a block diagram of a gray scale control device according to some embodiments;
[0106] FIG. 27 is a block diagram of a gray scale control device according to some embodiments. DETAILED DESCRIPTION
[0107] In the following, the technical solutions in the embodiments of the present disclosure will be described clearly and completely with reference to the drawings. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all the embodiments. Based on the embodiments provided by the present disclosure, all other embodiments obtained by a person of ordinary skill in the art belong to the scope of protection of the present disclosure.
[0108] Unless otherwise required by context, the term "comprise" and its other forms such as "comprises" and "comprising" are to be construed as open, inclusive, meaning that "comprising" does not exclude additional, unrecited elements. In the description of the specification, the terms "one embodiment", "some embodiments", "exemplary embodiments", "example", "specific example" or "some examples" are intended to mean that the specific feature, structure, material or characteristic being described in connection with this embodiment or example includes in at least one embodiment or example of the present disclosure. The illustrative representations of the above terms do not necessarily refer to the same embodiment or example. In addition, a specific feature, structure, material or characteristic can be included in any suitable manner in any one or more embodiments or examples.
[0109] In the following, the terms "first", "second" are only used for description purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined with "first", "second" can explicitly or implicitly include one or more of the features. In the description of the embodiments of the present disclosure, unless otherwise specified, the meaning of "a plurality of" is two or more.
[0110] "A, B and C at least one of" has the same meaning as "at least one of A, B or C", and includes the following combinations of A, B and C: only A, only B, only C, a combination of A and B, a combination of A and C, a combination of B and C, and a combination of A, B and C.
[0111] "A and / or B" includes the following three combinations: only A, only B, and a combination of A and B.
[0112] As used herein, the term "if' is, optionally, interpreted as meaning "when" or "while" or "in response to a determination" or "in response to a detection of," depending on the context. Similarly, the phrase "if it is determined" or "if [a stated condition or event] is detected" is, optionally, interpreted as meaning "upon it being determined" or "in response to a determination," or "upon detecting [a stated condition or event]," or "in response to the detection of [the stated condition or event]," depending on the context.
[0113] The use of "adapted to" or "configured to" herein means open and inclusive language that does not exclude devices that are adapted to or configured to perform additional tasks or steps.
[0114] Additionally, the use of "based on" means open and inclusive, as a process, step, calculation, or other action that is "based on" one or more conditions or values can in practice be based on additional conditions or values beyond those that are stated.
[0115] As used herein, "about," "approximately," or "around" includes the recited value and the average value within an acceptable range of deviation from the particular value, as determined by one of ordinary skill in the art considering the measurement in question and the error in measuring the particular quantity (i.e., the limitations of the measurement system).
[0116] As used herein, "equal" includes the recited condition and conditions that approximate the recited condition, the approximation being within an acceptable range of deviation, where the acceptable range of deviation is as determined by one of ordinary skill in the art considering the measurement in question and the error in measuring the particular quantity (i.e., the limitations of the measurement system). "Equal" includes absolute equality and approximate equality, where the acceptable range of deviation for approximate equality can be, for example, a difference between the two of less than or equal to 5% of either.
[0117] Hereinafter, terms related to embodiments of the present application are explained to facilitate understanding of the reader.
[0118] 1. The naked eye 3D technology aims to provide a display technology that can realize three-dimensional visual effect without auxiliary equipment. With the continuous progress and upgrading of technology, this naked eye 3D technology can be widely used in the field of consumer electronics products, especially in mainstream devices such as smart phones and televisions, and promote further innovation and development in related professional fields.
[0119] This naked eye 3D technology, through the optimization of the structure and algorithm of the display system, can provide users with an unprecedented immersive experience. In movies, games and virtual reality scenes, this technology can create a more realistic three-dimensional visual effect, making the audience feel as if they are in the story scene, greatly enhancing the interactivity and realism of the entertainment experience.
[0120] In addition, in the field of advertising dissemination, the naked eye 3D technology of the present application can attract more attention and improve the dissemination effect and memory point of the advertisement. At the same time, for professional training, the technology can simulate a more realistic operation scene to help students better master skills and knowledge and improve training efficiency and quality.
[0121] However, naked eye 3D technology still needs to overcome many technical barriers. Specifically, its image processing capability needs to be further optimized to ensure that clear and stable three-dimensional images can be presented at different viewing angles and distances, providing users with more realistic naked eye 3D effects and more immersive user experiences, making the technology have great market potential in entertainment, advertising, medical and education.
[0122] 2. Display principle of naked eye 3D technology. The human eye has the ability to perceive depth, which mainly depends on binocular disparity. Binocular disparity refers to the different viewing angles of the two eyes when observing the same object, resulting in slightly different images. After the brain fuses and processes these different images, we can perceive the depth and three-dimensionality of objects in space. As shown in Figure 1, in naked eye 3D display devices, most use the light splitting principle of prisms or gratings to transmit different images viewed by the left and right eyes to the corresponding eyes, to achieve the effect of naked eye 3D.
[0123] As shown in Figure 2, the current naked eye 3D technology mainly uses slit liquid crystal grating and cylindrical prism.
[0124] (1) Slit liquid crystal grating is a method that adds a grating in front of the screen to block the screen light, so that the image viewed by the left eye is displayed on the liquid crystal screen, and the opaque stripes will block the right eye. Similarly, the image that should be viewed by the right eye is displayed on the liquid crystal screen, and the opaque stripes will block the left eye. Then, using binocular disparity, a 3D effect can be achieved. However, due to the blocking of screen light, the picture brightness is only 1 / 4 of that of a 2D screen.
[0125] (2) Cylindrical prism is a method that uses the refraction principle of prisms to project the corresponding pixel points of the left and right eyes into the left and right eyes, respectively, to achieve image separation, so that the observer can see a 3D stereoscopic image. The biggest advantage of this technology compared to the slit grating technology is that the prism does not block light, so the picture brightness is not affected, and the 3D display effect is better.
[0126] 3. Crosstalk problem. The crosstalk problem in naked-eye 3D display is mainly caused by the arrangement method, optical element design and manufacturing process capability and the like. In actual application, the prism is usually placed in a tilted manner, so that the arrangement of the pixels on the 2D display device is consistent with the edge angle. In actual application, only the prism and other light splitting elements cannot completely achieve 100% light splitting effect, and the arrangement algorithm cannot completely divide all sub-pixels into the left view or the right view, that is, the image originally entering the left eye will have part of the brightness entering the right eye, thereby causing crosstalk.
[0127] Among them, the crosstalk rate is an important evaluation index of the naked-eye 3D effect quality, which is used to measure the brightness cross between the left and right eye images. When the crosstalk rate reaches a certain degree, the ghosting phenomenon can be perceived. As shown in FIG. 3, it is generally considered that when the crosstalk rate is greater than 2%, the ghosting phenomenon can be perceived, and when the crosstalk rate exceeds 10%, the obvious ghosting phenomenon will occur. Therefore, the occurrence of crosstalk will affect the actual viewing experience of naked-eye 3D.
[0128] 4. Multi-gaze point technology refers to dividing a single 3D image into multiple images with different viewing angles through specific optical devices or technical processing means, so that the audience can obtain a real stereoscopic effect at different viewing positions and angles. That is, through optical devices or technical processing, such as a light-transmitting prism (cylindrical prism), the 3D image is divided into multiple viewing angles or gaze points, and each gaze point corresponds to a different viewing position and angle.
[0129] The above gives a brief introduction of the related technology of the present application.
[0130] The naked-eye 3D technology can optimize the design of the prism and other light splitting elements to improve the light splitting effect in reducing the crosstalk rate, and at the same time can ensure the accuracy of eye tracking to improve the viewing experience and reduce crosstalk.
[0131] The arrangement algorithm in the traditional naked-eye 3D technology generally performs black insertion processing or white insertion processing on the sub-pixels in the transition area to reduce the crosstalk problem. However, the current single black insertion processing or white insertion processing on the sub-pixels will cause image distortion or increased crosstalk effect. Therefore, how to reduce the crosstalk rate has become a key technical problem to be solved in the field of naked-eye 3D display.
[0132] In view of this, the display device provided in the embodiments of the present application can determine a plurality of different gaze areas corresponding to the display panel in real time for the gaze point position of a target user, and flexibly adjust and control the gray scale values of the sub-pixels in different gaze areas. That is, different control strategies are adopted for different gaze areas, effectively solving the problem of limited visual range of naked-eye 3D viewers, while reducing crosstalk to a certain extent and improving 3D viewing effect, wherein the different control strategies affect the overall effect of the picture, thereby improving the user's viewing experience.
[0133] The embodiments of the present application will be described in detail below with reference to the accompanying drawings.
[0134] As shown in FIG. 4, FIG. 4 is a structural diagram of a display device 400 provided in the embodiments of the present application. The display device 400 can be a terminal device with a display panel, such as a television. The display device 400 can include a display panel 401, at least one processor 402, and a transceiver 403, and can further include a memory 404. The processor 402, the memory 404, and the transceiver 403 can be connected through a communication line.
[0135] In the embodiments of the present application, the display panel 401 is used to display images, and the display panel 401 corresponds to a plurality of periods, each period includes a plurality of gaze points, and each gaze point corresponds to an area. Each gaze point corresponds to an area, and each gaze point corresponds to a transition area and a non-transition area.
[0136] The transition area is the area between the critical lines of the areas corresponding to any two gaze points, and the non-transition area is the area other than the transition area.
[0137] In the embodiments of the application, the processor 402 can be a chip. The chip can include five categories of logic chips, storage chips, sensor chips, power supply chips and communication chips. Among them, the processor class mainly undertakes specific computing and control tasks in the system, such as microcontroller units (MCU), central processing units (CPU), graphics processing units (GPU), neural processing units (NPU) and the like. The storage class mainly undertakes the storage of data in the system, and some storage controller class chips, such as dynamic random access memory (DRAM), static random access memory (SRAM), flash eeprom memory (Flash) and the like. The sensing class mainly undertakes the collection, presentation and interaction of information in the system, such as input and output devices, some signal processing chips and the like. The communication class (wired and wireless) mainly undertakes the communication function of the chip in the system, such as some Ethernet chips, switching chips, wide and local area networks, point-to-point and ad hoc network chips, and auxiliary communication filtering, amplification, power and the like. Devices can belong to this category. The wireless fidelity (WiFi), Bluetooth, 5th generation mobile communication technology (5G) baseband, global positioning system (GPS), narrowband internet of things (NB-IoT), network card, switch and the like known to the public can be classified into this category.
[0138] Among them, the communication line can include a path for transmitting information between the above components.
[0139] The memory 404 can be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (RAM) or other type of dynamic storage device that can store information and instructions, an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disk storage, a magnetic disk storage or other magnetic storage devices, or any other medium capable of storing desired program code in the form of instructions or data structures and that can be accessed by a computer, but is not limited thereto.
[0140] In a possible design, the memory 404 can exist independently of the processor 402, that is, the memory 404 can be a memory external to the processor 402, and in this case, the memory 404 can be connected to the processor 402 through a communication line, used to store execution instructions or application program codes and controlled by the processor 402 to perform, to implement the network quality determination method provided in the embodiments of the present application. In another possible design, the memory 404 can also be integrated with the processor 402, that is, the memory 404 can be an internal memory of the processor 402, for example, the memory 404 is a cache, which can be used to temporarily store some data and instruction information, and the like.
[0141] As a realizable manner, the processor 402 can include one or more CPUs.
[0142] As shown in FIG. 5, FIG. 5 is a structural diagram of another display device provided in the embodiments of the present application. The display device can include an eye tracking module 501, a data transmission module 502, a display control module 503, and a prism grating module 504. The eye tracking module 501, the data transmission module 502, and the display control module 503 are connected through a communication network.
[0143] The eye tracking module 501 is configured to capture a gaze position at which a target user gazes at a display panel, and calculate and determine a coordinate of the gaze position, and send the coordinate to the data transmission module 502.
[0144] Exemplarily, the human eye tracking module 501 includes, but is not limited to, a binocular camera, a red-green-blue-depth camera (RGB-D camera), an infrared eye movement tracking camera, and the like. The human eye tracking module 501 can be installed at the top or the bottom of the display device to ensure that the human eye position and the movement direction of the eyeball of the target user can be directly captured.
[0145] In the embodiment of the present application, the data transmission module 502 can realize efficient and stable data transmission through various schemes such as SPI (Serial Peripheral Interface), USB (Universal Serial Bus), or PCIe (PCI Express, a high-speed serial computer expansion bus standard).
[0146] Specifically, the SPI interface can meet the application scenarios with extremely high requirements for data transmission timeliness due to its high real-time performance and high-speed data transmission capability; the USB interface becomes an ideal choice for transmitting a large amount of data due to its high bandwidth and flexible and convenient characteristics; and the PCIe interface, as a standard for connecting internal high-speed devices, has outstanding performance and exhibits significant advantages in the case of requiring extremely high data transmission rates.
[0147] Exemplarily, the data transmission module 502 can format the coordinates of the gaze position, i.e., the eyeball position coordinates (x, y, z), and encapsulate them into a standard data packet. Subsequently, a high-speed data bus (including but not limited to SPI, USB, PCIe, and the like) is used to establish a connection between the human eye tracking module 501 and the data transmission module 502. The data transmission module 502 can send the eyeball position coordinates (x, y, z) of the target user to the display control module 503 for subsequent processing. This design ensures low delay and high bandwidth in the data transmission process, thereby realizing accurate synchronization control of the camera real-time capturing of the eyeball coordinate position and the pixel arrangement of the display panel.
[0148] Further, the embodiment of the present application can realize real-time acquisition and transmission of accurate eyeball coordinate information to the display panel through the cooperative work of the modules, and further realize the synchronous adjustment of the display panel. This process not only improves the efficiency and accuracy of data transmission, but also ensures the stability and reliability of the whole human eye tracking and display device.
[0149] In the embodiment of the present application, the display control module 503 receives the eyeball position coordinates (x, y, z) of the target user sent by the data transmission module 502, and can realize dynamic adjustment of the pixel gray value on the display panel based on the eyeball position coordinates and the screen coordinate data of the gaze point through a transition processing method, thereby ensuring that the user can observe the best 3D visual effect at different positions.
[0150] Specifically, the display control module 503 receives the eye position coordinates (including but not limited to position information on the x, y, and z axes) provided by the human eye tracking module 501 and the calculated gaze point coordinate data on the display panel. Subsequently, the display control module 503 uses a transition processing method to accurately and smoothly adjust the gray scale values of the corresponding pixels on the display panel according to the real-time changes of the eye position coordinates and the gaze point screen coordinates.
[0151] The display control module 503 not only considers the continuity and smoothness of eye movement, but also fully combines the visual perception characteristics of the human eye to ensure that a natural and coherent visual effect is produced when adjusting the pixel gray scale values. In this way, the display control module 503 can dynamically optimize the image content on the display panel, allowing users to achieve the best 3D viewing experience even at different viewing positions.
[0152] Further, the display control module 503 technical solution proposed in the embodiments of the present application also has high flexibility and scalability, which can adapt to different types of display panels and 3D display technologies, and thus is widely applied to various 3D display devices and systems to provide users with more realistic and immersive visual experiences.
[0153] In the embodiments of the present application, the light splitting function of the prism grating module 504 can enable the target user to view the best 3D image effect at any angle. That is, the 3D display technology using cylindrical prisms can be used in the embodiments of the present application, aiming to provide stereoscopic and high-quality 3D visual experience for the target user by accurately controlling the separation and guidance of light.
[0154] Specifically, the 3D display technology uses the special optical properties of cylindrical prisms to separate the light from the display panel into different directions. During this process, the cylindrical prisms are cleverly installed at the front end of the display panel, and the internal lens structure can accurately regulate the light emitted by each pixel to ensure that the light is guided at a predetermined angle. As a result, the left eye and the right eye can respectively receive specially processed image information that is different, thereby forming a 3D stereoscopic effect in the brain.
[0155] To further improve the 3D display effect, the embodiments of the present application also propose a cylindrical prism installation method. Specifically, the cylindrical prisms are placed at an angle relative to the display panel. This design not only balances the loss of image resolution in the horizontal and vertical directions caused by parallax to some extent, so that the 3D image can maintain high clarity in all directions; at the same time, it can also effectively reduce the moire phenomenon and avoid the appearance of interfering stripes in the image, thereby further improving the user's visual experience.
[0156] It should be noted that the display device described in the embodiments of the present application is used to more clearly illustrate the technical solutions of the embodiments of the present application, and does not constitute a limitation on the technical solutions provided by the embodiments of the present application. Those skilled in the art can know that, with the evolution of display devices and the appearance of other display devices, the technical solutions provided by the embodiments of the present application are also applicable to similar technical problems.
[0157] The methods in the following embodiments can be implemented in the display device 400 with the hardware structure described above. The methods of the embodiments of the present application are described.
[0158] The gray scale control method provided by the embodiments of the present application will be described in detail below with reference to the accompanying drawings.
[0159] The embodiments of the present application can control and adjust the gray scale values of the sub-pixels to avoid the crosstalk problem. A gray scale control method provided by the embodiments of the present application will be described in detail below with reference to the accompanying drawings, as shown in FIG. 6. The gray scale compensation method can include S601-S602. S601 can also be referred to as a "determining a plurality of gaze regions" process, and S602 can also be referred to as a "controlling the sub-pixels of the corresponding gaze region according to different control strategies" process. S601-S602 will be described in detail below.
[0160] S601, based on the gaze point position of the target user in the display panel, determining a plurality of gaze regions corresponding to the display panel.
[0161] In the embodiments of the present application, the display device can obtain the gaze point position (gaze point coordinates) of the target user in real time through the human eye tracking module, and then the display device can divide the display panel into a plurality of gaze regions according to the gaze point position and the preset distance.
[0162] Exemplarily, the plurality of gaze regions include but are not limited to a center region, an edge region, and a peripheral region. The center region is a region centered on the gaze point position; the edge region is a region adjacent to the center region; the center region is a region centered on the gaze point position; and the peripheral region is a region other than the center region and the edge region.
[0163] For example, as shown in FIG. 7, a center region in the shape of a rectangle is obtained by expanding a certain preset distance (radius r1) to both sides of the gaze point position (A point) of the target user. Alternatively, a center region in the shape of a circle is obtained by expanding a distance of radius r1 to the periphery of the gaze point position (A point). The center region is an important region for the target user's gaze, and since the fovea is the most sensitive area for visual perception on the retina, it is responsible for high-resolution image processing, and the target user is also most sensitive to the visual effect in the center region. Correspondingly, the display device has the highest requirement for visual processing of the center region.
[0164] Further, the display device continues to expand a certain preset distance (radius r2) to both sides on the basis of the central region to obtain a rectangular edge region. Alternatively, a circular edge region is obtained by expanding a distance of radius r2 from the gaze point position (point A) as the center.
[0165] Further, the peripheral region can be a region outside the radius r2, which is usually not directly gazed at, and the corresponding visual demand is the lowest.
[0166] Specifically, the display device can dynamically adjust the gray scale values of the sub-pixels in the multiple gaze regions according to the size and resolution of the actual display panel, so as to apply different transition processing schemes in different regions and optimize the naked-eye 3D display effect.
[0167] S602, for each gaze region in the multiple gaze regions, controlling the gray scale values of the sub-pixels in the gaze region based on the control strategy corresponding to the gaze region.
[0168] Among them, the control strategies corresponding to at least two gaze regions in the multiple gaze regions are different.
[0169] In the embodiment of the present application, the display panel corresponds to multiple periods, a period includes multiple gaze points, and one gaze point corresponds to one region. The region corresponding to each gaze point includes a transition region and a non-transition region.
[0170] Among them, the transition region is the region between the critical lines of the regions corresponding to any two gaze points. It can be understood that when the center point of a certain sub-pixel is in the transition region between the critical lines of the regions corresponding to two gaze points, the sub-pixel will span the regions corresponding to the two gaze points.
[0171] In the embodiment of the present application, the non-transition region is a region other than the transition region, and the non-transition region is used to represent that a certain sub-pixel is entirely in the region corresponding to a gaze point. That is to say, the sub-pixel does not span the regions corresponding to two gaze points.
[0172] Exemplarily, as shown in FIG. 8, the display panel corresponds to multiple periods, and a period includes multiple gaze points, such as gaze point 1, gaze point 2, gaze point 3, gaze point 4, and gaze point 5. Each gaze point corresponds to a region, and the region corresponding to each gaze point includes a transition region and a non-transition region. For example, the transition region is the region of the shaded part in FIG. 8, and the non-transition region is the region of the non-shaded part in FIG. 8.
[0173] Meanwhile, there will be transition areas and non-transition areas in the central area, the edge area and the peripheral area, that is, the central area, the edge area and the peripheral area all coincide with the area corresponding to the gaze point.
[0174] For example, FIG. 7 and FIG. 8 are combined to form the area diagram as shown in FIG. 9a, taking gaze point 1 and gaze point 2 as an example. Taking the gaze point position (point A) of the target user as the center, a certain preset distance (radius r1) is expanded to the two sides to obtain the central area, and on the basis of the central area, a certain preset distance (radius r2) is further expanded to the two sides to obtain the edge area. Correspondingly, the peripheral area can be the area outside the radius r2.
[0175] As can be seen from FIG. 9a, the gaze point position (point A) is in the area corresponding to the gaze point 1, and since the above-mentioned central area spans the areas corresponding to the gaze point 1 and the gaze point 2, the central area includes the transition area (shaded part) and the non-transition area (non-shaded part). In this FIG. 9a, the edge area does not include the transition area and the non-transition area, and the embodiments of the present application only give an example for easy understanding. In actual scenarios, the edge area can also include the transition area and the non-transition area, which is not limited by the embodiments of the present application.
[0176] For another example, FIG. 7 and FIG. 8 are combined to form the area diagram as shown in FIG. 9b, the display panel corresponds to multiple periods, and one period includes multiple gaze points, such as gaze point 1, gaze point 2, gaze point 3, gaze point 4 and gaze point 5. Taking the gaze point position (point A) of the target user as the center, a certain preset distance (radius r1) is expanded to the two sides to obtain the central area, and on the basis of the central area, a certain preset distance (radius r2) is further expanded to the two sides to obtain the edge area. Correspondingly, the peripheral area can be the area outside the radius r2. It should be understood that different control strategies will be adopted for the B point in the central area, the C point in the edge area and the D point in the peripheral area to adjust the gray scale value.
[0177] The control strategy for the central area in the embodiments of the present application is as follows:
[0178] In the embodiments of the present application, for the multiple sub-pixels in the central area, the gray scale value of the sub-pixel in the transition area is reduced and / or the gray scale value of the sub-pixel in the non-transition area is increased.
[0179] Specifically, for the multiple sub-pixels in the central area, the processing manner of the display device can be any one of the following manner (1), manner (2), manner (3), manner (4) and manner (5).
[0180] Manner (1): for the plurality of sub-pixels in the center region, the gray scale value of the sub-pixel in the transition region among the plurality of sub-pixels is reduced. Illustratively, based on the position of the center point of the first sub-pixel in the target gaze point region and the width of the first region, the gray scale coefficient of the first sub-pixel is determined, and based on the gray scale coefficient of the first sub-pixel and the first image gray scale value of the first sub-pixel in the target gaze point region, the gray scale value of the first sub-pixel is reduced.
[0181] wherein the first sub-pixel is any sub-pixel in the transition region among the plurality of sub-pixels in the center region. The first image gray scale value is used to represent the gray scale value of the first sub-pixel in the first gaze point region, or is used to represent the gray scale value of the first sub-pixel in the second gaze point region.
[0182] In some embodiments, the target gaze point region is a region among the plurality of gaze point regions that has an influence on the gray scale value of the first sub-pixel.
[0183] Illustratively, the target gaze point region includes the first gaze point region and the second gaze point region, one of the first gaze point region and the second gaze point region is the region corresponding to the gaze point position, and the other is the adjacent region of the region corresponding to the gaze point position. That is, the display device can determine the target gaze point region through the gaze point position.
[0184] For example, in combination with FIG. 9a, taking the gaze point position (point A) as an example, the gaze point position (point A) is in the region corresponding to gaze point 1, then the region corresponding to gaze point 1 is the first gaze point region, and correspondingly, the region corresponding to gaze point 2 adjacent to the first gaze point region is the second gaze point region.
[0185] For another example, assuming that the gaze point position (point A) is in the region corresponding to gaze point 2, then the region corresponding to gaze point 2 is the first gaze point region. Taking the center line of the region corresponding to gaze point 2 as a boundary, if the position of the gaze point position (point A) is in the left region of the region corresponding to gaze point 2, then the second gaze point region is the region corresponding to gaze point 1. It should be understood that at this time, the region corresponding to gaze point 1 and the region corresponding to gaze point 2 will have an influence on the gray scale value of the first sub-pixel.
[0186] If the position of the gaze point position (point A) is in the right region of the region corresponding to gaze point 2, then the second gaze point region is the region corresponding to gaze point 3, and at this time, the region corresponding to gaze point 2 and the region corresponding to gaze point 3 are the regions that have an influence on the gray scale value of the first sub-pixel.
[0187] For another example, as shown in FIG. 9b, taking the gaze point position (point A) as an example, the gaze point position (point A) is in the gaze point 4 corresponding area, and the gaze point 4 corresponding area is the first gaze point area. Taking the center line of the gaze point 4 corresponding area as a boundary line, if the gaze point position (point A) is in the left area of the gaze point 4 corresponding area, the second gaze point area is the gaze point 3 corresponding area. If the gaze point position (point A) is in the right area of the gaze point 4 corresponding area, the second gaze point area is the gaze point 5 corresponding area. As shown in FIG. 9b, the second gaze point area is the gaze point 5 corresponding area.
[0188] For another example, the display device can determine the target gaze point area according to the position of the sub-pixel. The sub-pixel can be a first sub-pixel, a second sub-pixel, or a third sub-pixel.
[0189] For example, as shown in FIG. 9b, taking point B as an example. The point B can be understood as a first sub-pixel. The point B is in the gaze point 4 corresponding area, and the gaze point 4 corresponding area is the first gaze point area. Taking the center line of the gaze point 4 corresponding area as a boundary line, if the point B is in the left area of the gaze point 4 corresponding area, the second gaze point area is the gaze point 3 corresponding area. If the point B is in the right area of the gaze point 4 corresponding area, the second gaze point area is the gaze point 5 corresponding area. As shown in FIG. 9b, the second gaze point area is the gaze point 5 corresponding area.
[0190] For another example, as shown in FIG. 9b, taking point C as an example. The point C can be understood as a third sub-pixel. The point C is in the gaze point 5 corresponding area, and the gaze point 5 corresponding area is the first gaze point area. Taking the center line of the gaze point 5 corresponding area as a boundary line, if the point C is in the left area of the gaze point 5 corresponding area, the second gaze point area is the gaze point 4 corresponding area. If the point C is in the right area of the gaze point 5 corresponding area, the second gaze point area is the gaze point 1 corresponding area in the adjacent period. As shown in FIG. 9b, the second gaze point area is the gaze point 4 corresponding area.
[0191] It should be understood that the transition area provided by the embodiments of the present application includes but is not limited to the first sub-transition area and the second sub-transition area. The first sub-transition area is an area adjacent to the boundary of the gaze point area, and the second sub-transition area is a transition area other than the first sub-transition area.
[0192] Exemplarily, taking the target gaze point region as the first gaze point region (the region corresponding to gaze point 1) and the second gaze point region (the region corresponding to gaze point 2) as an example. As shown in FIG. 10, the width of one subpixel can be D-H; the width of 0.5 subpixels can be A-C, E-G, I-K, and the like. In the case that the center point of the first subpixel is in the C-D region, the first subpixel is completely in the first gaze point region; in the case that the center point of the first subpixel is in the H-I region, the first subpixel is completely in the second gaze point region. That is, A-C, D-H, and I-K are transition regions.
[0193] wherein, since A-B, E-F, F-G, and J-K are adjacent to the boundary of the gaze point region, A-B, E-F, F-G, and J-K can be the first sub-transition region. Correspondingly, the transition regions B-C, D-E, G-H, and I-J in the transition region except the first sub-transition region can be the second sub-transition region.
[0194] Further, after determining the target gaze point region, the gray scale value of the reduced first subpixel is calculated. First, according to the position of the center point of the first subpixel in the target gaze point region and the width of the first region, the gray scale coefficient of the first subpixel is determined.
[0195] wherein, the first region is a partial region in the target gaze point region.
[0196] In combination with FIG. 10, as shown in FIG. 11, in the case that the center point of the first subpixel is in any one of A-B, E-F, F-G, and J-K, the display device can reduce the gray scale values of the first subpixel corresponding position in the first gaze point region and the second gaze point region through the x^2 function. Specifically, the display device can determine the gray scale coefficient k_score of the first subpixel through the following formula 1. k_score=((position-line_f)^2 / d^2) Formula 1
[0197] wherein, position is the position of the center point of the first subpixel in the target gaze point region, that is, the distance between the center point of the first subpixel and the leftmost side of the target gaze point region; line_f is the width of the first region, that is, the width of A to F, and d is the width of the region between two letters.
[0198] It should be noted that, taking the width of A-B or J-K region as d as an example, the width of E-G region is 2d, wherein 0
[0199] Further, the display device reduces the gray scale value of the first sub-pixel based on the gray scale coefficient of the first sub-pixel and the image gray scale value of the first sub-pixel in the target gaze point region, to obtain a reduced gray scale value of the first sub-pixel.
[0200] The image gray scale value is used to represent the gray scale value of the first sub-pixel in different gaze point regions in the target gaze point region.
[0201] For example, taking the first sub-transition region in which the center point of the first sub-pixel is in the first gaze point region as an example. That is, the center point of the first sub-pixel is in the A-B region or the E-F region. The display device can substitute the gray scale coefficient k_score of the first sub-pixel into the following formula 2 to determine the reduced gray scale value value of the first sub-pixel. value=k_score*value_right Formula 2
[0202] The value_right is the gray scale value of the first sub-pixel in the first gaze point region.
[0203] It can be understood that the first sub-pixel is in different positions, the corresponding gray scale coefficient is different, and then the gray scale value is also different.
[0204] In the embodiment of the present application, the display device obtains the reduced gray scale value of the first sub-pixel in the manner of formula 1 and formula 2, and can adjust the current gray scale value of the first sub-pixel to the reduced gray scale value.
[0205] Method (2): For a plurality of sub-pixels in the center region, the gray scale value of a sub-pixel in a transition region in the plurality of sub-pixels is reduced. For example, the gray scale value of the first sub-pixel is blacked to reduce the gray scale value of the first sub-pixel, to obtain a reduced gray scale value of the first sub-pixel.
[0206] The first sub-pixel is any one of the plurality of sub-pixels in the center region in the transition region.
[0207] For example, in the case where the center point of the first sub-pixel is in the transition region, the display device sets the gray scale value of the first sub-pixel to a preset value. As shown in FIG. 10, taking 0 as an example of the preset value, in the case where the center point of the first sub-pixel is in the A-C region, the D-H region, and the I-K region, the display device sets the gray scale value of the first sub-pixel to 0, that is, the sub-pixel in the transition region is blacked. After the display device adopts the blacking processing in the embodiment of the present application, the display effect of the image can be as shown in FIG. 12.
[0208] For example, in a case that the center point of the first sub-pixel is in the first sub-transition region, the display device sets the gray scale value of the first sub-pixel as a preset value. As shown in FIG. 10, taking the preset value as 0 as an example, in a case that the center point of the first sub-pixel is in any one of the first sub-transition regions A-B, E-F, F-G, and J-K, the display device can set the gray scale value of the first sub-pixel as 0, i.e., performing the black elimination processing on the sub-pixel in the transition region.
[0209] Manner (3): For the plurality of sub-pixels in the center region, increasing the gray scale value of the sub-pixel in the non-transition region in the plurality of sub-pixels.
[0210] In some embodiments, the display device increases the gray scale value of the second sub-pixel based on the position of the center point of the second sub-pixel in the target gaze point region and the width of the target gaze point region, to obtain the increased gray scale value of the second sub-pixel.
[0211] The second sub-pixel is any one of the sub-pixels in the non-transition region in the plurality of sub-pixels in the center region.
[0212] For example, the display device determines the gray scale coefficient of the second sub-pixel based on the position of the center point of the second sub-pixel in the target gaze point region and the width of the target gaze point region, and determines the gray scale value of the second sub-pixel based on the gray scale coefficient of the second sub-pixel and the second image gray scale value of the second sub-pixel in the target gaze point region, and then takes the minimum gray scale value between the gray scale value of the second sub-pixel and the gray scale threshold value as the increased gray scale value of the second sub-pixel.
[0213] The second image gray scale value is used to represent the gray scale value of the second sub-pixel in the first gaze point region, or is used to represent the gray scale value of the second sub-pixel in the second gaze point region.
[0214] Optionally, the non-transition region can include a second sub-transition region. For example, in combination with FIG. 10, the non-transition region can be B-E and G-J. The non-transition region can also be C-D and H-I.
[0215] For example, taking the non-transition region as B-E and G-J as an example. The display device can increase the gray scale values of the first gaze point region and the second gaze point region corresponding to the position of the sub-pixel in the non-transition region through a sin function. Specifically, the display device can determine the gray scale coefficient k_score of the second sub-pixel through the following formula 3. 非 . k_score 非 = k_ratio*sin(2*π(position-d) / (deltax-4*d))+1 Formula 3
[0216] wherein k_ratio is an increasing coefficient; position is the position of the center point of the second sub-pixel in the target gaze point region; deltax is the width of the target gaze point region.
[0217] Further, taking the case that the center point of the second sub-pixel is in B-E as an example, the display device can determine the gray scale coefficient k_score of the second sub-pixel 非 = by substituting into the following formula 4, to determine the gray scale value value of the second sub-pixel 非 . value 非 = k_score 非 * value_right 非 Formula 4
[0218] wherein value_right 非 is the gray scale value of the second sub-pixel in the first gaze point region.
[0219] Correspondingly, if the center point of the second sub-pixel is in G-J, the display device can determine the gray scale value k_score of the second sub-pixel 非 = by substituting into the following formula 5, to determine the gray scale value value of the second sub-pixel 非 . value 非 = k_score 非 * value_left 非 Formula 5
[0220] wherein value_left 非 is the gray scale value of the second sub-pixel in the second gaze point region.
[0221] In the embodiments of the present application, the display device determines the gray scale value value of the second sub-pixel 非 After that, the display device compares the gray scale value value of the second sub-pixel 非 with the gray scale threshold value 255, and determines the minimum gray scale value between the two as the gray scale value of the second sub-pixel after increasing.
[0222] (4) For a plurality of sub-pixels in the center region, the gray scale value of a sub-pixel in the transition region among the plurality of sub-pixels is reduced, and the gray scale value of a sub-pixel in the non-transition region among the plurality of sub-pixels is increased. Illustratively, the display device can combine the above-mentioned manner (1) with manner (3), that is, the gray scale value of the sub-pixel in the transition region is reduced by using the method of manner (1), and the gray scale value of the sub-pixel in the non-transition region is increased by using the method of manner (3).
[0223] In the embodiment of the present application, the display effect of the image can be as shown in FIG. 13 after the combination of the manner (1) and the manner (3).
[0224] Manner (5): for the plurality of sub-pixels in the center region, the gray scale value of the sub-pixel in the transition region is reduced, and the gray scale value of the sub-pixel in the non-transition region is increased. Illustratively, the display device can combine the above-mentioned manner (2) and manner (3), that is, the gray scale value of the sub-pixel in the transition region is reduced by the method of manner (2), and the gray scale value of the sub-pixel in the non-transition region is increased by the method of manner (3).
[0225] In the embodiment of the present application, the display effect of the image can be as shown in FIG. 14 after the combination of the manner (2) and the manner (3).
[0226] Based on the above scheme, the display device in the embodiment of the present application performs the action of reducing the gray scale value for the sub-pixel in the transition region in the center region, and increases the gray scale value of the sub-pixel in the non-transition region, so as to balance the width of the high-luminance platform and the low-luminance platform in the transition region and the non-transition region, and further effectively improve the actual visible range of the naked eye 3D.
[0227] The above describes in detail how to process the plurality of sub-pixels in the center region.
[0228] The following describes in detail how the display device processes the plurality of sub-pixels in the edge region, that is, the control strategy for the edge region is as follows:
[0229] In the embodiment of the present application, for the plurality of sub-pixels in the edge region, the gray scale value of the sub-pixel in the transition region is reduced.
[0230] In some embodiments, based on the position of the center point of the third sub-pixel in the target gaze point region and the width of the third sub-pixel, the area ratio of the third sub-pixel is determined, and based on the area ratio of the third sub-pixel and the third image gray scale value of the third sub-pixel, the gray scale value of the third sub-pixel is reduced to obtain the reduced gray scale value of the third sub-pixel.
[0231] wherein the third sub-pixel is any one of the plurality of sub-pixels in the edge region and in the transition region; the area ratio of the third sub-pixel is used to represent the proportion of the third sub-pixel in the first gaze point region, or is used to represent the proportion of the third sub-pixel in the second gaze point region; and the third image gray scale value is used to represent the gray scale value of the third sub-pixel in the first gaze point region, or is used to represent the gray scale value of the third sub-pixel in the second gaze point region.
[0232] Exemplarily, in combination with FIG. 10, it is assumed that the third sub-pixel is in the first sub-transition region. Since the first sub-transition region includes four different position transition regions (for example, A-B, E-F, F-G, and J-K), respectively, the display device can obtain the area ratio of the third sub-pixel by different formulas when the third sub-pixel is in different position first sub-transition regions.
[0233] Specifically, the display device can determine the area ratio of the third sub-pixel as any one of the following case (1), case (2), case (3), and case (4).
[0234] Case (1), when the center point of the third sub-pixel is in the first sub-transition region A-B, the display device can determine the area ratio k_right of the third sub-pixel in the first gaze point region by the following formula 6. k_right=(position+subpixel / 2) / subpixel Formula 6
[0235] Wherein, position is the position of the center point of the third sub-pixel in the target gaze point region, and subpixel is the width of one sub-pixel (third sub-pixel). It should be noted that position can be understood as the distance from the center point of the third sub-pixel to the leftmost side of the target gaze point region. For example, when the center point of the third sub-pixel is on the line of point B, position is the distance from point A to point B.
[0236] Further, the display device can obtain the area ratio k_left of the third sub-pixel in the second gaze point region according to the area ratio k_right of the third sub-pixel in the first gaze point region, that is, k_left=1-k_right.
[0237] Case (2), when the center point of the third sub-pixel is in the first sub-transition region E-F, the display device can determine the area ratio k_right of the third sub-pixel in the first gaze point region by the following formula 7. k_right=(deltax / 2-position+subpixel / 2) / subpixel Formula 7
[0238] Wherein, position is the position of the center point of the third sub-pixel in the target gaze point region, subpixel is the width of one sub-pixel (third sub-pixel), and deltax is the width of the target gaze point region.
[0239] For example, as shown in FIG. 15, the center point of the third sub-pixel is at point E. deltax / 2 is the width of half of the target gaze point region, such as the width of A to F. Position is the width of A to E, and deltax / 2-position can obtain the width of E to F. subpixel / 2 is the width of half of the sub-pixel, that is, the width of P to E. The display device adds the width of E to F to the width of P to E to obtain the width of P to F, and calculates the proportion of the third sub-pixel in the first gaze point region through the width of P to F and the width of one sub-pixel.
[0240] It can be understood that the area proportion of the third sub-pixel in the embodiment of the present application can be understood as a process of solving the area.
[0241] The display device can obtain the proportion k_right of the third sub-pixel in the first gaze point region according to the proportion k_left of the third sub-pixel in the second gaze point region, that is, k_right=1-k_left.
[0242] In case (3), when the center point of the third sub-pixel is in the first sub-transition region F-G, the display device can determine the proportion k_right of the third sub-pixel in the first gaze point region through the following formula 8. k_left=(position-deltax / 2+subpixel / 2) / subpixel Formula 8
[0243] Wherein, position is the position of the center point of the third sub-pixel in the target gaze point region, subpixel is the width of one sub-pixel (the third sub-pixel), and deltax is the width of the target gaze point region.
[0244] The display device can obtain the proportion k_left of the third sub-pixel in the second gaze point region according to the proportion k_right of the third sub-pixel in the first gaze point region, that is, k_left=1-k_right.
[0245] In case (4), when the center point of the third sub-pixel is in the first sub-transition region J-K, the display device can determine the proportion k_right of the third sub-pixel in the first gaze point region through the following formula 9. k_left=(deltax-positon+subpixel / 2) / subpixel Formula 9
[0246] Wherein, position is the position of the center point of the third sub-pixel in the target gaze point region, subpixel is the width of one sub-pixel (the third sub-pixel), and deltax is the width of the target gaze point region.
[0247] The display device can obtain the proportion k_left of the third sub-pixel in the second gaze point area according to the proportion k_right of the third sub-pixel in the first gaze point area, that is, k_left=1-k_right.
[0248] In the embodiments of the present application, after the display device determines the area proportion of the third sub-pixel according to any one of the formulas in the above cases (1)-(4), the display device can determine the gray scale value of the third sub-pixel after reduction through the area proportion.
[0249] The area proportion of the third sub-pixel includes the proportion of the third sub-pixel in the first gaze point area and the proportion of the third sub-pixel in the second gaze point area.
[0250] It should be noted that whether the display device adopts the gray scale value of the third sub-pixel in the first gaze point area or the gray scale value of the third sub-pixel in the second gaze point area is determined according to whether the center point of the third sub-pixel is located in the first gaze point area or the second gaze point area. For example, if the center point of the third sub-pixel is located in the first gaze point area, the gray scale value of the third sub-pixel in the first gaze point area is adopted, and if the center point of the third sub-pixel is located in the second gaze point area, the gray scale value of the third sub-pixel in the second gaze point area is adopted.
[0251] Further, whether the display device adopts the gray scale value of the third sub-pixel in the first gaze point area or the gray scale value of the third sub-pixel in the second gaze point area is determined according to whether the first sub-transition area where the center point of the third sub-pixel is located is located in the first gaze point area or the second gaze point area. For example, if the first sub-transition area where the center point of the third sub-pixel is located is located in the first gaze point area, the gray scale value of the third sub-pixel in the first gaze point area is adopted, and if the first sub-transition area where the center point of the third sub-pixel is located is located in the second gaze point area, the gray scale value of the third sub-pixel in the second gaze point area is adopted.
[0252] In some embodiments, the display device reduces the gray scale value of the third sub-pixel based on the proportion of the third sub-pixel in the first gaze point area, the proportion of the third sub-pixel in the second gaze point area, and the gray scale value of the third sub-pixel in the first gaze point area, to obtain the gray scale value of the third sub-pixel after reduction.
[0253] Alternatively, the display device reduces the gray scale value of the third sub-pixel based on the proportion of the third sub-pixel in the first gaze point area, the proportion of the third sub-pixel in the second gaze point area, and the gray scale value of the third sub-pixel in the second gaze point area, to obtain the gray scale value of the third sub-pixel after reduction.
[0254] Exemplarily, as shown in FIG. 10, since the first sub-transition region includes four different position transition regions respectively, the display device can obtain the gray scale value of the third sub-pixel after reduction by different formulas when the third sub-pixel is in different position first sub-transition regions. Specifically, the display device determines the target gray scale value can be any one of the following case (5) and case (6).
[0255] Case (5), the display device adopts the gray scale value of the third sub-pixel in the first gaze point region to determine the gray scale value of the third sub-pixel after reduction. In combination with the above case (1) and case (2), as shown in FIG. 10. In the case that the center point of the third sub-pixel is in the first sub-transition region A-B, or the first sub-transition region E-F, since the first sub-transition region A-B and the first sub-transition region E-F are in the first gaze point region in the target gaze point region, the display device can determine the gray scale value value of the third sub-pixel after reduction by the following formula 10. value=(k_right-k_left)*value_right Formula 10
[0256] Wherein, value_right is the gray scale value of the third sub-pixel in the first gaze point region.
[0257] Case (6), the display device adopts the gray scale value of the third sub-pixel in the second gaze point region to determine the gray scale value of the third sub-pixel after reduction. In combination with the above case (3) and case (4), as shown in FIG. 10. In the case that the center point of the third sub-pixel is in the first sub-transition region F-G, or the first sub-transition region J-K, since the first sub-transition region F-G and the first sub-transition region J-K are in the second gaze point region in the target gaze point region, the display device can determine the gray scale value value of the third sub-pixel after reduction by the following formula 11. value=(k_left-k_right)*value_left Formula 11
[0258] Wherein, value_left is the gray scale value of the third sub-pixel in the second gaze point region.
[0259] In the embodiment of the present application, after the display device is processed by case (5) or case (6), the display effect of the image can be as shown in FIG. 16.
[0260] It can be understood that the target user is assumed to be at the gaze point 1. As shown in FIG. 17, the light emitted by the pixel on the 3D display panel passes through the light splitting effect of the prism and enters the left eye and the right eye of the target user, respectively. The image formed by the area viewed by the left eye through the prism grating is the left image. Similarly, the image formed by the area viewed by the right eye through the prism grating is the right image. That is to say, the third sub-pixel can correspond to an image gray scale value, i.e., a first gray scale value, in the first gaze point area. Correspondingly, the third sub-pixel can also correspond to an image gray scale value, i.e., a second gray scale value, in the second gaze point area.
[0261] In some embodiments, based on the first gray scale value of the third sub-pixel in the first gaze point area and the second gray scale value of the third sub-pixel in the second gaze point area, the gray scale value of the third sub-pixel is reduced to obtain the reduced gray scale value of the third sub-pixel.
[0262] The first gray scale value is determined based on the proportion of the third sub-pixel in the first gaze point area and the image gray scale value of the third sub-pixel in the first gaze point area; and the second gray scale value is determined based on the proportion of the third sub-pixel in the second gaze point area and the image gray scale value of the third sub-pixel in the second gaze point area.
[0263] For example, the display device can determine the first gray scale value based on the proportion of the third sub-pixel in the first gaze point area and the image gray scale value of the third sub-pixel in the first gaze point area, and determine the second gray scale value based on the proportion of the third sub-pixel in the second gaze point area and the image gray scale value of the third sub-pixel in the second gaze point area.
[0264] It should be understood that the first gray scale value is the adjusted gray scale value of the third sub-pixel in the first gaze point area, and the second gray scale value is the adjusted gray scale value of the third sub-pixel in the second gaze point area.
[0265] In the embodiments of the present application, the display device can determine the reduced gray scale value of the third sub-pixel according to the first gray scale value and the second gray scale value, so as to avoid the problem that the processing effect is not ideal due to the small area proportion of the third sub-pixel in the gaze point area and the large gray scale value of the third sub-pixel in the gaze point area.
[0266] For example, as shown in FIG. 10, since the first sub-transition area includes four different position transition areas (A-B, E-F, F-G, J-K), respectively, the display device can obtain the reduced gray scale value of the third sub-pixel by different formulas when the third sub-pixel is in different positions of the first sub-transition area. Specifically, the display device can determine the reduced gray scale value of the third sub-pixel as any one of the following case (7) and case (8).
[0267] Case (7), in combination with the above-mentioned case (1) and case (2), as shown in FIG. 10. In the case that the center point of the third sub-pixel is in the first sub-transition region A-B, or, the first sub-transition region E-F, since the first sub-transition region A-B and the first sub-transition region E-F are in the first gaze point region, the display device can determine the gray scale value value of the third sub-pixel after reduction by the following formula 12. value=k_left*value_left-k_right*value_right Formula 12
[0268] Case (8), in combination with the above-mentioned case (3) and case (4), as shown in FIG. 10. In the case that the center point of the third sub-pixel is in the first sub-transition region F-G, or, the first sub-transition region J-K, since the first sub-transition region F-G and the first sub-transition region J-K are in the second gaze point region, the display device can determine the gray scale value value of the third sub-pixel after reduction by the following formula 13. value=k_right*value_right-k_left*value_left Formula 13
[0269] It can be understood that if the area proportion of the third sub-pixel in the gaze point region is small, and the gray scale value of the third sub-pixel in the gaze point region is large, the brightness of the third sub-pixel is affected by the gray scale value. Similarly, if the area proportion of the third sub-pixel in the gaze point region is large, but the gray scale value of the third sub-pixel in the gaze point region is small, the brightness of the third sub-pixel is affected by the gray scale value. Further, the gray scale value of the third sub-pixel can be better adjusted by the above-mentioned case (7) and case (8). In the embodiment of the present application, after the display device processes the above-mentioned case (7) or case (8), the display effect of the image can be as shown in FIG. 18.
[0270] In another example, in combination with 10, it is assumed that the third sub-pixel is in the second sub-transition region. Since the second sub-transition region includes four different positions of the transition region (such as B-C, D-E, G-H, J-K), respectively, when the third sub-pixel is in the second sub-transition region in different positions, the display device can obtain the area proportion of the third sub-pixel by different formulas. Specifically, the display device can determine the area proportion of the third sub-pixel as any one of the following cases (9), (10), (11), and (12).
[0271] In case (9), when the center point of the third sub-pixel is in the second sub-transition region B-C, the display device can determine the proportion k_right of the third sub-pixel in the first gaze point region by formula 6 in case (1) described above. Correspondingly, the proportion k_left of the third sub-pixel in the second gaze point region is obtained, that is, k_left = 1-k_right.
[0272] In case (10), when the center point of the third sub-pixel is in the second sub-transition region D-E, the display device can determine the proportion k_right of the third sub-pixel in the first gaze point region by formula 7 in case (2) described above. Correspondingly, the proportion k_left of the third sub-pixel in the second gaze point region is obtained, that is, k_left = 1-k_right.
[0273] In case (11), when the center point of the third sub-pixel is in the second sub-transition region G-H, the display device can determine the proportion k_right of the third sub-pixel in the first gaze point region by formula 8 in case (3) described above. Correspondingly, the proportion k_left of the third sub-pixel in the second gaze point region is obtained, that is, k_left = 1-k_right.
[0274] In case (12), when the center point of the third sub-pixel is in the second sub-transition region J-K, the display device can determine the proportion k_right of the third sub-pixel in the first gaze point region by formula 9 in case (4) described above. Correspondingly, the proportion k_left of the third sub-pixel in the second gaze point region is obtained, that is, k_left = 1-k_right.
[0275] In the embodiments of the present application, after the display device determines the region proportion of the third sub-pixel by any one of the formulas in cases (9)-(12) described above, the display device can determine the gray scale value of the third sub-pixel after reduction based on the region proportion.
[0276] In a possible implementation, the display device can determine the gray scale value of the third sub-pixel after reduction based on the difference between the proportion of the third sub-pixel in the first gaze point region and the proportion of the third sub-pixel in the second gaze point region, and the gray scale value of the third sub-pixel in the second gaze point region.
[0277] Alternatively, the display device can also determine the gray scale value of the third sub-pixel after reduction based on the difference between the proportion of the third sub-pixel in the first gaze point region and the proportion of the third sub-pixel in the second gaze point region, and the gray scale value of the third sub-pixel in the first gaze point region.
[0278] Exemplarily, in combination with FIG. 10, since the second sub-transition region includes four different-position transition regions respectively, the display device can obtain the gray scale value of the third sub-pixel after reduction by different formulas when the third sub-pixel is in different-position second sub-transition regions. Specifically, the display device can determine the gray scale value of the third sub-pixel after reduction in any one of the following case (13) and case (14).
[0279] In case (13), the display device determines the gray scale value of the third sub-pixel after reduction by using the gray scale value of the third sub-pixel in the first gaze point region. In combination with the above case (9) and case (10), as shown in FIG. 10. In the case that the center point of the third sub-pixel is in the second sub-transition region B-C, or the second sub-transition region D-E, since the second sub-transition region B-C and the second sub-transition region D-E are in the first gaze point region, the display device can determine the gray scale value value of the third sub-pixel after reduction by using the formula 10 in the above case (5).
[0280] In case (14), the display device determines the gray scale value of the third sub-pixel after reduction by using the gray scale value of the third sub-pixel in the second gaze point region. In combination with the above case (3) and case (4), as shown in FIG. 10. In the case that the center point of the third sub-pixel is in the second sub-transition region G-H, or the second sub-transition region I-J, since the second sub-transition region G-H and the second sub-transition region I-J are in the second gaze point region, the display device can determine the gray scale value value of the third sub-pixel after reduction by using the formula 11 in the above case (6).
[0281] In the embodiment of the present application, when the center point of the third sub-pixel is in the second sub-transition region, the display device determines the gray scale value of the third sub-pixel after reduction by using the case (13) or the case (14), and adjusts the current gray scale value of the third sub-pixel, and the display effect of the adjusted image can be as shown in FIG. 14.
[0282] In another possible implementation, the display device can determine the first gray scale value based on the proportion of the third sub-pixel in the first gaze point region and the image gray scale value of the third sub-pixel in the first gaze point region, and determine the second gray scale value based on the proportion of the third sub-pixel in the second gaze point region and the gray scale value of the third sub-pixel in the second gaze point region.
[0283] It should be understood that the first gray scale value is the image gray scale value of the adjusted third sub-pixel in the first gaze point region, and the second gray scale value is the image gray scale value of the adjusted third sub-pixel in the second gaze point region.
[0284] In the embodiment of the present application, the display device can reduce the gray scale value of the third sub-pixel according to the first gray scale value and the second gray scale value to obtain the reduced gray scale value of the third sub-pixel, thereby avoiding the problem that the processing effect is not ideal due to the small area ratio of the third sub-pixel in the gaze point area and the large gray scale value of the third sub-pixel in the gaze point area.
[0285] For example, as shown in FIG. 10, since the second sub-transition area includes four different position transition areas (B-C, D-E, G-H, and I-J), the display device can obtain the reduced gray scale value of the third sub-pixel by different formulas when the third sub-pixel is in different position second sub-transition areas. Specifically, the display device can determine the reduced gray scale value of the third sub-pixel as any one of the following case (15) and case (16).
[0286] Case (15), in combination with the above case (9) and case (10), as shown in FIG. 10. When the center point of the third sub-pixel is in the second sub-transition area B-C or the second sub-transition area D-E, since the second sub-transition area B-C and the second sub-transition area D-E are in the first gaze point area, the display device can determine the reduced gray scale value value of the third sub-pixel by the formula 12 in the above case (7).
[0287] Case (16), in combination with the above case (11) and case (12), as shown in FIG. 10. When the center point of the third sub-pixel is in the second sub-transition area G-H or the second sub-transition area I-J, the second sub-transition area G-H and the second sub-transition area I-J are in the second gaze point area, and thus the display device can determine the reduced gray scale value value of the third sub-pixel by the formula 13 in the above case (8).
[0288] In the embodiment of the present application, when the center point of the third sub-pixel is in the second sub-transition area, the display device determines the reduced gray scale value of the third sub-pixel by case (15) or case (16), and adjusts the current gray scale value of the third sub-pixel. The display effect of the adjusted image can be as shown in FIG. 19.
[0289] In the embodiment of the present application, taking the 31.5 8K naked eye 3D project sample, the crosstalk test of the black and white image and the 3D effect shooting of the flower as examples. For the edge area, the display device reduces the gray scale value of the sub-pixel in the edge area, and compared with the layout algorithm without adding transition processing, the crosstalk rate test of the combined image and the actual 3D effect test of the flower show that the method of reducing the gray scale value of the sub-pixel in the edge area can reduce the crosstalk rate by about 1%, significantly weaken the ghosting phenomenon, and effectively improve the 3D effect.
[0290] In the embodiment of the present application, the gray scale value of the third sub-pixel is subjected to black taking processing, and the reduced gray scale value of the third sub-pixel is determined.
[0291] The third sub-pixel is any one of the plurality of sub-pixels in the transition region in the edge region.
[0292] For example, when the center point of the third sub-pixel is in the transition region, the display device sets the gray scale value of the third sub-pixel to a preset value. As shown in FIG. 10, taking 0 as the preset value, when the center point of the third sub-pixel is in the A-C region, the D-H region, and the I-K region, the display device sets the gray scale value of the third sub-pixel to 0, that is, the sub-pixel in the transition region is subjected to black taking processing.
[0293] The above is a detailed introduction to the processing mode of the sub-pixel in the transition region in the edge region in the embodiment of the present application.
[0294] The following is an overview of the processing mode of the peripheral region in the embodiment of the present application, that is, the control strategy for the peripheral region is as follows:
[0295] In the embodiment of the present application, the plurality of sub-pixels in the peripheral region are not subjected to adjustment control.
[0296] It should be understood that the peripheral region is a region other than the center region and the edge region. Since the peripheral region is usually not directly gazed, the corresponding visual demand is the lowest, and therefore the gray scale value of the sub-pixel in the peripheral region can not be processed to make up for the brightness reduction caused by reducing the gray scale value of the sub-pixel in other regions (the center region and the edge region).
[0297] It should be noted that the coverage range of the transition region and the non-transition region can be adjusted according to actual use. For example, the coverage range of the transition region is increased, and / or the coverage range of the non-transition region is reduced. If the coverage range of the transition region is increased, the range of the transition processing is also increased, and the effect of the transition processing of the display device on the gray scale value of the sub-pixel is also enhanced.
[0298] Based on the above technical solution, the display device of the embodiment of the present application can determine a plurality of different gaze regions corresponding to the display panel in real time according to the gaze point position of the target user, and flexibly adjust and control the gray scale value of the sub-pixel in different gaze regions. That is, different control strategies are adopted for different gaze regions, which effectively reduces the crosstalk rate, increases the naked-eye 3D viewing range, and improves the user experience.
[0299] In the embodiment of the present application, the display device can determine the position of the center point of the different sub-pixels in the target gaze point region.
[0300] In a possible implementation, the display device can determine a target gaze point area according to the gaze point position, and determine the position of the center point of the target sub-pixel in the target gaze point area based on the position of the center sub-pixel in the row where the target sub-pixel is located.
[0301] The target sub-pixel is any one of the first sub-pixel, the second sub-pixel, and the third sub-pixel mentioned above.
[0302] For example, the display device can obtain the width of the target gaze point area, and determine the width of the second area in the row where the target sub-pixel is located based on the width of the target gaze point area and the position of the center sub-pixel, and then determine the position of the center point of the target sub-pixel in the target gaze point area according to the width of the second area.
[0303] The second area is an incomplete area on the left side of the row where the target sub-pixel is located.
[0304] For example, as shown in FIG. 20, the distance between the human eye and the prism in the display panel is z, the distance between the prism and the display panel in the display panel is h, and the horizontal pitch value of the prism is pitch. The display device can determine the coverage range of one prism on the display panel, that is, a target gaze point area deltax satisfies the following formula 14: deltax=(z+h)*pitch / z Formula 14
[0305] The display device substitutes the target gaze point area deltax into formula 15 to obtain the width of the incomplete area on the leftmost side of the row: edge_distance=(x i -deltax / 2)%deltax Formula 15
[0306] The edge_distance is the width of a part of the row, x i is the position of the center sub-pixel in the ith row (the position of the center sub-pixel), and % is used to represent the remainder algorithm.
[0307] Further, the display device obtains the specific position of the area where the target sub-pixel is located according to the distance between the position of the center sub-pixel and the leftmost edge, that is, the display device substitutes the position x i of the center sub-pixel and the width of a part of the row edge_distance into the following formula 16: position=(x i +deltax-edge_distance)%deltax Formula 16
[0308] Wherein, the position is the position of the center point of the target sub-pixel in the target gaze point region. As shown in FIG. 21, the position x of the center sub-pixel is B i , and the position of the center point of the target sub-pixel is C.
[0309] For example, the position x of the center sub-pixel is 13, the width deltax of the target gaze point region is 5, and the width edge_distance of the leftmost incomplete region in the row is 2. The display device obtains (13+5-2) / 5=3 with a remainder of 2 by using the above formula 16, and determines that the center point of the target sub-pixel is in the second position of the fourth target gaze point region according to the result 3 with a remainder of 2. i For example, the position x of the center sub-pixel is 13, the width deltax of the target gaze point region is 5, and the width edge_distance of the leftmost incomplete region in the row is 2. The display device obtains (13+5-2) / 5=3 with a remainder of 2 by using the above formula 16, and determines that the center point of the target sub-pixel is in the second position of the fourth target gaze point region according to the result 3 with a remainder of 2. i For example, the position x of the center sub-pixel is 8, the width deltax of the target gaze point region is 5, and the width edge_distance of the leftmost incomplete region in the row is 2. The display device obtains (8+5-2) / 5=2 with a remainder of 1 by using the above formula 16, and determines that the center point of the target sub-pixel is in the first position of the third target gaze point region according to the result 2 with a remainder of 1.
[0310] It should be noted that the "row" in the embodiments of the present application can be understood as "the row of the target sub-pixel". That is, the "position of the center sub-pixel" can be understood as "the position of the center sub-pixel in the row of the target sub-pixel".
[0311] It can be understood that since the width of a target gaze point region includes a plurality of sub-pixels, in the case that the width deltax of the target gaze point region is 5, the width of a sub-pixel pixel can be 1, and 0-2.5 is the first gaze point region of the target gaze point region, and 2.5-5 is the second gaze point region of the target gaze point region.
[0312] As shown in FIG. 22, taking the case that the center point of the target sub-pixel is in the first position of the third target gaze point region as an example. If the center point of the target sub-pixel is in the first position, since the width of a sub-pixel pixel is 1, the target sub-pixel is in 0.5-1.5. It can be known that the target sub-pixel is completely in the first gaze point region and is not in the transition region. However, the previous sub-pixel of the target sub-pixel is a sub-pixel in the transition region, that is, the previous sub-pixel is in the position of 4.5-0.5 of the second target gaze point region and the third target gaze point region.
[0313] It can be understood that, in combination with FIG. 22, in a case where the width deltax of the target gaze point region is 5 and the width of one subpixel pixel is 1, the position of the center point of the target subpixel satisfies any one of the following conditions: less than 0.5, between 2 and 3, and greater than 4.5, and the center point of the target subpixel is in the transition region.
[0314] Therefore, by the above technical solutions, the display device provided in the embodiments of the present application can obtain the position of the center point of the target subpixel in the target gaze point region by formula 14 to formula 16, so as to facilitate subsequent adjustment and control of the gray scale value of the target subpixel.
[0315] It should be understood that the display device provided in the embodiments of the present application further includes a prism arranged above the display panel, and the prism can include a columnar prism, which is not limited in the embodiments of the present application.
[0316] In some embodiments, the display device determines the placement position of the prism based on device parameters of the display device.
[0317] The device parameters of the display device include but are not limited to the horizontal aperture of the prism, the arch height of the prism, the distance between the prism and the display panel, the number of subpixels of the display panel covered by the prism, the width of the subpixels of the display panel, and the like.
[0318] Exemplarily, according to the geometric optical lens imaging principle, in combination with the geometric relationship of FIG. 20 and FIG. 23, the following formula 17 and formula 18 can be obtained: z+hz=D2 / D1 Formula 17 hz=D3w Formula 18
[0319] In the formula, z is the distance from the eyes of the target user to the display panel, h is the distance between the prism and the display panel, D2 is the coverage width of the prism, D1 is the horizontal aperture of one prism, D3 is the width covered by the distance between the two eyes of the target user, and w is the distance between the left eye and the right eye of the target user, also known as the interpupillary distance.
[0320] When the optimal viewing distance z is reached, D3=0.5×D2. The value of D3 is substituted into formula 18 to obtain: hz=0.5×D2w Formula 19
[0321] Solving this equation, the expression of the air layer placement height h can be obtained, that is, formula 20: h=0.5×N×subpixel×wz Formula 20
[0322] In the formula, N is the number of subpixels on the display panel covered by each columnar prism, and subpixel is the width of each subpixel on the display panel.
[0323] Further, the prism horizontal aperture D1 is calculated, the obtained h value is substituted into the first formula, and the expression of the prism horizontal aperture D1 is obtained, that is, formula 21: D1=N×subpixel×z+hz formula 21
[0324] Further, the prism horizontal aperture D1 is calculated, the obtained h value is substituted into the first formula, and the expression of the prism horizontal aperture D1 is obtained, that is, formula 21: D1=N×subpixel×z+hz formula 21
[0325] Further, the prism horizontal aperture D1 is calculated, the obtained h value is substituted into the first formula, and the expression of the prism horizontal aperture D1 is obtained, that is, formula 21: D1=N×subpixel×z+hz formula 21
[0326] Through the above design steps, all the key parameters required for the cylindrical prism 3D display technology can be obtained. These parameters are mutually constrained to determine the placement position of the cylindrical prism, and then ensure that the cylindrical prism can accurately separate and guide the light to different directions, thereby providing high-quality 3D stereoscopic visual effect for the observer.
[0327] It should be noted that the formulas and parameters in the above design method are derived based on the geometric optics principle under ideal conditions. In actual application, other factors such as the resolution of the display panel and the machining precision of the cylindrical prism may also need to be considered to ensure that the final 3D display effect is optimal.
[0328] As shown in FIG. 25, the gray scale control method provided by the embodiment of the present application further includes the following S2501-S2502.
[0329] S2501, obtain the eye movement data of the target user.
[0330] In the embodiment of the present application, the display device can track the gaze point position of the target user in the display panel through the eye tracking module. The eye tracking module can execute a calibration program to establish a mapping relationship between the eye movement and the display screen coordinate system. When the target user gazes at the display panel, the eye tracking module can capture the eye movement data in real time and calculate the corresponding coordinates of the user's gaze point on the screen according to the mapping relationship, that is, the gaze point position.
[0331] Further, the eye tracking module of the embodiment of the present application can also process the binocular position information to determine the center of the two eyes, that is, the three-dimensional position coordinates (x, y, z) of the eyebrow center relative to the center point of the display screen. In this way, the embodiment of the present application can more accurately track the line of sight of the target user, and improve the accuracy and reliability of human-computer interaction.
[0332] S2502, determine the gaze point position of the target user on the display panel based on the eye movement data.
[0333] In the embodiments of the present application, the human eye tracking module can be a binocular camera. The embodiments of the present application can set two cameras at a certain distance apart as input devices, and the relative positional relationship between the binocular cameras is known and serves as the basis for subsequent calculation. The binocular camera can capture images of the same scene at the same time, and pre-process the images, including but not limited to denoising, enhancing contrast, etc., to improve the accuracy of subsequent processing.
[0334] Illustratively, the binocular camera uses an image matching algorithm to find corresponding feature points in the images captured by the two cameras, and calculates the parallax between the feature points. According to the parallax principle and known camera parameters (such as focal length, camera spacing, etc.), the depth information corresponding to each feature point is calculated, and after obtaining the depth information in the scene, the binocular camera can identify the human eye in the image in combination with human eye features (such as pupil position, eye corner shape, etc.), and calculate the position information of the human eye in the three-dimensional space based on the depth information.
[0335] Wherein, the parallax refers to the positional difference of the same object in the images of the two cameras, and the parallax is used to reflect the distance relationship between the object and the camera; the depth information is used to represent the distance of the object from the camera in the three-dimensional space.
[0336] Another example, taking the human eye tracking module as a red-green-blue depth camera (RGB-D camera) for example. The RGB-D camera of the embodiments of the present application integrates multiple high-precision sensors, including a red-green-blue (RGB) camera and a time of flight (TOF) depth sensor.
[0337] Specifically, the RGB camera captures color image information of the scene, which contains rich visual features and details, providing a basis for subsequent image processing and recognition. At the same time, the TOF depth sensor uses the time of flight principle of light pulses to quickly measure the distance from each point in the scene to the camera, thereby generating a high-precision depth image.
[0338] The embodiments of the present application can accurately calibrate the RGB camera and the TOF depth sensor, so that the data captured by the two can be strictly aligned in space. On this basis, image processing and computer vision algorithms are used to fuse and process the RGB image and the depth image, and the human eye features in the scene are extracted. Further, in combination with the depth information, the RGB-D camera can accurately calculate the precise coordinate position of the human eye in the three-dimensional space.
[0339] Yet another example is that the human eye tracking module is an infrared eye movement tracking camera. The infrared eye movement tracking camera integrates an infrared light source, an infrared camera, and an image processor. The infrared light source is used to emit a high-intensity infrared light beam to provide stable and sufficient infrared light illumination for the eye movement tracking process. The infrared camera can capture the infrared light reflected by the eye to form a clear and high-contrast eye image, ensuring that it can work normally under various environmental light conditions, thereby providing high-quality visual input for subsequent image processing and data analysis.
[0340] Specifically, the infrared camera can transmit the eye image to the image processor, and then the image processor processes the eye image captured by the eye movement sensor in real time, analyzes the transmitted data, calculates the eye position coordinates of the target user, and calculates the vector from the pupil center to the corneal reflection point based on the eye position coordinates and the corneal reflection point position, as the gaze direction of the target user.
[0341] For each eye, the gaze direction vector can be calculated, and the gaze direction vector can be extended to the display panel. The intersection of the display panel is the screen coordinates of the gaze point. That is, according to the relationship between the gaze direction vector and the display panel position, the two-dimensional coordinates of the gaze point on the display panel are calculated. If the gaze direction vectors of the two eyes do not completely coincide, the final gaze point coordinates are determined by weighted averaging or other algorithms.
[0342] Among them, the vector from the pupil center to the corneal reflection point is used as the gaze direction in the embodiment of the application.
[0343] It should be understood that due to the physiological structure of the human eye, especially the high-definition vision ability of the fovea, combined with the movement mode of the eyeball, the selective attention mechanism of the brain in information processing, and the natural pursuit of visual comfort, the target user naturally focuses their line of sight on a specific area when watching the screen. This focus not only improves the efficiency of the target user in processing visual information, but also effectively reduces visual fatigue.
[0344] Based on the above technical solutions, the embodiment of the application provides a naked eye 3D display device integrated with human eye tracking technology, and a gray scale control method (display method) matched therewith. The display device uses a high-definition camera and other precision sensors to capture and accurately calculate the eye position coordinates (gaze point position) of the target user in real time. Subsequently, through a data transmission module, the coordinates are immediately transmitted to the core of display control, i.e., the display control module. The display control module controls the gray scale value of the sub-pixels of the display panel according to the received coordinates.
[0345] It can be understood that, in view of the fact that the coordinates are in continuous dynamic change, and accompanied by specific influence area and other parameters, the display control module can synchronously and intelligently adjust the gray scale value of each pixel on the display panel.
[0346] Finally, through the precise light splitting processing of the prism grating module, the target user can enjoy an unparalleled 3D visual feast regardless of the viewing angle. The display device and the gray scale control method can be applied to high-end 3D displays, such as advanced game displays, virtual displays, etc.
[0347] In addition, for the naked eye 3D display device without eye tracking module and the gray scale control method (display method) matched therewith. The display device accurately sets the display parameters through the preset fixed distance and angle, ensuring that the user can watch the best 3D visual effect at a specific viewing angle position. The display device is particularly suitable for 3D advertising screens, 3D displays for display, etc., providing an immersive visual experience for users.
[0348] It should be noted that the embodiments of the present application can be mutually borrowed or referred to each other, for example, the same or similar steps, method embodiments, system embodiments and device embodiments can be mutually referred to, without limitation.
[0349] The embodiments of the present application can divide the functional modules or functional units of the gray scale control device according to the above-mentioned method examples, for example, each functional module or functional unit can be divided according to each function, or two or more functions can be integrated in one processing module. The above-mentioned integrated module can be realized in the form of hardware or software functional module or functional unit. Among them, the division of modules or units in the embodiments of the present application is illustrative, and is only a logical function division. When actually implemented, there can be another division mode.
[0350] As shown in FIG. 26, it is a structure schematic diagram of a gray scale control device provided by the embodiments of the present application. The device is applied to a display device, which includes: a display device including a display panel and a processor; the display panel corresponds to a plurality of gaze points, and one gaze point corresponds to one area. The area corresponding to each gaze point includes a transition area and a non-transition area.
[0351] Among them, the plurality of gaze points are the viewing points of the target user through different angles of the display panel; the transition area is the area between the critical lines of the areas corresponding to any two gaze points, and the non-transition area is the area other than the transition area.
[0352] The device comprises a processing unit 2501 and an acquisition unit 2502. The processing unit 2501 is configured to determine a plurality of gaze areas corresponding to the display panel based on a gaze point position of a target user in the display panel. The processing unit 2501 is further configured to control the gray scale value of a sub-pixel in each gaze area of the plurality of gaze areas based on a control strategy corresponding to the gaze area.
[0353] The control strategies corresponding to at least two gaze areas of the plurality of gaze areas are different.
[0354] In some embodiments, the processing unit 2501 is further configured to determine a target gaze area based on the gaze point position. The target gaze area is an area of the plurality of gaze areas that has an influence on the gray scale value of the sub-pixel. The target gaze area includes a first gaze area and a second gaze area. One of the first gaze area and the second gaze area is an area corresponding to the gaze point position, and the other is an adjacent area of the area corresponding to the gaze point position.
[0355] In some embodiments, the plurality of gaze areas includes a center area, and the center area is an area centered on the gaze point position. The processing unit 2501 is specifically configured to reduce the gray scale value of a sub-pixel in a transition area among the plurality of sub-pixels in the center area and / or increase the gray scale value of a sub-pixel in a non-transition area among the plurality of sub-pixels in the center area.
[0356] In some embodiments, the processing unit 2501 is specifically configured to determine a gray scale coefficient of a first sub-pixel based on a position of a center point of the first sub-pixel in the target gaze area and a width of a first area, and reduce the gray scale value of the first sub-pixel based on the gray scale coefficient of the first sub-pixel and a first image gray scale value of the first sub-pixel in the target gaze area.
[0357] The first sub-pixel is any one of the plurality of sub-pixels in the center area in the transition area. The first area is a partial area in the target gaze area. The first image gray scale value is used to represent the gray scale value of the first sub-pixel in the first gaze area or the gray scale value of the first sub-pixel in the second gaze area.
[0358] In some embodiments, the processing unit 2501 is specifically configured to perform black processing on the gray scale value of the first sub-pixel to reduce the gray scale value of the first sub-pixel.
[0359] The first sub-pixel is any one of the plurality of sub-pixels in the center area in the transition area.
[0360] In some embodiments, the processing unit 2501 is further configured to increase the gray scale value of the second sub-pixel based on a position of a center point of the second sub-pixel in the target gaze point region and a width of the target gaze point region.
[0361] The second sub-pixel is any one of the plurality of sub-pixels in the non-transition region of the center region.
[0362] In some embodiments, the processing unit 2501 is specifically configured to determine a gray scale coefficient of the second sub-pixel based on a position of a center point of the second sub-pixel in the target gaze point region and a width of the target gaze point region, and determine the gray scale value of the second sub-pixel based on the gray scale coefficient of the second sub-pixel and an image gray scale value of the second sub-pixel in the target gaze point region, and further take a minimum value between the gray scale value of the second sub-pixel and a gray scale threshold value as the increased gray scale value of the second sub-pixel.
[0363] The second image gray scale value is used to represent a gray scale value of the second sub-pixel in the first gaze point region, or is used to represent a gray scale value of the second sub-pixel in the second gaze point region.
[0364] In some embodiments, the plurality of gaze regions includes an edge region, the edge region being a region adjacent to the center region; the center region being a region centered on the gaze point position; and the processing unit 2501 is specifically configured to, for a plurality of sub-pixels in the edge region, decrease a gray scale value of a sub-pixel in a transition region among the plurality of sub-pixels.
[0365] The third image gray scale value is used to represent an image gray scale value of the third sub-pixel in the first gaze point region, or is used to represent an image gray scale value of the third sub-pixel in the second gaze point region.
[0366] In some embodiments, the processing unit 2501 is further configured to determine the area proportion of the third sub-pixel based on a position of a center point of the third sub-pixel in the target gaze point region and a width of the third sub-pixel.
[0367] The third sub-pixel is any one of the plurality of sub-pixels in the transition region of the edge region; and the area proportion of the third sub-pixel is used to represent a proportion of the third sub-pixel in the first gaze point region, or is used to represent a proportion of the third sub-pixel in the second gaze point region.
[0368] In some embodiments, the processing unit 2501 is specifically configured to:
[0369] decrease the gray scale value of the third sub-pixel based on the proportion of the third sub-pixel in the first gaze point region, the proportion of the third sub-pixel in the second gaze point region, and the gray scale value of the third sub-pixel in the first gaze point region; or
[0370] decrease the gray scale value of the third sub-pixel based on the proportion of the third sub-pixel in the first gaze point region, the proportion of the third sub-pixel in the second gaze point region, and the gray scale value of the third sub-pixel in the second gaze point region.
[0371] In some embodiments, the processing unit 2501 is specifically configured to:
[0372] decrease the gray scale value of the third sub-pixel based on the first gray scale value of the third sub-pixel in the first gaze point region and the second gray scale value of the third sub-pixel in the second gaze point region.
[0373] wherein the first gray scale value is determined based on the proportion of the third sub-pixel in the first gaze point region and the image gray scale value of the third sub-pixel in the first gaze point region; and the second gray scale value is determined based on the proportion of the third sub-pixel in the second gaze point region and the image gray scale value of the third sub-pixel in the second gaze point region.
[0374] In some embodiments, the processing unit 2501 is further configured to: perform black taking processing on the gray scale value of the sub-pixel to decrease the gray scale value of the sub-pixel.
[0375] wherein the sub-pixel is the first sub-pixel or the third sub-pixel, the first sub-pixel is any one of the plurality of sub-pixels in the center region that is in the transition region, and the third sub-pixel is any one of the plurality of sub-pixels in the edge region that is in the transition region.
[0376] In some embodiments, the processing unit 2501 is further configured to: increase the coverage range of the transition region, and / or decrease the coverage range of the non-transition region.
[0377] In some embodiments, the position of the center point of the sub-pixel in the target gaze point region can be determined by: determining the target gaze point region according to the gaze point position; and determining the position of the center point of the target sub-pixel in the target gaze point region based on the position of the center sub-pixel of the row in which the target sub-pixel is located.
[0378] wherein the target sub-pixel is any one of the first sub-pixel, the second sub-pixel, and the third sub-pixel; the first sub-pixel is any one of the plurality of sub-pixels in the center region that is in the transition region; the second sub-pixel is any one of the plurality of sub-pixels in the center region that is in the non-transition region; and the third sub-pixel is any one of the plurality of sub-pixels in the edge region that is in the transition region.
[0379] In some embodiments, the processing unit 2501 is specifically configured to: obtain a width of the target gaze point region, and determine a width of a second region of the target sub-pixel row based on the width of the target gaze point region and a position of the center sub-pixel, and further determine a position of the center point of the target sub-pixel in the target gaze point region according to the width of the second region.
[0380] In some embodiments, the second region is an incomplete region on the left side of the target sub-pixel row.
[0381] In some embodiments, the processing unit 2501 is further configured to: obtain an offset between the center sub-pixel of the target sub-pixel row and the center point of the display panel, and determine the position of the center sub-pixel of the target sub-pixel row based on the offset and the pixel width.
[0382] In some embodiments, the plurality of gaze regions includes a peripheral region, the peripheral region being a region other than the center region and the edge region; the center region being a region at the center of the gaze point position, and the edge region being a region adjacent to the center region; and the processing unit 2501 is specifically configured to: for a plurality of sub-pixels in the peripheral region, not performing adjustment control.
[0383] In some embodiments, the display device further includes a prism disposed above the display panel; and the processing unit 2501 is further configured to: determine a placement position of the prism based on a device parameter of the display device.
[0384] In some embodiments, the device parameter of the display device includes at least two of: a horizontal aperture of the prism; a camber height of the prism; a distance between the prism and the display panel; a number of sub-pixels of the display panel covered by the prism; and a width of the sub-pixels of the display panel.
[0385] When implemented by hardware, the obtaining unit 2502 in the embodiments of the present application can be integrated on a communication interface, and the processing unit 2501 can be integrated on a processor. The specific implementation manner is shown in FIG. 26.
[0386] FIG. 27 shows another possible structural schematic diagram of the gray scale control device involved in the above embodiments. The communication device includes a processor 2602 and a communication interface 2603. The processor 2602 is configured to control and manage the actions of the device, for example, to perform the steps performed by the processing unit 2501 described above, and / or to perform other processes of the techniques described herein. The communication interface 2603 is configured to support the communication of the device with other network entities, for example, to perform the steps performed by the obtaining unit 2502 described above. The device can also include a memory 2601 and a bus 2604, and the memory 2601 is configured to store the program code and data of the device.
[0387] The memory 2601 can be a memory or the like in the apparatus, which can include a volatile memory, such as a random access memory, and can also include a nonvolatile memory, such as a read-only memory, a flash memory, a hard disk, or a solid state disk, and can further include a combination of the above-mentioned memories.
[0388] The processor 2602 can be a central processing unit, a general purpose processor, a digital signal processor, an application specific integrated circuit, a field programmable gate array, or other programmable logic device, transistor logic device, hardware component, or any combination thereof, which can implement or execute the various exemplary logical blocks, modules, and circuits described in connection with the disclosure. The processor can implement or execute the various exemplary logical blocks, modules, and circuits described in connection with the disclosure. The processor can also be a combination of computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.
[0389] The bus 2604 can be an extended industry standard architecture (EISA) bus or the like. The bus 2604 can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one thick line is shown in FIG. 26, but it does not mean that there is only one bus or only one type of bus.
[0390] The apparatus in FIG. 26 can also be a chip. The chip includes one or more (including two) processors 2602 and a communication interface 2603.
[0391] Optionally, the chip further includes a memory 2605, which can include a read-only memory and a random access memory, and provides operation instructions and data to the processor 2602. A part of the memory 2605 can also include a non-volatile random access memory (NVRAM).
[0392] In some embodiments, the memory 2605 stores the following elements, execution modules or data structures, or their subsets, or their extended sets.
[0393] In the embodiments of the present application, the operation instructions stored in the memory 2605 (which can be stored in an operating system) are called to perform corresponding operations.
[0394] Some embodiments of the present disclosure provide a computer-readable storage medium (for example, a non-transitory computer-readable storage medium) having stored computer program instructions, which, when executed on a computer (for example, a receiving node), cause the computer to perform the synchronization method of any of the above-described embodiments.
[0395] For example, the above-described computer-readable storage medium can include, but is not limited to, a magnetic storage device (for example, a hard disk, a floppy disk, or a magnetic tape, etc.), an optical disc (for example, a CD (Compact Disk), a DVD (Digital Versatile Disk), etc.), a smart card, and a flash memory device (for example, an EPROM (Erasable Programmable Read-Only Memory), a card, a stick, or a key drive, etc.). The various computer-readable storage media described in the present disclosure can represent one or more devices and / or other machine-readable storage media for storing information. The term "machine-readable storage medium" can include, but is not limited to, a wireless channel and various other media capable of storing, containing, and / or carrying instructions and / or data.
[0396] Some embodiments of the present disclosure also provide a computer program product, for example, stored on a non-transitory computer-readable storage medium. The computer program product includes computer program instructions, which, when executed on a computer (for example, a receiving node), cause the computer to perform the synchronization method of the above-described embodiments.
[0397] Some embodiments of the present disclosure also provide a computer program. When the computer program is executed on a computer (for example, a receiving node), the computer program causes the computer to perform the synchronization method of the above-described embodiments.
[0398] The above-described computer-readable storage medium, computer program product, and computer program have the same beneficial effects as the synchronization method of some of the above-described embodiments, and thus are not described here again.
[0399] In several embodiments provided in the present application, it should be understood that the disclosed system, device, and method can be implemented in other manners. For example, the above-described device embodiments are merely illustrative. For example, the division of the units is only a logical function division. There can be another division manner for actual implementation. For example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed mutual couplings or direct couplings or communication connections can be indirect couplings or communication connections through some interfaces, devices, or units, and can be electrical, mechanical, or in other forms.
[0400] The units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment scheme.
[0401] In addition, each functional unit in each embodiment of the present application can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit.
[0402] The above is only a specific embodiment of the present disclosure, but the protection scope of the present disclosure is not limited thereto, and any person skilled in the art can think of changes or replacements within the technical range disclosed by the present disclosure, which should be covered within the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be subject to the protection scope of the claims.
Claims
1. A display device, wherein, The display device comprises a display panel and a processor; The processor is configured to determine a plurality of gaze areas corresponding to the display panel based on a gaze point position of a target user in the display panel; The processor is further configured to control the gray scale value of a sub-pixel in each of the plurality of gaze areas based on a control strategy corresponding to the gaze area. At least two of the plurality of gaze areas correspond to different control strategies.
2. The display device of claim 1, wherein, The display panel corresponds to a plurality of gaze points, and one gaze point corresponds to one area. Each gaze point corresponds to an area including a transition area and a non-transition area. The plurality of gaze points are the gaze points of the target user viewing the display panel from different angles. The transition area is the area between the critical lines of the areas corresponding to any two gaze points, and the non-transition area is the area other than the transition area.
3. The display device of claim 2, wherein, The processor is further configured to: determine a target gaze point area based on the gaze point position; the target gaze point area is an area in the plurality of gaze point areas that has an impact on the gray scale value of the sub-pixel; the target gaze point area includes a first gaze point area and a second gaze point area, one of which is the area corresponding to the gaze point position, and the other is the adjacent area of the area corresponding to the gaze point position.
4. The display device of claim 3, wherein, The plurality of gaze areas include a center area, which is the area where the gaze point position is located. The processor is specifically configured to: for a plurality of sub-pixels in the center area, reduce the gray scale value of a sub-pixel in the transition area and / or increase the gray scale value of a sub-pixel in the non-transition area.
5. The display device of claim 4, wherein, The processor is specifically configured to: determine a gray scale coefficient of a first sub-pixel based on the position of the center point of the first sub-pixel in the target gaze point area and the width of the first area; the first sub-pixel is any sub-pixel in the transition area of the plurality of sub-pixels in the center area; the first area is a part of the target gaze point area; reduce the gray scale value of the first sub-pixel based on the gray scale coefficient of the first sub-pixel and the first image gray scale value of the first sub-pixel in the target gaze point area; the first image gray scale value is used to represent the gray scale value of the first sub-pixel in the first gaze point area or the gray scale value of the first sub-pixel in the second gaze point area.
6. The display device of claim 4 or 5, wherein, The processor is specifically configured to: increase the gray scale value of a second sub-pixel based on the position of the center point of the second sub-pixel in the target gaze point area and the width of the target gaze point area; The second sub-pixel is any sub-pixel in the non-transition area of the plurality of sub-pixels in the center area.
7. The display device of claim 6, wherein, The processor is further configured to: determine a gray scale coefficient of the second sub-pixel based on the position of the center point of the second sub-pixel in the target gaze point area and the width of the target gaze point area. determine a gray scale value of the second sub-pixel based on a gray scale coefficient of the second sub-pixel and a second image gray scale value of the second sub-pixel in the target gaze point region; the second image gray scale value is used to represent a gray scale value of the second sub-pixel in the first gaze point region or a gray scale value of the second sub-pixel in the second gaze point region; take a minimum value between the gray scale value of the second sub-pixel and a gray scale threshold value of the plurality of sub-pixels as an increased gray scale value of the second sub-pixel.
8. The display device of claim 3, wherein, The plurality of gaze regions include an edge region adjacent to a central region; the central region is a region where the gaze point position is located. The processor is specifically configured to: For the plurality of sub-pixels in the edge region, reduce the gray scale value of the sub-pixel in the transition region among the plurality of sub-pixels.
9. The display device of claim 8, wherein, The processor is specifically configured to reduce the gray scale value of the third sub-pixel based on a region proportion of the third sub-pixel and a third image gray scale value of the third sub-pixel; the third image gray scale value is used to represent an image gray scale value of the third sub-pixel in the first gaze point region or an image gray scale value of the third sub-pixel in the second gaze point region.
10. The display device of claim 9, wherein, The processor is further configured to: determine the region proportion of the third sub-pixel based on a position of a center point of the third sub-pixel in a target gaze point region and a width of the third sub-pixel; the third sub-pixel is any one of the plurality of sub-pixels in the edge region and in the transition region; the region proportion of the third sub-pixel is used to represent a proportion of the third sub-pixel in the first gaze point region or a proportion of the third sub-pixel in the second gaze point region.
11. The display device of claim 9, wherein, The processor is specifically configured to: reduce the gray scale value of the third sub-pixel based on the proportion of the third sub-pixel in the first gaze point region, the proportion of the third sub-pixel in the second gaze point region, and a gray scale value of the third sub-pixel in the first gaze point region; or reduce the gray scale value of the third sub-pixel based on the proportion of the third sub-pixel in the first gaze point region, the proportion of the third sub-pixel in the second gaze point region, and a gray scale value of the third sub-pixel in the second gaze point region.
12. The display device of claim 9, wherein, The processor is specifically configured to: reduce the gray scale value of the third sub-pixel based on a first gray scale value of the third sub-pixel in the first gaze point region and a second gray scale value of the third sub-pixel in the second gaze point region; wherein the first gray scale value is determined based on the proportion of the third sub-pixel in the first gaze point region and an image gray scale value of the third sub-pixel in the first gaze point region; and the second gray scale value is determined based on the proportion of the third sub-pixel in the second gaze point region and an image gray scale value of the third sub-pixel in the second gaze point region.
13. The display device of claim 4 or 8, wherein, The processor is further configured to: The gray scale value of the sub-pixel is blackened to reduce the gray scale value of the sub-pixel; the sub-pixel is a first sub-pixel or a third sub-pixel, the first sub-pixel is any sub-pixel of the plurality of sub-pixels of the center region in the transition region, and the third sub-pixel is any sub-pixel of the plurality of sub-pixels of the edge region in the transition region.
14. The display device of any of claims 2-13, wherein, The processor is further configured to: Increase the coverage range of the transition region, and / or reduce the coverage range of the non-transition region.
15. The display device of any one of claims 4-6 or any one of claims 8-12, wherein, The position of the center point of the sub-pixel in the target gaze point region can be determined in the following manner: According to the gaze point position, a target gaze point region is determined; Based on the position of the center sub-pixel of the target sub-pixel row, the position of the center point of the target sub-pixel in the target gaze point region is determined; The target sub-pixel is any one of a first sub-pixel, a second sub-pixel, and a third sub-pixel; the first sub-pixel is any sub-pixel of the plurality of sub-pixels of the center region in the transition region; the second sub-pixel is any sub-pixel of the plurality of sub-pixels of the center region in the non-transition region; and the third sub-pixel is any sub-pixel of the plurality of sub-pixels of the edge region in the transition region.
16. The display device of claim 15, wherein, The processor is specifically configured to: Obtain the width of the target gaze point region; Based on the width of the target gaze point region and the position of the center sub-pixel, the width of a second region of the row of the target sub-pixel is determined; the second region is an incomplete region on the left side of the row of the target sub-pixel; According to the width of the second region, the position of the center point of the target sub-pixel in the target gaze point region is determined.
17. The display device of claim 15 or 16, wherein, The processor is further configured to: Obtain the offset between the center sub-pixel of the row of the target sub-pixel and the center point of the display panel; Based on the offset and the sub-pixel width, the position of the center sub-pixel of the row of the target sub-pixel is determined.
18. The display device of any one of claims 2-17, wherein, The plurality of gaze regions includes a peripheral region, the peripheral region being a region other than the center region and the edge region; the center region is a region centered on the gaze point position, and the edge region is a region adjacent to the center region; The processor is further configured to: For the plurality of sub-pixels in the peripheral region, no adjustment control is performed.
19. The display device of any one of claims 1-18, wherein, The display device further includes a prism disposed above the display panel; The processor is further configured to: Based on the device parameters of the display device, the placement position of the prism is determined.
20. The display device of claim 19, wherein, The device parameters of the display device include at least two of the following: The horizontal aperture of the prism; The arch height of the prism; The distance between the prism and the display panel; The number of sub-pixels covered by the prism on the display panel; The width of the sub-pixels of the display panel.
21. A gray scale control method, wherein, The method comprises: Based on the gaze point position of the target user in the display panel, a plurality of gaze regions corresponding to the display panel are determined; For each gaze region of the plurality of gaze regions, the gray scale value of the sub-pixel in the gaze region is controlled based on the control strategy corresponding to the gaze region. Corresponding control strategies of at least two gaze areas in the plurality of gaze areas are different.
22. A gray scale control device, wherein, The device comprises a processing unit; The processing unit is configured to determine a plurality of gaze areas corresponding to the display panel based on a gaze point position of a target user in the display panel; The processing unit is further configured to control a gray scale value of a sub-pixel in each gaze area in the plurality of gaze areas based on a corresponding control strategy of the gaze area. Corresponding control strategies of at least two gaze areas in the plurality of gaze areas are different.
23. A computer readable storage medium, wherein, The computer readable storage medium stores instructions, and when the computer executes the instructions, the computer executes the gray scale control method in claim 21.
24. A computer program product, wherein, The computer program product comprises instructions, and when the computer executes the instructions, the computer executes the gray scale control method in claim 21.
Citation Information
Patent Citations
Display device and electronic device
CN104205199A
Information processing device, information processing method, and program
CN116391223A
Method of multi-view image formation and stereoscopic image display device using the same
KR1020150037231A
Three dimensional image display device
KR1020150077167A
Image processing method, image processing device, and electronic apparatus
US20150245007A1