3D display system and method using stereo mapping coordinates

Abstract

In a three-dimensional (3D) display, a display panel having an array of subpixels may display an image according to stereo mapping coordinates associated with a viewer. A periodic optical element may direct light from the display panel to the viewer. The periodic optical element may be uniform along an optical axis that has an oblique angle relative to the display panel. A viewer tracker may determine the position of the viewer. The stereo mapping coordinates of a selected subpixel of the array of subpixels may be a function of the viewer's position, the position of the selected subpixel, a phase function of the periodic optical element, a separation between the periodic optical element and the display panel, and the refractive index of a material disposed between the periodic optical element and the display panel.

Description

[Technical Field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims priority to U.S. Provisional Patent Application Nos. 63 / 478,162, 63 / 478,163, and 63 / 478,164, filed January 1, 2023, each of which is incorporated herein by reference in its entirety.

[0002] STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT Not applicable [Background technology]

[0003] Multi-view displays, such as three-dimensional (3D) displays, can present different views of a single image to each of a viewer's eyes. Efforts are currently underway to reduce or eliminate the artifacts associated with these views. [Brief explanation of the drawings]

[0004] Various features of examples and embodiments consistent with the principles described herein may be more readily understood by reference to the following detailed description in conjunction with the accompanying drawings, in which like reference numerals refer to like structural elements.

[0005] [Figure 1] 1 is a schematic diagram of a three-dimensional (3D) display system including, in one example, a 3D display, according to one embodiment of principles described herein. [Figure 2] 1 is a front view of a display panel including an array of light emitting diodes in one example, according to one embodiment of principles described herein; [Figure 3] FIG. 1 is a front view of a display panel including an example backlight and light valve array, according to one embodiment of principles described herein. [Figure 4] FIG. 1 is a front view of a display panel including a PenTile arrangement of sub-pixels in one example, according to one embodiment of principles described herein. [Figure 5] 1 is a front view of a periodic optical element including, in one example, a lenticular lens array, according to one embodiment of principles described herein. FIG. [Figure 6] 6 is a cross-sectional view of the lenticular lens array of FIG. 5 in one example, according to one embodiment of principles described herein. [Figure 7] FIG. 1 is a front view of a periodic optical element including a parallax barrier with transmissive slits in one example, according to one embodiment of principles described herein. [Figure 8] 8 is a cross-sectional view of a parallax barrier with transmissive slits of FIG. 7 in one example, according to one embodiment of principles described herein. [Figure 9] 1 is a flowchart of a method for displaying a 3D image in one example, according to an embodiment of principles described herein. [Figure 10] 10 is a flowchart of a method for displaying a 3D image in one example, according to another embodiment of principles described herein. DETAILED DESCRIPTION OF THE INVENTION

[0006] Particular examples and embodiments have other features in addition to, or in place of, the features shown in the above-referenced figures, which and other features are described in detail below with reference to the above-referenced figures.

[0007] In a 3D display, a display panel having an array of subpixels may display an image according to stereo mapping coordinates associated with a viewer. A periodic optical element may direct light from the display panel to the viewer. The periodic optical element may be uniform along an optical axis that has an oblique angle relative to the display panel. A viewer tracker may determine the position of the viewer. The stereo mapping coordinates of a selected subpixel of the array of subpixels may be a function of the viewer's position, the position of the selected subpixel, a phase function of the periodic optical element, a separation between the periodic optical element and the display panel, and the refractive index of a material disposed between the periodic optical element and the display panel.

[0008] A controller may use the stereo mapping coordinates from a particular subpixel to determine whether light from that subpixel should be directed to the viewer's left eye or right eye. The controller may use the stereo mapping coordinates of the subpixel to select an image to represent by the subpixel, such as a subpixel in a "left image" that is directed to the viewer's left eye, a subpixel in a "right image" that is directed to the viewer's right eye, or a weighted combination of a subpixel in the "left image" and a subpixel in the "right image."

[0009] As used herein, the article "a" has its ordinary meaning in the patent art, i.e., "one or more." For example, "a subpixel" means one or more subpixels, and thus "the subpixel" herein means "the subpixel(s)." Also, any reference herein to "top," "bottom," "upper," "lower," "above," "below," "front," "back," "first," "second," "left," or "right" is not intended to be limiting. As used herein, the word "about" when applied to a value generally means within the tolerance of the equipment used to generate the value, or, unless expressly specified, may mean plus or minus 10%, plus or minus 5%, or plus or minus 1%. Furthermore, as used herein, the word "substantially" means majority, or nearly all, or all, or an amount in the range of about 51% to about 100%. Furthermore, the examples herein are for illustrative purposes only and are presented for purposes of explanation and not limitation.

[0010] Figure 1 shows a schematic diagram of a 3D display system 100 including, in one example, a 3D display 102, according to one embodiment of the principles described herein. In particular, Figure 1 shows an exploded view of the 3D display 102. The reference numeral conventions shown in Figure 1 and used below assume that the 3D display 102 extends in the (x,y) plane and that the z-axis extends away from the 3D display 102, generally toward the viewer, along a direction perpendicular to the plane of the 3D display 102. Other reference numeral conventions may be used.

[0011] As shown in FIG. 1, the 3D display 102 may include a display panel 106 having an array of subpixels 108 configured to display an image according to stereo mapping coordinates relative to a viewer 104. The subpixels 108 may be located at subpixel positions in a grid having grid axes. Each subpixel 108 may generate light having a specified color. For example, the subpixels 108 may include red, green, and blue subpixels, which generate red, green, and blue light, respectively. Other color / wavelength schemes may be used. The subpixels 108 may be grouped into pixels, each pixel including at least two subpixels 108 that generate light of different colors. Two possible configurations of the display panel 106 are described below and shown in FIGS. 2 and 3. Other configurations may also be used.

[0012] FIG. 2 shows a front view of a display panel 106A including an example array 202 of light-emitting diodes 208, in accordance with one embodiment of the principles described herein. In some embodiments, the light-emitting diodes 208 of the array 202 may be organic light-emitting diodes (OLEDs). Each light-emitting diode 208 may correspond to one subpixel 108. The array 202 of light-emitting diodes 208 may include a red light-emitting diode 208R, a green light-emitting diode 208G, and a blue light-emitting diode 208B, which correspond to red, green, and blue subpixels, respectively. A controller 118 (described below) may control the light-emitting diodes 208 individually or in one or more groups. Each light-emitting diode 208 may controllably generate light in response to an electrical signal provided by the controller 118 or by an appropriate light-emitting diode driver circuit in communication with the controller 118. The controller 118 may directly power a designated light-emitting diode 208 with power that varies as a function of the intensity at the corresponding location in the image. The power delivered to the light-emitting diodes 208 may optionally be pulse-width modulated at a modulation frequency greater than that perceptible to the human eye. Pulse-width modulation can simplify the design of a light-emitting diode array controller because any average power level can be generated from a relatively small number of instantaneous power levels by varying the duty cycle of the power. In some examples, the array 202 of light-emitting diodes 208 may be arranged in a repeating rectangular or square pattern across the surface area 210 of the array 202. For example, the array 202 may have grid axes 204 that are orthogonal to one another. In some examples, the grid axes 204 may be parallel to the edges 206 of the array 202 of light-emitting diodes 208.

[0013] FIG. 3 shows a front view of a display panel 106B including an example backlight 302 and a light valve array 304, according to one embodiment of the principles described herein. While FIG. 3 depicts the backlight 302 and the light valve array 304 as separate, in practice the backlight 302 and the light valve array 304 may be in contact or may be located as close together as practical. The backlight 302 may provide illumination with a uniform or substantially uniform intensity across the surface area of ​​the backlight 302. The backlight 302 may provide illumination with a relatively broad spectrum, such as including most or all of the visible portion of the electromagnetic spectrum. The backlight 302 may provide illumination over a continuum of propagation angles toward the light valve array 304. The backlight 302 may provide unmodulated illumination to the light valve array 304. The light valve array 304 may include light valves 308 that are individually controllable or controllable in one or more groups by a controller 118 (described below). Each light valve 308 may controllably attenuate illumination from the backlight, such as in response to an electrical signal provided by the controller 118 or by an appropriate light valve driver circuit in communication with the controller 118. The light valves 308 may have color filters that allow only a portion of the electromagnetic spectrum to pass through the light valve 308. For example, the light valves 308 may include a red light valve 308R with a red filter that allows only red light to pass through the red light valve 308R, a green light valve 308G with a green filter that allows only green light to pass through the green light valve 308G, and a blue light valve 308B with a blue filter that allows only blue light to pass through the blue light valve 308B. Other color schemes and numbers of colors may also be used. Suitable light valve arrays 304 include liquid crystal light valves, electrophoretic light valves, electrowetting-based light valves, and others. In some examples, the light valves 308 of the light valve array 304 may be arranged in a repeating rectangular or square pattern across the surface area 312 of the light valve array 304. For example, the light valve array 304 may have grid axes 204 that are orthogonal to one another. In some cases, the grid axes 204 may be parallel to the ends 306 of the light valve array 304.

[0014] FIG. 4 shows a front view of a display panel 106C including an example Pentile arrangement of subpixels 408, according to one embodiment of the principles described herein. The subpixels 408 may include light-emitting diodes 208 of the array 202 of light-emitting diodes 208 as shown in FIG. 2 or light valves 308 of the light valve array 304 as shown in FIG. 3, according to various embodiments. Compared to a conventional red-green-blue subpixel arrangement in which each pixel includes a red subpixel 408R (e.g., a light-emitting diode that generates red light), a green subpixel 408G (e.g., a light-emitting diode that generates green light), and a blue subpixel 408B (e.g., a light-emitting diode that generates blue light), the Pentile subpixel arrangement may include only two subpixels 408 (or light-emitting diodes) per pixel 402. The colors of the subpixels 408 in the display panel 106C may be arranged such that the missing color of a particular pixel 402 can be found in a neighboring pixel 404. While some display panels may use software sub-pixel rendering, which can aid in smooth features in an image, the display panel 106C described herein may turn off sub-pixel rendering when an image is displayed. For display panels 106C that turn off sub-pixel rendering when an image is displayed, the position of each sub-pixel 408 (e.g., each light-emitting diode) may be used to calculate the corresponding stereo mapping coordinates, rather than the center of the pixel 402 (e.g., the center of a designated group of sub-pixels 408 or a designated group of light-emitting diodes 208).

[0015] Referring again to FIG. 1 , the 3D display 102 may include a periodic optical element 110 that can direct light 112 corresponding to an image from the display panel 106 to the viewer 104. For example, the periodic optical element 110 may include a parallax optic or a parallax-generating optic. Two possible configurations of the periodic optical element 110 are described below and shown in FIGS. 5 and 6 and 7 and 8. Other configurations may also be used. Each of the configurations of FIGS. 5 and 6 and 7 and 8 may be used in combination with any of the configurations of FIGS. 2 and 3.

[0016] FIG. 5 illustrates a front view of a periodic optical element 110A including an example lenticular lens array 502, according to one embodiment of principles described herein. In some embodiments, the periodic optical element 110A including the lenticular lens array 502 may be referred to as either a parallax optic or a parallax-generating optic, as defined herein. FIG. 6 illustrates a cross-sectional view of an example lenticular lens array 502 of FIG. 5, according to one embodiment of principles described herein. The lenticular lens array 502 may include an array of thin, cylindrical lenslets 604 arranged to receive light from the display panel 106 and at least partially focus and direct the received light toward designated areas proximate the viewer's eyes.

[0017] FIG. 7 illustrates a front view of a periodic optical element 110B including a parallax barrier 702 with, in one example, transmissive slits 804, according to one embodiment of principles described herein. In some embodiments, the periodic optical element 110B including the parallax barrier 702 may be referred to as either a parallax optic or a parallax-generating optic, as defined herein. FIG. 8 illustrates a cross-sectional view of the parallax barrier 702 with, in one example, transmissive slits 804 of FIG. 7, according to one embodiment of principles described herein. The parallax barrier 702 may include an array of thin transmissive slits 804 and opaque strips 806 positioned to block portions of the displayed image in the left and right viewing regions. The transmissive slits 804 may be spatially positioned to ensure that left / right image portions are only visible within the corresponding left / right viewing regions for which they are intended. The parallax barrier 702 may be provided by a static physical layer with precisely positioned slits, or may be electronically generated in an adaptive intermediary liquid crystal display layer.

[0018] A periodic optical element 110 including one of a lenticular lens array 502 or a parallax barrier 702 with transmissive slits 804 may be operable with a display panel 106 including one of an array 202 of light emitting diodes 208 or a backlight 302 and a light valve array 304.

[0019] As shown in FIGS. 5 and 6 , the periodic optical element 110 may be uniform along the optical axis (OA) with a tilt angle α relative to the grid axis 204. For example, the periodic optical element 110 may have transmission features, such as lenslets or transmission slits, that are uniform along the optical axis (OA) and periodic along an orthogonal axis perpendicular to the optical axis (OA). As a specific example, the periodic optical element 110 may have transmission slits parallel to the optical axis (OA) and equally spaced along the orthogonal axis. As another specific example, the periodic optical element 110 may have cylindrical lenslets that are uniform in shape along the optical axis (OA), have curvature along the orthogonal axis, and are equally spaced (e.g., center-to-center) along the orthogonal axis. The periodic optical element 110 may be angled at the tilt angle α relative to the grid axis 204, which may optionally be parallel to the edge 206 of the array 202 of light-emitting diodes 208 or the edge 306 of the light valve array 304. For example, the tilt angle α may be between 45 degrees and a specified angle tolerance, e.g., between 44 and 46 degrees for a tolerance of + / -1 degree, between 43 and 47 degrees for a tolerance of + / -2 degrees, between 42 and 48 degrees for a tolerance of + / -3 degrees, between 41 and 49 degrees for a tolerance of + / -4 degrees, between 40 and 50 degrees for a tolerance of + / -5 degrees, or another suitable angle or range of angles.

[0020] As shown in FIG. 1 , the 3D display 102 may include a material 114 disposed between the display panel 106 and the periodic optical element 110. In some examples, the material 114 may extend entirely between the display panel 106 and the periodic optical element 110, such that light rays emitted from the display panel 106 pass only through the material 114 (and not through air or unfilled volume) before reaching the periodic optical element 110. In other examples, the material 114 may occupy only a portion of the volume between the display panel 106 and the periodic optical element 110, such that light rays emitted from the display panel 106 pass through at least a portion of the material 114 and through the air volume before reaching the periodic optical element 110. The material 114 may have a refractive index represented by n. The value of the refractive index n may be between about 1.3 and about 2, although other suitable values ​​may be used. Suitable materials may include glass, plastic, transparent optical adhesives, and others. In some examples, the material 114 may be supplied in liquid form and then cured in place, such as by exposure to ultraviolet light or heat. In other examples, the material 114 may be manufactured as a solid unit and placed in place within the 3D display 102. For example, the material 114 may function as a cover glass for the display panel 106. In some examples, the material 114 may function as a relatively high-precision spacing element. For example, the material 114 may be manufactured to have a specified thickness within a specified thickness tolerance, and the spacing between the display panel 106 and the periodic optical element 110 may be set to have a value equal to the specified thickness when the 3D display 102 is assembled.

[0021] As shown in FIG. 1 , the 3D display 102 may include a viewer tracker 116 that can determine the position of the viewer 104. The viewer tracker 116 may provide a tracked location of the viewer 104 (e.g., of the viewer's 104 head, one or both eyes of the viewer 104, or another anatomical feature of the viewer 104). The viewer tracker 116 may be coupled to a controller 118 (described below), such as by providing viewer position data (shown in FIG. 1 as coordinates xv, yv, and zv) that represents the measured location or position of the viewer 104. The viewer tracker 116 may provide the viewer position data to the controller 118 at regular or irregular intervals. The viewer tracker 116 may include a camera configured to capture images of the viewer 104. The viewer tracker 116 may further include an image processor (or a general-purpose computer programmed as an image processor) configured to determine the location of the viewer 104 in the captured image to provide a tracked location. In some examples, the controller 118 may include the image processor of the viewer tracker 116, such as by performing operations using the same processing circuitry. In other examples, the controller 118 may be separate from the image processor of the viewer tracker 116. Other suitable viewer trackers may be used, including viewer trackers based on LIDAR (e.g., using the time of flight of reflected light across a displayed scene to determine the distance to one or more objects in the scene, such as the viewer's head or the viewer's eyes) or other technologies. The controller 118 may use the output of the viewer tracker 116, among other data, to calculate stereo mapping coordinates, as described in more detail below.

[0022] 1, the 3D display system 100 may include a controller 118. The controller 118 may include a processor 120 and a memory 122 that stores instructions executable by the processor 120. The instructions may be executable by the processor 120 to perform data processing operations. The data processing operations may include, for a sub-pixel 108 of an array of sub-pixels 108 of the display panel 106, determining stereo mapping coordinates of the sub-pixel 108 and causing the display panel 106 to display an image according to the stereo mapping coordinates. These data processing operations are described in more detail below.

[0023] 9 shows a flowchart of an example method 900 for displaying a 3D image, according to one embodiment of principles described herein. The method 900 for displaying a 3D image may be performed by the 3D display system 100 or another suitable 3D display system, according to various embodiments. The method 900 for displaying a 3D image is just one method for displaying a 3D image. Other suitable methods may be used.

[0024] In operation 902, the 3D display system may use a viewer tracker, such as viewer tracker 116, to determine the position of the viewer.

[0025] In operation 904, the 3D display system may determine stereo mapping coordinates associated with the viewer.

[0026] In operation 906, the 3D display system may display the image using a display panel having an arrangement of sub-pixels, such as display panel 106, according to stereo mapping coordinates associated with the viewer.

[0027] In operation 908, the 3D display system may direct light from the display panel to a viewer using a periodic optical element, such as periodic optical element 110. The periodic optical element may be uniform along an optical axis that has an oblique angle relative to the display panel.

[0028] The stereo mapping coordinates of a selected subpixel of the array of subpixels may be a function of one or more parameters, such as the viewer's position, the position of the selected subpixel, the phase function of the periodic optical element, the separation between the periodic optical element and the display panel, and the refractive index of a material disposed between the periodic optical element and the display panel. Of the above parameters, the viewer's (three-dimensional) position may be dynamically measured by a viewer tracker while the 3D display system 100 is in use, while the other quantities may be known in advance without being measured while the 3D display system 100 is in use.

[0029] The stereo mapping coordinates may determine whether light from a specified subpixel is directed to the viewer's left eye or right eye. Controller 118 may use the stereo mapping coordinates of a specified subpixel to select an image to represent at the specified subpixel, such as a subpixel in a "left image" that is directed to the viewer's left eye, a subpixel in a "right image" that is directed to the viewer's right eye, or a weighted combination of a subpixel in the "left image" and a subpixel in the "right image."

[0030] 10 shows a flowchart of an example method 1000 for displaying a 3D image according to another embodiment of the principles described herein. The method 1000 for displaying a 3D image may be performed by the 3D display system 100 or another suitable 3D display system according to various embodiments. The method 1000 for displaying a 3D image is merely one method for displaying a 3D image. Other suitable methods may be used. In one example, operation 904 of method 900 (e.g., determining stereo mapping coordinates associated with a viewer) may include operations 1004, 1006, and 1008.

[0031] In operation 1002, the 3D display system may determine the position of the viewer using a viewer tracker, such as a viewer tracker.

[0032] In operation 1004, the 3D display system may determine the intermediate position as a function of one or more parameters, such as the position of the viewer, the position of the selected subpixel, the separation between the periodic optical element and the display panel, and the refractive index of a material disposed between the periodic optical element and the display panel. The intermediate position may correspond to a position on the periodic optical element where a light ray emanating from the display panel and reaching the viewer passes through the periodic optical element.

[0033] The intermediate position may be determined in a closed mathematical formula using ray tracing and the following four assumptions: First, it is assumed that the volume between the display panel and the periodic optical element is occupied by a material with a refractive index greater than 1. Second, it is assumed that the volume between the periodic optical elements is occupied by air with a refractive index greater than 1. Third, it is assumed that the periodic optical element forms a planar interface between air and a material with a refractive index greater than 1. Fourth, it is assumed that light rays are refracted at this planar interface located at the surface of the periodic optical element.

[0034] To provide mathematical notation, assume that the display panel extends in the (x,y) plane at a first z position and the periodic optical element extends in the (x,y) plane at a second z position. The position of a selected subpixel on the display panel is denoted as (xs,ys). The intermediate positions on the periodic optical element are denoted as (xi,yi). The (measured) position of the viewer is denoted as (xv,yv,zv).

[0035] In general, determining the intermediate position may include determining the x-coordinate of the intermediate position as a function of parameters including the position of the viewer, the x-coordinate of the position of the selected sub-pixel, the separation between the periodic optical element and the display panel, and the refractive index of a material disposed between the periodic optical element and the display panel. Similarly, determining the intermediate position may include determining the y-coordinate of the intermediate position as a function of parameters including the position of the viewer, the y-coordinate of the position of the selected sub-pixel, the separation between the periodic optical element and the display panel, and the refractive index of a material disposed between the periodic optical element and the display panel.

[0036] Mathematically, determining the intermediate position is done by using Equation (1)

[0037]

number

[0038] Determining the intermediate position is done by using Equation (2) xi=xs+q(xv-xs) (2) The method may further include setting an x-coordinate xi of the intermediate position according to:

[0039] Determining the intermediate position is done by using Equation (3) yi=ys+q(yv-ys) (3) The method may further include setting a y coordinate yi of the intermediate position according to:

[0040] The intermediate position (xi, yi) corresponds to the position on the periodic optical element where a ray of light that leaves the display panel from subpixel position (xs, ys) and reaches the viewer at position (xv, yv, zv) passes through the periodic optical element.

[0041] Returning to FIG. 10, in operation 1006, the 3D display system may apply a phase function to the intermediate position to generate a phase value.

[0042] The phase function may be linear with respect to position on the periodic optical element in a direction angled relative to the optical axis. The phase function may receive as input the intermediate positions determined in operation 1004. The phase function may generate a single phase value as a function of the intermediate positions.

[0043] For example, along the extension of a first lenticular lens or first transmission slit, the phase value may have a first value, such as zero. The phase value may increase linearly between the first lenticular lens or first transmission slit and the adjacent second lenticular lens or second transmission slit. Along the extension of the second lenticular lens or second transmission slit, the phase value may have a second value, such as one. The phase value may thus be linear, having a constant value along each lenticular lens or each transmission slit and a linearly increasing value in the area between adjacent lenticular lenses or adjacent transmission slits.

[0044] In some examples, the phase function may have integer values ​​at the lenticular lenses or transmission slits and linearly increasing decimal values ​​between the lenticular lenses or transmission slits, thereby essentially "numbering" the lenticular lenses or transmission slits in sequence.

[0045] In general, applying the phase function to the intermediate position to generate the phase value may include summing a first quantity, a second quantity, and a third quantity to form the phase value. The first quantity may represent the phase at a specified position on the display panel, such as the center of the display panel or the center of the periodic optical element. The second quantity may be the x-coordinate of the intermediate position divided by the period of the periodic optical element along the x-direction. The third quantity may be the y-coordinate of the intermediate position divided by the period of the periodic optical element along the y-direction.

[0046] Mathematically, applying a phase function to the intermediate positions to generate the phase values ​​is given by Eq. (4)

[0047]

number

[0048] Returning to FIG. 10, in operation 1008, the 3D display system may use the phase values ​​to form stereo mapping coordinates associated with the viewer.

[0049] In general, using the phase values ​​to form the stereo mapping coordinates may include taking the remainder of the phase values ​​to form the stereo mapping coordinates.

[0050] Mathematically, for a phase function that assigns consecutive integers to the lenticular lens or transmission slits, forming the stereo mapping coordinates using the phase values ​​is given by Equation (5): S=φ mod 1 (5) where φ is a phase value. For example, for a specified subpixel, if the phase value φ is equal to 5.7, the corresponding stereo mapping coordinate S is equal to 0.7.

[0051] In some configurations, the 3D display system may display two adjacent views of a multi-view image. For example, the 3D display system may allocate three or more views by mapping N views k to a phase band [k / N, (k+1) / N]. Other suitable configurations may also be used.

[0052] In operation 1010, the 3D display system may display an image using a display panel having an array of sub-pixels, such as display panel 106, according to stereo mapping coordinates associated with a viewer. Controller 118 may cause the display panel to display the image according to the stereo mapping coordinates of the sub-pixels of the display panel. Two configurations for displaying an image according to stereo coordinates are described below.

[0053] In a first configuration, displaying the image according to the stereo mapping coordinate of the selected subpixel may include comparing the stereo mapping coordinate with a specified threshold. In some examples, the specified threshold may be the midpoint (e.g., 0.5) of a specified range (e.g., between 0 and 1) of the stereo mapping coordinate. In response to this comparison, the controller 118 may cause the display panel to display one of a portion of the image corresponding to the viewer's left eye or a portion of the image corresponding to the viewer's right eye at the selected subpixel. In an example of a phase function that assigns consecutive integers to a lenticular lens or a transmission slit, the specified threshold may be equal to 0.5. If the stereo mapping coordinate is between 0 and 0.5, the specified subpixel is positioned to direct light toward the viewer's left eye (or right eye). If the stereo mapping coordinate is between 0.5 and 1, the specified subpixel is positioned to direct light toward the viewer's right eye (or left eye).

[0054] In a second configuration, displaying the image according to the stereo mapping coordinates of the selected subpixels may include combining a portion of the image corresponding to the viewer's left eye and a portion of the image corresponding to the viewer's right eye in a ratio that depends on the value of the stereo mapping coordinates to form a blended portion of the image and displaying the blended portion of the image at the selected subpixels. The ratio may vary according to a nonlinear smoothing function. The nonlinear smoothing function may form the blended portion of the image in a linear color space. Such blending of the images may smooth transitions between images that may occur at certain values ​​of the stereo mapping coordinates, such as at or near values ​​of 0, 0.5, and 1.

[0055] In operation 1012, the 3D display system may direct light from the display panel to a viewer using a periodic optical element, such as periodic optical element 110. The periodic optical element may be uniform along an optical axis that has an oblique angle relative to the display panel.

[0056] At a viewing distance D from the 3D display, the stereo viewing window (e.g., the phase value of a given subpixel varies over its entire range, e.g., from 0 to 1) is n * D * In some examples, the viewing window may span twice the interocular distance IO of the viewer. In these examples, the period px of the periodic element in the x-direction may be (2 * IO * d) / (n * D) may be chosen to be equal to (or approximately equal to)

[0057] To further illustrate the systems and related methods disclosed herein, a non-limiting list of examples is provided below. Each of the following non-limiting examples may stand alone or may be combined with any one or more of the other examples in any permutation or combination.

[0058] In Example 1, a method for displaying a three-dimensional (3D) image may include determining a position of a viewer using a viewer tracker; determining stereo mapping coordinates associated with the viewer; displaying the image using a display panel having an array of subpixels according to the stereo mapping coordinates associated with the viewer; and directing light from the display panel to the viewer using a periodic optical element, the periodic optical element directing the light uniformly along an optical axis having an oblique angle with respect to the display panel, wherein the stereo mapping coordinates of selected subpixels of the array of subpixels are a function of the position of the viewer, the position of the selected subpixel, a phase function of the periodic optical element, a separation between the periodic optical element and the display panel, and a refractive index of a material disposed between the periodic optical element and the display panel.

[0059] In Example 2, the method of Example 1 may optionally be configured such that determining the stereo mapping coordinates of the selected subpixels includes determining intermediate positions as a function of the viewer's position, the position of the selected subpixel, a separation between the periodic optical element and the display panel, and a refractive index of a material disposed between the periodic optical element and the display panel; applying a phase function to the intermediate positions to generate phase values; and forming the stereo mapping coordinates using the phase values.

[0060] In Example 3, the method of any one of Examples 1-2 may optionally be configured such that the intermediate position corresponds to a position on the periodic optical element where a light ray emanating from the display panel and reaching a viewer passes through the periodic optical element.

[0061] In Example 4, the method of any one of Examples 1-3 may be optionally configured such that determining the intermediate position includes determining the x-coordinate of the intermediate position as a function of the position of the viewer, an x-coordinate of the position of the selected subpixel, a distance between the periodic optical element and the display panel, and a refractive index of a material disposed between the periodic optical element and the display panel; and determining the y-coordinate of the intermediate position as a function of the position of the viewer, a y-coordinate of the position of the selected subpixel, a distance between the periodic optical element and the display panel, and a refractive index of a material disposed between the periodic optical element and the display panel.

[0062] In Example 5, the method of any one of Examples 1-4 further comprises:

[0063]

number

[0064] In Example 6, the method of any one of Examples 1-5 may optionally be configured such that the phase function is linear with respect to position on the periodic optical element in a direction angled relative to the optical axis.

[0065] In Example 7, the method of any one of Examples 1-6 may be optionally configured such that applying the phase function to the intermediate position to generate the phase value includes summing a first amount, a second amount, and a third amount to form the phase value, wherein the first amount represents a phase at the specified position on the display panel, the second amount is an x-coordinate of the intermediate position divided by a period of the periodic optical element along the x-direction, and the third amount is a y-coordinate of the intermediate position divided by a period of the periodic optical element along the y-direction.

[0066] In Example 8, the method of any one of Examples 1 to 7 further comprises applying a phase function to the intermediate positions to generate the phase values.

[0067]

number

[0068] In Example 9, the method of any one of Examples 1-8 may be optionally configured such that forming the stereo mapping coordinates using the phase values ​​includes taking a remainder of the phase values ​​to form the stereo mapping coordinates.

[0069] In Example 10, the method of any one of Examples 1-9 may be optionally configured such that forming the stereo mapping coordinates using the phase values ​​includes setting the stereo mapping coordinate S equal to S=φ mod 1, where φ is the phase value.

[0070] In Example 11, the method of any one of Examples 1-10 may be optionally configured such that displaying the image according to the stereo mapping coordinates of the selected subpixels includes comparing the stereo mapping coordinates to a specified threshold, and displaying one of a portion of the image corresponding to the viewer's left eye or a portion of the image corresponding to the viewer's right eye at the selected subpixels in response to the comparison.

[0071] In Example 12, the method of any one of Examples 1-11 may optionally be configured such that displaying the image in accordance with the stereo mapping coordinates of the selected sub-pixels includes combining a portion of the image corresponding to the viewer's left eye and a portion of the image corresponding to the viewer's right eye in a ratio that depends on the values ​​of the stereo mapping coordinates to form a blended portion of the image, and displaying the blended portion of the image at the selected sub-pixels.

[0072] In Example 13, the method of any one of Examples 1-12 may optionally be configured such that the ratio is configured to vary according to a non-linear smoothing function, and the non-linear smoothing function is configured to form the blended portion of the image in linear color space.

[0073] In Example 14, a three-dimensional (3D) display may include a display panel having an array of subpixels configured to display an image according to stereo mapping coordinates relative to a viewer; a periodic optical element configured to direct light from the display panel to the viewer, the periodic optical element being uniform along an optical axis having an oblique angle with respect to the display panel; and a viewer tracker configured to determine a position of the viewer, wherein the stereo mapping coordinates of selected subpixels of the array of subpixels are a function of the position of the viewer, the position of the selected subpixel, a phase function of the periodic optical element, a separation between the periodic optical element and the display panel, and a refractive index of a material disposed between the periodic optical element and the display panel.

[0074] In Example 15, the 3D display of Example 14 may optionally be configured such that the periodic optical element comprises one of a lenticular lens array or a parallax barrier with transmissive slits.

[0075] In Example 16, the 3D display of any one of Examples 14-15 may optionally be configured such that the display panel is an organic light emitting diode array with a PenTile subpixel arrangement, and the display panel is configured to turn off subpixel rendering when an image is displayed.

[0076] In Example 17, the 3D display of any one of Examples 14-16 may optionally be configured such that the tilt angle is within a specified angular tolerance from 45 degrees.

[0077] In Example 18, a three-dimensional (3D) display system may include a display panel having an array of subpixels configured to display an image according to stereo mapping coordinates relative to a viewer, the subpixels being located at subpixel locations in a grid having a grid axis; a periodic optical element configured to direct light corresponding to the image from the display panel to the viewer, the periodic optical element being uniform along an optical axis having a tilt angle relative to the grid axis; a viewer tracker configured to determine a position of the viewer; and a controller comprising a processor and a memory storing instructions executable by the processor, the instructions being executable by the processor to perform a data processing operation, the data processing operation including, for selected subpixels of the array of subpixels:

[0078]

number

[0079]

number

[0080] In Example 19, the 3D display system of Example 18 may optionally be configured such that the data processing operations further include comparing the stereo mapping coordinates to a specified threshold, the specified threshold being a midpoint of a specified range of the stereo mapping coordinates, and, in response to the comparison, causing one of a portion of the image corresponding to the viewer's left eye or a portion of the image corresponding to the viewer's right eye to be displayed on selected subpixels of the display panel.

[0081] In Example 20, the 3D display system of any one of Examples 18-19 may optionally be configured such that the data processing operations further include combining a portion of the image corresponding to the viewer's left eye and a portion of the image corresponding to the viewer's right eye in a ratio that depends on the values ​​of the stereo mapping coordinates to form a blended portion of the image, and causing the display panel to display the blended portion of the image at selected sub-pixels, the ratio being configured to vary according to a non-linear smoothing function, the non-linear smoothing function being configured to form the blended portion of the image in a linear color space.

[0082] Thus, examples and embodiments of 3D display systems and methods capable of displaying images according to stereo mapping coordinates relative to a viewer have been described. The examples described above illustrate only some of the many specific examples that illustrate the principles described herein. Clearly, those skilled in the art can readily devise numerous other configurations without departing from the scope defined by the following claims. [Explanation of symbols]

[0083] 100 3D Display System 102 3D Display 104 Viewer 106, 106A, 106B, 106C display panels 108, 408, 408R, 408G, 408B subpixels 110, 110A, 110B Periodic Optical Element 112 light 114 Material 116 Viewer Tracker 118 Controller 120 processors 122 memory 202 array 204 Grid Axis 206, 306 End 208, 208R, 208G, 208B light-emitting diodes 210 surface area 302 Backlight 304 Light valve array 308, 308R, 308B, 308G light valve 312 surface area 402 pixels 502 lenticular lens array 604 Small Lens 702 Parallax Barrier 804 Transmission slit 806 Strip 900 ways 1000 ways

Claims

1. 1. A method for displaying a three-dimensional (3D) image, comprising: determining a viewer's location using a viewer tracker; determining stereo mapping coordinates associated with the viewer; displaying an image using a display panel having an arrangement of sub-pixels according to the stereo mapping coordinates associated with the viewer; directing light from the display panel to the viewer using a periodic optical element, the periodic optical element directing light uniformly along an optical axis that has an oblique angle relative to the display panel; Including, the stereo mapping coordinates of a selected subpixel of the array of subpixels are a function of the position of the viewer, the position of the selected subpixel, a phase function of the periodic optical element, a separation between the periodic optical element and the display panel, and a refractive index of a material disposed between the periodic optical element and the display panel.

2. Determining the stereo mapping coordinates of the selected sub-pixels includes: determining an intermediate position as a function of the position of the viewer, the position of the selected subpixel, the separation between the periodic optical element and the display panel, and the refractive index of the material disposed between the periodic optical element and the display panel; applying the phase function to the intermediate locations to generate phase values; forming the stereo mapping coordinates using the phase values; The method of claim 1 , comprising:

3. 3. The method of claim 2, wherein the intermediate positions correspond to positions on the periodic optical element where light rays emanating from the display panel and reaching the viewer pass through the periodic optical element.

4. determining the intermediate position determining an x-coordinate of the intermediate position as a function of the position of the viewer, an x-coordinate of the position of the selected subpixel, the separation between the periodic optical element and the display panel, and the refractive index of the material disposed between the periodic optical element and the display panel; determining a y-coordinate of the intermediate position as a function of the position of the viewer, a y-coordinate of the position of the selected subpixel, the separation between the periodic optical element and the display panel, and the refractive index of the material disposed between the periodic optical element and the display panel; 3. The method of claim 2, comprising:

5. determining the intermediate position [Equation 1] where d is the separation between the periodic optical element and the display panel, n is the refractive index of the material disposed between the periodic optical element and the display panel, xv is the x-component of the position of the viewer, yv is the y-component of the position of the viewer, zv is the z-component of the position of the viewer, xs is the x-component of the position of the selected sub-pixel, and ys is the y-component of the position of the selected sub-pixel; setting the x-coordinate of the intermediate position xi equal to xi=xs+q(xv-xs); setting the y coordinate of the intermediate position yi equal to yi = ys + q (yv - ys); 3. The method of claim 2, comprising:

6. 3. The method of claim 2, wherein the phase function is linear with respect to position on the periodic optical element in a direction angled relative to the optical axis.

7. applying the phase function to the intermediate positions to generate the phase values; summing the first amount, the second amount, and the third amount to form the phase value; Including, the first quantity represents a phase at a specified location on the display panel; the second amount is the x-coordinate of the intermediate position divided by the period of the periodic optical element along the x-direction; The method of claim 2 , wherein the third amount is the y coordinate of the intermediate position divided by the period of the periodic optical element along the y direction.

8. applying the phase function to the intermediate positions to generate the phase values; [Equation 2] where φ is the phase value at a center of the periodic optical element, xi is the x-component of the intermediate position, yi is the y-component of the intermediate position, α is the tilt angle, and px is the period of the periodic optical element taken along the x-direction.

9. The method of claim 2 , wherein using the phase values ​​to form the stereo mapping coordinates comprises taking remainders of the phase values ​​to form the stereo mapping coordinates.

10. 3. The method of claim 2, wherein forming the stereo mapping coordinates using the phase values ​​comprises setting the stereo mapping coordinates S equal to S=φ mod 1, where φ is the phase value.

11. displaying the image according to the stereo mapping coordinates of the selected sub-pixels; comparing the stereo mapping coordinates to a specified threshold; displaying one of a portion of the image corresponding to the viewer's left eye or a portion of the image corresponding to the viewer's right eye at the selected sub-pixels in response to the comparison; The method of claim 1 , comprising:

12. displaying the image according to the stereo mapping coordinates of the selected sub-pixels; combining a portion of the image corresponding to the viewer's left eye and a portion of the image corresponding to the viewer's right eye in a ratio that depends on the values ​​of the stereo mapping coordinates to form a blended portion of the image; displaying the blended portion of the image at the selected sub-pixels; The method of claim 1 , comprising:

13. The method of claim 12 , wherein the ratio is configured to vary according to a non-linear smoothing function, the non-linear smoothing function configured to form the blended portion of the image in a linear color space.

14. 1. A three-dimensional (3D) display, comprising: a display panel having an array of sub-pixels configured to display an image according to stereo mapping coordinates relative to a viewer; a periodic optical element configured to direct light from the display panel to the viewer, the periodic optical element being uniform along an optical axis that has an oblique angle relative to the display panel; a viewer tracker configured to determine a position of the viewer; and Equipped with a three-dimensional (3D) display, wherein the stereo mapping coordinates of a selected subpixel of the array of subpixels are a function of the position of the viewer, the position of the selected subpixel, a phase function of the periodic optical element, a separation between the periodic optical element and the display panel, and a refractive index of a material disposed between the periodic optical element and the display panel.

15. 15. The 3D display of claim 14, wherein the periodic optical element comprises one of a lenticular lens array or a parallax barrier with transmissive slits.

16. 15. The 3D display of claim 14, wherein the display panel is an organic light emitting diode array with a Pentile subpixel arrangement, and the display panel is configured to turn off subpixel rendering when the image is displayed.

17. 15. The 3D display of claim 14, wherein the tilt angle is within a specified angular tolerance of 45 degrees.

18. 1. A three-dimensional (3D) display system, comprising: a display panel having an array of sub-pixels configured to display an image according to stereo mapping coordinates relative to a viewer, the sub-pixels being located at sub-pixel positions in a grid having grid axes; a periodic optical element configured to direct light corresponding to the image from the display panel to the viewer, the periodic optical element being uniform along an optical axis having an oblique angle relative to the grid axis; a viewer tracker configured to determine a position of the viewer; and a controller comprising a processor and a memory storing instructions executable by said processor, said instructions being executable by said processor to perform data processing operations; and wherein the data processing operation comprises, for a selected sub-pixel of the array of sub-pixels: [Equation 3] where d is the separation between the periodic optical element and the display panel, n is the refractive index of a material disposed between the periodic optical element and the display panel, xv is the x-component of the position of the viewer, yv is the y-component of the position of the viewer, zv is the z-component of the position of the viewer, xs is the x-component of the position of the selected sub-pixel, and ys is the y-component of the position of the selected sub-pixel; setting the x-coordinate of the intermediate position xi equal to xi=xd+q(xv-xs); setting the y coordinate yi of the intermediate position equal to yi=yd+q(yv-ys); [Equation 4] setting the phase value to a phase value φ given by setting φc as the phase value at the specified position of the periodic optical element, α as the tilt angle, and px as the period of the periodic optical element taken along the x direction; setting the stereo mapping coordinate S equal to S=φ mod 1; A three-dimensional (3D) display system comprising:

19. The data processing operation comprises: comparing the stereo mapping coordinates with a specified threshold, the specified threshold being the midpoint of a specified range of the stereo mapping coordinates; displaying one of a portion of the image corresponding to the viewer's left eye or a portion of the image corresponding to the viewer's right eye at the selected sub-pixels of the display panel in response to the comparison; 20. The 3D display system of claim 18, further comprising:

20. The data processing operation comprises: combining a portion of the image corresponding to the viewer's left eye and a portion of the image corresponding to the viewer's right eye in a ratio that depends on the values ​​of the stereo mapping coordinates to form a blended portion of the image; causing the display panel to display the blended portion of the image at the selected sub-pixels, the ratio being configured to vary according to a non-linear smoothing function, the non-linear smoothing function being configured to form the blended portion of the image in a linear color space; and 20. The 3D display system of claim 18, further comprising:

Images