Predictive head tracking multi-view display and method

Abstract

A predictive head tracking multi-view display includes a multi-beam backlight that provides a plurality of light beams having different principal angular directions corresponding to different view directions of a multi-view image. A processor receives a plurality of temporary views of a multi-view image. The temporary view corresponds to a different view direction. A processor receives information about a predicted location of a user. The processor shifts the temporary view relative to the view direction to form a plurality of shifted views corresponding to different view directions. The shifted view is shifted by a shift value that varies as a function of the predicted position of the user and over the field of view of the multi-view image. The light valve array modulates the plurality of light beams to provide a plurality of shifted views of the multi-view image in a view direction as the multi-view image.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to U.S. Provisional Patent Application Serial No. 63 / 340,369, filed on May 10, 2022, the entire contents of which are incorporated herein by reference. Background Art

[0003] Electronic displays are almost ubiquitous media for transmitting information to users of a wide variety of devices and products. The most commonly used electronic displays include cathode ray tubes (CRTs), plasma display panels (PDPs), liquid crystal displays (LCDs), electroluminescent displays (ELs), organic light emitting diodes (OLEDs), and active matrix OLED (AMOLED) displays, electrophoretic displays (EPs), and various displays (e.g., digital micromirror devices, electrowetting displays, etc.) using electromechanical or electrofluidic light modulation. Generally speaking, electronic displays can be classified as active displays (i.e., displays that emit light) or passive displays (i.e., displays that modulate light provided by another source). Examples of active displays include CRTs, PDPs, and OLED / AMOLEDs. Displays that are generally classified as passive when considering emitted light are LCD and EP displays. Although passive displays generally exhibit attractive performance characteristics, including but not limited to inherent low power consumption, they may be found to be somewhat limited in use in many practical applications due to the lack of luminous ability. BRIEF DESCRIPTION OF THE DRAWINGS

[0004] The various features of examples and embodiments according to the principles described herein may be more readily understood by reference to the following detailed description taken in conjunction with the accompanying drawings, in which like reference numerals represent like structural elements, and in which:

[0005] Figure 1 A perspective view of a multi-view display in an example is shown, according to an embodiment consistent with the principles described herein.

[0006] Figure 2 A graphical representation of angular components of light beams having a particular principal angle direction corresponding to a view direction of a multi-view display in an example is shown, according to an embodiment consistent with principles described herein.

[0007] Figure 3 A cross-sectional view of an example head-tracking multi-view display is shown, according to an embodiment consistent with the principles described herein.

[0008] Figure 4 A plan view of an example of a shift-invariant head-tracking multi-view display is shown, where the shift value does not vary across the field of view of the multi-view images.

[0009] Figure 5A A plan view of an example head-tracked multi-view display used in a peel-away mode with a user in a first position is shown, according to an embodiment consistent with principles described herein.

[0010] Figure 5B A plan view of an example head-tracked multi-view display used in a peel-away mode with a user in a second position is shown, according to an embodiment consistent with principles described herein.

[0011] Figure 5C A plan view of an example head-tracked multi-view display used in a peel-away mode with a user in a third position is shown, according to an embodiment consistent with principles described herein.

[0012] Fig. 6A A plan view of an example head-tracking multi-view display used in a sliding mode with a user in a first position is shown, according to an embodiment consistent with principles described herein.

[0013] Figure 6B A plan view of an example head-tracking multi-view display used in a sliding mode with a user in a second position is shown, according to an embodiment consistent with principles described herein.

[0014] Figure 6C A plan view of an example head-tracking multi-view display used in a sliding mode with a user at a third position is shown, according to an embodiment consistent with principles described herein.

[0015] Figure 7 A diagram illustrating a model of display latency for a head-tracking multi-view display in an example, according to an embodiment consistent with the principles described herein.

[0016] Figure 8 A block diagram illustrating sources of delay in an example head-tracking multi-view display system is shown, according to an embodiment consistent with the principles described herein.

[0017] Fig. 9 Shown is a block diagram of an example head tracking multi-view display system, according to an embodiment consistent with the principles described herein.

[0018] Fig.10 A flowchart of an example method of operation for a head tracking multi-view display is shown, according to an embodiment consistent with the principles described herein.

[0019] Certain examples and embodiments have other features that are in addition to or in lieu of the features shown in the above drawings. These and other features are described in detail below with reference to the above drawings. DETAILED DESCRIPTION

[0020] Examples and embodiments according to the principles described herein provide a multi-view or three-dimensional (3D) image display that employs information about the user's position over time, sometimes referred to as "head tracking" or alternatively referred to as "head-tracked". Embodiments consistent with the principles described herein may employ a multi-view display to provide different sets of views of a scene represented by a multi-view image depending on the user's position. A head-tracking multi-view display may receive temporary views of a multi-view image corresponding to different view directions. A head-tracking (or head-tracking) multi-view display may receive information about a predicted position of a user, such as from a multi-tracked position of a user obtained from a head-tracking sensor. In some examples, the predicted position may include a forecast of what is most likely to happen in the future (based on current information, past experience, or a model or formula), as well as an estimate as a set of potential approximations or values ​​or quantities for prediction. In some examples, the predicted position may include a "best" or most likely estimate of a future position. A head-tracking (or head-tracking) multi-view display may shift the temporary view relative to the view direction to form a shifted view corresponding to a different view direction. The shifted views may be shifted by a shift value that varies as a function of the predicted position of the user and varies across the field of view of the multi-view image.

[0021] It may be beneficial to use a shift value that changes over the field of view of a multi-view image. For example, in a display using a shift value that does not change over the field of view of a multi-view image, a user may perceive different views of the multi-view image at different locations on the display, which may make the user feel uneasy or discordant. As a specific example, a user may simultaneously perceive a portion of the display as showing a first view and another portion of the display as showing a second view. In contrast, in a display in which the shift value changes over the field of view of a multi-view image as described in detail below, the user may perceive the same view over the full field of view of the multi-view image. Presenting a multi-view image so that the user perceives the same view over the field of view of the multi-view image (e.g., avoiding a situation in which the user perceives a portion of the display as showing a first view and another portion of the display as showing a second view) can provide a more realistic viewing experience for the user. In a specific example, one eye of the user may perceive the first view over the full field of view of the multi-view image, and the other eye of the user may perceive the second view over the full field of view of the multi-view image, so that the user may experience a stereoscopic effect.

[0022] In various embodiments, a head tracking sensor or algorithm may provide information about the position or location of a user relative to a multi-view display. That is, the user location may be determined or inferred by tracking the location of the user's head or other anatomical features. For ease of discussion herein and not limitation, embodiments or components described herein may be referred to as including or using "head tracking," such as in multi-view displays, systems, and methods that employ, for example, head tracking.

[0023] In addition, the head tracking sensor or algorithm can take into account the movement of the user. For example, a head tracking (or head tracking) multi-view display can shift a temporary view relative to a view direction to form a shifted view corresponding to a different view direction. The shifted view can be shifted by a shift value that varies as a function of the predicted position of the user. The predicted position can be determined from past tracking positions, such as by determining a velocity or determining a velocity and acceleration from past tracking positions. The shift value can take into account the delay caused by one or both of a raster scan of the display panel and a raster scan or rolling shutter of the head tracking sensor. The shift value can vary over the field of view of the multi-view image.

[0024] In various embodiments, a predictive head tracking multi-view display may include a multi-beam backlight that provides multiple light beams with different principal directions, the different principal directions corresponding to different view directions of a multi-view image. A processor may receive multiple temporary views of the multi-view image. The temporary views may correspond to different view directions. The processor may receive information about a predicted position of a user. The processor may shift the temporary views relative to the view direction to form multiple shifted views corresponding to different view directions. The shifted views may be shifted by a shift value that varies as a function of the predicted position of the user and varies over a field of view of the multi-view image. A light valve array may modulate the multiple light beams to provide multiple shifted views of the multi-view image to the view direction as the multi-view image.

[0025] Figure 1 1 shows a perspective view of a multi-view display 10 in an example, according to an embodiment consistent with the principles described herein. Figure 1 As shown, the multi-view display 10 includes a screen 12 to display a multi-view image to be viewed. The multi-view display 10 provides different views 14 of the multi-view image in different view directions 16 relative to the screen 12. The view directions 16 are shown as arrows extending from the screen 12 in various different principal directions. The different views 14 are shown as shaded polygonal boxes at the ends of the arrows (i.e., depicting the view directions 16). Only four views 14 and four view directions 16 are shown, all of which are by way of example and not limitation. Note that although the different views 14 are shown in FIG. Figure 114 is shown as being above the screen, but when the multi-view images are displayed on the multi-view display 10, the view 14 actually appears on or near the screen 12. Depicting the view 14 above the screen 12 is only for simplicity of explanation and is intended to represent viewing the multi-view display 10 from a corresponding one of the view directions 16 corresponding to the particular view 14.

[0026] According to the definition herein, a view direction, or equivalently a light beam having a direction corresponding to a view direction of a multi-view display, generally has a principal angle direction given by an angular component {θ, φ}. The angular component θ is referred to herein as the "elevation component" or "elevation angle" of the light beam. The angular component φ is referred to as the "azimuth component" or "azimuth angle" of the light beam. According to the definition, the elevation angle θ is an angle in a vertical plane (e.g., a plane perpendicular to the multi-view display screen), while the azimuth angle φ is an angle in a horizontal plane (e.g., a plane parallel to the multi-view display screen). Figure 2 An example is shown with view directions (eg, Figure 1 16 in the multi-view display). In addition, the light beam 20 is emitted or emanates from a specific point according to the definition herein. That is, the light beam 20 has a central ray associated with a specific origin within the multi-view display according to the definition. Figure 2 The beam (or view direction) origin O is also shown.

[0027] Furthermore, as used herein, the term "multi-view" as used in the terms "multi-view image" and "multi-view display" is defined as a plurality of views representing different viewing angles or angular disparity between views including a plurality of views. Additionally, as defined herein, the term "multi-view" explicitly includes more than two different views (i.e., a minimum of three views and typically more than three views) herein. Thus, a "multi-view display" as used herein is explicitly distinguished from a stereoscopic display that includes only two different views to represent a scene or image. Note, however, that although a multi-view image and a multi-view display include more than two views, as defined herein, a multi-view image can be viewed (e.g., on a multi-view display) as a stereoscopic image pair by selecting only two of the multi-view views to be viewed at a time (e.g., one view for each eye).

[0028] "Multi-view pixels" are defined herein as a set of sub-pixels representing a "view" pixel in each of a similar plurality of different views of a multi-view display. Specifically, a multi-view pixel may have a separate sub-pixel corresponding to a view pixel in each different view of a multi-view image, or represent a view pixel in each different view of a multi-view image. In addition, according to the definition herein, the sub-pixels of a multi-view pixel are so-called "directional pixels" because each sub-pixel is associated with a predetermined view direction of a corresponding one of the different views. In addition, according to various examples and embodiments, different view pixels represented by the sub-pixels of a multi-view pixel may have identical or at least substantially similar positioning or coordinates in each different view. For example, a first multi-view pixel may have a separate sub-pixel corresponding to a view pixel located at {x1, y1} in each different view of a multi-view image, while a second multi-view pixel may have a separate sub-pixel corresponding to a view pixel located at {x2, y2} in each different view, and so on.

[0029] In this document, a "lightguide" is defined as a structure that guides light within the structure using total internal reflection. In particular, a lightguide may include a core that is substantially transparent at the operating wavelength of the lightguide. In various examples, the term "lightguide" generally refers to a dielectric optical waveguide that uses total internal reflection to guide light at the interface between the dielectric material of the lightguide and the material or medium surrounding the lightguide. By definition, the condition for total internal reflection is that the refractive index of the lightguide is greater than the refractive index of the surrounding medium adjacent to the surface of the lightguide material. In some embodiments, in addition to or in place of the above-mentioned refractive index difference, the lightguide may include a coating to further promote total internal reflection. The coating may be, for example, a reflective coating. The lightguide may be any of a number of lightguides, including but not limited to one or both of a plate or slab lightguide and a strip lightguide.

[0030] Furthermore, in this document, the term "plate" when applied to a lightguide, as in "plate lightguide", is defined as a segmented or differently planar layer or sheet, which is sometimes referred to as a "flat plate" lightguide. In particular, a plate lightguide is defined as a lightguide configured to guide light in two substantially orthogonal directions defined by a top surface and a bottom surface (i.e., opposing surfaces) of the lightguide. Furthermore, according to the definition herein, the top surface and the bottom surface are both separated from each other and may be substantially parallel to each other, at least in a differential sense. That is, within any small differential section of the plate lightguide, the top surface and the bottom surface are substantially parallel or coplanar.

[0031] In some embodiments, the plate light guide may be substantially flat (i.e., confined to a plane), and thus, the plate light guide is a planar light guide. In other embodiments, the plate light guide may be curved in one or two orthogonal dimensions. For example, the plate light guide may be curved in a single dimension to form a cylindrical plate light guide. However, any curvature has a sufficiently large radius of curvature to ensure that total internal reflection is maintained within the plate light guide to guide light.

[0032] As used herein, a "light source" is defined as a source of light (e.g., an optical emitter configured to generate and emit light). For example, a light source may include an optical emitter, such as a light emitting diode (LED) that emits light when activated or turned on. In particular, as used herein, a light source may be a source of substantially any light or include substantially any optical emitter, including but not limited to one or more of the following: a light emitting diode (LED), a laser, an organic light emitting diode (OLED), a polymer light emitting diode, a plasma-based optical emitter, a fluorescent lamp, an incandescent lamp, and virtually any other source of light. The light generated by the light source may have a color (i.e., may include light of a specific wavelength), or may be a range of wavelengths (e.g., white light). In some embodiments, a light source may include a plurality of optical emitters. For example, a light source may include a group of optical emitters or a set of optical emitters, wherein at least one of the optical emitters generates light having a color or an equivalent wavelength different from the color or wavelength of light generated by at least one other optical emitter in the group or set. For example, different colors may include primary colors (e.g., red, green, blue).

[0033] In this document, a "multi-view image" is defined as a plurality of images (i.e., greater than three images), wherein each image of the plurality of images represents a different view corresponding to a different view direction of the multi-view image. As such, a multi-view image is a collection of images (e.g., two-dimensional images) that, when displayed on a multi-view display, can facilitate the perception of depth and thus appear to a user as an image of a 3D scene. Multi-view images that provide pairs of views representing a 3D scene consistent with viewing by a user from different but related perspectives are defined as 3D images.

[0034] Embodiments consistent with the principles described herein may be implemented using a variety of devices and circuits, including but not limited to integrated circuits (ICs), very large scale integrated circuits (VLSI) circuits, application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), digital signal processors (DSPs), graphics processor units (GPUs), etc. One or more, firmware, software (such as program modules or instruction sets), and combinations of two or more of the above. For example, an embodiment or an element thereof may be implemented as a circuit element within an ASIC or VLSI circuit. An embodiment employing an ASIC or VLSI circuit is an example of a hardware-based circuit implementation.

[0035] In another example, an embodiment may be implemented as software using a computer programming language (e.g., C / C++) that is executed in an operating environment or a software-based modeling environment (e.g., The software-based modeling environment is further executed by a computer (e.g., stored in a memory and executed by a processor or graphics processor of a general-purpose computer). Note that one or more computer programs or software may constitute a computer program mechanism, and a programming language may be compiled or interpreted, e.g., configurable or configured (which may be used interchangeably in this discussion) to be executed by a processor or graphics processor of a computer.

[0036] In yet another example, a block, module, or element of an apparatus, device, or system (e.g., an image processor, a camera, etc.) described herein may be implemented using an actual or physical circuit (e.g., as an IC or ASIC), while another block, module, or element may be implemented in software or firmware. In particular, according to the definitions herein, for example, some embodiments may be implemented using a substantially hardware-based circuit method or device (e.g., IC, VLSI, ASIC, FPGA, DSP, firmware, etc.), while other embodiments may also be implemented as software or firmware using a computer processor or graphics processor to run software, or as a combination of software or firmware and hardware-based circuits.

[0037] In addition, as used herein, the article "a" is intended to have its ordinary meaning in the patent field, i.e., "one or more". For example, "a lens" refers to one or more lenses, and therefore, "the lens" refers to "one or more lenses" in this article. In addition, any reference to "top", "bottom", "upper", "lower", "up", "lower", "front", "back", "first", "second", "left" or "right" in this article is not intended to be a limitation of this article. In this article, the term 'about' when applied to a value generally means within the tolerance range of the device used to produce the value, or may mean plus or minus 10%, or plus or minus 5%, or plus or minus 1%, unless otherwise expressly stated. In addition, as used herein, the term "substantially" means most, or almost all, or all, or an amount in the range of about 51% to about 100%. In addition, the examples in this article are intended to be illustrative only and are presented for discussion purposes rather than as limitations.

[0038] According to some embodiments of the principles described herein, there is provided a head tracking multi-view display 100. In some embodiments, head tracking multi-view display 100 may be referred to as a head tracking multi-view display. Figure 3 A cross-sectional view of a head-tracking multi-view display 100 in an example is shown, according to an embodiment consistent with the principles described herein. The head-tracking multi-view display 100 is configured to provide multiple views of a scene as a multi-view image, i.e., a displayed multi-view image. In particular, the head-tracking multi-view display 100 provides multiple views in corresponding multiple view directions. Figure 3 In FIG. 1 , view directions or equivalently views of a plurality of views are depicted as arrows 102 extending from the head tracking multi-view display 100 pointing in different angular directions. For convenience, view directions or equivalently views of a plurality of views are labeled with view identification numbers 104. Figure 3 In the specific example of FIG. 1 , the head tracking multi-view display 100 provides eight views; other numbers of views may also be used. Figure 3 The views in FIG. 1 are identified by view identification numbers 104 as 1 through 8; other identifiers, such as letters A through H, may also be used. Figure 3 The view identification number 104 is for convenience only and does not imply that the views are sequential or ordered in any way.

[0039] like Figure 3 As shown, the head tracking multi-view display 100 includes a multi-beam backlight 106. The multi-beam backlight 106 is configured to provide a plurality of light beams having different principal directions corresponding to different view directions of the multi-view image. Figure 3In a configuration of , the multi-beam backlight 106 may include a light source 108, which is controlled by a controller 110. The light source 108 may direct light to an edge of a light guide 112. The light guide 112 may propagate the light as guided light within the light guide 112. A plurality of multi-beam elements 114 may direct respective portions of the guided light out of the light guide 112 to form a plurality of light beams. Figure 3 The configuration of the multi-beam backlight 106 shown in FIG. 1 is only one example of a multi-beam backlight 106 ; other suitable configurations may also be used.

[0040] like Figure 3 As shown, the head tracking multi-view display 100 also includes a processor 116. Figure 3 In an example of, the processor 116 is included in the controller 110. In other configurations, the processor 116 may be separated from the controller 110. The processor 116 is configured to receive multiple temporary views of the multi-view image. The multiple temporary views may correspond to different view directions. The processor 116 is also configured to receive information about the predicted position of the user 118, such as information including a predicted direction or predicted distance between the user 118 and the light-emitting portion of the display. In an example, the predicted position of the user 118 may include information about the predicted view direction of the user 118. The processor 116 is also configured to shift the temporary view relative to the view direction to form multiple shifted views corresponding to different view directions. In various embodiments, the shifted views are shifted by or according to a shift value. The shift value may vary as a function of the predicted position of the user 118. In various embodiments, the shift value may also vary over the field of view of the multi-view image. Details on the calculation of the shift value are provided below.

[0041] like Figure 3 As shown, the head tracking multi-view display 100 further includes a light valve array 120. The light valve array 120 is configured to modulate light beams in the plurality of light beams to provide a plurality of shifted views of a multi-view image to a view direction as a multi-view image. The light valve array 120 may be controlled by a controller 110. In various embodiments, any of a variety of different types of light valves may be used as the light valves of the light valve array 120, including but not limited to one or more of a liquid crystal light valve, an electrophoretic light valve, and a light valve based on electrowetting.

[0042] like Figure 3As shown, the head tracking multi-view display 100 also includes a head tracker 122. The head tracker 122 is configured to provide a tracking position of the user 118 (e.g., the head of the user 118, or one or both eyes of the user 118, or another anatomical feature of the user 118). The head tracker 122 can be coupled to the processor 116 so that the processor 116 can store a plurality of tracking positions over time (e.g., tracking positions obtained at regular or irregular time intervals). The processor 116 can use the stored tracking positions to determine the predicted position, as described below. The head tracker 122 may include a camera configured to capture an image of the user 118. The head tracker 122 may also include an image processor (or a general purpose computer programmed as an image processor) configured to determine the position of the user 118 within the captured image to provide the tracking position. In some examples, the processor 116 may include an image processor of the head tracker 122, such as by performing operations using the same processing circuit. In other examples, the processor 116 may be separated from the image processor of the head tracker 122. Other suitable head trackers may also be used, including lidar-based head trackers (e.g., using the time of flight of reflected light on a viewing scene to determine the distance to one or more objects in the scene (such as a user's head or the user's eyes)) or other techniques. The output of the head tracker 122 may be used to modify the operation of the head-tracked multi-view display 100 (e.g., modulation of the light beam by the light valve array 120). For example, the determined position of the user 118 may be provided to one or both of a processor (such as the processor 116) and a light valve driver (e.g., the driver circuit or controller 110) of the head-tracked multi-view display 100 to adjust the emission pattern from the head-tracked multi-view display 100 to correspond to the position of the user. Other examples of head tracker 122 implementations may include any of a variety of two-dimensional (2D) and three-dimensional (3D) object tracking systems, such as, but not limited to Object tracking system. is a registered trademark of Microsoft Corporation in Redmond, Washington.

[0043] As mentioned above, and explained in detail below, Figure 3 The head tracking multi-view display 100 determines a shift value that varies across the field of view of the multi-view image. To demonstrate the effect of varying the shift value across the field of view of the multi-view image, Figure 4 A plan view of an example of a shift-invariant head-tracking multi-view display 400 is shown, where the shift value does not vary over the field of view of the multi-view images. Instead, the shift value is constant or invariant over the field of view of the multi-view images, such as over the field of view of the active surface area of ​​the shift-invariant head-tracking multi-view display 400.

[0044] exist Figure 4 In the example of FIG. 4 , different regions of the multi-view image may be visible using different views of the multi-view image for some positions of the user 402. For example, the upper left corner of the multi-view image may be visible using view number 1, the center portion of the multi-view image may be visible using view number 2, and the lower right corner of the multi-view image may be visible using view number 3. Because the image perceived by the user 402 at the user position of the head-tracked multi-view display 400 that is invariant with respect to the shift may include regions from different views of the multi-view image, the perceived image may be distorted or may contain artifacts from misalignment of the views or at boundaries between different view portions.

[0045] Varying the shift value across the field of view of the multi-view image can help overcome the disadvantages of the shift-invariant head-tracking multi-view display 400. Specifically, varying the shift value across the full field of view of the multi-view image can help ensure that all or substantially all of the multi-view image shows a single view (or a single view combination) to the user. The following paragraphs describe in detail an example of determination of the shift value.

[0046] Processor 116 may determine the shift values ​​to provide two general functions for head-tracked multi-view display 100. A first general function of the shift values ​​is to direct a specified view toward the eyes of user 118 as user 118 changes position relative to the display. A second general function of the shift values ​​is to ensure that across the entire multi-view image (such as extending over a specified active surface area of ​​the head-tracked multi-view display), only a single specified view (or specified combination of views) is visible, such that adjacent views or pseudo-views are not visible. In other words, the calculated shift values, as described in detail below, may ensure that user 118 does not see a portion of the multi-view image in a first view and another portion of the multi-view image in a second view, thereby avoiding Figure 4 An example of a shift-invariant head-tracking multi-view display 400 .

[0047] The processor 116 may include a mathematical model that predicts which view is visible to the user 118 as a function of the user 118 position and as a function of the user 118's view direction at or on a surface area of ​​the head-tracked multi-view display. The view may be represented as a real number. For example, for a multi-view image containing eight views, the view may be represented by an integer N, where N may have an integer value from one to eight (including this number). The user 118 may have a central head position represented by spatial coordinates (x, y, z). The head-tracked multi-view display may have a pixel position represented by spatial coordinates (x0, y0) within the effective surface area of ​​the head-tracked multi-view display. The mathematical model may determine the number of views N (x, y, z, x0, y0), which is a function of the user position and the pixel position. In other words, for each combination of user position (x, y, z) and pixel position (x0, y0), the mathematical model may determine which view N is visible.

[0048] The shift value, represented as the quantity δN, is a dimensionless quantity that represents a correction or addition to the number of views N. For example, a shift value δN of +1 may involve incrementing the number of views (e.g., number of views 3) by a value of +1 (e.g., to number of views 4). The shift value δN may vary from one pixel position to another pixel position over the effective surface area of ​​the head tracking multi-view display (e.g., over the field of view of the multi-view images). Allowing the shift value δN to vary over the field of view of the multi-view images may ensure that the user 118 sees only one specified multi-view image (or one specified combination of multi-view images) over the entire multi-view image.

[0049] The processor may calculate the shift values ​​to achieve a particular effect in the perceived view. Two such effects are referred to hereinafter as "peeling mode" and "sliding mode", both of which are explained in more detail hereinafter.

[0050] In peel mode, the views may progress from one view to another as the user 118 changes positioning, such that the user 118 may view the multi-view image from a number of different views depending on the position of the user 118. In some embodiments, in peel mode, the shift values ​​may be selected such that the movement of the user 118 allows the user 118 to view the advancing views that match the advancement of the temporary view. In some embodiments, in peel mode, the shift values ​​may be selected such that the movement of the user 118 provides the user with a sense of parallax as the views progress.

[0051] The peeling mode can extend the view partitioning of the head-tracked multi-view display without changing the parallax effect. In the peeling mode, the shift value δN can be calculated as a function of the static view number N0 that is unchanged with respect to the user position and the pixel position, the center view number N(x,y,z,0,0) indicating which view is visible at the center of the display from the user position, and the pixel-dependent view number N(x,y,z,x0,y0) indicating which view is visible at a specified pixel position from the user position, as follows:

[0052] δN = N0 + N(x, y, z, 0, 0) – N(x, y, z, x0, y0) (1)

[0053] Figure 5A A plan view of a head-tracked multi-view display 500 used in a peel-away mode in an example is shown, with a user 502 located in a first position, according to an embodiment consistent with the principles described herein. At the first position, the user 502 can view a first view (indicated by numeral 1) of a multi-view image over the entire multi-view image.

[0054] Figure 5B A plan view of a head-tracked multi-view display 500 used in a peel-away mode in an example is shown, with a user 502 located at a second position, according to an embodiment consistent with the principles described herein. At the second position, the user 502 can view a second view of the multi-view image (indicated by the number 2) over the entire multi-view image.

[0055] Figure 5C A plan view of a head-tracked multi-view display 500 used in a peeled-away mode in an example is shown with a user 502 at a third position, according to an embodiment consistent with the principles described herein. At the third position, the user 502 can view a third view (indicated by numeral 3) of the multi-view image over the entire multi-view image.

[0056] In sliding mode, a single view (or a single combination of views) follows the user 118 as the user 118 changes positioning. For example, the sliding mode may effectively act as an image stabilizer, which may ensure that the user 118 only views a specified view (or a specified combination of views) and prevent other views from being visible as the user 118 changes positioning. In some embodiments, in sliding mode, the shift value may be selected so that the shifted view follows the movement of the user 118 and allows the user 118 to view only a single view or a single combination of views as the user 118 moves. The sliding mode may ensure that the user 118 experiences a uniform static view without parallax, represented by the quantity N0. In sliding mode, head tracking may effectively counteract any movement of the user 118 and may provide the user 118 with a 3D experience similar to using 3D glasses in a movie theater.

[0057] Using the same definitions as above, the shift value δN can be calculated as follows:

[0058] δN = N0 – N(x, y, z, x0, y0) (2)

[0059] Fig. 6A A plan view of a head-tracked multi-view display 600 used in a sliding mode in an example is shown, with a user 602 at a first position, according to an embodiment consistent with the principles described herein. At the first position, the user 602 can view a first view (indicated by numeral 1) of a multi-view image over the entire multi-view image.

[0060] Figure 6B A plan view of a head-tracked multi-view display 600 used in a sliding mode in an example is shown with a user 602 at a second position, according to an embodiment consistent with the principles described herein. At the second position, the user 602 can view a first view (indicated by numeral 1) of the multi-view image over the entire multi-view image.

[0061] Figure 6C A plan view of a head-tracking multi-view display 600 used in a sliding mode in an example is shown with a user 602 at a third position, according to an embodiment consistent with the principles described herein. At the third position, the user 602 can view a first view (indicated by numeral 1) of the multi-view image over the entire multi-view image.

[0062] In some embodiments, the shift values ​​may be selected such that a first 3D view of the multi-view image for the left eye of user 118 and a second 3D view of the multi-view image for the right eye of user 118 are constant when user 118 moves.

[0063] In general, the shift value δN may not be an integer, but may be the sum of an integer k and a fractional number q (between 0 and 1, excluding this number). For example, in some embodiments, the shift value may correspond to a non-integer number of views of the multi-view image. As another example, in some embodiments, the shift value may correspond to a non-integer number of light valves on the light valve array. Where a pure integer shift value δN may involve shifting one view to the angular position of another view, a fractional (e.g., non-integer) shift value δN may involve combining adjacent views to form a combined view or a fractional view. There are many possible ways to combine adjacent views to form a combined view. In some embodiments, the processor may be configured to form a shifted view by combining two adjacent temporary views. In some embodiments, the processor may be configured to form a shifted view by non-linearly combining two adjacent temporary views (i.e., combining two adjacent temporary views in a non-linear manner).

[0064] In some embodiments, the processor is configured to form the shifted view by converting pixel values ​​of two adjacent temporary views from gamma space to linear space to form linear space pixel values, linearly summing the linear space pixel values ​​to form a linear sum value, and converting the linear sum value from the linear space to the gamma space. For example, the nonlinear blending function f(q) may be defined to have a value of 0 for q=0, a value of 0.5 for q=0, and a value of 1 for q=1, a dimensionless exponent γ may convert a red-green-blue (RBG) pixel value from the gamma space to the linear space, and the pixel value of view k may be calculated by the quantity V k Indicates that the pixel value of the adjacent view k+1 can be expressed by the quantity V k+1 Represented by V, and the pixel value of the fractional view k+q can be represented by V k+q It is represented and calculated as follows:

[0065] V k+q = [(1 – f(q))(V k ) γ + (f(q))(V k+1 ) γ ] 1 / γ (3)

[0066] In some examples, where sub-pixels of different colors correspond to different views, the shift value δN may be calculated separately for each color.

[0067] According to some embodiments of the principles described herein, a head-tracking multi-view display system is provided. The head-tracking multi-view display system is configured to provide or "display" a 3D or multi-view image representing a scene. In particular, the multi-view image is provided as a plurality of different "views" associated with the multi-view image. For example, the different views may provide a "glasses-free" (e.g., autostereoscopic) representation of information in the multi-view image being displayed. In addition, according to various embodiments, different sets of views may be provided for different positions or locations (e.g., head positions) of a user of the head-tracking multi-view display system.

[0068] As described above, the shift value may vary across the field of view of the multi-view image. In addition, the shift value may include a time correction so that the controller or processor may determine the shift value based on the location where the user is expected to be at a future time, rather than at a recently measured or tracked location. For example, the controller may use a past measured location or a past tracked location to determine the predicted location of the user at a specified future time. The specified future time may be offset from the current time or reference time by a positioning-related time interval that takes into account any or all of the following: a raster scan of the light valve array (e.g., a positioning-related delay), a delay of the light valve array (e.g., a positioning-independent delay), a rolling shutter of the head tracker, and a delay of the head tracker. Using a predicted position rather than a recently tracked position can help reduce or eliminate artifacts, such as crosstalk with adjacent views, as the user moves relative to the head tracking multi-view display system. Other types of shutters may also be used, including a global shutter or another suitable exposure adjustment mechanism.

[0069] In some embodiments, the predicted position may include a predicted position at a future time. The future time may differ from the reference time by a delay of the light valve array.

[0070] In some embodiments, the light valve array may include a raster scan. The light valve array may have a delay that varies across the light valve array as a function of the raster scan. The predicted position may include a predicted position at a future time associated with the location. The future time associated with the location may differ from a reference time by the delay of the light valve array.

[0071] In some embodiments, the processor may be further configured to determine a predicted location of the user based on a plurality of past measured locations of the user.

[0072] In some embodiments, the predictive head tracking multi-view display may further include a head tracker configured to provide a plurality of past measured positions of a user. The head tracker may include a camera configured to capture consecutive images of the user. The head tracker may further include an image processor configured to determine the position of the user within each captured image to provide the plurality of past measured positions.

[0073] In some embodiments, the processor may be further configured to calculate the speed of the user from at least two of the plurality of past measurement positions. The processor may be further configured to determine a predicted position of the user based on the speed of the user and the most recent measurement position of the plurality of past measurement positions. For these configurations, the processor performs the calculations using the assumption that the speed of the user is constant or nearly constant over time within the relatively short duration of a single frame of a light valve array operating at a video rate (such as 30 Hz, 60 Hz, 75 Hz, 90 Hz, 120 Hz, greater than 120 Hz, or another suitable value).

[0074] Mathematically, the calculation can be performed using the assumption that the user's velocity is constant or nearly constant over time as shown below. For the most recent tracked position represented by the quantity x0, the quantity T representing the time delay corresponding to a particular light valve on the light valve array (and optionally, a particular location on the sensor of the head tracker), and the velocity v, the predicted position x is given by the quantity x0+vT.

[0075] The processor may calculate the velocity v as follows. For a head tracker that performs 1, 2, 3, etc. number of measurements, past measurements of the user's position x at times T1, T2, T3, etc. may be denoted x1, x2, x3, etc. The processor may calculate the velocity v as the quantity (x i -x j ) / (T i -T j ), where measurements i and j are past tracking measurements. In some examples, the processor may calculate velocity v as the quantity (x2-x1) / (T2-T1), where measurements 1 and 2 are the two most recent tracking measurements. In some examples, the processor may calculate velocity using two measurements that are not directly consecutive (e.g., including one or more measurements between the two measurements). In some examples, the processor may calculate velocity using more than two measurements, such as a rolling average of velocity calculations. Other suitable computational techniques may also be used. It should be understood that position and velocity are multidimensional quantities, and the expressions provided above involve only one-dimensional components (such as x); similar expressions may be written for other dimensional components (e.g., y and z).

[0076] In some embodiments, the processor may be further configured to calculate the acceleration of the user from at least three of the plurality of past measurement locations. The processor may be further configured to determine the predicted position of the user based on the acceleration of the user, the speed of the user, and the most recent measurement location of the plurality of past measurement locations.

[0077] Mathematically, the calculation performed using the user's velocity and the user's acceleration can be as follows. For the most recently tracked position represented by the quantity x0, the quantity T representing the time delay corresponding to a particular light valve on the light valve array (and optionally, a particular location on the sensor of the head tracker), the velocity v and the acceleration a, the predicted position x is given by the quantities x0+vT+(aT 2 ) / 2 is given.

[0078] The processor may calculate the acceleration a as follows. Using the same numerical scheme as above, the head tracker and processor may form the calculation of the user's velocity as v1, v2, v3, etc. The processor may calculate the acceleration a as the quantity (v i -v j ) / (T i -T j ), where measurements i and j are taken at time T i and T j In some examples, the processor may calculate the acceleration a as the quantity (v2-v1) / (T2-T1), where measurements 1 and 2 are the two most recently tracked measurements. In some examples, the processor may calculate the acceleration using two velocity measurements that are not directly consecutive (e.g., including one or more measurements between the two velocity measurements). In some examples, the processor may calculate the acceleration using more than two velocity measurements, such as a rolling average of the acceleration calculations. Other suitable computational techniques may also be used. It should be understood that position, velocity, and acceleration are multidimensional quantities, and the expressions provided above involve only one-dimensional components (such as x); similar expressions may be written for other dimensional components (e.g., y and z).

[0079] In some embodiments, the controller may implement feedback based on the detected actual position or detected actual changes in position or view direction, such as updating or changing the predicted position continuously or in discrete increments.

[0080] In some embodiments, the controller may implement pattern matching for predicting the location. Pattern matching may assist and / or replace velocity and / or acceleration in determining the predicted location. For example, based on historical information about the user, or may be based on program content, the user's behavioral pattern may be unique to the user. As a specific example, a multi-view image may show a car driving through the field of view, and the controller may "anticipate" the user's viewing direction or head to follow the car. Other examples may also be used.

[0081] Figure 7 A diagram illustrating a model of display latency for a head-tracked multi-view display in an example according to an embodiment consistent with the principles described herein is shown. The model includes a graph of pixel position (or pixel row) along a vertical axis as a function of time along a horizontal axis.

[0082] Line 702 extending from the upper left position to the lower right position may represent gate scanning of the display. Diagonal cross-hatched area 704 may correspond to an area where pixels of the liquid crystal panel are continuously switched between a first state corresponding to a current frame and a second state corresponding to a next frame that continuously follows the current frame. Figure 7 Three consecutive frames are shown, denoted as frame t-1, frame t, and frame t+1. The checkerboard cross-hatched area 706 may correspond to an area where the liquid crystal panel is idle. The duration between the start of a raster scan of the liquid crystal panel to the end of a raster scan of the liquid crystal panel is given by the quantity Traster.

[0083] Assuming the display has height H and has a uniform rate of raster scanning, then as a function of pixel row y and with Figure 7 The delay ΔT(y) corresponding to the positioning 710 in can be calculated as follows:

[0084]

[0085] The quantity ΔT(0) corresponds to the start of the raster scan and is Figure 7 The quantity T_raster is a duration representing how long it takes the display to raster scan the entire display area.

[0086] Equation (5) shows how the total delay associated with a given pixel can be calculated as follows:

[0087]

[0088] The quantity ΔT(y0,y) represents the delay as a function of pixel positioning. The quantity R corresponds to the time when the raster scan begins. The quantity E corresponds to the time when the exposure time ends. The quantity T corresponds to the raster time of the display (e.g., how long it takes for the display to completely scan the display area). The quantity H is the height of the display. The quantity T0 is the exposure time of the display. The quantities y and y0 have zero values ​​at the top (or other suitable edge) of the display or camera frame.

[0089] Figure 8 A block diagram illustrating sources of latency in an example head tracking multi-view display system 800 is shown, according to an embodiment consistent with the principles described herein. Head tracking multi-view display system 800 may include a camera 810, a system 820, and a display 830.

[0090] A camera 810 as part of a head tracker may acquire a tracking image or a series of tracking images. The camera 810 may include an image sensor that may include a rolling shutter so that different portions of the camera 810's field of view may be detected at different times. The rolling shutter may impart a location-dependent component to the camera 810's latency. The camera 810 may also include one or more sources of location-independent latency, including travel time for data to propagate from the camera 810 to the system 820, face detection time (e.g., the time it takes to determine if a face is present and where the eyes of the face are located), rendering time, etc. When coupled to the system 820, the camera 810 may be synchronized with the system clock. For example, for a camera 810 with a rolling shutter, the camera 810 can be synchronized to a particular location in the camera's field of view, such as the center of the field of view, a corner of the field of view, or another suitable location.

[0091] System 820 can render interlaced images. System 820 can include a general processing unit. System 820 can include a master clock to which camera 810 and display 830 can be synchronized.

[0092] The display 830 may show an image, such as by forming a pattern on a light valve array. The time that a viewer sees the image (ignoring the time it takes for light to propagate from the light valve array to the viewer's eye) is actually the time it takes to display the image. Display delays may include travel time from a general processing unit of the system 820 to the display 830, pixel update time, raster time, etc. Raster time may be position dependent (e.g., raster time may vary from one light valve to another on a light valve array). Other sources of delay may be position independent (e.g., may be constant on a light valve array).

[0093] For convenience, the total delay of the system can be grouped into (first) tracking delay and (second) display delay.

[0094] In some embodiments, the predicted position may include a predicted position at a future time. The future time may differ from the reference time by a sum of a first delay of the light valve array and a second delay of the camera.

[0095] In some embodiments, the light valve array may include a raster scan. The light valve array may have a first delay that varies across the light valve array as a function of the raster scan. The camera may include a rolling shutter. The camera may have a second delay that varies across the field of view of the camera as a function of the rolling shutter. The predicted position may include a predicted position at a future time associated with the positioning. The future time associated with the positioning may differ from a reference time by the sum of the first delay and the second delay.

[0096] Fig. 9A block diagram of an example head tracking multi-view display system 200 is shown, according to an embodiment consistent with the principles described herein. The head tracking multi-view display system 200 is configured to display a multi-view image according to different views in different view directions. Specifically, light beams emitted by the head tracking multi-view display system 200 are used to display the multi-view image and may correspond to pixels of different views (i.e., view pixels). Different views, or equivalently different view directions, are shown as being from Fig. 9 2. Arrow 202 is an arrow 202 emitted by head tracking multi-view display system 200 in FIG. As provided below, arrow 202 also represents a light beam emitted by head tracking multi-view display system 200.

[0097] The head tracking multi-view display system 200 includes a head tracking multi-view display 210. The head tracking multi-view display 210 includes a multi-beam backlight configured to provide a plurality of beams having different principal directions corresponding to different view directions of a multi-view image. The head tracking multi-view display system 200 includes at least one processor 240 configured to receive a plurality of temporary views of the multi-view image, the plurality of temporary views corresponding to different view directions, receive information about a predicted position of a user 230, and shift the temporary views relative to the view directions to form a plurality of shifted views corresponding to the different view directions, the shifted views being shifted by a shift value that varies as a function of the predicted position of the user 230 and varies over a field of view of the multi-view image. In some examples, various tasks may be performed by a single processor 240. In other examples, the tasks may be divided between more than one processor 240. The processor 240 may optionally be coupled to a storage device and / or memory that may store data corresponding to past measured positions or past tracked positions from the head tracker 220. The head tracking multi-view display 210 includes a light valve array configured to modulate light beams of a plurality of light beams to provide a plurality of shifted views of a multi-view image to view directions as the multi-view image.

[0098] The head tracking multi-view display system 200 includes a head tracker 220 configured to provide a predicted position of a user 230 to a processor 240. The head tracker 220 may include a camera having a field of view 222 that includes the user 230. The camera is configured to capture an image of the user 230. The head tracker 220 may also include an image processor configured to determine a position of the user 230 within the captured image to provide the predicted position.

[0099] According to other embodiments of the principles described herein, there is provided a method of operating a head-tracking multi-view display. Fig.10A flowchart is shown of a method 300 for operation of a head tracking multi-view display in an example, according to an embodiment consistent with the principles described herein.

[0100] like Fig.10 As shown, a method 300 of operating a head-tracked multi-view display includes providing 310 a plurality of light beams having different principal angle directions corresponding to different view directions of a multi-view image using a multi-beam backlight. The multi-beam backlight may be similar to the multi-beam backlight 106 in structure and function.

[0101] like Fig.10 As shown, the method 300 for operating a head-tracked multi-view display also includes receiving, using a processor, a plurality of temporary views 320 of the multi-view image. The plurality of temporary views correspond to different view directions. The temporary views may represent original, unmodified, or unshifted portions of the 3D image to be displayed to the user using the multi-view display. The processor may be similar in structure and function to the processor 116.

[0102] like Fig.10 As shown, the method 300 for operating a head-tracked multi-view display further includes shifting the temporary view 330 relative to the view direction using a processor to form a plurality of shifted views corresponding to different view directions. The shifted views are shifted by a shift value that varies as a function of the predicted position of the user and varies over the field of view of the multi-view image.

[0103] like Fig.10 As shown, the method 300 for operating a head-tracked multi-view display further includes modulating a light beam 340 of the plurality of light beams using a light valve array to provide a plurality of shifted views of the multi-view image to a view direction as the multi-view image. The light valve array may be similar to the light valve array 120 in structure and function.

[0104] In some embodiments, the method 300 for operating a head-tracked multi-view display further comprises combining two adjacent temporary views with a processor to form a shifted view. In some embodiments, the method 300 for operating a head-tracked multi-view display further comprises combining two adjacent temporary views with a processor nonlinearly to form a shifted view. In some embodiments, the processor forms the shifted view by converting pixel values ​​of two adjacent temporary views from a gamma space to a linear space to form a linear space pixel value, linearly summing the linear space pixel values ​​to form a linear sum value, and converting the linear sum value from the linear space to the gamma space. In some embodiments, the shift value corresponds to a non-integer number of views of the multi-view image. In some embodiments, such as in the above-described stripping mode, the processor selects the shift value so that the user's movement allows the user to view an advancing view that matches the advancement of the temporary view. In some embodiments, such as in the above-described stripping mode, the processor selects the shift value so that the user's movement provides the user with a sense of parallax as the view advances.

[0105] In some embodiments, such as in the sliding mode described above, the processor selects the shift value so that the shifted view follows the user's movement and allows the user to view only a single view or a single combination of views as the user moves. In some embodiments, such as in the sliding mode described above, the processor selects the shift value to provide the user with a first three-dimensional view of the multi-view image to the user's left eye, and a second three-dimensional view of the multi-view image to the user's right eye. The first three-dimensional view and the second three-dimensional view may be constant as the user moves.

[0106] Thus, examples and embodiments of head-tracked multi-view displays, head-tracked multi-view display systems, and methods of operation for head-tracked multi-view displays have been described, in which temporary views are shifted relative to a view direction to form multiple shifted views corresponding to different view directions, the shifted views being shifted by a shift value that varies as a function of a predicted position of a user and varies over a field of view of a multi-view image. The above examples are merely illustrative of some of the many specific examples that represent the principles described herein. Clearly, many other arrangements can be readily devised by those skilled in the art without departing from the scope defined by the appended claims.

Claims

1. A predictive head tracking multi-view display comprising: a multi-beam backlight configured to provide a plurality of light beams having different principal angle directions corresponding to different view directions of a multi-view image; A processor, the processor being configured to: receiving a plurality of temporary views of the multi-view image, the plurality of temporary views corresponding to the different view directions; receiving information about a predicted location of a user, the information about the predicted location being based on a plurality of measured locations of the user; and shifting the temporary view relative to the view direction to form a plurality of shifted views corresponding to the different view directions, the shifted views being shifted by a shift value that varies as a function of the predicted position of the user and that varies across a field of view of the multi-view image; and A light valve array is configured to modulate light beams of the plurality of light beams to provide the plurality of shifted views of the multi-view image to the view directions as the multi-view image.

2. The predictive head tracking multi-view display of claim 1, wherein: The predicted position comprises a predicted position at a future time; and The future time differs from the reference time by the delay of the light valve array.

3. The predictive head tracking multi-view display of claim 1 , wherein: The light valve array includes raster scanning; The light valve array has a delay that varies across the light valve array as a function of the raster scan; The predicted position comprises a predicted position at a future time associated with the positioning; and The positioning-related future time differs from a reference time by the delay of the light valve array.

4. The predictive head tracking multi-view display of claim 1, wherein the processor is further configured to determine the predicted position of the user based on a plurality of past measured positions of the user.

5. The predictive head tracking multi-view display of claim 4, further comprising a head tracker configured to provide the plurality of past measured positions of the user, the head tracker comprising a camera configured to capture consecutive images of the user, the head tracker further comprising an image processor configured to determine the position of the user within each captured image to provide the plurality of past measured positions.

6. The predictive head tracking multi-view display of claim 5, wherein the processor is further configured to: calculating a speed of the user from at least two past measurement positions among the plurality of past measurement positions; and The predicted location of the user is determined based on the speed of the user and a most recent measured location of the plurality of past measured locations.

7. The predictive head tracking multi-view display of claim 5, wherein the processor is further configured to: calculating a velocity of the user from at least two past measurement locations of the plurality of past measurement locations; calculating an acceleration of the user from at least three past measurement positions of the plurality of past measurement positions; and The predicted position of the user is determined based on the acceleration of the user, the speed of the user, and a most recent past measured position of the plurality of past measured positions.

8. The predictive head tracking multi-view display of claim 5, wherein: The predicted position comprises a predicted position at a future time; and The difference between the future time and the reference time is the sum of the first delay of the light valve array and the second delay of the camera.

9. The predictive head tracking multi-view display of claim 5, wherein: The light valve array includes raster scanning; The light valve array has a first delay that varies across the light valve array as a function of the raster scan; The camera includes a rolling shutter; the camera having a second time delay that varies across the camera's field of view as a function of the rolling shutter; The predicted position includes a predicted position at a future time associated with positioning; and The future time related to the positioning differs from the reference time by the sum of the first delay and the second delay.

10. The predictive head tracking multi-view display of claim 1, wherein the processor is further configured to shift the temporary view relative to the view direction to form the shifted view by combining two adjacent temporary views.

11. The predictive head tracking multi-view display of claim 10, wherein the processor is further configured to form the shifted view by non-linearly combining the two adjacent temporary views.

12. The predictive head tracking multi-view display of claim 11, wherein the processor is further configured to form the shifted views by: converting pixel values ​​of the two adjacent temporary views from a gamma space to a linear space to form linear space pixel values; performing linear summation on the linear space pixel values ​​to form a linear summation value; and The linear sum value is converted from linear space to gamma space.

13. The predictive head tracking multi-view display of claim 1, wherein the shift value corresponds to a non-integer number of views of the multi-view image.

14. The predictive head tracking multi-view display of claim 1, wherein: The shift value is selected so that movement of the user allows the user to view an advancing view that matches an advancement of the temporary view; and The shift values ​​are selected such that the user's movement provides the user with a perception of parallax as the views advance.

15. The predictive head tracking multi-view display of claim 1, wherein: The shift values ​​are selected so that the shifted views follow the movement of the user and allow the user to see only a single view or a single combination of views as the user moves; and The shift values ​​are selected to provide the user with a first three-dimensional view of the multi-view image to a left eye of the user and a second three-dimensional view of the multi-view image to a right eye of the user, the first three-dimensional view and the second three-dimensional view being invariant when the user moves.

16. A method of operating a predictive head tracking multi-view display, the method comprising: Using a multi-beam backlight, providing a plurality of light beams having different principal angle directions corresponding to different view directions of a multi-view image; Receiving, with a processor, a plurality of temporary views of the multi-view image, the plurality of temporary views corresponding to the different view directions; receiving, with the processor, information regarding a predicted location of a user, the information regarding the predicted location being based on a plurality of measured locations of the user; shifting, with the processor, the temporary view relative to the view direction to form a plurality of shifted views corresponding to the different view directions, the shifted views being shifted by a shift value that varies as a function of the predicted position of the user and that varies across a field of view of the multi-view image; and Light beams of the plurality of light beams are modulated, using a light valve array, to provide the plurality of shifted views of the multi-view image as the multi-view image to the view directions.

17. The method according to claim 16, further comprising: determining the predicted location based on a plurality of past measured locations of the user; capturing sequential images of the user using a head tracker including a camera; and A position of the user within each captured image is determined to provide the plurality of past measured positions.

18. The method of claim 17, wherein: The light valve array includes raster scanning; The light valve array has a delay that varies across the light valve array as a function of the raster scan; The predicted position comprises a predicted position at a future time associated with the positioning; and The future time associated with the positioning differs from the reference time by the delay of the light valve array.

19. The method of claim 17, wherein: The light valve array includes raster scanning; The light valve array has a first delay that varies across the light valve array as a function of the raster scan; The camera includes a rolling shutter; the camera having a second time delay that varies across the camera's field of view as a function of the rolling shutter; The predicted position includes a predicted position at a future time associated with positioning; and The future time related to the positioning differs from the reference time by the sum of the first delay and the second delay.

20. A predictive head tracking multi-view display comprising: a head tracker comprising a camera configured to capture successive images of a user, the head tracker further comprising an image processor configured to determine a position of the user within each captured image to provide a plurality of past measured positions of the user; a multi-beam backlight configured to provide a plurality of light beams having different principal angle directions corresponding to different view directions of a multi-view image; A processor, the processor being configured to: determining a predicted location of the user based on the plurality of past measured locations of the user; receiving a plurality of temporary views of the multi-view image, the plurality of temporary views corresponding to the different view directions; and shifting the temporary view relative to the view direction to form a plurality of shifted views corresponding to the different view directions, the shifted views being shifted by a shift value that varies as a function of the predicted position of the user and that varies across a field of view of the multi-view image; and a light valve array configured to modulate light beams of the plurality of light beams to provide the plurality of shifted views of the multi-view image to the view direction as the multi-view image, the light valve array comprising a raster scan, the light valve array having a delay that varies across the light valve array as a function of the raster scan, the predicted position comprising a predicted position at a position-dependent future time that differs from a reference time by the delay of the light valve array.

Images