Light field display system for adult

Abstract

To obtain an adult entertainment environment customized for each viewer including AI holographic performers that engage viewers within the environment.SOLUTION: A light field (LF) display system for displaying a holographic content within an adult entertainment context is disclosed. The LF display system includes a plurality of LF displays that, in one embodiment, is tiled to form an array of LF displays within an environment. This LF display system may customize a viewer's experience using artificial intelligence (AI) and machine learning (ML) models that track and respond to each viewer's movements and / or requests in the environment and their behaviors (body languages, facial expressions, tone of voice, etc.) through various sensors (cameras, microphones, LF display sensors, etc.).SELECTED DRAWING: Figure 5A

Description

CROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This application is related to International Application Nos. PCT / US2017 / 042275, PCT / US2017 / 042276, PCT / US2017 / 042418, PCT / US2017 / 042452, PCT / US2017 / 042462, PCT / US2017 / 042466, PCT / US2017 / 042467, PCT / US2017 / 042468, PCT / US2017 / 042469, PCT / US2017 / 042470, and PCT / US2017 / 042679, all of which are incorporated by reference in their entireties. [Background technology]

[0002] This disclosure relates to holographic environments, and in particular to light field displays implemented within adult environments.

[0003] Various techniques have been proposed to augment reality and simulate virtual environments. These techniques often involve stereoscopic images displayed on electronic displays within a headset, simulating the illusion of depth. Head and eye tracking sensors can be used to estimate which parts or objects in the virtual environment are being viewed by the viewer. However, these traditional approaches require the viewer to wear some sort of external device (e.g., 3D glasses, near-eye displays, head-mounted displays, etc.) display (e.g., for stereoscopic, virtual reality, augmented reality, or mixed reality) in order to view the content. In virtual reality, wearing the external device completely removes the viewer from reality. This can be dangerous when simulating some activities or sports, as the viewer may unknowingly bump into other objects or people in the environment (e.g., a virtual tennis game may require an area the size of a real tennis court to play). Summary of the Invention

[0004] A light field (LF) display system for displaying holographic content within an adult entertainment context is disclosed. The LF display system, in one embodiment, comprises a plurality of LF displays tiled to form an array of LF displays within an environment. The LF display system may customize the viewer's experience using artificial intelligence (AI) and machine learning (ML) models that track and respond to each viewer's movements and requests within the environment and their behaviors (body language, facial expressions, tone of voice, etc.) via various sensors (cameras, microphones, LF display sensors, etc.). Thus, the result is a customized adult entertainment environment for each viewer, including AI holographic performers that engage the viewer within the environment.

[0005] In one embodiment, the LF display system obtains the viewer's preferences for holographic content. This may include obtaining information stored for the viewer if the viewer is a returning visitor. Or, the system may receive a selection from the viewer of one or more holographic performers, for example from a catalog. The holographic performers may be live models that stream live holographic content to the LF display system from various remote locations, AI representations of real people (models, actresses, actors, etc.), or computer-generated models (anime, manga, etc.).

[0006] The LF Display System presents holographic content to the viewer, including holographic performers, according to the viewer's preferences, images presented at locations within the holographic object volume of the environment that are seen by the viewer as if the holographic performer were a real person standing in the room and speaking to them.

[0007] During the presentation of holographic content, the tracking system of the LF display system captures sensory information for the viewer in order to guide the AI ​​not only spatially but also behaviorally with respect to the viewer. Thus, the sensory information includes the viewer's interactions with the holographic performers and other objects in the environment while identifying contextual features of the viewer such as body language (which may indicate, e.g., joy, excitement, disappointment, boredom, etc.), including facial expressions, voice analysis and recognition, and other general feedback that the viewer may explicitly state (e.g., commands for the holographic performer to perform an action, etc.).

[0008] Thus, the LF display system adjusts the presentation of holographic content, such as the behavior of the holographic performer, in response to the viewer's sensory information acquired by the tracking system. This can be as small as a smile or laugh from the holographic performer in response to a comment from the viewer, or it can be a larger behavior adjustment that involves the holographic performer taking an action in response to a request from the viewer. Thus, in one embodiment, the response performed by the holographic performer is generated using an AI model based on the interaction from the viewer. Thus, the viewer does not need to wear an external device to see and interact with the holographic performer. The LF display system presents the holographic performer visible to the viewer in much the same way that a real human would be seen.

[0009] Thus, this disclosure describes a combination of holographic displays, multiple different sensors (e.g., haptic, audio, visual, etc.), networks, and, in various embodiments, AI and ML models to generate holographic adult products that replace or augment the physical with a virtual one without the need for special eyewear, glasses, or head-mounted accessories. [Brief description of the drawings]

[0010] [Figure 1] FIG. 2 is a diagram of a light field display module for presenting holographic objects in accordance with one or more embodiments.

[0011] [Figure 2A] 1 is a cross-sectional view of a portion of a light field display module according to one or more embodiments.

[0012] [Figure 2B] 1 is a cross-sectional view of a portion of a light field display module according to one or more embodiments.

[0013] [Figure 3A] FIG. 1 is a perspective view of a light field display module according to one or more embodiments.

[0014] [Figure 3B] 1 is a cross-sectional view of a light field display module including an interleaved energy relay device according to one or more embodiments.

[0015] [Figure 4A] FIG. 1 is a perspective view of a portion of a light field display system that is tiled in two dimensions to form a single-sided seamless surface environment in accordance with one or more embodiments.

[0016] [Figure 4B] FIG. 1 is a perspective view of a portion of a light field display system in a multi-surface seamless surface environment in accordance with one or more embodiments.

[0017] [Figure 4C] FIG. 2 is a top view of a light field display system having a collective surface in a wing-type configuration in accordance with one or more embodiments.

[0018] [Figure 4D]FIG. 2 is a side view of a light field display system having a collection surface in a tilted configuration in accordance with one or more embodiments.

[0019] [Figure 4E] FIG. 2 illustrates a top view of a light field display system having a collection surface on the front wall of a room in accordance with one or more embodiments.

[0020] [Figure 5A] FIG. 1 is a block diagram of a light field display system in accordance with one or more embodiments.

[0021] [Figure 5B] FIG. 1 is a block diagram of a light field environment incorporating a light field display system for adult simulation in accordance with one or more embodiments.

[0022] [Figure 6] FIG. 2 is a diagram of an LF display system in an adult entertainment environment presenting holographic performers to an audience, in accordance with one or more embodiments.

[0023] [Figure 7A] FIG. 1 is a first diagram of an embodiment of an LF display system for presenting holographic content to a viewer, including a sensation simulation device operating in coordination with the holographic content, in accordance with one or more embodiments.

[0024] [Figure 7B] FIG. 7B is a second diagram of the embodiment of the LF display system shown in FIG. 7A, where the sensory simulation device is augmented with holographic content, according to one or more embodiments.

[0025] [Figure 8] 1 is a flowchart for presenting adult holographic content to a viewer in accordance with one or more embodiments. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0026] A light field (LF) display system is implemented in an adult entertainment environment to present holographic content, such as holographic performers or models, to a user. The LF display system comprises an LF display assembly configured to present holographic content including one or more holographic objects that would be visible to one or more viewers within a viewing volume of the adult entertainment environment. The holographic models may also be augmented with other sensory stimuli (e.g., tactile, sound, or smell). For example, an ultrasonic emitter in the LF display system may emit ultrasonic pressure waves that provide a tactile surface for some or all of the holographic performers or other holographic objects in the environment. The holographic content may include additional visual content (i.e., 2D or 3D visual content). Coordination of emitters to ensure a cohesive experience is possible is part of the system in a multi-emitter implementation (i.e., projection of a holographic object with an associated mating tactile surface generated from a volumetric tactile projection system, providing multiple sensory stimuli at any given time). The LF display assembly may include one or more LF display modules for generating the holographic content.

[0027] The LF display assembly may form a single-sided or multi-sided seamless surface environment. For example, the LF display assembly may form a multi-sided seamless surface environment that encapsulates an enclosure of an adult entertainment environment. A viewer of the LF display system may enter the enclosure, which may be partially or completely transformed with holographic content generated by the LF display system. The holographic content may extend or enhance physical objects (e.g., chairs or benches) present within the enclosure. Additionally, the viewer may be free to look around the enclosure and view the holographic content without the need for eyewear devices and / or headsets. Additionally, the adult entertainment environment enclosure may have surfaces that are covered by the LF display modules of the LF display assembly. For example, in some cases, some or all of the walls, ceilings, and floors are covered with LF display modules.

[0028] The LF display system may receive input via a tracking system and / or a sensory feedback assembly. Based on the input, the LF display system may adjust the holographic content as well as provide feedback to the associated components. Additionally, the LF display system may incorporate a viewer profiling system to identify each viewer and provide personalized content to each viewer. The viewer profiling system may further record other information regarding the viewer's visit to the adult entertainment environment, which may be used in subsequent visits to personalize the holographic content.

[0029] In some embodiments, an LF display system may include elements that allow the system to simultaneously emit at least one type of energy and absorb at least one type of energy to respond to the viewer and create an interactive experience. For example, an LF display system may emit both holographic objects for viewing and ultrasound for tactile perception, while simultaneously absorbing image information for viewer tracking and other scene analysis, while absorbing ultrasound to detect touch responses by the viewer. As an example, such a system may project a holographic performer that, when virtually "touched" by a viewer, modifies its "behavior" according to the touch stimulus. The components of the display system that perform energy sensing of the environment may be integrated into the display surface via bidirectional energy elements that both emit and absorb energy, or may be dedicated sensors separate from the display surface, such as ultrasonic speakers and imaging capture devices such as cameras.

[0030] The LF display system may also incorporate a system for tracking the viewer's movements within the holographic object volume and / or the viewing volume of the LF display system. The tracked movements of the viewer may be used to enhance an immersive adult entertainment experience. For example, the LF display system may use the tracking information to facilitate the viewer's interaction with the holographic content (e.g., pressing a holographic button). The LF display system may use the tracking information to monitor the position of a finger relative to the holographic object. For example, the holographic object may be a button that may be "pressed" by the viewer. The LF display system may project ultrasonic energy to generate a tactile surface that corresponds to the button and occupies substantially the same space as the button. The LF display system may use the tracking information to dynamically move the button as well as dynamically move the position of the tactile surface as the button is "pressed" by the viewer. The LF display system may use the tracking information to provide a holographic object that looks at the viewer and / or makes eye contact with the viewer or otherwise interacts with the viewer. The LF display system can use the tracking information to provide the viewer with holographic objects to "touch," and the ultrasonic speakers create a tactile surface that allows the holographic objects to interact with the viewer via touch. Light Field Display System Overview

[0031] FIG. 1 is a diagram 100 of a light field (LF) display module 110 presenting a holographic object 120, according to one or more embodiments. The LF display module 110 is part of a light field (LF) display system. The LF display system presents holographic content, including at least one holographic object, using one or more LF display modules. The LF display system can present the holographic content to one or more viewers. In some embodiments, the LF display system can also augment the holographic content with other sensory content (e.g., touch, sound, smell, temperature, etc.). For example, as discussed below, the projection of focused ultrasound can generate hollow haptics that can simulate some or all of the surface of a holographic object. The LF display system includes one or more LF display modules 110 and is discussed in detail below with respect to FIGS. 2-5.

[0032] The LF display module 110 is a holographic display that presents a holographic object (e.g., holographic object 120) to one or more viewers (e.g., viewer 140). The LF display module 110 includes an energy device layer (e.g., a light-emitting electronic display or an acoustic projection device) and an energy waveguide layer (e.g., an optical lens array). Additionally, the LF display module 110 may include an energy relay layer to combine multiple energy sources or detectors together to form a single surface. At a high level, the energy device layer generates energy (e.g., holographic content), which is then directed to an area in space according to one or more four-dimensional (4D) light field functions using the energy waveguide layer. The LF display module 110 may also simultaneously project and / or sense one or more types of energy. For example, the LF display module 110 may be able to project holographic images as well as ultrasound tactile surfaces into a viewing volume while simultaneously detecting image data from the viewing volume. The operation of the LF display module 110 is discussed in more detail below with respect to FIGS.

[0033] The LF display module 110 generates a holographic object within the holographic object volume 160 using one or more 4D light field functions (e.g., derived from a plenoptic function). The holographic object may be three-dimensional (3D), two-dimensional (2D), or some combination thereof. Additionally, the holographic object may be multi-colored (e.g., full color). The holographic object may be projected in front of a screen plane, behind a screen plane, or segmented by a screen plane. The holographic object 120 may be presented to be perceived anywhere within the holographic object volume 160. The holographic object within the holographic object volume 160 may appear to the viewer 140 as floating in space.

[0034] The holographic object volume 160 represents a volume in which a holographic object can be perceived by the viewer 140. The holographic object volume 160 may extend in front of the surface of the display area 150 (i.e., toward the viewer 140) so that the holographic object can be presented in front of the plane of the display area 150. Additionally, the holographic object volume 160 may extend behind the plane of the display area 150 (i.e., away from the viewer 140), allowing the holographic object to be presented as if it were behind the plane of the display area 150. In other words, the holographic object volume 160 can include all light rays that may originate (e.g., projected) from the display area 150 and converge to create a holographic object. Here, the light rays may converge to a point in front of, at, or behind the display surface. In simpler terms, the holographic object volume 160 encompasses all volumes in which a holographic object can be perceived by the viewer.

[0035] The viewing volume 130 is the volume of space in which a holographic object (e.g., holographic object 120) presented by the LF display system in the holographic object volume 160 is fully visible. The holographic object may be presented in the holographic object volume 160 and viewed in the viewing volume 130 such that it is indistinguishable from the actual object. The holographic object is formed by projecting the same light rays that would be generated from the surface of the object if it physically existed.

[0036] In some cases, the holographic object volume 160 and corresponding viewing volume 130 may be relatively small, such as designed for a single viewer. In other embodiments, for example, as discussed in detail below with respect to Figures 4, 6, 7A, 7B, 8, LF display modules may be scaled and / or tiled to create larger holographic object volumes and corresponding viewing volumes that can accommodate a wide range of viewers (e.g., from one person to several thousand people). The LF display modules presented in this disclosure may be constructed such that the entire surface of the LF display includes holographic imaging optics, with no inactive or dead space and no need for bezels. In these embodiments, the LF display modules may be tiled such that the imaging area is continuous across the seams between the LF display modules, and the join lines between the tiled modules are substantially undetectable using eye vision. Notably, in some configurations, portions of the display surface may not include holographic imaging optics, not described in detail herein.

[0037] The flexible size and / or shape of the viewing volume 130 allows the viewer 140 to be unconstrained within the viewing volume 130. For example, the viewer 140 can move to different positions within the viewing volume 130 and see different views of the holographic object 120 from corresponding viewpoints. For illustration, with reference to FIG. 1 , the viewer 140 is in a first position relative to the holographic object 120 such that the holographic object 120 is seen in a head-on view of the dolphin. The viewer 140 can move to other locations relative to the holographic object 120 to see different views of the dolphin. For example, the viewer 140 can move to see the left side of the dolphin, the right side of the dolphin, etc., as if the viewer 140 were looking at an actual dolphin and would change the viewer's relative position to the actual dolphin to see different sides of the dolphin. In some embodiments, the holographic object 120 is visible to all viewers within the viewing volume 130 who have an unobstructed (i.e., unobstructed by an object / person) line of sight to the holographic object 120. These viewers may be unconstrained so that they can move around within the viewing volume to see different perspectives of the holographic object 120. Thus, the LF display system can present a holographic object such that multiple unconstrained viewers can simultaneously view the holographic object in real-world space from different perspectives, as if the holographic object were physically present.

[0038] In contrast, traditional displays (e.g., stereoscopic, virtual reality, augmented reality, or mixed reality) generally require each viewer to wear some external device (e.g., 3D glasses, near-eye display, or head-mounted display) to view the content. Additionally and / or alternatively, traditional displays may require the viewer to be constrained to a particular viewing position (e.g., to a chair with a fixed location relative to the display). For example, when viewing an object displayed by a stereoscopic display, the viewer always focuses on the display surface rather than the object, and the display always presents only two views of the object that follow the viewer as they try to move around the perceived object, causing distortions in the perception of the object. However, in light field displays, the viewer of a holographic object presented by an LF display system does not need to wear an external device or be confined to a particular position to view the holographic object. The LF display system presents the holographic object in a way that appears to the viewer nearly the same as the physical object appears to the viewer, without requiring special eyewear, glasses, or head-mounted accessories. Furthermore, the viewer can view the holographic content from any location within the viewing volume.

[0039] In particular, the potential locations of holographic objects within the holographic object volume 160 are limited by the size of the volume. To increase the size of the holographic object volume 160, the size of the display area 150 of the LF display module 110 may be increased and / or multiple LF display modules may be tiled together to form a seamless display surface. The seamless display surface has an effective display area that is larger than the display areas of the individual LF display modules. Some embodiments related to tiling of LF display modules are discussed below with respect to Figures 4, 6, and 7. As illustrated in Figure 1, the display area 150 is rectangular, resulting in a holographic object volume 160 that is pyramidal. In other embodiments, the display area may have some other shape (e.g., hexagonal) that also affects the shape of the corresponding viewing volume.

[0040] Additionally, while the above discussion has focused on presenting the holographic object 120 within a portion of the holographic object volume 160 that is between the LF display module 110 and the viewer 140, the LF display module 110 can additionally present content to the holographic object volume 160 behind the plane of the display area 150. For example, the LF display module 110 can make the display area 150 appear to be the surface of the ocean with the holographic object 120 popping out of it. Also, the displayed content may be such that the viewer 140 can see underwater marine life through the displayed surface. Furthermore, the LF display system can generate content that moves seamlessly around the holographic object volume 160, including behind and in front of the plane of the display area 150.

[0041] 2A is a cross-section 200 of a portion of an LF display module 210, according to one or more embodiments. The LF display module 210 may be the LF display module 110. In other embodiments, the LF display module 210 may be another LF display module having a different display area shape than the display area 150. In an exemplary embodiment, the LF display module 210 includes an energy device layer 220, an energy relay layer 230, and an energy waveguide layer 240. Some embodiments of the LF display module 210 have different components than those described herein. For example, in some embodiments, the LF display module 210 does not include the energy relay layer 230. Similarly, functionality may be distributed among components in a different manner than described herein.

[0042] The display system described herein presents an emission of energy that replicates the energy that normally surrounds real-world objects, where the emitted energy is directed in a specific direction from every coordinate on the display surface. The directed energy from the display surface allows for the convergence of many energy rays, thereby creating a holographic object. For example, in visible light, the LF display projects an extremely large number of rays that may converge at any point within the holographic object volume, so that from the perspective of a viewer located farther away than the object being projected, those rays will appear to come from the surface of a real-world object located in this region of space. In this way, the LF display is generating reflected rays that, from the viewer's perspective, appear to come from the surface of such an object. The viewer's viewpoint can be changed on any particular holographic object, and the viewer will see different views of that holographic object.

[0043] The energy device layer 220 includes one or more electronic displays (e.g., light-emitting displays such as OLEDs) and one or more other energy projection and / or energy receiving devices described herein. The one or more electronic displays are configured to display content according to display instructions (e.g., from a controller of the LF display system). The one or more electronic displays include multiple pixels, each having an intensity that is individually controlled. Many types of commercial displays can be used within the LF display, such as light-emitting LED and OLED displays.

[0044] The energy device layer 220 may also include one or more acoustic projection devices and / or one or more acoustic receiving devices. The acoustic projection devices generate one or more pressure waves that complement the holographic object 250. The generated pressure waves may be, for example, audible, ultrasonic, or some combination thereof. An array of ultrasonic pressure waves may be used (e.g., at the surface of the holographic object 250) for volumetric haptics. The audible pressure waves are used to provide audio content (e.g., immersive audio) that may complement the holographic object 250. For example, assuming the holographic object 250 is a dolphin, one or more acoustic projection devices may be used to (1) generate a tactile surface juxtaposed with the surface of the dolphin so that the viewer can touch the holographic object 250, and (2) provide audio content corresponding to sounds made by the dolphin, such as snapping, high-pitched sounds, shrieking, etc. The acoustic receiving device (e.g., a microphone or microphone array) may be configured to monitor ultrasonic and / or audible pressure waves within a localized area of ​​the LF display module 210.

[0045] The energy device layer 220 may also include one or more image sensors. The image sensors may be sensitive to light in the visible light band, and possibly other bands (e.g., infrared). The image sensors may be, for example, a complementary metal oxide semiconductor (CMOS) array, a charge-coupled device (CCD), an array of photodetectors, some other sensor that captures light, or some combination thereof. The LF display system may use data captured by the one or more image sensors for viewer location tracking.

[0046] In some configurations, the energy relay layer 230 relays energy (e.g., electromagnetic energy, mechanical pressure waves, etc.) between the energy device layer 220 and the energy waveguide layer 240. The energy relay layer 230 includes one or more energy relay elements 260. Each energy relay element includes a first surface 265 and a second surface 270 and relays energy between the two surfaces. The first surface 265 of each energy relay element may be coupled to one or more energy devices (e.g., electronic displays or acoustic projection devices). The energy relay elements may be composed of, for example, glass, carbon, optical fiber, optical film, plastic, polymer, or some combination thereof. Additionally, in some embodiments, the energy relay elements may adjust the magnification (increase or decrease) of the energy passing between the first surface 265 and the second surface 270. If the relay provides magnification, the relay may take the form of an array of bonded tapered relays, called tapers, where one end of the taper may be substantially larger in area than the opposite end. The larger ends of the tapers can be plastered together to form a seamless energy surface 275. One advantage is that space is created at the smaller ends of each taper to accommodate the mechanical envelope of multiple energy sources, such as the bezels of multiple displays. This extra space allows energy sources to be placed side-by-side on the smaller taper side, with each energy source having an active area within the smaller taper surface that directs energy and is relayed to the larger seamless energy surface. Another advantage of using a taper relay is that the combined seamless energy surface formed by the larger ends of the tapers has no non-imaging dead space. Because there are no borders or bezels, the seamless energy surfaces can be tiled together to form a larger surface that is substantially seamless according to the visual acuity of the eye.

[0047] The second surfaces of adjacent energy relay elements together form an energy plane 275. In some embodiments, the separation between the edges of adjacent energy relay elements is less than the smallest perceptible contour defined, for example, by the visual acuity of a human eye having 20 / 40 vision, such that the energy plane 275 is virtually seamless from the perspective of a viewer 280 within the viewing volume 285.

[0048] In some embodiments, one or more energy relay elements exhibit energy localization, such that the efficiency of energy transport in a longitudinal direction substantially perpendicular to surfaces 265 and 270 is much higher than the efficiency of transport in a perpendicular transverse plane, and the energy density is highly localized in this transverse plane as an energy wave propagates between surfaces 265 and 270. This energy localization allows energy distributions, such as images, to be efficiently relayed between these surfaces without significant loss of resolution.

[0049] The waveguide layer 240 uses waveguide elements in the energy waveguide layer 240 to direct energy from locations (e.g., coordinates) on the energy plane 275 into specific propagation paths from the display plane outward into the holographic viewing volume 285. As an example, for electromagnetic energy, the waveguide elements in the energy waveguide layer 240 direct light from locations on the seamless energy plane 275 along different propagation directions through the viewing volume 285. In various examples, the light is directed according to a 4D light field function to form the holographic object 250 within the holographic object volume 255.

[0050] Each waveguide element in the energy waveguide layer 240 may be, for example, a lenslet composed of one or more elements. In some configurations, the lenslet may be a positive lens. The positive lens may have a spherical, aspheric, or freeform surface profile. Additionally, in some embodiments, some or all of the waveguide elements may include one or more additional optical components. The additional optical components may be, for example, energy suppression structures such as baffles, positive lenses, negative lenses, spherical lenses, aspheric lenses, freeform lenses, liquid crystal lenses, liquid lenses, refractive elements, diffractive elements, or some combination thereof. In some embodiments, at least one of the lenslets and / or additional optical components may also dynamically adjust refractive power. For example, the lenslet may be a liquid crystal lens or a liquid lens. The dynamic adjustment of the surface profile, the lenslet and / or the at least one additional optical component may provide additional directional control of the light projected from the waveguide element.

[0051] In an illustrative example, the holographic object volume 255 of the LF display has a boundary formed by light rays 256 and 257, but may be formed by other light rays. The holographic object volume 255 is a continuous volume that extends both in front of the energy waveguide layer 240 (i.e., toward the viewer 280) and behind it (i.e., away from the viewer 280). In an illustrative example, light rays 256 and 257 are projected from opposite edges of the LF display module 210 at the largest angle relative to the normal of the display surface 277 that can be perceived by the user, but they may be other projected light rays. These light rays define the field of view of the display and therefore the boundary of the holographic viewing volume 285. In some cases, these light rays define a holographic viewing volume (e.g., an ideal viewing volume) where the entire display may be observed without vignetting. As the field of view of the display increases, the convergence point of light rays 256 and 257 becomes closer to the display. Thus, a display with a wider field of view allows viewer 280 to view the entire display at a closer viewing distance. Additionally, light rays 256 and 257 may form an ideal holographic object volume. A holographic object presented within the ideal holographic object volume may be viewed anywhere within viewing volume 285.

[0052] In some examples, the holographic object may be presented in only a portion of the viewing volume 285. In other words, the holographic object volume may be divided into any number of viewing sub-volumes (e.g., viewing sub-volume 290). Additionally, the holographic object may be projected outside the holographic object volume 255. For example, the holographic object 251 is presented outside the holographic object volume 255. Because the holographic object 251 is presented outside the holographic object volume 255, it is not visible from all locations within the viewing volume 285. For example, the holographic object 251 may be visible from locations within the viewing sub-volume 290, but not from locations of the viewer 280.

[0053] For example, to illustrate viewing holographic content from different viewing sub-volumes, turn to FIG. 2B. FIG. 2B illustrates a cross section 200 of a portion of an LF display module, according to one or more embodiments. The cross section of FIG. 2B is the same as the cross section of FIG. 2A. However, FIG. 2B shows a different set of light rays projected from the LF display module 210. Light rays 256 and light rays 257 still form the holographic object volume 255 and the viewing volume 285. However, as shown, the light rays projected from the top of the LF display module 210 and the bottom of the LF display module 210 overlap to form various viewing sub-volumes (e.g., view sub-volumes 290A, 290B, 290C, and 290D) within the viewing volume 285. A viewer in a first viewing sub-volume (e.g., 290A) may be able to perceive holographic content presented in the holographic object volume 255 that is not perceivable by viewers in the other viewing sub-volumes (e.g., 290B, 290C, and 290D).

[0054] More simply, as illustrated in FIG. 2A, holographic object volume 255 is a volume in which a holographic object may be presented by the LF display system such that the holographic object may be perceived by a viewer (e.g., viewer 280) in viewing volume 285. Thus, viewing volume 285 is an example of an ideal viewing volume, and holographic object volume 255 is an example of an ideal object volume. However, in various configurations, a viewer may perceive a holographic object presented by LF display system 200 in other exemplary holographic object volumes as a viewer in other exemplary viewing volumes perceives holographic content. More generally, "eyeline guidelines" apply when viewing holographic content projected from an LF display module. Eyeline guidelines dictate that a line formed by the viewer's eye position and the holographic object being viewed must intersect the LF display surface.

[0055] When viewing the holographic content presented by the LF display module 210, each eye of the viewer 280 will see a different perspective of the holographic object 250 because the holographic content is presented according to a 4D light field function. Furthermore, as the viewer 280 moves within the viewing volume 285, the viewer will see different perspectives of the holographic object 250 as other viewers within the viewing volume 285 would see. As will be appreciated by those skilled in the art, 4D light field functions are well known in the art and will not be described in further detail herein.

[0056] As described in more detail herein, in some embodiments, the LF display can project more than one type of energy. For example, the LF display can project two types of energy, such as, for example, mechanical and electromagnetic energy. In this configuration, the energy relay layer 230 includes two separate energy relays that are interleaved together at the energy plane 275, but are separated such that the energy is relayed to two different energy device layers 220. Here, one relay can be configured to transport electromagnetic energy and another relay can be configured to transport mechanical energy. In some embodiments, the mechanical energy can be projected from a location between the electromagnetic waveguide elements on the energy waveguide layer 240, which helps to form a structure that inhibits light from being transported from one electromagnetic waveguide element to another. In some embodiments, the energy waveguide layer 240 can also include waveguide elements that transport focused ultrasound along a specific propagation path according to display instructions from the controller.

[0057] Note that in an alternative embodiment (not shown), the LF display module 210 does not include the energy relay layer 230. In this case, the energy plane 275 is an output plane formed using one or more adjacent electronic displays in the energy device layer 220. Also, in some embodiments, the separation between the edges of adjacent electronic displays is less than the smallest perceptible contour defined by the visual acuity of a human eye with 20 / 40 vision, such that the energy plane is virtually seamless from the perspective of a viewer 280 within the viewing volume 285. LF Display Module

[0058] FIG. 3A is a perspective view of an LF display module 300A according to one or more embodiments. The LF display module 300A may be the LF display module 110 and / or the LF display module 210. In other embodiments, the LF display module 300A may be some other LF display module. In an exemplary embodiment, the LF display module 300A includes an energy device layer 310, an energy relay layer 320, and an energy waveguide layer 330. The LF display module 300A is configured to present holographic content from a display surface 365 as described herein. For convenience, the display surface 365 is illustrated as a dashed outline on the frame 390 of the LF display module 300A, but more precisely, it is the surface directly in front of the waveguide element bounded by the inner rim of the frame 390. Some embodiments of the LF display module 300A have components different from those described herein. For example, in some embodiments, the LF display module 300A does not include the energy relay layer 320. Similarly, functionality may be distributed between components in ways different from those described herein.

[0059] Energy device layer 310 is one embodiment of energy device layer 220. Energy device layer 310 includes four energy devices 340 (three are visible in the figure). The energy devices 340 may all be of the same type (e.g., all electronic displays) or may include one or more different types (e.g., including an electronic display and at least one acoustic energy device).

[0060] The energy relay layer 320 is one embodiment of the energy relay layer 230. The energy relay layer 320 includes four energy relay devices 350 (three are visible in the figure). The energy relay devices 350 may all relay the same type of energy (e.g., light) or may relay one or more different types (e.g., light and sound). Each of the relay devices 350 includes a first surface and a second surface, where the second surfaces of the energy relay devices 350 are arranged to form a single seamless energy surface 360. In an exemplary embodiment, each of the energy relay devices 350 is tapered such that the first surface has a smaller surface area than the second surface, which allows the mechanical envelope of the energy device 340 to be housed at the smaller end of the taper. This allows the seamless energy surface to be borderless, since the entire area may project energy. This means that this seamless energy surface can be tiled by placing multiple instances of the LF display module 300A together without dead space or bezels, such that the entire combined surface is seamless. In other embodiments, the first surface and the second surface have the same surface area.

[0061] The energy waveguide layer 330 is one embodiment of the energy waveguide layer 240. The energy waveguide layer 330 includes a plurality of waveguide elements 370. As discussed above with respect to FIG. 2, the energy waveguide layer 330 is configured to direct energy from a seamless energy plane 360 ​​along specific propagation paths according to a 4D plenoptic function to form a holographic object. Note that in an exemplary embodiment, the energy waveguide layer 330 is bounded by a frame 390. In other embodiments, the frame 390 is absent and / or has a reduced thickness. Removal or reduction in the thickness of the frame 390 may facilitate tiling of the LF display module 300A with additional LF display modules.

[0062] Note that in the exemplary embodiment, the seamless energy surface 360 ​​and the energy waveguide layer 330 are planar. In alternative embodiments not shown, the seamless energy surface 360 ​​and the energy waveguide layer 330 may be curved in one or more dimensions.

[0063] The LF display module 300A may be configured with additional energy sources present on the surface of the seamless energy surface, allowing the projection of energy fields in addition to the light field. In one embodiment, an acoustic energy field may be projected from an electrostatic speaker (not illustrated) mounted at any number of locations on the seamless energy surface 360. Additionally, the electrostatic speaker of the LF display module 300A is positioned within the light field display module 300A such that the dual energy surface simultaneously projects a sound field and holographic content. For example, the electrostatic speaker may be formed of one or more diaphragm elements that are transparent to some wavelengths of electromagnetic energy and driven with conductive elements. The electrostatic speaker may be mounted on the seamless energy surface 360 ​​such that the diaphragm elements cover some of the waveguide elements. The conductive electrodes of the speaker may be collocated with a structure designed to suppress light transmission between the electromagnetic waveguides and / or may be located at a location between the electromagnetic waveguide elements (e.g., frame 390). In various configurations, the speakers can project multiple sources of focused ultrasonic energy that produce audible sound and / or a tactile surface.

[0064] In some configurations, the energy devices 340 may sense energy. For example, the energy devices may be microphones, light sensors, acoustic transducers, etc. As such, the energy relay devices may also relay energy from the seamless energy surface 360 ​​to the energy device layer 310. That is, the seamless energy surface 360 ​​of the LF display module forms a bidirectional energy surface when the energy devices and the energy relay devices 340 are configured to simultaneously emit and sense energy (e.g., emit a light field and sense sound).

[0065] More broadly, the energy device 340 of the LF display module 300A can be either an energy source or an energy sensor. The LF display module 300A can include various types of energy devices that function as energy sources and / or energy sensors to facilitate the projection of high quality holographic content to a user. Other sources and / or sensors include thermal sensors or sources, infrared sensors or sources, image sensors or sources, mechanical energy transducers that generate acoustic energy, feedback sources, and the like. Many other sensors or sources are possible. Additionally, the LF display modules can be tiled such that the LF display modules can form an assembly that projects and senses multiple types of energy from a large aggregate seamless energy surface.

[0066] In various embodiments of the LF display module 300A, the seamless energy surface 360 ​​may have various surface portions, with each surface portion configured to project and / or emit a particular type of energy. For example, if the seamless energy surface is a dual energy surface, the seamless energy surface 360 ​​includes one or more surface portions that project electromagnetic energy and one or more other surface portions that project ultrasonic energy. The surface portions that project ultrasonic energy may be located on the seamless energy surface 360 ​​between the waveguide elements and / or may be co-located with structures designed to inhibit light transmission between the electromagnetic waveguide elements. In examples where the seamless energy surface is a bidirectional energy surface, the energy relay layer 320 may include two types of energy relay devices interleaved in the seamless energy surface 360. In various embodiments, the seamless energy surface 360 ​​may be configured such that the portions of the surface under any particular waveguide element 370 are all energy sources, all energy sensors, or a mix of energy sources and energy sensors.

[0067] 3B is a cross-sectional view of an LF display module 300B including an interleaved energy relay device, according to one or more embodiments. The LF display module 300B can be configured either as a dual energy projection device for projecting two or more types of energy, or as a bi-directional energy device for simultaneously projecting one type of energy and sensing another type of energy. The LF display module 300B can be the LF display module 110 and / or the LF display module 210. In other embodiments, the LF display module 302 can be some other LF display module.

[0068] The LF display module 300B includes many components configured similarly to those of the LF display module 300A of FIG. 3A. For example, in an exemplary embodiment, the LF display module 300B includes an energy device layer 310, an energy relay layer 320, a seamless energy surface 360, and an energy waveguide layer 330 that include at least the same functionality as described with respect to FIG. 3A. Additionally, the LF display module 300B presents and / or receives energy from a display surface 365. In particular, the components of the LF display module 300B are alternatively connected and / or oriented differently than the components of the LF display module 300A of FIG. 3A. Some embodiments of the LF display module 300B have different components than those described herein. Similarly, functionality can be distributed among the components in a different manner than described herein. FIG. 3B illustrates a design of a single LF display module 302 that can be tiled to create a dual energy projection surface or a bidirectional energy surface with a larger area.

[0069] In one embodiment, the LF display module 300B is an LF display module of a bidirectional LF display system. The bidirectional LF display system can project energy and simultaneously sense energy from a display surface 365. The seamless energy surface 360 ​​includes both energy projection locations and energy sensing locations closely interleaved on the seamless energy surface 360. Thus, in the example of FIG. 3B, the energy relay layer 320 is configured in a different manner than the energy relay layer of FIG. 3A. For convenience, the energy relay layer of the LF display module 300B is referred to herein as an "interleaved energy relay layer."

[0070] The interleaved energy relay layer 320 includes two legs of a first energy relay device 350A and a second energy relay device 350B. Each of the legs is illustrated as a lightly shaded area. Each of the legs is made of a flexible relay material and can be formed with a sufficient length for use with energy devices of various sizes and shapes. In some areas of the interleaved energy relay layer, the two legs are tightly interleaved together as they approach a seamless energy surface 360. In the illustrative example, the interleaved energy relay device 352 is illustrated as a darkly shaded area.

[0071] The energy relay devices are configured to relay energy between different energy devices while being interleaved in a seamless energy plane 360. The energy devices are in the energy device layer 310. As illustrated, energy device 340A is connected to energy relay device 350A and energy device 340B is connected to energy relay device 350B. In various embodiments, each energy device may be an energy source or an energy sensor.

[0072] The energy waveguide layer 330 includes a waveguide element 370 for guiding energy waves from the seamless energy surface 360 ​​along a projected path toward a series of convergence points. In this example, a holographic object 380 is formed at the series of convergence points. Notably, as illustrated, the convergence of energy at the holographic object 380 occurs on the viewer side of the display surface 365. However, in other examples, the convergence of energy may be anywhere within the holographic object volume that extends both in front of the display surface 365 and behind the display surface 365. The waveguide element 370 can simultaneously guide the incoming energy to an energy device (e.g., an energy sensor), as described below.

[0073] In one exemplary embodiment of the LF display module 300B, a light-emitting display is used as the energy source and an image sensor is used as the energy sensor. In this manner, the LF display module 300B can simultaneously project holographic content and detect light from the volume in front of the display surface 365.

[0074] In one embodiment, the LF display module 300B is configured to project a light field from a projection location of the display surface in front of the display surface 365 while simultaneously capturing a light field from in front of the display surface 365. In this embodiment, the energy relay device 350A connects a first set of locations in the seamless energy surface 360 ​​positioned under the waveguide element 370 to the energy device 340A. In one example, the energy device 340A is an emissive display having an array of source pixels. The energy relay device 340B connects a second set of locations in the seamless energy surface 360 ​​positioned under the waveguide element 370 to the energy device 340B. In one example, the energy device 340B is an image sensor having an array of sensor pixels. The LF display module 302 may be configured such that the locations in the seamless energy surface 365 under a particular waveguide element 370 are all emissive display locations, all image sensor locations, or some combination of locations. In other embodiments, the bidirectional energy surface may project and receive various other forms of energy.

[0075] In another exemplary embodiment of the LF display module 300B, the LF display module is configured to project two different types of energy. For example, the energy device 340A is a light-emitting display configured to emit electromagnetic energy, and the energy device 340B is an ultrasonic transducer configured to emit mechanical energy. As such, both light and sound can be projected from various locations on the seamless energy surface 360. In this configuration, the energy relay device 350A connects the energy device 340A to the seamless energy surface 360 ​​and relays the electromagnetic energy. The energy relay device is configured to have properties that make the transport of electromagnetic energy efficient (e.g., change the refractive index). The energy relay device 350B connects the energy device 340B to the seamless energy surface 360 ​​and relays the mechanical energy. The energy relay device 350B is configured to have properties for efficient transport of ultrasonic energy (e.g., distribution of materials with different acoustic impedances). In some embodiments, the mechanical energy can be projected from locations between the waveguide elements 370 on the energy waveguide layer 330. The locations of projecting mechanical energy may form structures that serve to inhibit light from being transported from one electromagnetic waveguide element to another. In one example, a spatially separated array of locations of projecting ultrasonic mechanical energy may be configured to create three-dimensional haptic shapes and surfaces in air. The surfaces may coincide with a projected holographic object (e.g., holographic object 380). In some examples, phase delays and amplitude variations across the array may assist in creating haptic shapes.

[0076] In various embodiments, the interactive LF display module 302 may include multiple energy device layers, with each energy device layer including a particular type of energy device. In these examples, the energy relay layer is configured to relay the appropriate type of energy between the seamless energy plane 360 ​​and the energy device layer 330. Tiled LF Display Module

[0077] 4A is a perspective view of a portion of an LF display system 400 that is tiled in two dimensions to form a single-sided seamless surface environment, according to one or more embodiments. The LF display system 400 includes a plurality of LF display modules that are tiled to form an array 410. More specifically, each small square in the array 410 represents a tiled LF display module 412. The array 410 can, for example, cover some or all of a surface (e.g., a wall) of a room. The LF array can cover other surfaces, such as, for example, tabletops, billboards, rotundas, etc.

[0078] Array 410 can project one or more holographic objects. For example, in an exemplary embodiment, array 410 projects holographic object 420 and holographic object 430. Tiling of LF display module 412 not only allows for a much larger viewing volume, but also allows objects to be projected farther away from array 410. For example, in an exemplary embodiment, the viewing volume is approximately the entire area in front of and behind array 410, rather than a localized volume in front of (and behind) LF display module 412.

[0079] In some embodiments, the LF display system 400 presents the holographic object 420 to a viewer 430 and a viewer 434. The viewer 430 and the viewer 434 receive different perspectives of the holographic object 420. For example, the viewer 430 is presented with a straight-on view of the holographic object 420, while the viewer 434 is presented with a more oblique view of the holographic object 420. As the viewer 430 and / or the viewer 434 move, they are presented with different perspectives of the holographic object 420. This allows the viewer to visually interact with the holographic object by moving relative to the holographic object. For example, as the viewer 430 walks around the holographic object 420, the viewer 430 sees different sides of the holographic object 420, as long as the holographic object 420 remains within the holographic object volume of the array 410. Thus, viewer 430 and viewer 434 can simultaneously view holographic object 420 in real-world space as if holographic object 420 were actually there. Additionally, viewer 430 and viewer 434 do not need to wear an external device to view holographic object 420, since holographic object 420 appears to the viewer in much the same way that a physical object appears. Additionally, holographic object 422 is illustrated here behind the array, since the viewing volume of the array extends behind the surface of the array. In this way, holographic object 422 can be presented to viewer 430 and / or viewer 434 as if it were farther away from the viewer than the surface of array 410.

[0080] In some embodiments, LF display system 400 may include a tracking system that tracks the positions of viewer 430 and viewer 434. In some embodiments, the tracked positions are the positions of the viewers. In other embodiments, the tracked positions are the positions of the viewers' eyes. Eye position tracking differs from gaze tracking, which tracks where the eyes are looking (e.g., using orientation to determine gaze location). The eyes of viewer 430 and the eyes of viewer 434 are in different locations.

[0081] In various configurations, the LF display system 400 may include one or more tracking systems. For example, in the exemplary embodiment of FIG. 4A, the LF display system includes a tracking system 440 that is external to the array 410. Here, the tracking system may be a camera system coupled to the array 410. The external tracking system is described in more detail with respect to FIG. 5A. In other exemplary embodiments, the tracking system may be incorporated into the array 410, as described herein. For example, an energy device (e.g., energy device 340) of an LF display module 412 included in the array 410 may be configured to capture an image of a viewer in front of the array 440. In either case, the tracking system of the LF display system 400 determines tracking information about a viewer (e.g., viewer 430 and / or viewer 434) viewing the holographic content presented by the array 410.

[0082] The tracking information represents the position of the viewer or the position of a portion of the viewer (e.g., one or both eyes of the viewer, or a limb of the viewer) in space (e.g., relative to the tracking system). The tracking system can use any number of depth determination techniques to determine the tracking information. Depth determination techniques may include, for example, structured light, time of flight, stereo imaging, some other depth determination technique, or some combination thereof. The tracking system may include various systems configured to determine the tracking information. For example, the tracking system may include one or more infrared sources (e.g., structured light sources), one or more image sensors capable of capturing images in infrared (e.g., red-blue-green-infrared cameras), and a processor that executes a tracking algorithm. The tracking system may determine the viewer's position using depth estimation techniques. In some embodiments, the LF display system 400 generates a holographic object based on the tracked positions, actions, or gestures of the viewer 430 and / or the viewer 434 as described herein. For example, the LF display system 400 may generate a holographic object in response to a viewer coming within a threshold distance and / or a particular position of the array 410.

[0083] LF display system 400 can present one or more holographic objects customized for each viewer based in part on the tracking information. For example, viewer 430 can be presented with holographic object 420, but not with holographic object 422. Similarly, viewer 434 can be presented with holographic object 422, but not with holographic object 420. For example, LF display system 400 tracks the positions of each of viewer 430 and viewer 434. LF display system 400 determines the viewpoint of the holographic object that should be seen by the viewer based on the viewer's position relative to where the holographic object should be presented. LF display system 400 selectively projects light from specific pixels that correspond to the determined viewpoint. Thus, viewer 434 and viewer 430 can potentially have completely different experiences simultaneously. In other words, LF display system 400 can present holographic content to a viewing sub-volume of the viewing volume. For example, as shown in the figure, the viewing volume is represented as all the space before and after the array. In this example, LF display system 400 can track the position of viewer 430 so that LF display system 400 can present space content (e.g., holographic object 420) to a viewing sub-volume surrounding viewer 430 and safari content (e.g., holographic object 422) to a viewing sub-volume surrounding viewer 434. In contrast, conventional systems would have to use individual headsets to provide a similar experience.

[0084] In some embodiments, the LF display system 400 may include one or more sensory feedback systems. The sensory feedback systems provide other sensory stimuli (e.g., touch, sound, or smell) that enhance the holographic objects 420 and 422. For example, in the exemplary embodiment of FIG. 4A, the LF display system 400 includes a sensory feedback system 442 external to the array 410. In one example, the sensory feedback system 442 may be an electrostatic speaker coupled to the array 410. The external sensory feedback system is described in more detail with respect to FIG. 5A. In other exemplary embodiments, the sensory feedback system may be incorporated into the array 410, as described herein. For example, an energy device (e.g., energy device 340A of FIG. 3B) of the LF display module 412 included in the array 410 may be configured to project ultrasonic energy to a viewer in front of the array and / or receive image information from a viewer in front of the array. In either case, the sensory feedback system presents sensory content to and / or receives sensory content from a viewer (e.g., viewer 430 and / or viewer 434) viewing holographic content presented by array 410 (e.g., holographic object 420 and / or holographic object 422).

[0085] The LF display system 400 may include a sensory feedback system including one or more acoustic projection devices external to the array. Alternatively or additionally, the LF display system 400 may include one or more acoustic projection devices integrated into the array 410 as described herein. The acoustic projection devices may project ultrasonic pressure waves that generate volumetric haptics of one or more surfaces of the holographic object (e.g., at the surface of the holographic object 420) when a portion of the viewer comes within a threshold distance of the one or more surfaces. The volumetric haptics allow the user to touch and feel the surface of the holographic object. The multiple acoustic projection devices may project audible pressure waves that provide audio content (e.g., immersive audio) to the viewer. Thus, the ultrasonic pressure waves and / or the audible pressure waves may serve to complement the holographic object.

[0086] In various embodiments, the LF display system 400 can provide other sensory stimuli based in part on the tracked position of the viewer. For example, the holographic object 422 illustrated in FIG. 4A is a lion, and the LF display system 400 can cause the holographic object 422 to roar both visually (i.e., the holographic object 430 appears to roar) and audibly (i.e., one or more sound projection devices project pressure waves that the viewer 430 perceives as a lion's roar emanating from the holographic object 422).

[0087] Note that in the example configuration, the holographic viewing volume may be limited in a manner similar to the viewing volume 285 of the LF display system 200 of Figure 2. This can limit the amount of perceived immersion a viewer would experience with a single wall display unit. One way to address this is to use multiple LF display modules tiled along multiple sides, as described below with respect to Figures 4B-4F.

[0088] FIG. 4B is a perspective view of a portion of a LF display system 402 in a multi-sided seamless surface environment, according to one or more embodiments. The LF display system 402 is substantially similar to the LF display system 400, except that multiple LF display modules are tiled to create a multi-sided seamless surface environment. More specifically, the LF display modules are tiled to form an array that is a six-sided collective seamless surface environment. Multiple LF display modules, each square of FIG. 4B, cover all walls, ceiling, and floor of the room. In other embodiments, multiple LF display modules may cover some, but not all, of the walls, floor, ceiling, or some combination thereof. In other embodiments, multiple LF display modules are tiled to form some other collective seamless surface. For example, walls may be curved such that a cylindrical collective energy environment is formed. Additionally, as described below with respect to FIGS. 6-9, in some embodiments, the LF display modules may be tiled to form surfaces (e.g., walls, etc.) of a venue or private viewing room.

[0089] The LF display system 402 can project one or more holographic objects. For example, in an exemplary embodiment, the LF display system 402 projects the holographic object 420 into an area surrounded by the six-sided aggregated seamless surface environment. Thus, the viewing volume of the LF display system is also contained within the six-sided aggregated seamless surface environment. Note that in an exemplary configuration, the viewer 432 can be positioned between the holographic object 420 and the LF display module 414 that is projecting the energy (e.g., light and / or pressure waves) used to form the holographic object 420. Thus, the positioning of the viewer 434 may prevent the viewer 430 from perceiving the holographic object 420 formed from the energy from the LF display module 414. However, in the exemplary configuration, there is at least one other LF display module, such as, for example, the LF display module 416, that is not obstructed (e.g., by the viewer 434) and that can project energy to form the holographic object 420. In this way, viewer occlusion in the space may obscure parts of the holographic projection, but this effect is much smaller than if there were a holographic display panel on only one side of the volume. Holographic object 422 is illustrated "outside" the walls of the six-sided aggregated seamless surface environment because the holographic object volume extends behind the aggregated surfaces. Viewer 430 and / or viewer 434 may therefore perceive holographic object 422 as "outside" the six-sided environment, which the viewer may move throughout.

[0090] As discussed above with reference to Figure 4A, in some embodiments, the LF display system 402 may actively track the viewer's position and dynamically instruct different LF display modules to present holographic content based on the tracked position. Thus, the multi-surface configuration may provide a more robust environment (e.g., as compared to Figure 4A) for presenting holographic objects, where an unconstrained viewer may freely move throughout an area surrounded by the multi-surface seamless surface environment.

[0091] In particular, various LF display systems may have different configurations. Furthermore, each configuration may have a particular orientation of the surfaces that together form a seamless display surface ("aggregate surface"). That is, the LF display modules of an LF display system may be tiled to form various aggregate surfaces. For example, in FIG. 4B, LF display system 402 includes LF display modules that are tiled to form a six-sided aggregate surface that approximates the walls of a room. In some other examples, the aggregate surface may occur only on a portion of a surface (e.g., half of a wall) rather than the entire surface (e.g., the entire wall). Several examples are described herein.

[0092] In some configurations, a collective surface of an LF display system may include a collective surface configured to project energy toward a localized viewing volume, which may enable a higher quality viewing experience, for example, by increasing the density of projected energy within a particular viewing volume, widening the FOV of a viewer within that volume, and moving the viewing volume closer to the display surface.

[0093] For example, Figure 4C shows a top view of an LF display system 450A with a collective surface in a "wing" configuration. In this example, the LF display system 450A is located in a room having a front wall 452, a back wall 454, a first side wall 456, a second side wall 458, a ceiling (not shown), and a floor (not shown). The first side wall 456, the second side wall 458, the back wall 454, the floor, and the ceiling are all orthogonal. The LF display system 450A includes LF display modules tiled to form a collective surface 460 that covers the front wall. The front wall 452, and therefore the collecting surface 460, includes three portions: (i) a first portion 462 (i.e., a central surface) that is generally parallel to the rear wall 454; (ii) a second portion 464 (i.e., a first side surface) that connects the first portion 462 to the first side 456 and is angled to project energy toward the center of the room; and (iii) a third portion 466 (i.e., a second side surface) that connects the first portion 462 to the second side 458 and is angled to project energy toward the center of the room. The first portion is a vertical plane in the room and has a horizontal and vertical axis. The second and third portions are angled toward the center of the room along the horizontal axis.

[0094] In this example, the viewing volume 468A of the LF display system 450A is in the center of the room and is partially surrounded by three portions of the collecting surface 460. The collecting surfaces that at least partially surround the viewer (the "surrounding surfaces") increase the viewer's immersive experience.

[0095] For illustration, consider, for example, a collective surface having only a central surface. Referring to FIG. 2A, rays projected from either edge of the display surface will create an ideal holographic volume and an ideal viewing volume as described above. Now consider, for example, the case where the central surface includes two side surfaces angled toward the viewer. In this case, rays 256 and 257 will be projected at a larger angle from the normal of the central surface. Thus, the field of view of the viewing volume will be enlarged. Similarly, the holographic viewing volume will be closer to the display surface. Additionally, a holographic object projected at a certain distance from the display surface will be closer to its viewing volume because the second and third two parts are tilted closer to the viewing volume.

[0096] Simply put, a display surface with only a central surface has a planar field of view, a planar threshold separation between the (central) display surface and the viewing volume, and a planar proximity between the holographic object and the viewing volume. Adding one or more side surfaces angled toward the viewer increases the field of view relative to the planar field, decreases the separation between the display surface and the viewing volume relative to the planar separation, and increases the proximity between the display surface and the holographic object relative to the planar proximity. Angling the side surfaces further toward the viewer further increases the field of view, decreases the separation, and increases the proximity. In other words, the angled arrangement of the side surfaces increases the immersive experience of the viewer.

[0097] Additionally, as described below with respect to FIG. 6, deflection optics can be used to optimize the size and position of the viewing volume for LF viewing parameters (eg, dimensions and FOV).

[0098] Returning to Figure 4D, in a similar example, Figure 4D shows a top view of an LF display system 450B having a collective surface in a "slope" configuration. In this example, the LF display system 450B is located in a room having a front wall 452, a back wall 454, a first side wall (not shown), a second side wall (not shown), a ceiling 472, and a floor 474. The first side wall, second side wall, back wall 454, floor 474, and ceiling 472 are all orthogonal. The LF display system 450B includes LF display modules tiled to form a collective surface 460 that covers the front wall. The front wall 452, and therefore the collecting surface 460, includes three portions: (i) a first portion 462 (i.e., a central surface) that is generally parallel to the rear wall 454; (ii) a second portion 464 (i.e., a first side surface) that connects the first portion 462 to the ceiling 472 and is angled to project energy toward the center of the room; and (iii) a third portion 464 (i.e., a second side surface) that connects the first portion 462 to the floor 474 and is angled to project energy toward the center of the room. The first portion is a vertical plane in the room, having a horizontal and vertical axis. The second and third portions are angled toward the center of the room along the vertical axis.

[0099] In this example, the viewing volume 468B of the LF display system 450B is in the center of the room and is partially surrounded by three portions of the collective surface 460. Similar to the configuration shown in FIG. 4C, two side portions (e.g., second portion 464 and third portion 466) are angled to surround the viewer and form a surrounding surface. The surrounding surface expands the viewing FOV from any viewer's viewpoint within the holographic viewing volume 468B. Additionally, the surrounding surface allows the viewing volume 468B to be closer to the surface of the display so that projected objects appear closer. In other words, the angled arrangement of the side surfaces expands the field of view, reduces separation, and increases the proximity of the collective surface, thereby increasing the viewer's immersive experience. Additionally, as discussed below, deflection optics can be used to optimize the size and position of the viewing volume 468B.

[0100] The tilted configuration of the side portions of the collecting surface 460 allows the holographic content to be presented closer to the viewing volume 468B than if the third portion 466 were not tilted. For example, the lower extremities (such as legs) of a form in which a character is presented, with a tilted configuration of the LF display system, may appear closer and more realistic than if a LF display system with a flat front wall were used.

[0101] Additionally, the configuration of the LF display system and the environment in which it is located may allow the shape and location of the viewing volume and viewing sub-volumes to be known.

[0102] 4E, for example, illustrates a top view of an LF display system 450C having a collection surface 460 on a front wall 452 of a room. In this example, an LF display system 450D is located in a room having a front wall 452, a back wall 454, a first side wall 456, a second side wall 458, a ceiling (not shown), and a floor (not shown).

[0103] The LF display system 450C projects various light rays from the collecting surface 460. The light rays projected from the left side of the collecting surface 460 have a horizontal angular range 481, the light rays projected from the right side of the collecting surface have a horizontal angular range 482, and the light rays projected from the center of the collecting surface 460 have a horizontal angular range 483. Between these points, the projected light rays can take intermediate values ​​of the angular range, as described below with respect to FIG. 6. In this way, a viewing volume 468C is created by having a gradient deflection angle for the projected light rays across the display surface. Furthermore, this configuration avoids wasting display resolution when projecting light rays onto the side walls 456 and 458.

[0104] FIG. 4F illustrates a side view of an LF display system 450D having a collecting surface 460 on a front wall 452 of a room. In this example, the LF display system 450E is located in a room having a front wall 452, a back wall 454, a first side wall (not shown), a second side wall (not shown), a ceiling 472, and a floor 474. In this example, the floor is stepped such that each step is higher in a staircase as one moves from the front wall to the back wall. Here, each step of the floor contains a viewing subvolume (e.g., display subvolumes 470A and 470B). The stepped floor allows for non-overlapping viewing subvolumes. That is, each viewing subvolume has a line of sight from the viewing subvolume to the collecting surface 460 that does not pass through another viewing subvolume. In other words, this orientation creates a "stadium seating" effect where the vertical offset between the steps allows each step to "look over" the viewing subvolumes of the other steps. LF display systems that include non-overlapping viewing sub-volumes can provide a higher quality viewing experience than LF display systems with overlapping viewing volumes. For example, in the configuration shown in FIG. 4F, different holographic content can be projected to an audience in viewing sub-volumes 470A and 470B. Controlling the LF Display System

[0105] FIG. 5A is a block diagram of an LF display system 500, according to one or more embodiments. The LF display system 500 comprises an LF display assembly 510 and a controller 520. The LF display assembly 510 includes one or more LF display modules 512 that project a light field. The LF display modules 512 may include a source / sensor system 514 that includes an integrated energy source and / or energy sensor that projects and / or senses other types of energy. The controller 520 includes a data store 522, a network interface 524, and an LF processing engine 530. The controller 520 may also include a tracking module 526, and a viewer profiling module 528. In some embodiments, the LF display system 500 also includes a sensory feedback system 570 and a tracking system 580. The LF display systems described in the context of FIGS. 1-4 are embodiments of the LF display system 500. In other embodiments, the LF display system 500 includes additional or fewer modules than those described herein. Similarly, functionality may be distributed among modules and / or different entities in ways different than described herein. Applications of LF display system 500 are also discussed in more detail below with respect to Figures 6-10.

[0106] The LF display assembly 510 provides holographic content within a holographic object volume that is visible to a viewer located within the viewing volume. The LF display assembly 510 can provide the holographic content by executing display instructions received from the controller 520. The holographic content can include one or more holographic objects projected in front of a collecting surface, onto the LF display assembly 510, behind the collecting surface of the LF display assembly 510, or some combination thereof. Generation of display instructions using the controller 520 is described in more detail below.

[0107] The LF display assembly 510 provides holographic content using one or more LF display modules (e.g., any of the LF display module 110, the LF display system 200, and the LF display module 300) included in the LF display assembly 510. For convenience, the one or more LF display modules may be described herein as LF display modules 512. The LF display modules 512 may be tiled to form the LF display assembly 510. The LF display modules 512 may be structured as various seamless surface environments (e.g., single surface, multi-surface, venue wall, curved surface, etc.). That is, the tiled LF display modules form a collective surface. As described above, the LF display module 512 includes an energy device layer (e.g., energy device layer 220) and an energy waveguide layer (e.g., energy waveguide layer 240) that present the holographic content. The LF display module 512 may also include an energy relay layer (e.g., energy relay layer 230) that transfers energy between the energy device layer and the energy waveguide layer when presenting the holographic content.

[0108] The LF display module 512 may also include other integrated systems configured for energy projection and / or energy sensing, as described above. For example, the light field display module 512 may include any number of energy devices (e.g., energy device 340) configured to project and / or sense energy. For convenience, the integrated energy projection system and integrated energy sensing system of the LF display module 512 may be collectively described herein as a source / sensor system 514. The source / sensor system 514 is integrated within the LF display module 512 such that the source / sensor system 514 shares the same seamless energy surface as the LF display module 512. In other words, the collective surface of the LF display assembly 510 includes the functionality of both the LF display module 512 and the source / sensor module 514. That is, the LF assembly 510 including the LF display module 512 with the source / sensor system 514 can simultaneously project energy and / or sense energy while projecting a light field. For example, the LF display assembly 510 may include an LF display module 512 and a source / sensor system 514 configured as a dual energy plane or a bidirectional energy plane as described above.

[0109] In some embodiments, the LF display system 500 uses the sensory feedback system 570 to augment the generated holographic content with other sensory content (e.g., conditioned touch, sound, or smell, etc.). The sensory feedback system 570 can augment the projection of the holographic content by executing display instructions received from the controller 520. In general, the sensory feedback system 570 includes any number of sensory feedback devices (e.g., the sensory feedback system 442) external to the LF display assembly 510. Some exemplary sensory feedback devices may include conditioned sound projection and receiving devices, aroma projection devices, temperature regulation devices, force actuation devices, pressure sensors, transducers, etc. In some cases, the sensory feedback system 570 may have similar functionality as the light field display assembly 510, or vice versa. For example, both the sensory feedback system 570 and the light field display assembly 510 may be configured to generate a sound field. As another example, the sensory feedback system 570 may be configured to generate a tactile surface, while the light field display assembly 510 is not.

[0110] To illustrate, in one exemplary embodiment of the light field display system 500, the sensory feedback system 570 may include an acoustic projection device. The acoustic projection device is configured to generate one or more pressure waves that complement the holographic content when executing the display instructions received from the controller 520. The generated pressure waves may be, for example, audible (for sound), ultrasonic (for touch), or some combination thereof. Similarly, the sensory feedback system 570 may include an aroma projection device. The projection device may be configured to impart a scent to some or all of the target area when executing the display instructions received from the controller. The aroma device may be tied into an air circulation system (e.g., ducts, fans, vents, etc.) to regulate airflow within the target area. Additionally, the sensory feedback system 570 may include a temperature adjustment device. The temperature adjustment device is configured to increase or decrease the temperature of some or all of the target area when executing the display instructions received from the controller 520.

[0111] In some embodiments, the sensory feedback system 570 is configured to receive input from a viewer of the LF display system 500. In this case, the sensory feedback system 570 includes various sensory feedback devices for receiving input from the viewer. The sensory feedback devices can include devices such as acoustic receiving devices (e.g., microphones), pressure sensors, joysticks, motion detectors, transducers, etc. The sensory feedback system can transmit the detected input to the controller 520 to adjust the generation of the holographic content and / or sensory feedback.

[0112] To illustrate, in one exemplary embodiment of a light field display assembly, the sensory feedback system 570 includes a microphone. The microphone is configured to record sounds (e.g., gasps, screams, laughter, etc.) made by one or more viewers. The sensory feedback system 570 provides the recorded sounds to the controller 520 as viewer input. The controller 520 can use the viewer input to generate the holographic content. Similarly, the sensory feedback system 570 can include a pressure sensor. The pressure sensor is configured to measure a force applied to the pressure sensor by the viewer. The sensory feedback system 570 can provide the measured force to the controller 520 as viewer input.

[0113] In some embodiments, the LF display system 500 includes a tracking system 580. The tracking system 580 includes any number of tracking devices configured to determine the position, movement, and / or characteristics of a viewer within a target area. Generally, the tracking devices are external to the LF display assembly 510. Some exemplary tracking devices include a camera assembly ("camera"), one or more 2D cameras, a light field camera, a depth sensor, structured light, a LIDAR system, a card scanning system, or other tracking device capable of tracking a viewer within a target area.

[0114] The tracking system 580 may include one or more energy sources that illuminate some or all of the target area with light. In some cases, however, when presenting holographic content, the target area is illuminated with natural light and / or ambient light from the LF display assembly 510. The energy sources project light when executing instructions received from the controller 520. The light may be, for example, a structured light pattern, a pulse of light (e.g., an IR flash), or some combination thereof. The tracking system may project light within the visible band (approximately 380 nm to 750 nm), within the infrared (IR) band (approximately 750 nm to 1700 nm), within the ultraviolet band (10 nm to 380 nm), some other portion of the electromagnetic spectrum, or some combination thereof. Sources may include, for example, light emitting diodes (LEDs), micro LEDs, laser diodes, TOF depth sensors, tunable lasers, etc.

[0115] The tracking system 580, when executing instructions received from the controller 520, can adjust one or more emission parameters. An emission parameter is a parameter that affects how light is projected from a source of the tracking system 580. Emission parameters can include, for example, brightness, pulse rate (including continuous illumination), wavelength, pulse length, any other parameter that affects how light is projected from the source assembly, or any combination thereof. In one embodiment, the source projects pulses of light in a time-of-flight operation.

[0116] The camera of the tracking system 580 captures an image of the light (e.g., structured light pattern) reflected from the target area. The camera captures the image as it executes the tracking instructions received from the controller 520. As previously described, the light may be projected by the source of the tracking system 580. The camera may include one or more cameras. That is, the camera may be, for example, an array of photodiodes (1D or 2D), a CCD sensor, a CMOS sensor, some other device that detects some or all of the light projected by the tracking system 580, or some combination thereof. In one embodiment, the tracking system 580 may include a light field camera external to the LF display assembly 510. In other embodiments, the camera is included as part of an LF display module included in the LF display assembly 510. For example, as previously described, if the energy relay element of the light field module 512 is a bidirectional energy layer that interleaves both a light-emitting display and an image sensor with the energy device layer 220, the LF display assembly 510 may be configured to project a light field and simultaneously record image information from a viewing area in front of the display. In one embodiment, the images captured from the bidirectional energy surface form a light field camera. The camera provides the captured images to the controller 520.

[0117] The cameras of tracking system 580 may adjust one or more imaging parameters when executing tracking instructions received from controller 520. Imaging parameters are parameters that affect how the cameras capture images. Imaging parameters may include, for example, frame rate, aperture, gain, exposure length, frame timing, rolling shutter or global shutter capture mode, any other parameter that affects how the cameras capture images, or any combination thereof.

[0118] The controller 520 controls the LF display assembly 510 and any other components of the LF display system 500. The controller 520 comprises a data store 522, a network interface 524, a tracking module 526, a viewer profiling module 528, and a light field processing engine 530. In other embodiments, the controller 520 includes additional or fewer modules than those described herein. Similarly, functionality may be distributed among modules and / or among different entities in a manner different from that described herein. For example, the tracking module 526 may be part of the LF display assembly 510 or the tracking system 580.

[0119] The data store 522 is a memory that stores information for the LF display system 500. The stored information may include display instructions, tracking instructions, emission parameters, imaging parameters, a virtual model of the target area, tracking information, images captured by the camera, one or more viewer profiles, calibration data for the light field display assembly 510, configuration data for the LF display system 510 including the resolution and orientation of the LF module 512, desired viewing volume shape, 3D models, scenes and environments, content for graphics creation including materials and textures, other information that may be used by the LF display system 500, or some combination thereof. The data store 522 is a memory such as a read only memory (ROM), a dynamic random access memory (DRAM), a static random access memory (SRAM), or some combination thereof.

[0120] The network interface 524 allows the light field display system to communicate with other systems or environments over a network. In one example, the LF display system 500 receives holographic content from a remote light field display system via the network interface 524. In another example, the LF display system 500 uses the network interface 524 to transmit holographic content to a remote data store.

[0121] The tracking module 526 tracks viewers watching content presented by the LF display system 500. To do so, the tracking module 526 generates tracking instructions that control the operation of sources and / or cameras of the tracking system 580 and provides the tracking instructions to the tracking system 580. The tracking system 580 executes the tracking instructions and provides tracking inputs to the tracking module 526.

[0122] The tracking module 526 can determine the position of one or more viewers within the target area (e.g., sitting or standing). The determined position can be, for example, relative to some reference point (e.g., the display surface). In other embodiments, the determined position can be within a virtual model of the target area. The tracked position can be, for example, a tracked position of the viewer and / or a tracked position of a portion of the viewer (e.g., eye location, hand location, etc.). The tracking module 526 determines the position using one or more images captured from cameras of the tracking system 580. The cameras of the tracking system 580 can be distributed around the LF display system 500 and can capture images in stereo, allowing the tracking module 526 to passively track the viewer. In other embodiments, the tracking module 526 actively tracks the viewer. That is, the tracking system 580 illuminates a portion of the target area and images the target area, and the tracking module 526 determines the position using time-of-flight and / or structured light depth determination techniques. The tracking module 526 uses the determined positions to generate tracking information.

[0123] The tracking module 526 can also receive tracking information as input from a viewer of the LF display system 500. The tracking information can include body movements of the viewer corresponding to various input options provided by the LF display system 500. For example, the tracking module 526 can track the body movements of the viewer and assign any of the various movements as input to the LF processing engine 530. The tracking module 526 can provide the tracking information to the data store 522, the LF processing engine 530, the viewer profiling module 528, any other component of the LF display system 500, or some combination thereof.

[0124] Although not limited to the viewer's hands, the tracking system 580 can record the viewer's hand movements and send the recording to the tracking module 526. The tracking module 526 tracks the viewer's hand movements in the recording and sends the input to the LF processing engine 530. As described below, the viewer profiling module 528 determines that information in the image indicates that the viewer's hand movements are associated with a positive response. Thus, if a sufficient number of viewers are recognized to have a positive response, the LF processing engine 530 generates appropriate holographic content for that response. For example, the LF processing engine 530 may project confetti into the scene.

[0125] The LF display system 500 includes a viewer profiling module 528 configured to identify and profile viewers. The viewer profiling module 528 generates a profile of one or more viewers viewing holographic content displayed by the LF display system 500. The viewer profiling module 528 generates the viewer profile based in part on viewer input and monitored viewer behavior, actions, and reactions. The viewer profiling module 528 can access information obtained from the tracking system 580 (e.g., recorded images, videos, audio, etc.) and process the information to determine various information. In various examples, the viewer profiling module 528 can use any number of machine vision or machine hearing algorithms to determine viewer behavior, actions, and reactions. Monitored viewer behaviors can include, for example, smiles, cheers, applause, laughter, fear, screams, excitement levels, recoil, changes in other gestures or movements by the viewer, etc.

[0126] More generally, a viewer profile may include any information received and / or determined regarding a viewer viewing holographic content from the LF display system. For example, each viewer profile may record that viewer's actions or responses to content displayed by the LF display system 500. Some example information that may be included in a viewer profile is provided below.

[0127] In some embodiments, the viewer profile may describe the viewer's response to viewed characters, actors, scenes, etc. For example, the viewer profile may indicate that the viewer generally has a positive response to content that occurs in a particular scene (e.g., time period, location, combinations thereof, etc.).

[0128] In some embodiments, the viewer profile may indicate characteristics of the viewer. For example, the viewer is wearing a sweatshirt with a university logo. In this case, the viewer profile may indicate that the viewer is likely to prefer holographic content associated with the university that the sweatshirt is associated with. More broadly, viewer characteristics that may be indicated in the viewer profile may include, for example, age, gender, ethnicity, clothing, viewing location in a venue, etc.

[0129] In some embodiments, the viewer profile may indicate the viewer's preferences with respect to desirable features of a scene. For example, the viewer profile may indicate holographic object volumes in which holographic content should be displayed (e.g., on a wall) and holographic object volumes in which holographic content should not be displayed (e.g., above the viewer's head). The viewer profile may also indicate that the viewer would like to have a haptic interface presented near them or would like to avoid a haptic interface.

[0130] In another example, a viewer profile indicates a history of content viewed for a particular viewer. For example, the viewer profiling module 528 may determine that the viewer has previously viewed content on the system. Thus, the LF display system 500 may display different holographic content than the viewer did the last time he or she viewed content on the system.

[0131] In some embodiments, the data store 522 includes a viewer profile store that stores viewer profiles generated, updated, and / or maintained by the viewer profiling module 528. The viewer profiles may be updated in the data store at any time by the viewer profiling module 528. For example, in one embodiment, the viewer profile store receives and stores information about a particular viewer in a viewer profile for that viewer when that viewer views holographic content provided by the LF display system 500. In this example, the viewer profiling module 528 includes a facial recognition algorithm that can recognize the viewer and reliably identify the viewer when the viewer views the presented holographic content. To illustrate, when a viewer enters a target area of ​​the LF display system 500, the tracking system 580 captures an image of the viewer. The viewer profiling module 528 inputs the captured image and uses a facial recognition algorithm to identify the viewer's face. The identified face is associated with a viewer profile in the profile store, such that all input information captured about that viewer may be stored in that viewer's profile. The viewer profiling module may also utilize a card identification scanner, a voice identifier, a radio frequency identification (RFID) chip scanner, a bar code scanner, etc. to positively identify the viewer.

[0132] Because the viewer profiling module 528 can reliably identify the viewer, the viewer profiling module 528 can determine each visit of each viewer to the LF display system 500. The viewer profiling module 528 can then store the date and time of each visit in a viewer profile for each viewer. Similarly, the viewer profiling module 528 can store input from the viewer received from any combination of the sensory feedback system 570, the tracking system 580, and / or the LF display assembly 510 as the input occurs. The viewer profile system 528 can additionally receive further information about the viewer from other modules or components of the controller 520, which information can be stored with the viewer profile. Other components of the controller 520 can then also access the stored viewer profile to determine future content to be provided to that viewer.

[0133] The LF processing engine 530 generates 4D coordinates in a rasterized format ("rasterized data") that, when executed by the LF display assembly 510, cause the LF display assembly 510 to present holographic content. The LF processing engine 530 can access the rasterized data from the data store 522. Additionally, the LF processing engine 530 can construct the rasterized data from vectorized data sets. The vectorized data is described below. The LF processing engine 530 can also generate sensory instructions necessary to provide sensory content that augments the holographic object. As described above, the sensory instructions, when executed by the LF display system 500, can generate haptic surfaces, sound fields, and other forms of sensory energy supported by the LF display system 500. The LF data processing engine 530 can access the sensory instructions from the data store 522 or construct the sensory instructions to form the vectorized data sets. Collectively, the 4D coordinates and sensory data represent display instructions executable by the LF display system to generate holographic and sensory content.

[0134] The amount of rasterized data describing the flow of energy through the various energy sources in the LF display system 500 is incredibly large. While it is possible to display the rasterized data on the LF display system 500 when accessed from the data store 522, it is not possible to efficiently transmit (e.g., via the network interface 524), receive, and then display the rasterized data on the LF display system 500. Take, for example, rasterized data representing a short film for holographic projection by the LF display system 500. In this example, the LF display system 500 includes a display containing several gigapixels, and the rasterized data includes information for each pixel location on the display. The corresponding size of the rasterized data is enormous (e.g., many gigabytes per second of film display time) and unmanageable for efficient transfer over a commercial network via the network interface 524. The problem of efficient transfer may be amplified in applications involving live streaming of holographic content. If an interactive experience is desired using input from the sensory feedback system 570 or tracking module 526, additional problems with simply storing rasterized data in the data store 522 arise. To enable interactive experiences, the light field content generated by the LF processing engine 530 may be modified in real-time in response to sensory or tracking input. In other words, in some cases, the LF content cannot simply be read from the data store 522.

[0135] Thus, in some configurations, data representing holographic content for display by the LF display system 500 may be transferred to the LF processing engine 530 in a vectorized data format ("vectorized data"). The vectorized data may be orders of magnitude smaller than rasterized data. Furthermore, the vectorized data provides high image quality while having a data set size that allows for efficient sharing of the data. For example, the vectorized data may be a sparse data set derived from a denser data set. Thus, the vectorized data may have an adjustable balance between image quality and data transmission size based on how the sparse vectorized data is sampled from the denser rasterized data. The adjustable sampling to generate the vectorized data allows for optimization of image quality at a particular network speed. As a result, the vectorized data allows for efficient transmission of the holographic content over the network interface 524. The vectorized data may also allow for live streaming of the holographic content over commercial networks.

[0136] In summary, the LF processing engine 530 can generate holographic content derived from rasterized data accessed from the data store 522, vectorized data accessed from the data store 522, or vectorized data received via the network interface 524. In various configurations, the vectorized data can be encoded prior to data transmission and decoded after receipt by the LF controller 520. In some examples, the vectorized data is encoded for additional data security and performance improvements associated with data compression. For example, the vectorized data received by the network interface can be encoded, vectorized data received from a holographic streaming application. In some examples, the vectorized data can require a decoder, the LF processing engine 530, or both, to access the information content encoded in the vectorized data. The encoder and / or decoder systems may be available to customers or may be licensed to third-party vendors.

[0137] The vectorized data includes information for each of the sensory areas supported by the LF display system 500 in a manner that supports an interactive experience. For example, the vectorized data for an interactive holographic experience includes any vectorized characteristics that can provide accurate physics for each of the sensory areas supported by the LF display system 500. The vectorized characteristics can include any characteristics that can be synthetically programmed, captured, computationally evaluated, etc. The LF processing engine 530 can be configured to convert the vectorized characteristics of the vectorized data into rasterized data. The LF processing engine 530 can then project the holographic content converted from the vectorized data from the LF display assembly 510. In various configurations, the vectorized properties may include one or more red / green / blue / alpha channel (RGBA) + depth images, multi-view images with or without depth information at various resolutions that may include one high-resolution central image and other views at lower resolution, albedo and reflectance, surface normals, other optical effects, surface identity, geometric object coordinates, virtual camera coordinates, display surface location, lighting coordinates, surface contact stiffness, contact ductility, contact intensity, amplitude and coordinates of sound fields, environmental conditions, somatosensory energy vectors associated with mechanoreceptors of texture or temperature, sound, and coordinates of other sensory domain properties. Many other vectorized properties are possible.

[0138] The LF display system 500 can also generate interactive viewing experiences. That is, the holographic content can respond to input stimuli, including information about the viewer's location, gestures, interactions, interactions with the holographic content, or other information derived from the viewer profiling module 528 and / or tracking module 526. For example, in one embodiment, the LF processing system 500 uses real-time performance vectorized data received via the network interface 524 to create an interactive viewing experience. In another example, if a holographic object needs to immediately move in a particular direction in response to a viewer's interaction, the LF processing engine 530 can update the rendering of the scene so that the holographic object moves in that requested direction. This may require the LF processing engine 530 to use the vectorized data set to render a light field in real time based on a 3D graphical scene with proper object placement and movement, collision detection, occlusion, color, shading, lighting, etc., to respond correctly to the viewer's interaction. The LF processing engine 530 converts the vectorized data into rasterized data for presentation by the LF display assembly 510.

[0139] The rasterized data includes holographic content instructions and sensory instructions (display instructions) that represent the real-time performance. The LF display assembly 510 simultaneously projects the holographic and sensory content of the real-time performance by executing the display instructions. The LF display system 500 monitors viewer interactions (e.g., voice responses, touch, etc.) with the presented real-time performance content using a tracking module 526 and a viewer profiling module 528. In response to the viewer interactions, the LF processing engine creates an interactive experience by generating additional holographic and / or sensory content for presentation to the viewer.

[0140] To illustrate, consider one exemplary embodiment of an LF display system 500 that includes an LF processing engine 530 that generates a number of holographic objects representing balloons dropping from a ceiling. A viewer may move to touch the holographic objects representing the balloons. In response, a tracking system 580 tracks the movement of the viewer's hands relative to the holographic objects. The viewer's movements are recorded by the tracking system 580 and transmitted to the controller 520. The tracking module 526 continuously determines the movement of the viewer's hands and transmits the determined movement to the LF processing engine 530. The LF processing engine 530 determines the placement of the viewer's hands in the scene and adjusts the real-time rendering of the graphics to include any changes (such as position, color, or occlusion) required for the holographic objects. The LF processing engine 530 instructs the LF display assembly 510 (and / or the sensory feedback system 570) to generate a haptic surface using a volumetric haptic projection system (e.g., using an ultrasonic speaker). The generated haptic surface corresponds to at least a portion of the holographic object and occupies substantially the same space as some or all of the exterior surface of the holographic object. The LF processing engine 530 uses the tracking information to dynamically direct the LF display assembly 510 to move the location of the haptic surface along with the location of the rendered holographic object such that the viewer is given both the visual and haptic perception of touching the balloon. In simpler terms, as the viewer sees their hand touching the holographic balloon, the viewer simultaneously feels haptic feedback indicating that their hand is touching the holographic balloon and the balloon changes position or motion in response to the touch. In some examples, rather than presenting an interactive balloon in content accessed from the data store 522, the interactive balloon may be received as part of the holographic content received from a live streaming application via the network interface 524.

[0141] The holographic content in the holographic content track may be associated with any number of temporal, auditory, visual, etc. cues for displaying the holographic content. For example, a holographic content track may include holographic content that is displayed at a particular time in the content. In another example, a holographic content track may include holographic content that is presented when the sensory feedback system 570 records a particular audio cue. In another example, a holographic content track may include holographic content that is displayed when the tracking system 580 records a particular visual cue. Determining the auditory and visual cues is described in more detail below.

[0142] The holographic content track may also include spatial rendering information. That is, the holographic content track may indicate spatial locations for presenting the holographic content. For example, the holographic content tract may indicate that a particular holographic content is presented in some holographic viewing volumes and not in others. Similarly, the holographic content track may indicate that a holographic content is presented in some viewing volumes and not in others.

[0143] The LF processing engine 500 may also modify the holographic content to fit the venue or location in which it is being presented. For example, not all locations are the same size, have the same layout, or have the same technical configuration. Thus, the LF processing engine 530 can modify the holographic content so that it appears properly within a particular location. In one embodiment, the LF processing engine 530 can access a configuration file for the venue, which includes the location's layout, resolution, field of view, other technical specifications, etc. The LF processing engine 530 can render and present the holographic content based on the information contained in the configuration file.

[0144] The LF processing engine 530 can also create holographic content for display by the LF display system 500. Importantly, creating holographic content for display is distinct from accessing or receiving holographic content for display. That is, when creating content, the LF processing engine 530 generates entirely new content for display rather than accessing previously generated and / or received content. The LF processing engine 530 can create holographic content for display using information from the tracking system 580, the sensory feedback system 570, the viewer profiling module 528, the tracking module 528, or some combination thereof. In some examples, the LF processing engine 530 can access information from elements of the LF display system 500 (e.g., tracking information and / or viewer profile) and, accordingly, create holographic content based on that information and display the created holographic content using the LF display system 500. The created holographic content can be augmented with other sensory content (e.g., touch, sound, or smell) when displayed by the LF display system 500. Additionally, the LF display system 500 can store the generated holographic content so that it can be displayed in the future.

[0145] Additionally, the LF processing engine 530 may perform actions within the application in response to action requests received, for example, from an administrator, a viewer, or both. In some embodiments, the action requests may be verbal commands provided by a viewer within the target area. The verbal commands may be detected using an acoustic device. For example, a viewer may be able to use one or more verbal commands (e.g., pause or unpause) to pause and / or unpause content being presented by the LF display system 500. In some embodiments, the action requests may be body movements provided by a viewer within the target area. The body movements may be recorded by the tracking system 580. For example, a viewer may converse with a holographic adult performer to perform certain actions and provide various services. These may be content-based actions or requests performed by the holographic performer, or body-based actions or requests, for example, to dim the lights, change the scenery, order snacks or drinks, and the like.

[0146] The one or more sensory devices, in some embodiments, are used by the viewer in conjunction with an application executed by the LF processing engine 530. These sensory devices include personal massagers, insertion devices, protrusion devices, animatronic objects, robots, and any other objects used to promote human sexual pleasure. The one or more sensory devices can be operated independently of the LF display system 500, but in some embodiments, the one or more sensory devices work in concert with the holographic content presented by the LF processing engine 530. In one embodiment, the one or more sensory devices can receive operating instructions from the LF processing engine 530 to operate according to an application executed by the LF processing engine 530. In another embodiment, one or more LF display modules can be incorporated into or on one or more sensory devices to augment the appearance of the sensory simulation device, or the LP display system 500 can track the location of the sensory simulation device in the environment and have the one or more display modules augment the appearance of the sensory simulation device. Dynamic Content Generation for LF Display Systems

[0147] In some embodiments, the LF processing engine 530 incorporates artificial intelligence (AI) models to create holographic content for display by the LF display system 500. The AI ​​models may include supervised or unsupervised learning algorithms, including but not limited to regression models, neural networks, classifiers, or other AI algorithms. The AI ​​models may be used to determine viewer preferences based on viewer information recorded by the LF display system 500 (e.g., by the tracking system 580), which may include information about viewer behavior.

[0148] The AI ​​model can access information from the data store 522 to create the holographic content. For example, the AI ​​model can access viewer information from one or more viewer profiles in the data store 522 or can receive viewer information from various components of the LF display system 500. To illustrate, the AI ​​model can determine that a viewer enjoys viewing holographic content in which an actor or model in the content is wearing a bow tie. The AI ​​model can determine a preference based on a group of viewers' positive reactions or responses to previously viewed holographic content that includes an actor wearing a bow tie. That is, the AI ​​model can create holographic content that is personalized for a set of viewers according to the learned viewer preferences. So, for example, the AI ​​model can create bow ties for actors that appear in holographic content viewed by a group of viewers using the LF display system 500. The AI ​​model can also store each learned viewer preference in a viewer profile store in the data store 522. In some examples, the AI ​​model can create holographic content for an individual viewer rather than a group of viewers.

[0149] One example of an AI model that may be used to identify viewer characteristics, identify responses, and / or generate holographic content based on the identified information is a convolutional neural network model with layers of nodes where the value of a node in a current layer is a transformation of the value at a node in a previous layer. The transformations in the model are determined through a set of weights and parameters that connect the current layer and the previous layer. For example, the AI ​​model may include five layers of nodes, namely layers A, B, C, D, and E. The transformation from layer A to layer B is given by function W1, the transformation from layer B to layer C is given by W2, the transformation from layer C to layer D is given by W3, and the transformation from layer D to layer E is given by W4. In some examples, the transformations may also be determined through a set of weights and parameters used to transform between previous layers in the model. For example, the transformation W4 from layer D to layer E may be based on the parameters used to perform the transformation W1 from layer A to layer B.

[0150] The input to the model may be an image captured by tracking system 580, encoded on convolutional layer A, and the output of the model is the decoded holographic content from output layer E. Alternatively or additionally, the output may be viewer features determined in the image. In this example, the AI ​​model identifies latent information in the image that represents viewer features in identification layer C. The AI ​​model reduces the dimensionality of convolutional layer A to the dimensionality of identification layer C to identify any features, actions, responses, etc. in the image. In some examples, the AI ​​model then increases the dimensionality of identification layer C to generate the holographic content.

[0151] The image from the tracking system 580 is encoded into a convolutional layer A. The image input into the convolutional layer A may be associated with various features and / or reaction information, etc., in the identification layer C. The associated information between these elements may be retrieved by applying a set of transformations between the corresponding layers. That is, the convolutional layer A of the AI ​​model represents the encoded image, and the identification layer C of the model represents the smiling viewer. The smiling viewer in a given image may be identified by applying the transformations W1 and W2 to the pixel values ​​of the image in the space of the convolutional layer A. The weights and parameters of the transformations may indicate the relationship between the information contained in the image and the identification of the smiling viewer. For example, the weights and parameters may be quantizations of the shape, color, size, etc., contained in the information representing the smiling viewer in the image. The weights and parameters may be based on historical data (e.g., previously tracked viewers).

[0152] Smiling viewers in the image are identified in identification layer C. Identification layer C represents smiling viewers identified based on latent information about smiling viewers in the image.

[0153] The identified smiling viewers in the image can be used to generate holographic content. To generate the holographic content, the AI ​​model starts with the identification layer C and applies transformations W2 and W3 to a given identified smiling viewer value in the identification layer C. The transformations result in a set of nodes in the output layer E. The weights and parameters of the transformations can indicate a relationship between the identified smiling viewer and a particular holographic content and / or preference. The holographic content may be output directly from the nodes in the output layer E, or the content generation system may decode the nodes in the output layer E into holographic content. For example, if the output is a set of identified features, the LF processing engine can use the features to generate the holographic content.

[0154] Additionally, the AI ​​model may include layers known as intermediate layers. An intermediate layer is a layer that does not correspond to an image and identifies features / responses, etc., or generates holographic content. For example, in the given example, layer B is an intermediate layer between convolutional layer A and identification layer C. Layer D is an intermediate layer between identification layer C and output layer E. Hidden layers are latent representations of various aspects of identification that are not observed in the data, but may govern the relationship between elements of the image when identifying features and generating holographic content. For example, a node in the hidden layer may have a strong connection (e.g., large weight value) with input values ​​and identification values ​​that share a commonality of "smile of a laughing person". As another example, another node in the hidden layer may have a strong connection with input values ​​and identification values ​​that share a commonality of "scream of a scared person". Of course, there may be any number of linkages in a neural network. Additionally, each intermediate layer is a combination of functions, such as, for example, residual blocks, convolutional layers, pooling operations, skip connections, concatenation, etc. Any number of hidden layers B may serve to reduce the convolutional layer down to a discriminative layer, and any number of hidden layers D may serve to augment the discriminative layer up to an output layer.

[0155] In one embodiment, the AI ​​model includes a deterministic method trained with reinforcement learning (thereby creating a reinforcement learning model). The model is trained to improve the quality of the performance using measurements from the tracking system 580 as inputs and modifications to the created holographic content as outputs.

[0156] Reinforcement learning is a machine learning system in which a machine learns "what to do" (how to map situations to actions) to maximize a numerical reward signal. The learner (e.g., LF processing engine 530) is not told what action to take (e.g., generating a given holographic content), but instead discovers, by trying actions, which action will bring the greatest reward (e.g., increasing the quality of the holographic content by making more people cheer). In some cases, an action may affect not only the immediate reward, but also the next situation and, through it, all subsequent rewards. These two features (trial-and-error exploration and delayed reward) are the two distinguishing features of reinforcement learning.

[0157] Reinforcement learning is defined by characterizing the learning problem, not by characterizing the learning method. Essentially, a reinforcement learning system captures the key aspects of the problem facing a learning agent that interacts with an environment to achieve a goal. That is, in the example of generating a song for a performer, a reinforcement learning system captures information about the audience in the venue (e.g., age, temperament, etc.). Such an agent senses the state of the environment and performs actions that affect the state to achieve one or more goals (e.g., create a pop song that the audience will cheer). In its most basic form, a reinforcement learning formulation includes three aspects for the learner: senses, actions, and goals. Continuing with the song example, the LF processing engine 530 senses the state of the environment with sensors in the tracking system 580, displays holographic content to the audience in the environment, and achieves a goal that is a measure of the audience's acceptance of the song.

[0158] One of the challenges that arise in reinforcement learning is the trade-off between exploration and exploitation. To increase rewards in a system, a reinforcement learning agent will favor actions that it has tried in the past and found to be effective at producing rewards. However, to discover actions that produce rewards, the learning agent will choose actions that it has not previously chosen. The agent "exploits" the information it already knows to obtain rewards, but "explores" information to select better actions in the future. The learning agent tries various actions, gradually favoring those that it thinks are best while still trying new actions. In probabilistic tasks, each action is typically tried many times to obtain a reliable estimate for the expected reward. For example, if the LF processing engine creates holographic content that it knows will cause viewers to laugh at the performance after a long time has passed, the LF processing engine can modify the holographic content so that the time it takes for viewers to laugh decreases.

[0159] Moreover, reinforcement learning considers the entire problem of a goal-directed agent interacting with an uncertain environment. A reinforcement learning agent has a clear goal, can sense aspects of the environment, and can select actions to receive high rewards (i.e., a roaring crowd). Furthermore, the agent typically operates despite significant uncertainty about the environment it faces. When reinforcement learning involves planning, the system addresses the interaction of planning with real-time action selection, as well as the problem of how to acquire and improve environmental factors. For reinforcement learning to make progress, important sub-problems must be studied in isolation, and sub-problems play distinct roles in a complete, interactive, goal-seeking agent.

[0160] A reinforcement learning problem is a framing of a machine learning problem in which interactions are processed and actions are taken to achieve a goal. The learner and decision maker are called the agent (e.g., LF processing engine 530). What the agent interacts with, including everything external to the agent, is called the environment (e.g., the audience in the field). These two interact continuously, with the agent choosing actions (e.g., creating holographic content) and the environment responding to those actions by presenting the agent with new situations. The environment also gives rise to a reward, a special numerical value that the agent tries to maximize over time. In one context, the reward serves to maximize the audience's positive response to the holographic content. A complete specification of the environment defines a task, which is one instance of a reinforcement learning problem.

[0161] To provide more context, the agent (e.g., content generation system 350) and the environment interact at each of a sequence of discrete time steps, i.e., t=0, 1, 2, 3, etc. At each time step t, the agent receives some representation of a state st of the environment (e.g., measurements from tracking system 580). The state st is in S, where S is a set of possible states. Based on the state st and the time step t, the agent selects an action (e.g., have the performer do the splits). The action at is in A(st), where A(st) is a set of possible actions. After one time state, in part as a result of the agent's action, the agent receives a numerical reward rt+1. The state rt+1 is in R, where R is a set of possible rewards. Once the agent receives the reward, the agent selects a new state st+1.

[0162] At each time step, the agent implements a mapping from states to the probability of choosing each possible action. This mapping is called the agent's policy and is denoted by πt, where πt(s,a) is the probability that at=a if st=s. Reinforcement learning methods can dictate how the agent changes its policy as a result of the states and rewards resulting from the agent's actions. The agent's goal is to maximize the total amount of reward the agent receives over time.

[0163] This reinforcement learning framework is flexible and can be applied in many different ways to many different problems (e.g., generating holographic content).The framework proposes that any problem (or objective) of learning goal-directed behavior, whatever the details of the senses, memories, and controllers, can be boiled down to three signals passing between the agent and its environment: one signal representing the choice made by the agent (action), one signal representing the rationale for the choice made (state), and one signal defining the agent's goal (reward).

[0164] Of course, the AI ​​model may include any number of machine learning algorithms. Some other AI models that may be used are linear and / or logistic regression, classification and regression trees, k-means clustering, vector quantization, etc. In either case, generally, the LF processing engine 530 takes input from the tracking module 526 and / or the viewer profiling module 528, and the machine learning model creates the holographic content accordingly. Similarly, the AI ​​model may direct the rendering of the holographic content.

[0165] The LF processing engine 530 can create holographic content based on a movie. For example, a movie playing in a movie theater may be associated with a set of metadata that describes the characteristics of the movie. The metadata may include, for example, setting, genre, actors, actresses, theme, title, runtime, rating, etc. The LF processing engine 530 can access any of the metadata describing the movie and, in response, generate holographic content for presentation within the venue. For example, a movie titled "The Last Merman" is about to be screened in a venue augmented with the LF display system 500. The LF processing engine 530 accesses the metadata of the movie to create holographic content for the walls of the venue. Here, the metadata includes that the setting is underwater and the genre is romance. The LF processing engine 530 inputs the metadata into an AI model and, in response, receives holographic content for display on the walls of the venue. In this example, the LF processing engine 530 creates a seaside sunset for display on the walls of the venue.

[0166] In one example, the LF processing engine 530 can convert traditional two-dimensional (2D) content into holographic content for display by the LF display system. For example, the LF processing engine 530 can input traditional movies or other content into an AI model, which converts any portion of the traditional movie into holographic content. In one example, the AI ​​model can convert traditional movies into holographic content by using machine learning algorithms trained by converting the two-dimensional data into holographic data. In various situations, the training data may have been previously generated, created, or a combination of the two. The LF display system 500 can then display holographic content related to the movie rather than a traditional two-dimensional version of the movie. For example, the holographic content can be an adult scene using the setting of a scene from a movie.

[0167] The above examples of creating content are not limiting. In the broadest sense, the LF processing engine 530 creates holographic content for presentation to a viewer of the LF display system 500. The holographic content may be created based on any of the information contained in the LF display system 500. A Content Delivery Network for Holographic Adult Simulation

[0168] 5B is a block diagram of a light field environment incorporating a light field display system for adult simulation, according to one or more embodiments. The content delivery system for adult simulation 560 illustrated by FIG. 5B includes one or more client LF display systems 500A and 500B, a network 575, one or more third party systems 585, and an online system 590. In alternative configurations, different and / or additional components may be included in the LF content delivery system for adult simulation 560. For example, the online system 590 may include a social networking system, a content sharing network, or another system that provides content to viewers.

[0169] The client LF display systems 500A and 500B can display holographic content, receive input, and transmit and / or receive data over the network 575. The client LF display systems 500A and 500B are embodiments of the LF display system 500. As such, each client LF display system includes a controller configured to receive holographic content over the network 575 and an LF display assembly (e.g., LF display assembly 510). The LF display assembly may include one or more LF display modules (e.g., LF display module 512) to present the holographic content to a viewer located at a viewing volume as an adult simulation within a holographic object volume. The client LF display systems 500A and 500B are configured to communicate over the network 575. In some embodiments, the client LF display systems 500A and 500B execute an application that allows a viewer of the client LF display system to interact with the online system 590. For example, the client LF display system 500A executes a browser application to enable interaction between the client LF display system 500A and the online system 590 over the network 575. In other embodiments, the client LF display system 500A interacts with the online system 590 through an application programming interface (API) that runs on the client LF display system 500A's native operating system, such as IOS® or ANDROID™. For efficient transfer speeds, data of the LF display systems 500A and 500B may be transferred over the network 575 as vectorized data.The LF processing engine (e.g., LF processing engine 530) of each client LF display system may decode the vectorized data and convert it to a rasterized format for display on a corresponding LF display assembly (e.g., LF display assembly 510).

[0170] The client LF display systems 500A and 500B are configured to communicate over a network 575, which may include any combination of local area and / or wide area networks, using both wired and / or wireless communication systems. In some embodiments, the network 575 uses standard communication technologies and / or protocols. For example, the network 575 includes communication links using technologies such as Ethernet, 802.11, Worldwide Interoperability for Microwave Access (WiMAX), 3G, 4G, Code Division Multiple Access (CDMA), Digital Subscriber Line (DSL), etc. Examples of networking protocols used to communicate over the network 575 include Multiprotocol Label Switching (MPLS), Transmission Control Protocol / Internet Protocol (TCP / IP), Hypertext Transport Protocol (HTTP), Simple Mail Transfer Protocol (SMTP), and File Transfer Protocol (FTP). Data exchanged over the network 575 may be represented using any suitable format, such as Hypertext Markup Language (HTML) or Extensible Markup Language (XML). In some embodiments, all or some of the communication links of the network 575 may be encrypted using any suitable technology or technologies.

[0171] One or more third party systems 585 may be coupled to the network 575 for communicating with the online system 590. In some embodiments, the third party systems 585 are adult content systems, e.g., content providers, that communicate holographic content to be distributed to the client LF display systems 500A and 500B over the network 575. In some embodiments, the third party systems 585 may also communicate the holographic content to the online system 590, which may then distribute the holographic content to the client LF display systems 500A and 500B. Each third party system 585 has a content store 582 that may store holographic content items that may be distributed for presentation to the client LF display systems 500A and 500B. The third party systems 585 may provide holographic content to one or more of the client LF display systems 500A and 500B in exchange for payment. In one embodiment, the holographic content items may be associated with a cost that may be collected by the online system 590 when distributed to the client LF display systems 500A and 500B.

[0172] An online system 590 may mediate the distribution of holographic content by providing the holographic content to client LF display systems 500A and 500B in exchange for payment. The holographic content is provided over a network 575. The online system 590 includes a viewer profile store 592, a content store 594, a transaction module 596, and a content delivery module 598. In other embodiments, the online system 590 may include additional, fewer, or different components for various applications. Conventional components such as network interfaces, security functions, load balancers, failover servers, administration and network operation consoles, etc. are not shown so as not to obscure the details of the system architecture.

[0173] Viewers of the online system 590 may be associated with viewer profiles stored in the viewer profile store 592. The viewer profiles may include declarative information about the viewer explicitly shared by the viewer and may also include profile information inferred by the online system 590. In some embodiments, the viewer profiles include multiple data fields, each describing one or more attributes of a corresponding online system viewer. Examples of information stored in a viewer profile include biographical, demographic, and other types of descriptive information (job history, education, gender, hobbies or preferences, location, etc.). The viewer profile may also store other information provided by the viewer, such as images or videos. In certain embodiments, an image of a viewer may be tagged with information identifying the online system viewer displayed in the image, and the information identifying the image with which the viewer was tagged is stored in the viewer's viewer profile. The viewer profiles in the viewer profile store 592 may also maintain references to corresponding viewer actions performed on content items in the content store 594, including the viewer's monitored responses or viewer characteristics captured in a tracking system (e.g., tracking system 580) and determined by a tracking module (e.g., tracking module 526). The viewer's monitored responses may include the viewer's location in the viewing volume, the viewer's movements, the viewer's gestures, the viewer's facial expressions, and the viewer's gaze. The LF display assembly may update the presentation of the holographic content in response to the viewer's monitored responses. The viewer characteristics may include the viewer's demographic information, work history, education history, gender, income, money spent on purchases, hobbies, location, age, viewing history, time spent on items, categories of items previously viewed, and purchase history. The LF display assembly may update the display of the holographic content in response to the viewer characteristics. In some embodiments, the viewer profile store 592 may store viewer characteristics and viewer information inferred by an online system.In some embodiments, a viewer profile may store information provided by one or more client LF display systems, which may include information provided and / or information recorded or inferred from a viewer profiling module (e.g., viewer profiling module 528).

[0174] While viewer profiles in the viewer profile store 592 are often associated with individuals, allowing individuals to interact with one another via the online system 590, viewer profiles may also be stored for entities, such as businesses or organizations. This allows entities to establish a presence on the online system 590 to connect and exchange content with viewers of other online systems. An entity may use a brand page associated with the entity's viewer profile to post information about itself, its products, or provide other information to viewers of the online system 590. A viewer profile associated with a brand page may contain information about the entity itself, providing viewers with background or information data about the entity. In one embodiment, other viewers of the online system 590 may interact with the brand page (e.g., connect to the brand page to receive information posted to the brand page or receive information from the brand page). A viewer profile in the viewer profile store 592 may maintain references to interactions performed by a corresponding viewer. As described above, any information stored in a viewer profile (e.g., viewer profiling module 528) may be used as input with machine learning or AI models to create holographic content for display to viewers.

[0175] The content store 594 stores holographic content, such as holographic content delivered to viewers of one or more of the client LF display systems 500A and 500B. Examples of holographic content other than holographic adult content can range from advertisements (e.g., advertising upcoming sales, promoting brands, etc.), announcements (e.g., political speeches, pep talks, etc.), public service alerts (e.g., tornado alerts, kidnapping alerts, etc.), news information (e.g., news headlines, sports scores, etc.), weather information (e.g., local weather forecasts, air quality index, etc.), venue information (e.g., box office hours, schedule of upcoming shows, etc.), traffic and traffic conditions (e.g., traffic reports, road closures, etc.), business entities information (e.g., office directories, business hours, etc.), performances (e.g., concerts, plays, etc.), artistic content (e.g., sculptures, pottery, etc.), other holographic content, or any combination thereof. In some embodiments, viewers of the online system may create holographic content that is stored by the content store 594. In other embodiments, the holographic content is received from a third party system 585 separate from the online system 590. An object in the content store 594 may represent a single piece of content, or an "item" of content.

[0176] The transaction module 596 provides holographic content to one or more of the client LF display systems 500A and 500B in exchange for payment. In one embodiment, the transaction module 596 manages transactions in which holographic content stored in the content store 594 is distributed to the client LF display systems 500A and 500B over the network 575. In one embodiment, the client LF display systems 500A and / or 500B, or networked entity owners of the client LF display systems 500A and 500B, may provide payment for a particular holographic content item, and the transaction may be managed by the transaction module 596. Alternatively, a third party system 585 may provide content from the content store 582 to the LF display systems 500A and / or 500B in exchange for a transaction fee provided to the transaction module 596. In other embodiments, the online system 590 may distribute content directly to the client LF display systems 500A and 500B, with or without the transaction module 596 charging the account of a particular entity. In some embodiments, the client LF display systems 500A and 500B are associated with one or more viewer profiles, and corresponding viewer accounts are charged the cost of presentation of the holographic content items by the transaction module 596. In some embodiments, the holographic content items may be purchased and used indefinitely or may be rented for a period of time. Rewards collected in whole or in part by the transaction module 596 may then be provided to the provider of the holographic content item. For example, a third party system 585 that provided an adult holographic content item from the content store 582 may receive a portion of the rewards collected from the client LF display systems 500A and 500B for the purchase of the adult holographic content item.

[0177] The content delivery module 598 provides the holographic content items to the client LF display systems 500A and 500B. The content delivery module 598 may receive requests from the transaction module 596 with holographic content items to be presented to the client LF display systems 500A and / or 500B. The content delivery module 598 retrieves the holographic content items from the content store 594 and provides the holographic content items to the client LF display systems 500A and / or 500B for display to a viewer.

[0178] In some embodiments, the client LF display systems 500A and 500B may record an instance of the presentation of the holographic content depending in part on whether an input is received. In an embodiment, the client LF display systems 500A and 500B may be configured to receive an input in response to the presentation of the holographic content. In some embodiments, the client LF display systems 500A and 500B may confirm an instance of the presentation of the holographic content if the viewer provides a response to a prompt provided during the presentation of the holographic content. For example, the client LF display system 500A receives a voice input from the viewer (e.g., after a prompt is given) that is used by the client LF display system 500A to confirm the presentation of the holographic content. The client LF display systems 500A and 500B may confirm an instance of the presentation of the holographic content using a combination of the received input and other metrics (e.g., information obtained by the tracking system 580). In other embodiments, the client LF display systems 500A and 500B may be configured to update the presentation of the holographic content in response to the received input.

[0179] In some configurations, the client LF display systems 500A and 500B in the adult content delivery system 560 may have different hardware configurations. The holographic content may be presented based on the hardware configurations of the client LF display systems 500A and 500B. The hardware configurations may include the resolution, the number of projected rays per degree, the field of view, the deflection angle on the display surface, and the dimensions of the display surface. Each hardware configuration may generate or utilize sensory data in a different data format. As previously discussed, the holographic content, including all sensory data (e.g., holographic, audio, and haptic data), may be transferred to the client LF display systems 500A and 500B as an encoded and vectorized format. As such, the LF processing engine (e.g., LF processing engine 530) of each client LF display system may decode the encoded data of the LF display system on which it is presented, taking into account the corresponding hardware configuration of the client LF display system 500A or 500B. For example, a first client LF display system 500A may have a first hardware configuration and a second client LF display system 500B may have a second hardware configuration. The first client LF display system 500A may receive the same holographic content as the second client LF display system. Despite the differences in the first and second hardware configurations, the LF processing engines of each LF display system 500A and 500B must present the holographic content, possibly at different resolutions, different fields of view, etc. Lightfield Display System for Adult Entertainment

[0180] 6 is a perspective view of a portion of an LF display system 500 tiled to form a multi-sided seamless surface in an adult entertainment venue 600, according to one or more embodiments. The LF display system 500 includes a plurality of LF display modules 610 tiled to form an array of LF display modules 610. The array can, for example, cover some or all of the surfaces of a room (e.g., one or more walls, a floor, and / or a ceiling). In this example, a viewer 620 is viewing holographic content in the form of a holographic performer 630. In this example, instead of watching porn on a computer screen or through a virtual reality (VR) headset, the viewer 620 is standing in a room with a holographic performer 630 being displayed by an array of LF display modules 610.

[0181] As mentioned above, the LF display system 500 may customize the viewer's experience using artificial intelligence (AI) and machine learning (ML) models that use tracking information from the tracking system 580, which records each viewer's movements as they interact with the holographic content within the adult entertainment venue 600. This includes viewer behavior (body language, facial expressions, tone of voice, etc.) that is tracked via various sensors. In general, the information about the viewer obtained by the tracking system includes the viewer's response to the holographic content and the characteristics of the viewer viewing the holographic content. The viewer's response may include the viewer's location, the viewer's movements, the viewer's gestures, or the viewer's facial expressions. The viewer's characteristics include the viewer's age, the viewer's gender, the viewer's preferences, etc. In another embodiment, the image sensing elements of the tracking system 580 may be integrated into the display surface of the LF display module 610 via a bidirectional energy element that emits and absorbs energy, although as mentioned above, the image sensing elements may be dedicated sensors (e.g., cameras and / or microphones) separate from the display surface. In such embodiments, image data can potentially be captured from more angles compared to several 2D cameras placed throughout the environment. In some embodiments, light field image data is recorded by the LF display module. The images or light field data captured by the display surface of the LF display module 610 can potentially be from all angles, unobstructed by objects and other viewers within the adult entertainment environment. Thus, the result is a customized AI (e.g., holographic performer 630) that engages the viewer based on behaviors observed within the adult entertainment venue 600.Thus, unlike a virtual reality (VR) environment where the viewer is limited to viewing a virtual scene displayed through a headset, the LF display system 500 can track and respond to much smaller cues and movements made by the viewer 620, such as body language and tone of voice, through a more immersive sensor system using real objects, such as holographic performers. Additionally, the viewer 620 is not distracted by the weight or discomfort associated with specialized glasses, spectacles, or head-mounted accessories that are common in VR systems.

[0182] Thus, the LF processing engine 530, in one embodiment, generates the holographic performer 630, and the tracking system 580 captures image data for interactions between the viewer 620 and the holographic performer 630. These interactions may be overt interactions, such as a conversation between the two parties, or they may be smaller interactions, such as the viewer's body language responding to a movement or comment from the holographic performer 630. The LF processing engine 530 also generates responses for the holographic performer 630 to execute in response to the interaction using AI and / or ML models.

[0183] In another embodiment, the holographic performer 630 may be a holographic representation of another person, such as a significant other viewer 620 who is participating in the couple's session from a remote location. For example, the holographic performer 630 in FIG. 6 may be a live holographic representation of a second viewer who is located remotely from the adult entertainment venue 600 where the viewer 620 is located. In this embodiment, the controller 520 receives image data of the second viewer captured by one or more image capture elements of the system at the location where the second viewer is located. The LF processing engine 530 thus obtains this image data and generates a live holographic representation of the second viewer within the adult entertainment venue 600 for presentation to the viewer 602. In this example, a live holographic representation of the viewer 620 may be generated and provided for simultaneous presentation to the second viewer at the location of the second viewer. In this embodiment, the session does not necessarily have to be pornographic, rather, the couple may play games together or sit down and eat a meal together from different physical locations. Thus, the viewer 620 and the second viewer may be physically located hundreds of miles away from each other, but can converse, have dinner together, etc. as if they were in the same room. Alternatively, the scene depicted in Fig. 6 can further be used in the context of speed dating or virtual dating. While Fig. 6 shows a venue 600 in which multiple surfaces of the room (walls, ceiling, floor) are covered with LF display modules 610, it is possible to have implementations in which fewer surfaces or only portions of the surfaces are covered with LF display modules 610.

[0184] The LF display system of the entertainment venue 600 may include a viewer profiling module 528, as described above. In summary, as described above, the viewer profiling system is configured to identify a viewer's response to the holographic content, or a characteristic of a viewer viewing the holographic content, and include the identified response or characteristic in a viewer profile. The characteristic may include any of the viewer's location, viewer's movement, viewer's gestures, viewer's preferences, the user's facial expression, the user's gender, the user's age, and the user's clothing. In one embodiment, the information about the viewer in the viewer profile is used as an input to an AI model, and the holographic content is generated in part based on this AI model. As an example, in the entertainment venue 600, once the viewer is identified, the holographic performer 530 may speak, perform physical body movements, or act in a manner that maximizes the viewer's 520 pleasure.

[0185] The LF display system in the entertainment venue (e.g., entertainment venue 600) may further comprise a sensory feedback system comprising at least one sensory feedback device configured to provide sensory feedback when a second energy as holographic content is presented. For example, the processing engine may be configured to augment the generated holographic content with sensory content including tactile stimuli, acoustic stimuli, temperature stimuli, olfactory stimuli, pressure stimuli, force stimuli, or any combination thereof. Using the example previously described, the LF display surface may be a dual energy surface that simultaneously projects holographic content (visible electromagnetic energy) and mechanical energy in the form of sound waves. In one embodiment, the sound waves are generated from a transparent ultrasonic transducer that is attached to the display surface and can be driven such that a volumetric tactile surface is created. The resulting tactile surface may coincide with one or more holographic objects or be projected near a holographic object such as a holographic performer. Projection in two sensory regions may result in a more immersive experience for the viewer, especially if the volumetric tactile surface is altered in response to the viewer's tracked movements or monitored responses to the holographic content. The viewer's tracked movements or monitored responses may be inputs to the AI ​​model. Here, the volumetric haptic surface is projected based in part on the AI ​​model to maximize the appeal of the holographic performer 630 to the viewer 620. The haptic surface may be modified by the LF processing engine 530 to include varying the resistance of the generated volumetric haptic surface in response to a user's touch, selecting a texture for the generated volumetric haptic surface, or adjusting the haptic intensity of the generated haptic surface based on the value of a parameter received at the controller 520. As an example, the holographic performer 630 may bring a body part closer to the viewer 620, generating a haptic surface to simulate a corresponding haptic sensation from the performer, perhaps aligned with information stored in the viewer profiling module 528.As a further example, the holographic performer 630 may move parts of its body and the volumetric haptic surface may be adjusted to follow this rapid movement or apply variations in this movement (e.g., moving faster than the holographic content) in a manner that excites the viewer 620 (e.g., by providing a vibration sensation). The tracked responses of the viewer (i.e., body movements, facial expressions), as well as information in the viewer profile, may be used by AI models to adjust the holographic content and accompanying sensory stimuli to maximize the viewer's pleasure.

[0186] FIG. 7A is a first diagram of a venue 750, an embodiment of an LF display system 500 presenting holographic content to an audience 620, including a sensation simulation device 700 operating in concert with the holographic content, according to one or more embodiments. FIG. 7A further illustrates an audience 620 in the venue 750 with a sensation simulation device 700 that may be used by the audience 620 in conjunction with the holographic content (e.g., the faster the holographic performer moves, the stronger the stimulation provided by the sensation simulation device 700, etc.). In one embodiment, the sensation simulation device 700 may be a personal massager, a doll, an insertion device, a protrusion device, an animatronic object, a robotic doll, or any other object that may be used to promote human sexual pleasure. The sensation simulation device 700 may operate independently of the LF display system 500, although in some embodiments, the sensation simulation device 700 may also operate in concert with the holographic content presented by the LF processing engine 530. In one embodiment, the sensory simulation device 700 can receive operating instructions from the LF processing engine 530 to operate according to an application executed by the LF processing engine 530. In another embodiment, one or more LF display modules can be incorporated into or on the sensory simulation device 700 to enhance the appearance of the sensory device. In another embodiment, the LF display system 500 can have holographic content presented on the sensory simulation device 700 to enhance or even hide its appearance, as shown in FIG. 7B.

[0187] FIG. 7B illustrates a venue 750 with the LF display system described above with respect to FIG. 7A, in accordance with one or more embodiments, where the sensory simulation device 700 is augmented with holographic content. In this embodiment, the holographic content augmenting the sensory simulation device 700 is the holographic performer 630 discussed above with respect to FIG. 6, which in one embodiment hides the sensory simulation device 700 and creates the illusion that the holographic performer 630, rather than the sensory simulation device 700, is providing the physical stimulation to the audience 620. The LF display system 500 knows the location of the sensory simulation device 700. In one embodiment, the tracking system 580 identifies the location of the sensory simulation device 700 within the venue 600 (e.g., the location coordinates of the device 700) and provides the location of the device 700 to the LF processing engine 530. In some embodiments, the LF processing engine 530 uses the tracking module to identify the location of the user within the environment. The viewer can issue instructions to guide the holographic performer 630 to move its holographic body, including having the holographic performer move a body location, move a body position, or achieve a specific repetitive body movement. The instructions can include either instructions recorded by the sensory feedback system 570 (e.g., verbal instructions), or instructions including recognized body movements, gestures, body positions, etc. recorded by the tracking system 580 and interpreted by the tracking module 526. In some embodiments, based on the location of the viewer 620, the location of the device 700, or instructions from the viewer to move the holographic performer's body, or any combination of these, the LF processing engine 530 generates rendering instructions for the holographic performer 630 to be presented in a manner that can give pleasure to the viewer 620. The LF processing engine 530 can also generate control instructions for the sensory simulation device 700 in a manner that gives pleasure to the viewer 620.In other embodiments, AI models can be used within the LF processing engine 530 to render holographic content to maximize the enjoyment of the viewer 630 using as input either stimuli (e.g., audio information) recorded by the sensory feedback system 570, or body movements, gestures, body positions, etc. recorded by the tracking system 580 and / or interpreted by the tracking module 526.

[0188] Additionally, in embodiments in which the holographic performer 630 is a holographic representation of another person (e.g., a significant other, a live chat partner, etc.) participating in the couple's session from a remote location, the remote viewer (e.g., a significant other, a live chat partner, etc.) may be able to remotely control the intensity of the stimuli provided to the viewer 630 via the sensory simulation device 700. In another embodiment, the LF processing engine 530 may vary the intensity of the stimuli provided to the viewer 630 by the sensory simulation device 700 based on (e.g., proportionally, etc.) the remote viewer's speed or intensity of movement and / or other contextual features (e.g., audible sounds, noise volume, facial expressions, etc.).

[0189] 8 is a flow diagram of a method 800 for displaying adult holographic content to a viewer 600 in the context of an LF network (e.g., LF network 550). Method 800 may include additional or fewer steps, which may occur in a different order. Additionally, various steps, or combinations of steps, may be repeated any number of times during the execution of the method.

[0190] Initially, the venue 600 including the LF display system 500 obtains (810) the viewer's 620 preferences for holographic content to be presented by the LF display system 500 in the venue 600. This may involve the LF display system 500 obtaining the viewer's 620 information stored in the viewer profiling system 590, or the system 500 receiving the viewer's selection of one or more holographic performers 630, for example, from a catalog or other list of performers or models. The holographic performers 630 may be live models, recorded AI representations of real people (e.g., models, actresses, actors, etc.), or computer-generated models (e.g., anime cartoons, etc.) that stream live holographic content of themselves to the LF display system 500 via the network system 552.

[0191] Depending on the viewer's preferences, the LF display system 500 presents (820) the holographic content to the viewer within the holographic object volume within the venue 600. As noted above, in one embodiment, the holographic display is multiple LF display modules 610 forming one or more surfaces within the venue 600, tiled to form a seamless display surface having an effective display area that is collectively larger than the display area of ​​any single LF display module 610. Thus, the holographic performer 630 is a hologram presented at a location within the holographic object volume of the venue 600 that the viewer 620 can see as if the performer were a real person standing in the room and talking to the viewer, without the viewer 620 having to wear a hat or device.

[0192] The tracking system 580 or sensory feedback system 570 of the LF display system 500 obtains (830) sensory information about the viewer 620 viewing the holographic content. This includes the viewer's interaction with the holographic performer 630 while identifying one or more contextual characteristics of the viewer 620. These contextual viewer characteristics include ML classified instances of the viewer's 620 body language, which may indicate joy, excitement, disappointment, boredom, etc., including classified facial expressions of the viewer 620, vocalization analysis (e.g., not only what the viewer expresses, but how they express it, tone, etc.), the viewer's movements relative to the holographic performer, other general feedback that may be explicitly stated by the user (e.g., user commands for the holographic performer 630 to perform an action, etc.), and the like.

[0193] Thus, the LF display system 500 adjusts (640) the presentation of holographic content, such as the actions of the holographic performer 630, in response to the sensory information obtained from the tracking system 580. This can be something as small as a smile or a laugh from the holographic performer 630 in response to a comment from the viewer 620 to the holographic performer 630 performing an action in response to a request from the viewer 620 (e.g., dim the lights, change the scenery, order a drink, etc.). As described above, the response performed by the holographic performer 630 can be generated using an AI model based on the interaction from the viewer 620. Thus, the holographic performer 630 is a hologram presented at a location within the holographic object volume of the venue 600 that the viewer 620 can see as if the holographic performer 630 were a real person standing in the room and talking to the viewer, without the viewer 620 having to wear a hat or device. The AI ​​model can enable the viewer 620 to seamlessly converse with the holographic performer 630 as if they were a real person standing in the room together. Additional configuration information

[0194] The foregoing description of embodiments of the present disclosure has been presented for purposes of illustration and is not intended to be exhaustive or to limit the disclosure to the precise form disclosed. Those skilled in the relevant art will recognize that numerous modifications and variations are possible in light of the above disclosure.

[0195] Some portions of this specification describe embodiments of the present disclosure in terms of algorithms and symbolic representations of operations on information. These algorithmic descriptions and representations are commonly used by those skilled in the data processing arts to effectively convey the substance of their work to others skilled in the art. While these operations are described functionally, computationally, or logically, it will be understood that they are implemented by computer programs or equivalent electrical circuits, microcode, or the like. Furthermore, it has proven convenient at times to refer to arrangements of these operations as modules, without loss of generality. The described operations and their associated modules may be embodied in software, firmware, hardware, or any combination thereof.

[0196] Any of the steps, operations, or processes described herein may be performed or implemented using one or more hardware or software modules, alone or in combination with other devices. In one embodiment, the software modules are implemented in a computer program product comprising a computer-readable medium containing computer program code that can be executed by a computer processor to perform any or all of the steps, operations, or processes described.

[0197] The embodiments of the present disclosure may also relate to an apparatus for performing the operations herein. The apparatus may be specially constructed for the required purposes and / or may comprise a general-purpose computing device selectively activated or reconfigured by a computer program stored in the computer. Such a computer program may be stored in a non-transitory tangible computer-readable storage medium, or any type of medium suitable for storing electronic instructions, that may be coupled to a computer system bus. Furthermore, any computing system referred to herein may include a single processor or may be an architecture employing a multiple processor design to increase computing power.

[0198] Embodiments of the present disclosure may also relate to products produced by the computing processes described herein. Such products may include information resulting from the computing processes, which information is stored in a non-transitory, tangible, computer-readable storage medium, and may include any embodiment of the computer program products or other data combinations described herein.

[0199] Finally, the language used herein has been selected primarily for ease of reading and instructional purposes, and may not have been selected to define or limit the subject matter of the present invention. Accordingly, the scope of the present disclosure is intended to be limited not by this detailed description, but by any claims issued on an application based thereon. Accordingly, the disclosure of the embodiments is intended to illustrate, but not to limit, the scope of the present disclosure, which is set forth in the following claims.

Claims

1. 1. A light field (LF) display system, comprising: a processing engine for generating holographic content, said processing engine augmenting said generated holographic content with sensory content including haptic stimuli; a light field display assembly having one or more LF display modules for presenting the holographic content to one or more viewers positioned within a viewing volume of the one or more LF display modules of a simulated environment; a sensory feedback system comprising at least one sensory feedback device that provides sensory feedback as a second energy when the holographic content is presented, the sensory feedback system having an ultrasonic energy projection device that generates a volumetric tactile surface that approximates or matches a surface of the presented holographic object; and a tracking system for tracking the viewer's movements within the viewing volume of the LF display system; Equipped with the ultrasonic energy projection device adjusts one or more of the resistance of the generated volumetric tactile surface to a user's touch, the texture of the generated volumetric tactile surface, or the tactile resistance of the generated tactile surface in response to the tracked movements of the viewer. LF display system.

2. the LF display system receives the holographic content in an encoded format over a network and decodes the holographic content into a format for presentation to the viewer; and the encoded format is a vectorized format and the decoded format is a rasterized format; The LF display system according to claim 1 .

3. The holographic content is presented based on a hardware configuration of the LF display system; and The hardware configuration is: resolution; Number of projected rays per degree; field of view; The deflection angle of the display surface; and the dimensions of the display surface; including one or more of The LF display system according to claim 1 .

4. the tracking system obtains information about a viewer viewing the holographic content; and the information acquired by the tracking system includes characteristics of a viewer viewing the holographic content; The LF display system according to claim 1 .

5. the tracking system having one or more light field cameras, 2D cameras, or depth sensors that capture images of an area in front of the one or more LF display modules; the one or more light field cameras, 2D cameras, or depth sensors are external to the light field display assembly; 5. An LF display system according to any one of claims 1 to 4.

6. Identifying a viewer viewing the holographic content presented by the LF display module; and generating a viewer profile for each of said identified viewers; Further equipped with a viewer profiling system, The LF display system according to claim 1 .

7. the viewer profiling system identifies viewer responses to the holographic content or characteristics of a viewer viewing the holographic content and includes the identified responses or characteristics in a viewer profile. The LF display system according to claim 6.

8. the processing engine further augments the generated holographic content with sensory content including acoustic stimuli, temperature stimuli, olfactory stimuli, pressure stimuli, force stimuli, or any combination thereof. The LF display system according to claim 1 .

9. the tracked movements of the viewer are input to an AI model, and the volumetric haptic surface is projected based in part on the AI ​​model. The LF display system according to claim 1 .

10. the one or more LF display modules form one or more surfaces within an environment, the one or more LF display modules being tiled to form a seamless display surface having an effective display area larger than the display area of ​​a single LF display module. The LF display system according to claim 1 .

11. a plurality of transparent ultrasonic transducers are attached to the seamless display surface and driven to create the volumetric tactile surface; The LF display system according to claim 10.

12. a content engine that generates the holographic content for presentation by the one or more LF display modules; and a tracking system for acquiring information about the one or more viewers within the viewing volume, the information including one or more viewer interactions with the holographic content; The LF display system of claim 1 further comprising:

13. The holographic content is a live holographic view of a second viewer presented to a first viewer, the second viewer being located at a distance from the first viewer, and the LF display system further comprises: receiving live image data of the second viewer; and generating a live holographic representation of the second viewer for presentation to the first viewer; The LF display system according to claim 11.

14. The holographic content is generated based on the information acquired by the tracking system, the tracking system further comprising: receiving one or more interactions from one of the one or more viewers with a holographic performer presented at a location within a holographic object volume of the environment; and using an AI model to generate a response based on the one or more interactions from the viewer, the response being performed by the holographic performer in relation to the viewer; or identifying one or more contextual viewer characteristics, the one or more contextual viewer characteristics including at least one of: one or more classified instances of body language of the viewer, one or more classified facial expressions of the viewer, a vocal analysis of the viewer, or some combination thereof; and using an AI model to cause the holographic performer to at least one of respond to and / or perform one or more actions in response to the identified one or more contextual viewer characteristics from the viewer; The LF display system according to claim 12.

15. the holographic content is generated based on the information acquired by the tracking system; a sensation simulation device that receives operational instructions from the content engine to operate in coordination with the holographic content presented by the one or more LF display modules; the sensation simulation device is provided or at least augmented by an ultrasonic energy projection device which generates a volumetric tactile surface, the volumetric tactile surface being projected near or coincident with a surface of the presented holographic object; The LF display system according to claim 12.

Images