System for virtual display and vehicle arrangement with such a

Abstract

A virtual display system comprises: a frustum prism comprising reflective surfaces or refracting surfaces; and a projector configured to generate a light beam having a hologram, each divided into multiple sub-holograms for multiple viewers, and direct the light beam toward the frustum prism. The frustum prism is configured to divide the light beam into multiple sub-light beams via the reflective surfaces or the refracting surfaces and direct the sub-holograms toward the viewers' eyes.

Description

introduction

[0001] The present disclosure relates to virtual image displays within a vehicle.

[0002] The document DE 601 05 018 T2 discloses a system for virtual display according to the preamble of claim 1. The documents WO 2007 / 131 817 A1 and DE 10 2008 040 578 A1 disclose related systems

[0003] Display devices are used in a variety of applications. Some example display devices are flat-panel displays, projection displays, and head-up displays. The display devices can be either transmissive or reflective. A vehicle may include multiple display devices to display various information to vehicle occupants (or observers). For example, some vehicles have an infotainment system that includes a display or panel that displays various infotainment and other vehicle information. Summary

[0004] A virtual display system is disclosed and includes: a frustum prism comprising reflective surfaces or refracting surfaces; and a projector configured to generate a light beam having a hologram divided into a plurality of sub-holograms for a plurality of viewers, and direct the light beam toward the frustum prism. The frustum prism is configured to divide the light beam into a plurality of sub-light beams via the reflective surfaces or the refracting surfaces and direct the sub-holograms toward the viewers' eyes.

[0005] In other features, the frustum prism includes reflective surfaces. The reflective surfaces are configured to reflect the partial holograms to the observer's eyes.

[0006] Other features of the frustum prism include refractive surfaces. These refractive surfaces are transparent and designed or configured to refract the partial holograms toward the observer's eyes.

[0007] In other features, the virtual display system further comprises a control module configured to control a spatial light modulator of the projector to encode each of the partial holograms with a respective set of eyeboxes for each of the viewers.

[0008] In other respects, the frustum prism is steerable.

[0009] In other features, the reflecting surfaces or the refracting surfaces are movable to direct the partial light rays toward the viewers to display images to the viewers simultaneously.

[0010] The frustum prism comprises four reflective surfaces, each of which reflects one of the partial holograms to a respective viewer.

[0011] In other features, the light beam is transmitted through the frustum prism and parts of the light beam with the partial holograms are refracted by means of the refracting surfaces and directed towards the observer.

[0012] In other features, the virtual display system further comprises a control module, wherein the projector includes a spatial light modulator, and the control module is configured to control the spatial light modulator to implement a lens function to independently establish a virtual image distance for each of the viewers and / or to encode a focal length for each of the viewers into a respective one of the partial holograms for that viewer per frame.

[0013] According to the invention, a vehicle assembly is provided comprising: the virtual display system; and a vehicle support structure supporting the frustum prism and the projector.

[0014] In other features, a virtual display system is disclosed and includes: panels having reflective surfaces; and a projector configured to generate a light beam having a hologram, each divided into sub-holograms for multiple viewers, and direct the light beam toward the panels. The panels are configured to divide the light beam into sub-holograms via the reflective surfaces and direct the sub-holograms toward the viewers' eyes.

[0015] In other features, the virtual display system further includes: eye trackers configured to track the positions and gaze directions of the viewers' eyes; actuator assemblies configured to adjust or set the positions and orientations of the panels; and a control module configured to adjust the positions and orientations of the panels based on the positions and gaze directions of the eyes.

[0016] In other features, the control module is configured to control movement of each of the panels independently and control the projector to display images to viewers simultaneously.

[0017] In other features, the virtual display system includes a control module configured to control a spatial light modulator of the projector to encode each of the partial holograms with a respective set of eyeboxes for each of the viewers.

[0018] In other features, the virtual display system further comprises a control module, wherein the projector includes a spatial light modulator, and the control module is configured to control the spatial light modulator to implement a lens function to independently establish a virtual image distance for each of the viewers and / or to encode a focal length for each of the viewers into a respective one of the partial holograms for that viewer per frame.

[0019] In other features, a vehicle assembly is disclosed and further includes: the virtual display system; and a vehicle support structure supporting the panels and the projector.

[0020] In other features, a multiplexed virtual display system is disclosed and includes: a steerable panel having a reflective surface; a projector configured to project a light beam at a frame rate.frame rate of a multiple of a refresh rate and directs the light beam onto the steerable plate so that images at the refresh rate are displayed to each of a plurality of viewers, the steerable plate being configured to reflect the light beam across the reflective surface and direct the light beam toward the eyes of the viewers to display the images to each of the viewers simultaneously; a motor-actuator assembly configured to move the steerable plate; eye trackers configured to detect positions and view angles of the viewers' eyes; and a control module configured to control movement of the steerable plate to direct the light beam toward the viewers' eyes based on the positions and view angles.

[0021] In other features, the control module is configured to control a spatial light modulator of the projector to encode each of the partial holograms with a respective set of eyeboxes for each of the viewers.

[0022] In other features, the projector includes a spatial light modulator. The control module is configured to control the spatial light modulator to implement a lens function to independently establish a virtual image distance for each of the viewers and / or to encode a focal length for each of the viewers into a respective one of multiple holograms for that viewer per frame.

[0023] In other features, a vehicle assembly is disclosed and includes: the multiplexed virtual display system; and a vehicle support structure supporting the motor actuator assembly, the steerable plate, and the projector.

[0024] Further areas of applicability of the present disclosure will become apparent from the detailed description, claims, and drawings. The detailed description and specific examples are provided for illustrative purposes only. Brief description of the drawings

[0025] The present disclosure will be more fully understood from the detailed description and the accompanying drawings, in which: Fig. 1 is a side view of an exemplary frustum prism virtual display system implemented in a vehicle according to the present disclosure; Fig. 2 is a functional block diagram of an exemplary projector directing a light beam onto a frustum prism or multiple movable plates with reflective surfaces in accordance with the present disclosure; Fig. 3 is an exemplary representative top view of a light beam from a spatial light modulator (SLM) including partial holograms with respective sets of eyeboxes impinging on angled surfaces of a frustum prism to generate partial light beams in accordance with the present disclosure; Fig. 4 is a perspective view of a frustum prism and a corresponding projector, wherein angled surfaces of the frustum prism are implemented as reflective surfaces in accordance with the present disclosure; Fig. 5 is a perspective view of a frustum prism and a corresponding projector, wherein angled surfaces of the frustum prism are implemented as refracting surfaces in accordance with the present disclosure; Fig. 6 is a functional block diagram and a perspective view of a feedback system with movable plates having reflective surfaces according to the present disclosure; and Fig. 7 illustrates an exemplary method for a virtual display for displaying multiple virtual images to multiple viewers in accordance with the present disclosure.

[0026] Reference numerals may be reused in the drawings to identify similar and / or identical elements. Detailed description

[0027] In a shared vehicle where occupants sit facing each other in a "campfire"-like arrangement, a user experience can be created where each occupant can interact with one of several virtual displays. The virtual displays can appear to the occupants as projections of images hovering in front of each occupant, for example, 1 meter away from each occupant. Occupants can interact with the displayed images by making gestures and / or issuing voice commands. The imaging systems implement gesture recognition and voice recognition for received gestures and / or voice commands. Interaction can also be based on occupant gaze directions (or angles), which can be determined using tracking cameras that track the viewpoints of the occupants' eyes.When an occupant looks at a specific object in a virtual image, the system can provide specific information and / or react based on the occupant's corresponding viewing angle. Each virtual display of a vehicle can be expensive and relatively large.

[0028] The examples presented here include non-multiplexed and multiplexed virtual display systems for vehicle occupants (or observers). The non-multiplexed virtual display systems may include a single projector and either a frustum prism or multiple movable panels with reflective surfaces that can be positioned and oriented to perform functions similar to the facets (or angled surfaces) of a frustum prism. The multiplexed virtual display systems may include a single projector and a single steerable mirror. The same or different content can be displayed to each of multiple viewers by means of the individual projectors. The virtual display systems are configured in a "campfire" configuration, where the viewers face each other, as opposed to all viewers being seated and facing the same direction.Each of the individual projectors includes an SLM that generates subdivided encoded holograms. As an example, each hologram generated by a projector can be subdivided to provide multiple sub-holograms that are directed toward the respective viewers via a frustum prism or one or more movable reflective surfaces. In embodiments that include a frustum prism (or a pyramidal prism) or multiple movable reflective surfaces, the frustum prism or movable reflective surfaces split an SLM output light beam into separate sub-light beams. In an embodiment that includes a single steerable mirror, the SLM output light beam is directed toward the steerable mirror, which is rotated sequentially and iteratively to direct the light beam toward the viewers.

[0029] The systems disclosed herein enable each vehicle occupant to have an individual viewing perspective that cannot be observed by other vehicle occupants. The systems also allow all or some of the occupants to share the same content. The individual and shared viewing perspectives can be implemented for gaming applications, movie viewing applications, information delivery applications, etc.

[0030] The disclosed systems minimize the number of image projectors (or display sources) and include display components associated with displaying images to multiple vehicle occupants. This reduces the associated costs, the number of components, and the spatial (or volumetric) requirements (or the amount of space reserved within a vehicle for display systems and components). Examples include using a single projector to project images with the same or different content to multiple occupants. The images for the occupants are provided simultaneously and can be displayed on independent virtual displays. The images originate from the same projector.

[0031] The examples disclosed herein may include a virtual three-dimensional (3D) display that projects encoded real-time "holograms" via a spatial light modulator (SLM) controlled by a computer and / or a control module. A lens function is encoded and / or programmed into the holograms of two images displayed simultaneously. The focus lens function independently establishes the virtual image distances (VIDs) appropriate for each occupant. The focus lens function is a dynamic function that changes over time per frame and has the functionality of a lens. In other words, the encoded focal length for each occupant (or viewer) is encoded into the hologram (or respective sub-hologram) for each viewer per frame. There is one lens function for each viewer.The VIDs and other information described herein can be encoded into the holograms. Such a projection system allows the encoded projected information to be replicated per viewer to expand the viewing area or the number of eyeboxes visible to each viewer. This is achieved by filling an observer's potential viewing area with multiple renderings of an image to be viewed by the observer regardless of the viewing perspective or angle. The encoding can be further extended to allow subdivision of the encoding SLM, provided the SLM is large enough to maintain a target resolution to support multiple viewers viewing different information.

[0032] Fig. 1 shows a virtual display system 100 implemented in a vehicle 104 that includes a frustum prism 102. A projector 106 generates a light beam with content for multiple viewers (two viewers A and B are shown). Although two viewers are shown, the projector 106 and the frustum prism 102 can generate additional images for additional viewers. The light beam is directed onto the frustum and split into multiple sub-light beams that are reflected by facets (or angled surfaces) 110, 112 of the frustum prism 102 and directed toward viewers A, B. The frustum prism 102 can be mounted to a roof 116 of the vehicle 104 via a mounting bracket assembly 114. In one embodiment, the frustum prism 102 and the projector 106 are implemented in a headliner of the vehicle 104.The projector 106 is controlled by a control module 120.

[0033] Although in Fig. 1, cameras may be included and used by the control module 120 to determine what information should be provided to each user based on gestures and / or viewpoints of the viewers. Example cameras are shown in Fig. 6. The cameras can also be used to detect the presence of viewers. The projector 106 can generate images for each viewer when a viewer is present.

[0034] In one embodiment, the mounting bracket assembly 114 may include a motor-actuator assembly to rotate the frustum prism 110. Each facet of the frustum prism 110 is steerable toward each viewer. The control module 120 may control the motor-actuator assembly as described below to provide a best image to each viewer. This may include moving the facets to reflect light rays in the direction of the viewer's line of sight.

[0035] Fig. Figure 2 shows a projector 200 having a light source 202 (e.g., a laser) and a spatial light modulator (SLM) 204 that directs a light beam onto a frustum prism or multiple movable plates with reflective surfaces, represented as an oval 206. Examples of a frustum prism and movable plates with reflective surfaces are shown in Fig. 1 and 3-6. A control module 208 (e.g., one of the control modules 120, 620 of Fig. 1 and Fig. 6) Controls states of the SLM 204 and the movable plates, if included or present. The frustum prism and the movable plates split a beam from the SLM 204 into multiple beams (e.g., 4 beams) with respective views that may contain the same or different content. The SLM 204 is controlled by the control module 208 to generate the hologram encoded with multiple images (e.g., 4 images), using separate image lens functions for independent virtual image positions. The projector 200 outputs the hologram divided into multiple sub-holograms (e.g., 4 holograms) 209 encoded for separate images (e.g., images AD), separate virtual image distances, separate propagation paths, and directed onto i) different faces (or angled surfaces) of a frustum prism or ii) reflective surfaces of movable plates.Depending on the embodiment, the frustum prism or the movable plates split the beam from the SLM 204 into several sub-beams (or channels) 211. Each channel may contain a respective computer-processed image.

[0036] Fig. Figure 2 is a simplified view of the projector 200. Each hologram and frame of the SLM 204 are divided into sub-holograms and sub-frames, each directed toward the viewers. Each of the sub-holograms, labeled 209, contains multiple replicated eyeboxes for each viewer to account for viewer movement. Each viewer can see one of the eyeboxes in the set of replicated eyeboxes provided for that viewer. Fig. 2, a representative eyebox region 210 is shown containing replicated eyeboxes represented as replicated versions of an image A of a motorcyclist, displayed multiple times per frame and at different angles to account for movement and / or different viewpoints of the corresponding viewer. Although each of the sub-holograms 209 is shown with a single image, A, B, C, or D, each of the sub-holograms includes information for multiple versions of the corresponding image, as represented by the eyebox region 210. Each viewer sees only one of the eyebox images at any given time. Oval 512 represents one eye of the viewer seeing image A. Other viewers may see images B, C, and D.

[0037] Fig. Figure 3 shows an exemplary representative top view of a light beam 300 from an SLM (e.g., the SLM 204 of Fig. 2), which contains respective partial holograms with respective sets of eyeboxes 302, 304, 306, 308 that impinge on facets (or angled surfaces) of a frustum prism 311 to generate partial light beams 312, 314, 316, 318 in respective portions of the output beam 300 of the corresponding projector. The frustum prism 311 includes a first planar surface 320 and a second planar surface 322 extending parallel to the first planar surface. The frustum prism 311 further includes four angled planar surfaces 330, 332, 334, 336. Each of four viewers, represented by ovals 340, 342, 344, 346, sees the image in one of the corresponding sets of eyeboxes. This is represented by light beam parts 350, 352, 354, 356.The arrangement of the eyebox replication can be modified, provided the beam diameter is large and there is sufficient resolution to contain multiple sets of eyeboxes for the multiple viewers in four sub-areas of the projector's output beam simultaneously.

[0038] Fig. Figure 4 shows a frustum prism 400 and a corresponding projector 402, wherein facets (or angled surfaces) 406 of the frustum prism 400 are implemented as reflective surfaces. The angled surfaces 406 reflect portions of a light beam projected by the projector 402 to respective viewers (e.g., viewers 1-4). The projector 402 can be assigned to one of the projectors (e.g., 106 or 200) of the Fig. 1-2. In one embodiment, the frustum prism 400 and projector 402 are implemented in a headliner of a vehicle and are supported by one or more structural members of the vehicle's roof.

[0039] Fig. 5 shows a frustum prism 500 and a corresponding projector 502, with facets (or angled surfaces) 504 of the frustum prism 500 implemented as refractive and refracting surfaces, respectively. Portions of a light beam emitted by the projector 502 are refracted at the angled surfaces 504 and directed toward respective viewers (e.g., viewers 1-4). In one embodiment, the frustum prism 500 and the projector 502 are implemented in a headliner and supported by one or more structural components of the roof of the vehicle.

[0040] When implementing Fig. 5, distortion and chromatic dispersion may occur. This can be addressed or remedied during hologram generation via the appropriate control module and SLM, and / or by adding an additional optical element such as a programmable liquid crystal phase plate between the projector 502 and the frustum prism 500. Chromatic dispersion may also be remedied i) via the selection of the frustum glass material and / or ii) by adding optics positioned along the optical path and configured to compensate for chromatic dispersion.

[0041] Fig. Figure 6 shows a feedback system 600 comprising movable plates 602, 604, 606, 608 with reflective surfaces 610, 612, 614, 616. Portions of a light beam emitted by a projector 601 are reflected by the reflective surfaces 610, 612, 614, 616 and directed toward respective viewers (e.g., viewers 1-4). The reflective surfaces 610, 612, 614, 616 may comprise metallic materials and / or coatings. Although the reflective surfaces are shown as the front surfaces of plates 602, 604, 606, 608, the reflective surfaces may be the back surfaces of plates 602, 604, 606, 608, where portions of the light pass through the glass bodies of plates 602, 604, 606, 608 and are reflected by the reflective back surfaces. In this way, plates 602, 604, 606, 608 are implemented as mirrors.In one embodiment, the projector 601, the panels 602, 604, 606, 608, and the motor actuator assemblies 624 are implemented in a headliner of a vehicle and are supported by one or more structural members of the roof of the vehicle.

[0042] The feedback system 600 may include a control module 620, cameras 622, and motor-actuator assemblies 624. The cameras 622 may be used to detect the presence, positions, viewing directions, and angles of the observers. The control module 620 adjusts the positions and orientations of the plates 602, 604, 606, 608 and thus the reflective surfaces 610, 612, 614, 616 via the motor-actuator assemblies 624 based on the outputs of the cameras 622. The motor-actuator assemblies 624 may include motors, actuators, mounts, etc. for moving the plates 602, 604, 606, 608. The control module 620 may determine information to provide to each of the users based on gestures and / or viewpoints of the viewers detected via the cameras 622.

[0043] In one embodiment, instead of a single beam being directed by an SLM onto the plates 602, 604, 606, 608 and split into multiple partial light beams, the SLM emits a single beam having a repetition rate (e.g., 30 frames / second) of the virtual display multiple times (e.g., quadruple for four viewers). The single beam is directed onto a single steerable mirror, which is rotated to direct the beam onto each of the viewers. Thus, a single mirror is used instead of four, which are rotated to direct the images onto the four viewers. The single mirror can be positioned centrally between the four viewers. Four images can be provided to four viewers via the single steerable mirror. Thus, instead of four movable mirrors, a single steerable mirror can be implemented for the four viewers or a different number of viewers.The control module 620 can adjust the frame rate of the light beam directed onto the steerable mirror based on the number of viewers. The steerable mirror can be implemented as a point-to-point design rather than a continuously pivoting scanning mirror.

[0044] Fig. Figure 7 illustrates an exemplary method for a virtual display for displaying multiple virtual images to multiple viewers. The operations may be performed iteratively. The operations may be performed by one of the control modules, one of the projectors, one of the SLMs, and optionally one or more of the cameras, as referred to herein.

[0045] At 700, the control module controls the projector's light source (e.g., laser) to generate a light beam. At 702, the control module controls the SLM to generate a hologram that is divided into multiple sub-holograms for respective viewers. The sub-holograms contain, as described above, respective sets of replicated eyeboxes for the viewers. A beam is generated with the hologram that contains multiple channels containing information for the viewers.

[0046] At 704, the control module may determine whether a frustum prism is used to split the beam containing the hologram. If so, operation 706 may be performed; otherwise, operation 710 may be performed if multiple movable reflective surfaces are used to split the beam containing the hologram.

[0047] At 706, the beam with the hologram is directed onto the angled surfaces of the frustum prism. At 708, the beam is split into several sub-beams for the respective channels and reflected or refracted by the angled surfaces of the frustum prism toward the observers. The method can terminate following operation 708 or return to operation 702.

[0048] At 710, the beam with the hologram is directed onto the reflective surfaces of the movable plates. At 712, the beam is split into several sub-beams for the respective channels and reflected from the angled surfaces of the reflective surfaces of the movable plates to the viewers.

[0049] At 714, eye trackers (e.g. the cameras 622 in Fig. 6) Detect the current positions and viewing directions (or angles) of the observers' eyes. At 716, the control module may determine the positions and orientation of the reflective surfaces. This may include determining the X, Y, and Z positions of the reflective surfaces and the associated X and Y angles of the reflective surfaces.

[0050] At 718, the control module can calculate expected image positions of the partial light beams generated for multiple viewers located at different locations or positions. At 720, the control module can calculate differences between current values ​​of the eye trackers associated with the positions and gaze directions of the viewers' eyes and the expected values ​​of the image positions of the partial light beams.

[0051] At 722, the control module may adjust one or more angles and / or positions of the one or more reflective surfaces to minimize errors and provide the best views of the images to the occupants. This is based on the positions and viewing directions of the viewers' eyes and the differences determined at 720. This may include positioning the reflective surfaces so that the generated partial light beams are in the viewers' lines of sight and are directed toward and / or parallel to the viewers' lines of sight (or viewing directions). The method may end after operation 722 or return to operation 702.

[0052] The examples presented herein minimize the number of projectors and corresponding components required within a vehicle, thus minimizing system costs and associated space requirements. The examples allow multiple users to share the same projector and view the same or different images with the same or different content. The generated images are delivered via the same or different virtual image pitches and different propagation paths.

[0053] The examples described above include a projector that divides the projected pupils of eyebox replicators into four subzones or regions. Each region is provided with unique content for each of the four viewers. In some embodiments, the projector's output is directed toward a frustum-shaped beam reflector (or a frustum prism with reflective surfaces), which directs portions of the beam toward the multiple viewers. In another embodiment, the projector's output is directed toward a frustum-shaped refractor (or a frustum prism with multiple refracting surfaces), which redirects portions of the beam toward the multiple viewers. In another embodiment, the projector's output is directed toward the viewers via a steerable mirror and / or multiple movable plates (or mirrors).The projector and SLM of the steerable mirror version operate at a multiple of the refresh rate of the virtual display.

[0054] In another embodiment, the output of the projector is directed independently to each viewer, with each facet of a steerable frustum-like beamsplitter being independently controlled based on outputs from eye-tracking devices (e.g., cameras) to direct reflected beams to respective viewers. The "steerable frustrum-like beamsplitter" refers to the exemplary implementation of Fig. 6 and comprises multiple independently controlled plates. Each facet of the steerable frustum-type beamsplitter has a bidirectional tilt, allowing tilt in the x and y directions to compensate for each observer's viewing direction.

[0055] In some embodiments, a projector's output is spatially divided into multiple images with unique VIDs and propagation paths, with each image then simultaneously and / or concurrently directed to a different viewer via hologram lens encoding. The projector's output (or hologram) is directed into a frustum prism, which redirects the hologram toward the user's eyes.

[0056] A virtual image projection display is disclosed, configured to project to four viewers simultaneously using sequential operation, with hologram lens coding generating a unique VID and propagation path for each viewer. The output of the virtual image projection display is redirected to the users' eyes using a frustum prism.

[0057] The disclosed implementation of a frustum prism can have several different configurations, including reflective and refractive implementations. A multi-plate design with angled reflective surfaces can be independently controlled via motor-actuator assemblies capable of tilting the plates to cover the possible viewpoints of the viewers within the projector's field of view, creating replicated eyeboxes.

[0058] Furthermore, although each of the embodiments is described above as having certain features, one or more of those features described with respect to any embodiment of the disclosure may be implemented in one of the other embodiments and / or combined with features of one of the other embodiments, even if that combination is not explicitly described. In other words, the described embodiments are not mutually exclusive, and permutations of one or more embodiments with each other remain within the scope of this disclosure.

[0059] Spatial and functional relationships between elements (e.g., between modules, circuit elements, semiconductor layers, etc.) are described using various terms, including "connected," "engaged," "coupled," "adjacent," "near," "on," "above," "below," and "disposed." Unless explicitly described as "direct," when a relationship between first and second elements is described in the above disclosure, that relationship may be a direct relationship, with no other intervening elements present between the first and second elements, but may also be an indirect relationship, with one or more intervening elements (either spatial or functional) present between the first and second elements.As used herein, the phrase "at least one of A, B, and C" should be construed to mean a logical (A OR B OR C) using a non-exclusive logical OR, and should not be construed to mean "at least one of A, at least one of B, and at least one of C."

[0060] In the figures, the direction of an arrow, as indicated by the arrowhead, generally illustrates the flow of information (e.g., data or instructions) of interest to the illustration. For example, if element A and element B exchange a lot of information, but information transmitted from element A to element B is important to the illustration, the arrow may point from element A to element B. This unidirectional arrow does not imply that no other information is transmitted from element B to element A. Moreover, for information transmitted from element A to element B, element B may send requests for, or acknowledgments of receipt of, the information to element A.

[0061] Throughout this application, including the definitions below, the term "module" or "controller" may be replaced by the term "circuit." "The term "module" may refer to, be part of, or include an application-specific integrated circuit (ASIC); a digital, analog, or mixed analog / digital discrete circuit; a digital, analog, or mixed analog / digital integrated circuit; a combinational logic circuit; a field-programmable gate array (FPGA); a processor circuit (shared, dedicated, or group) executing code; a memory circuit (shared, dedicated, or group) storing code executed by the processor circuit; other suitable hardware components that provide the described functionality; or a combination of some or all of the above components, such as in a system-on-chip.

[0062] The module may include one or more interface circuits. In some examples, the interface circuits may include wired or wireless interfaces connected to a local area network (LAN), the Internet, a wide area network (WAN), or combinations thereof. The functionality of any given module of the present disclosure may be distributed among multiple modules connected via interface circuits. For example, multiple modules may enable load balancing. In another example, a server module (also known as a remote or cloud module) may perform some functions for a client module.

[0063] The term code, as used above, may include software, firmware, and / or microcode, and may refer to programs, routines, functions, classes, data structures, and / or objects. The term shared processor circuitry includes a single processor circuit that executes some or all of the code from multiple modules. The term group processor circuitry includes a processor circuit that, in combination with additional processor circuitry, executes some or all of the code from one or more modules. References to multiple processor circuits include multiple processor circuits on individual chips, multiple processor circuits on a single chip, multiple cores of a single processor circuit, multiple threads of a single processor circuit, or any combination of the above.The term shared memory circuit refers to a single memory circuit that stores some or all of the code from multiple modules. The term group memory circuit refers to a memory circuit that, in combination with additional memories, stores some or all of the code from one or more modules.

[0064] The term "memory circuit" is a subset of the term "computer-readable medium." As used herein, the term "computer-readable medium" does not include transitory electrical or electromagnetic signals propagating through a medium (such as a carrier wave); therefore, the term "computer-readable medium" can be considered tangible and non-transitory.Non-limiting examples of a non-transitory, tangible computer-readable medium include non-volatile memory circuits (such as a flash memory circuit, an erasable programmable read-only memory circuit, or a mask read-only memory circuit), volatile memory circuits (such as a static random access memory circuit or a dynamic random access memory circuit), magnetic storage media (such as an analog or digital magnetic tape or a hard disk drive), and optical storage media (such as a CD, a DVD, or a Blu-ray Disc).

[0065] The devices and methods described in this application may be implemented, in part or in whole, by a special-purpose computer created by configuring a general-purpose computer to perform one or more specific functions embodied in computer programs. The functional blocks, flowchart components, and other elements described above serve as software specifications that can be translated into computer programs through the routine work of a person skilled in the art or programmer.

[0066] The computer programs contain processor-executable instructions stored on at least one non-transitory, tangible, computer-readable medium. The computer programs may also contain or rely on stored data. The computer programs may include a basic input / output system (BIOS) that interacts with the computer's special-purpose hardware, device drivers that interact with specific special-purpose devices of the computer, one or more operating systems, user applications, background services, background applications, etc.

[0067] The computer programs may contain: (i) a description text to be analyzed, such as HTML (Hypertext Markup Language), XML (Extensible Markup Language) or JSON (JavaScript Object Notation), (ii) assembly code, (iii) object code generated from the source code by a compiler, (iv) source code for execution by an interpreter, (v) source code for compilation and execution by a just-in-time compiler, etc. By way of example only, source code may be written using syntax from languages ​​including C, C++, C#, ObjectiveC, Swift, Haskell, Go, SQL, R, Lisp, Java®, Fortran, Perl, Pascal, Curl, OCaml, JavaScript®, HTML5 (Hypertext Markup Language 5th Revision), Ada, ASP (Active Server Pages), PHP (PHP: Hypertext Preprocessor), Scala, Eiffel, Smalltalk, Erlang, Ruby, Flash®, Visual Basic®, Lua, MATLAB, SIMULINK and Python®. legend

[0068] In the drawings, N stands for No and Y stands for Yes.

Claims

[1] A virtual display system (100) comprising: a frustum prism (102, 311, 400, 500) having a plurality of reflective surfaces (110, 112, 206, 406) or a plurality of refracting surfaces (504); and a projector (200, 402, 502, 601) configured to generate a light beam (300) comprising a hologram divided into a plurality of partial holograms (209) for a plurality of viewers (A, B), and direct the light beam (300) onto the frustum prism (102, 311, 400, 500), wherein the frustum prism (102, 311, 400, 500) is configured to split the light beam (300) into a plurality of partial light beams (312, 314, 316, 318) via the plurality of reflective surfaces (110, 112, 206, 406) or the plurality of refracting surfaces (504) and to direct the plurality of partial holograms (209) onto the eyes (512) of the plurality of viewers (A, B), characterized by , that the frustum prism (102, 311, 400, 500) comprises four reflective surfaces (110, 112, 206, 406), each reflecting a corresponding one of the plurality of partial holograms (209) to a respective one of the plurality of viewers (A, B). [2] The virtual display system (100) of claim 1, wherein: the frustum prism (102, 311, 400, 500) has the plurality of reflective surfaces (110, 112, 206, 406); and the plurality of reflective surfaces (110, 112, 206, 406) are configured to reflect the plurality of partial holograms (209) onto the eyes (512) of the plurality of viewers (A, B). [3] The virtual display system (100) of claim 1, wherein: the frustum prism (102, 311, 400, 500) has the plurality of refracting surfaces (504); and the plurality of refractive surfaces (504) are transmissive and configured to refract the plurality of partial holograms (209) to the eyes (512) of the plurality of viewers (A, B). [4] The virtual display system (100) of claim 1, further comprising a control module (120, 208, 620) configured to control a spatial light modulator (204) of the projector (200, 402, 502, 601) to encode each of the plurality of sub-holograms (209) with a respective set of eyeboxes (302, 304, 306, 308) for each of the plurality of viewers (A, B). [5] The virtual display system (100) of claim 1, wherein the frustum prism (102, 311, 400, 500) is steerable. [6] The virtual display system (100) of claim 1, wherein the plurality of reflective surfaces (110, 112, 206, 406) or the plurality of refracting surfaces (504) are movable to direct the plurality of partial light beams (312, 314, 316, 318) toward the plurality of viewers (A, B) to simultaneously display a plurality of images (A, B, C, D) to the plurality of viewers (A, B). [7] The virtual display system (100) of claim 1, wherein the light beam (300) is transmitted through the frustum prism (102, 311, 400, 500) and portions of the light beam (300) having the plurality of partial holograms (209) are refracted by the plurality of refractive surfaces (504) respectively and directed toward the plurality of viewers (A, B). [8] The virtual display system (100) of claim 1, further comprising a control module (120, 208, 620), wherein the projector (200, 402, 502, 601) includes a spatial light modulator (204), and the control module (120, 208, 620) is configured to control the spatial light modulator (204) to: to implement a lens function to independently establish a virtual image distance for each of the plurality of viewers (A, B); and / or to encode a focal length for each of the plurality of viewers (A, B) into a respective one of the plurality of partial holograms (209) for that viewer (A, B) per frame. [9] Vehicle arrangement comprising: a virtual display system (100) according to claim 1; and a vehicle support structure supporting a frustum prism (102, 311, 400, 500) and a projector (200, 402, 502, 601).

Images