Autostereoscopic bonfire display

Abstract

The present invention relates to an autostereoscopic bonfire display, and specifically discloses a system for generating floating images for a plurality of passengers within a vehicle, the system comprising: a passenger monitoring system adapted to monitor the position of the head and eyes of each passenger; a computing engine in communication with the passenger monitoring system, the computing engine adapted to compute a holographic image and encode the holographic image onto a display of the image generating unit hologram generator; and a beam diverting device adapted to receive information from the passenger monitoring system relating to the position of the head and eyes of each passenger of the plurality of passengers, and the display is adapted to project the holographic image onto the beam diverting device, and the beam diverting device is adapted to divert the holographic image from the passenger monitoring system based on the information received from the passenger monitoring system. And redirecting the projected holographic image to the eyes of each passenger in the plurality of passengers.

Description

Technical Field

[0001] The present disclosure relates to a system for generating a floating image viewable by passengers within a vehicle. Background Art

[0002] Current in-vehicle entertainment systems typically include a screen or monitor mounted within the vehicle for viewing by the passengers. Some systems include smaller individual screens, with each passenger having a screen for their personal viewing. Known systems incorporate a reverse head-up display architecture that uses a beam splitter that must be attached to a structure within the vehicle cabin and must be constantly readjusted to accommodate changes in height and position of passengers within the vehicle cabin.

[0003] While current systems achieve their intended purposes, a new and improved system is needed to provide multiple occupants within a vehicle with a floating three-dimensional image that appears at a central location within the vehicle. Summary of the invention

[0004] According to several aspects of the present disclosure, a system for generating floating images for multiple passengers in a vehicle comprises: a passenger monitoring system, the passenger monitoring system being adapted to monitor the position of a head and eyes of each of a plurality of passengers; a computing engine communicating with the passenger monitoring system, the computing engine being adapted to calculate a holographic image and encode the holographic image onto a display of a picture generation unit (PGU) hologram generator, and a beam steering device, wherein the beam steering device is adapted to receive information related to the position of a head and eyes of each of the plurality of passengers from the passenger monitoring system via the computing engine, and the display being adapted to project the holographic image onto the beam steering device, and the beam steering device being adapted to redirect the projected holographic image to the eyes of each of the plurality of passengers based on the information received from the passenger monitoring system.

[0005] According to another aspect, the computation engine is further adapted to encode a lens function into the holographic image based on information received from the passenger monitoring system.

[0006] According to another aspect, the holographic image includes a right-eye image and a left-eye image; the computing engine is suitable for computing the right-eye image and the left-eye image, and alternately encoding the right-eye image onto the display and encoding the left-eye image onto the display, switching back and forth between encoding the right-eye image and encoding the left-eye image at a frequency greater than 30 Hz; the display is suitable for alternately projecting the right-eye image and the left-eye image onto the beam steering device at a frequency greater than 30 Hz and synchronized with the computing engine; and the beam steering device is suitable for redirecting the right-eye image directly to the right eye of each of the multiple passengers, and redirecting the left-eye image directly to the left eye of each of the multiple passengers, wherein the right-eye image and the left-eye image are slightly different perspectives of a single image, so that when the right eye of each of the multiple passengers receives the right-eye image and the left eye of each of the multiple passengers receives the left-eye image, each of the multiple passengers perceives a three-dimensional image floating within the vehicle.

[0007] According to another aspect, the beam steering device comprises a waveguide comprising an exit surface with a fixed wavefront curvature, the waveguide being adapted to adjust a focusing distance of the holographic image.

[0008] According to another aspect, the light beam steering device further comprises a first lens adapted to further adjust the focusing distance of the right eye image, and a second lens adapted to further adjust the focusing distance of the left eye image.

[0009] According to another aspect, the beam steering device includes a first beam splitter prism adapted to redirect the right eye image to the right eye of each of the plurality of passengers, and a second beam splitter prism adapted to redirect the left eye image to the left eye of each of the plurality of passengers.

[0010] According to another aspect, the beam steering device includes a plurality of directional lenses, each of the plurality of directional lenses being suitable for steering the right eye image to the right eye of one of the plurality of passengers, or steering the left eye image to the left eye of one of the plurality of passengers.

[0011] According to another aspect, the beam steering device also includes a plurality of micro-electromechanical system (MEMS) mirrors, each of the plurality of MEMS mirrors being suitable for steering the right-eye image to the right eye of one of the plurality of passengers, or steering the left-eye image to the left eye of one of the plurality of passengers.

[0012] According to another aspect, the display includes a right-eye display and a left-eye display; the computing engine is suitable for computing the right-eye image and the left-eye image, and simultaneously encoding the right-eye image onto the right-eye display and encoding the left-eye image onto the left-eye display; and the right-eye display and the left-eye display are suitable for simultaneously projecting the right-eye image through the waveguide onto the first beam splitter prism and projecting the left-eye image through the waveguide onto the second beam splitter prism.

[0013] According to another aspect, the light beam steering device is installed in the vehicle adjacent to passenger seats opposite to the plurality of passengers, or is installed in the vehicle above passenger seats opposite to the plurality of passengers.

[0014] According to several aspects of the present disclosure, a method for generating floating images for multiple passengers in a vehicle includes: monitoring the positions of the heads and eyes of multiple passengers with a passenger monitoring system; calculating a holographic image with a computing engine that communicates with the passenger monitoring system, and encoding the holographic image onto a display of a picture generation unit (PGU) hologram generator; receiving information related to the head and eye positions of the passengers from the passenger monitoring system with a beam steering device via the computing engine; and projecting the holographic image onto the beam steering device with the display; and redirecting the projected holographic image to the eyes of each of the multiple passengers with the beam steering device based on the information received from the passenger monitoring system.

[0015] According to another aspect, the method further includes encoding, with the computational engine, a lens function into the holographic image based on information received from the passenger monitoring system.

[0016] According to another aspect, the holographic image includes a right-eye image and a left-eye image, and using the computing engine to calculate the holographic image also includes: using the computing engine to calculate the right-eye image and the left-eye image; encoding the holographic image onto a display of a picture generation unit (PGU) hologram generator, also includes: alternately encoding the right-eye image onto the display using the computing engine, and encoding the left-eye image onto the display using the computing engine, and switching back and forth between encoding the right-eye image and encoding the left-eye image at a frequency greater than 30 Hz; projecting the holographic image onto the beam steering device using the display, also includes: alternately encoding the right-eye image and the left-eye image at a frequency greater than 30 Hz and synchronized with the computing engine. An image is projected onto the beam steering device; and the projected holographic image is redirected to the eyes of each of the multiple passengers using the beam steering device, and the right-eye image is directly redirected to the right eye of each of the multiple passengers using the beam steering device, and the left-eye image is directly redirected to the left eye of each of the multiple passengers using the beam steering device, wherein the right-eye image and the left-eye image are slightly different perspectives of a single image, so that when the right eye of each of the multiple passengers receives the right-eye image, and when the left eye of each of the multiple passengers receives the left-eye image, each of the multiple passengers perceives a three-dimensional image floating within the vehicle.

[0017] According to another aspect, the beam steering device redirects the projected holographic image to the eyes of each of the plurality of passengers, further comprising: adjusting a focus distance of the holographic image using an exit surface of a waveguide of the beam steering device.

[0018] According to another aspect, redirecting the projected holographic image to the eyes of each of the multiple passengers using the beam steering device also includes: adjusting the focusing distance of the right eye image of the holographic image using a first lens, and adjusting the focusing distance of the left eye image of the holographic image using a second lens.

[0019] According to another aspect, redirecting the projected holographic image to the eyes of each of the multiple passengers using the beam steering device also includes: steering the right-eye image to the right eye of each of the multiple passengers using one of the multiple directional lenses, and steering the left-eye image to the left eye of each of the multiple passengers using one of the multiple directional lenses.

[0020] According to another aspect, redirecting the projected holographic image to the eyes of each of the multiple passengers using the beam steering device also includes: steering the right eye image to the right eye of each of the multiple passengers using one of the multiple micro-electromechanical system (MEMS) mirrors, and steering the left eye image to the left eye of each of the multiple passengers using one of the multiple MEMS mirrors.

[0021] According to another aspect, the display includes a right-eye display and a left-eye display; and wherein encoding the holographic image onto the display of the picture generation unit (PGU) hologram generator also includes: simultaneously, encoding the right-eye image onto the right-eye display with the computing engine, and encoding the left-eye image onto the left-eye display with the computing engine; projecting the holographic image onto the beam steering device with the display also includes: simultaneously projecting the right-eye image and the left-eye image with the right-eye display and the left-eye display; and projecting the projected Redirecting the holographic image to the eyes of each of the multiple passengers also includes: simultaneously redirecting the right-eye image directly to the right eye of each of the multiple passengers and redirecting the left-eye image directly to the left eye of each of the multiple passengers, wherein the right-eye image and the left-eye image are slightly different perspectives of a single image, so that when the right eye of each of the multiple passengers receives the right-eye image, and when the left eye of each of the multiple passengers receives the left-eye image, each of the multiple passengers perceives a three-dimensional image floating within the vehicle.

[0022] Further areas of applicability will become apparent from the description provided herein.It should be understood that the description and specific examples are intended for purposes of illustration only and are not intended to limit the scope of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The drawings described herein are for illustration purposes only and are not intended to limit the scope of the present disclosure in any way.

[0024] Figure 1 is a schematic diagram of a vehicle according to an exemplary embodiment of the present disclosure;

[0025] Figure 2 is a schematic diagram of a system according to an exemplary embodiment of the present disclosure;

[0026] Figure 3 is a schematic top view of a vehicle cabin in which each of four passengers seated in the vehicle cabin can access a system according to an exemplary embodiment of the present disclosure;

[0027] Figure 4 is a front schematic diagram of two seats within a vehicle, wherein a system according to an exemplary embodiment is located between the two seats;

[0028] Figure 5 is a schematic diagram of a system according to an exemplary embodiment, wherein a beam steering apparatus includes a waveguide adapted to switch back and forth between projecting a right-eye image and projecting a left-eye image and a single display;

[0029] Figure 6 yes Figure 5 A schematic diagram of a system as shown, wherein the display includes a right-eye display and a left-eye display, which are adapted to project a right-eye image and a left-eye image simultaneously; and

[0030] Figure 7 is a schematic flow chart illustrating a method according to an exemplary embodiment of the present disclosure.

[0031] The drawings are not necessarily drawn to scale, and some features may be exaggerated or minimized, for example, to show details of a particular component. In some cases, well-known components, systems, materials, or methods are not described in detail to avoid obscuring the present disclosure. Therefore, the specific structural and functional details disclosed herein should not be interpreted as limiting, but merely as a basis for the claims and as a representative basis for teaching those skilled in the art to adopt the present disclosure in different ways. DETAILED DESCRIPTION

[0032] The following description is merely exemplary in nature and is not intended to limit the present disclosure, application or use. In addition, it is not intended to be constrained by any express or implied theory presented in the aforementioned technical field, background technology, brief invention content or the following specific embodiments. It should be understood that throughout the drawings, the corresponding reference numerals represent similar or corresponding parts and features. As used herein, the term module is to indicate any hardware, software, firmware, electronic control component, processing logic and / or processor device individually or in any combination, including but not limited to: an application-specific integrated circuit (ASIC) that executes one or more software or firmware programs, an electronic circuit, a processor (shared, dedicated or group) and a memory, a combinational logic circuit, and / or other suitable components that provide the described functions. Although the drawings shown herein depict examples with certain element arrangements, additional intermediate elements, devices, features or components may be present in actual embodiments. It should also be understood that the drawings are merely illustrative and may not be drawn to scale.

[0033] As used herein, the term "vehicle" is not limited to automobiles. Although the present technology is described primarily in conjunction with automobiles herein, the present technology is not limited to automobiles. These concepts can be used in a wide variety of applications, such as in conjunction with aircraft, ships, other vehicles, and consumer electronic components.

[0034] According to an exemplary embodiment, Figure 1 A vehicle 10 is shown with an associated system 11 for generating floating images for a plurality of passengers within the vehicle 10 in accordance with various embodiments. Generally speaking, the system 11 for generating floating images for a plurality of passengers within the vehicle 10 works in conjunction with other systems within the vehicle 10 to display various information and infotainment content for the passengers. The vehicle 10 generally includes a chassis 12, a body 14, front wheels 16, and rear wheels 18. The body 14 is disposed on the chassis 12 and substantially surrounds the components of the vehicle 10. The body 14 and the chassis 12 may together form a vehicle frame. The front wheels 16 and the rear wheels 18 are each rotatably coupled to the chassis 12 near respective corners of the body 14.

[0035] In various embodiments, the vehicle 10 is an autonomous vehicle, and the system 11 is incorporated into the autonomous vehicle 10 (hereinafter referred to as the autonomous vehicle 10). The autonomous vehicle 10 is, for example, a vehicle that is automatically controlled to transport passengers from one location to another. The autonomous vehicle 10 is depicted as a sedan in the illustrated embodiment, but it should be understood that any other vehicle may also be used, including motorcycles, trucks, sport utility vehicles (SUVs), recreational vehicles (RVs), etc. In an exemplary embodiment, the autonomous vehicle 10 is a so-called level 4 or level 5 automation system. A level 4 system represents "high automation" and refers to the driving mode-specific performance of the autonomous driving system in all aspects of dynamic driving tasks, even if the human driver does not respond appropriately to the intervention request. A level 5 system represents "full automation" and refers to the full-time performance of the autonomous driving system in all aspects of dynamic driving tasks under all road and environmental conditions that a human driver can manage.

[0036] As shown, the autonomous vehicle 10 generally includes a propulsion system 20, a transmission system 22, a steering system 24, a braking system 26, a sensor system 28, an actuator system 30, at least one data storage device 32, a controller 34, and a communication system 36. In an embodiment where the autonomous vehicle 10 is an electric vehicle, the transmission system 22 may not be present. In various embodiments, the propulsion system 20 may include an internal combustion engine, an electric motor such as a traction motor, and / or a fuel cell propulsion system. The transmission system 22 is configured to transfer power from the propulsion system 20 to the front wheels 16 and the rear wheels 18 of the vehicle according to a selectable transmission ratio. According to various embodiments, the transmission system 22 may include a stepped automatic transmission, a continuously variable transmission, or other suitable transmissions. The braking system 26 is configured to provide braking torque to the front wheels 16 and the rear wheels 18 of the vehicle. In various embodiments, the braking system 26 may include friction brakes, wire control brakes, regenerative braking systems (such as electric machines), and / or other suitable braking systems. The steering system 24 affects the position of the front wheels 16 and the rear wheels 18. Although depicted as including a steering wheel for illustrative purposes, in some embodiments contemplated within the scope of the present disclosure, the steering system 24 may not include a steering wheel.

[0037] The sensor system 28 includes one or more sensing devices 40a-40n that sense observable conditions of the external environment and / or the internal environment of the autonomous vehicle 10. The sensing devices 40a-40n may include, but are not limited to, radar, lidar, global positioning system, optical camera, thermal camera, ultrasonic sensor, and / or other sensors. The camera may include two or more digital cameras spaced a selected distance from each other, wherein the two or more digital cameras are used to obtain stereo images of the surrounding environment so as to obtain a three-dimensional image. The sensing devices 40a-40n may include sensors that monitor dynamic variables of the vehicle, such as the speed of the vehicle, the acceleration of the vehicle, the number of times the brakes are applied, etc. The actuator system 30 controls one or more vehicle 10 features, such as, but not limited to, the propulsion system 20, the transmission system 22, the steering system 24, and the braking system 26.

[0038] The vehicle controller 34 includes at least one processor 44 and a computer readable storage device or medium 46. The at least one data processor 44 can be any custom or commercially available processor, a central processing unit (CPU), a graphics processing unit (GPU), an auxiliary processor of several processors associated with the controller 34, a semiconductor-based processor, a microprocessor (in the form of a microchip or chipset), a macroprocessor, any combination thereof, or any device generally used to execute instructions. The computer readable storage device or medium 46 can include volatile and non-volatile storage devices such as read-only memory (ROM), random access memory (RAM), and keep alive memory (KAM). KAM is a persistent or non-volatile memory that can be used to store various operating variables when the at least one data processor 44 is powered off. The computer readable storage device or medium 46 may be implemented using any of a variety of known storage devices, such as a PROM (programmable read-only memory), an EPROM (electrical PROM), an EEPROM (electrically erasable PROM), flash memory, or any other electrical, magnetic, optical, or combination storage device capable of storing data (some of which represents executable instructions) used by the controller 34 in controlling the vehicle 10.

[0039] The instructions may include one or more separate programs, each of which includes an ordered list of executable instructions for implementing logical functions. When executed by at least one processor 44, the instructions receive and process signals from sensor system 28, execute logic, calculations, methods, and / or algorithms for automatically controlling components of autonomous vehicle 10, and generate control signals to actuator system 30 to automatically control components of autonomous vehicle 10 based on logic, calculations, methods, and / or algorithms. Although Figure 1 Only one controller 34 is shown, but embodiments of the autonomous vehicle 10 may include any number of controllers 34 that communicate via any suitable communication medium or combination of communication mediums and collaborate to process sensor signals, execute logic, calculations, methods and / or algorithms, and generate control signals to automatically control features of the autonomous vehicle 10.

[0040] In various embodiments, one or more instructions of the controller 34 are embodied in a trajectory planning system, and when executed by at least one data processor 44, the instructions generate trajectory outputs that solve kinematic and dynamic constraints of the environment. For example, the instructions receive as input process sensor and map data. The instructions perform a graph-based approach with a customized cost function to handle different road scenarios in both cities and highways.

[0041] The communication system 36 is configured to wirelessly communicate information to / from other remote entities 48, such as, but not limited to, other vehicles ("V2V" communication), infrastructure ("V2I" communication), remote systems, remote servers, cloud computers, and / or personal devices. In an exemplary embodiment, the communication system 36 is a wireless communication system configured to communicate via a standard wireless local area network (WLAN) using IEEE 802.11 or by using cellular data communications. However, additional or alternative communication methods such as dedicated short-range communication (DSRC) channels are also considered to be within the scope of the present disclosure. A DSRC channel refers to a unidirectional or bidirectional short- to medium-range wireless communication channel designed specifically for automotive use, as well as a set of corresponding protocols and standards.

[0042] refer to Figure 2 The system 11 for generating floating images for a plurality of passengers 50 in a vehicle 10 includes a passenger monitoring system 52 including at least one camera 54 adapted to monitor the position of the head and eyes 78R, 78L of each of the plurality of passengers 50. For purposes of description, Figure 2 The multiple passengers 50 in the vehicle are represented as including a first passenger 50A and a second passenger 50B. The passenger monitoring system 52, commonly referred to as a driver monitoring system or DMS, is a vehicle safety technology based on artificial intelligence (AI) that monitors the attention of each of the multiple passengers 50A, 50B through at least one camera 54. The purpose of the passenger monitoring system 52 is to identify passengers and detect the level of vigilance through software, and provide alarms in the event of drowsiness, distraction, etc. to avoid accidents. The main features of the DMS include driver ID, distraction detection, drowsiness detection, specific activity detection, blink detection, emotion recognition, and eye tracking. Used in the system 11 of the present disclosure, the main purpose of the driver monitoring system 52 is to monitor the position of the eyes 78R, 78L of each of the multiple passengers 50A, 50B, and to monitor the gaze direction of each of the multiple passengers 50A, 50B.

[0043] The system 11 also includes a computing engine 56 that communicates with the passenger monitoring system 52 and is adapted to compute a holographic image 58 (phase hologram) and encode the holographic image 58 onto a display 60 of a picture generation unit (GPU) hologram generator 62. The display 60 is illuminated by a light source (such as, as non-limiting examples: an RGB laser or SLED light source). When illuminated, each display pixel will generate a wavefront whose phase corresponds to the phase of the position of the hologram encoded at that pixel.

[0044] In an exemplary embodiment, the computing engine 56 is further adapted to encode the lens function into the holographic image 58 based on information received from the passenger monitoring system 52. The passenger monitoring system 52 collects information about the exact position of the eyes 78R, 78L of each of the plurality of passengers 50A, 50B and determines the appropriate focus distance 64 at which the holographic image 58 should be perceived by each of the plurality of passengers 50A, 50B, the plurality of wavefronts leaving the display 60 interfere constructively and destructively with each other so that the wavefronts reveal the image pattern of the holographic image 58 at the appropriate distance 64, which may also be tuned by encoding the lens function into the encoded holographic image. Thus, two pieces of information are encoded into the holographic image 58, namely the image information and the appropriate focus distance 64 at which each of the plurality of passengers 50A, 50B should perceive the holographic image 58 (i.e., the distance at which the wavefronts come together to form the holographic image 58). The tunability of the appropriate focus distance 64 enables the system 11 to display the holographic image 58 with a variable virtual image distance. The holographic image with a variable virtual image distance enables the system 11 to project the floating holographic image 58 to each passenger in the plurality of passengers 50A, 50B and to make the floating holographic image 58 appear closer or farther away.

[0045] As indicated by arrows 90, 92, light exiting the display 60 travels along a straight path until the light encounters a beam steering device 68. In an exemplary embodiment, the beam steering device 68 is adapted to receive information regarding the position of the head and eyes 78R, 78L of each of the plurality of passengers 50A, 50B from the passenger monitoring system 52 via the computing engine 56, and the beam steering device 68 is adapted to redirect the holographic image 58 to the eyes 78R, 78L of the passengers 50A, 50B, as indicated by arrows 94 and 96. The corneal lens of the passenger 50A, 50B Fourier transforms the hologram that creates an image on the retina of the passenger 50A, 50B. The holographic image 58 is perceived at an appropriate distance 64 from the passenger 50A, 50B (as specified by the lens function encoded into the holographic image 58) in front of each of the plurality of passengers 50A, 50B.

[0046] refer to Figure 3 In an exemplary embodiment, a system 11 is provided for each passenger 50A, 50B, 50C, 50D in a vehicle compartment 70 of the vehicle 10. As shown, the vehicle compartment 70 includes a first seat 72A occupied by a first passenger 50A, a second seat 72B occupied by a second passenger 50B, a third seat 72C occupied by a third passenger 50C, and a fourth seat 72D occupied by a fourth passenger 50D.

[0047] The first passenger 50A and the second passenger 50B include the first plurality of passengers. As shown by arrow 74A, the first camera 54A of the first passenger monitoring system 52 monitors the position of the eyes of the first passenger 50A. As shown by arrow 74B, the second camera 54B of the passenger monitoring system 52 monitors the position of the eyes of the second passenger 50B. The computing engine 56, the first PGU hologram generator 62A and the first beam steering device 68A direct the first holographic image 58 to the eyes of the first plurality of passengers (including the first passenger 50A, as shown by arrow 76A; and, including the second passenger 50B, as shown by arrow 76B). The third and fourth passengers 50C, 50D include the second plurality of passengers. As shown by arrow 74C, the third camera 54C of the passenger monitoring system 52 monitors the position of the eyes of the third passenger 50C. As shown by arrow 74B (according to the description below, it should be arrow 74D here), the fourth camera 54D of the passenger monitoring system 52 monitors the position of the eyes of the fourth passenger 50D. The computing engine 56, the second PGU hologram generator 62B and the second beam steering device 68B direct the second holographic image to the eyes of the third passenger 50C as shown by arrow 76C, and direct the second holographic image to the eyes of the fourth passenger 50D as shown by arrow 76D.

[0048] like Figure 3 As shown, a single computing engine 56 supports the first, second, third, and fourth cameras 54A, 54B, 54C, 54D, the first and second PGU hologram generators 62A, 62B, and the first and second beam steering devices 68A, 68B of the passenger monitoring system 52. It should be understood that multiple computing engines may be utilized without departing from the scope of the present disclosure.

[0049] refer to Figure 4 In an exemplary embodiment, the beam steering device 68 is mounted within the vehicle 10 adjacent to or above the passenger seats 80A, 80B opposite the plurality of passengers 50A, 50B. Figure 4 As shown, the beam steering device 68 is positioned between two seats 80A, 80B that are directly opposite the seats where the plurality of passengers 50A, 50B are seated. This positions the beam steering device 68 in a horizontal and vertical position that provides the beam steering device 68 with the best opportunity to redirect (as shown by arrow 69) the holographic image (as shown by arrow 66) from the PGU directly to the eyes 78R, 78L of each of the plurality of passengers 50A, 50B. Referring again to Figure 3, the first PGU 62A and the first beam steering device 68A providing images for the first and second passengers 50A, 50B are located between the third and fourth seats 72C, 72D for the third and fourth passengers 50C, 50D. Similarly, the second PGU 62B and the second beam steering device 68B providing images for the third and fourth passengers 50C, 50D are located between the first and second seats 72A, 72B for the first and second passengers 50A, 50B directly opposite the third and fourth passengers 50C, 50D.

[0050] It should be understood that the beam steering devices 68A, 68B can also be positioned higher up in the vehicle 10, above the first, second, third and fourth seats 72A, 72B, 72C, 72D. The main issue when placing the PGU hologram generators 62A, 62B and the beam steering devices 68A, 68B is to ensure that the passengers 50A, 50B, 50C, 50D sitting in the first, second, third and fourth seats 72A, 72B, 72C, 72D do not block the holographic image from being redirected to other passengers 50A, 50B, 50C, 50D.

[0051] Reference again Figure 2 In another exemplary embodiment, the holographic image 58 includes a right eye image (indicated by arrow 94) and a left eye image (indicated by arrow 96). The computing engine 56 is adapted to compute the right eye image and the left eye image and alternately encode the right eye image onto the display 60, as indicated by line 86, and encode the left eye image onto the display 60, as indicated by line 88, switching back and forth between encoding the right eye image and encoding the left eye image at a frequency greater than 30 Hz.

[0052] The display 60 is adapted to alternately project a right eye image, as indicated by arrow 90, and a left eye image, as indicated by arrow 92, onto the beam steering device 68 at a frequency greater than 30 Hz and synchronized with the computing engine 56. The display 60 is synchronized with the computing engine 56, wherein when the computing engine 56 encodes the right eye image onto the display 60, as indicated by arrow 90, the display 60 projects the right eye image onto the beam steering device 68, as indicated by line 86, and when the computing engine 56 encodes the left eye image onto the display 60, as indicated by arrow 92, the display 60 projects the left eye image onto the beam steering device 68, as indicated by line 88.

[0053] The beam steering device 68 is suitable for: redirecting the right eye image directly to the right eye 78R of each passenger in the multiple passengers 50A, 50B, as shown by arrow 94, and redirecting the left eye image directly to the left eye 78L of each passenger in the multiple passengers 50A, 50B, as shown by arrow 96, wherein the right eye image and the left eye image are slightly different perspectives of a single image, so that when the right eye 78R of each passenger in the multiple passengers 50A, 50B receives the right eye image of each passenger and the left eye 78L of each passenger in the multiple passengers 50A, 50B receives the left eye image, each passenger in the multiple passengers 50A, 50B perceives a three-dimensional image 58 floating within the vehicle 10.

[0054] This is called sequential time multiplexing. Sequential time multiplexing requires that the PGU 62 and the computing engine 56 be able to switch back and forth between the right eye image and the left eye image quickly enough to eliminate any image flicker that can be perceived by the viewing passenger 50. In an exemplary embodiment, the beam steering device 68 is adapted to sequentially redirect the right eye image of the holographic image 58 to the right eye 78R of each passenger in the plurality of passengers 50A, 50B, as indicated by arrow 94, in less than 33 μs. After 33 μs, the computing engine 56 and the PGU 62 switch to projecting the left eye image to the beam steering device 68, and the beam steering device 68 redirects the left eye image of the holographic image 58 to the left eye 78L, as indicated by arrow 96. In less than 33 μs, the left eye image of the holographic image 58 is redirected to the left eye 78L of each passenger in the plurality of passengers 50A, 50B.

[0055] This process is repeated, alternating between the right eye image and the left eye image in less than 33 μs. If the switching frequency between the right eye image and the left eye image is greater than 30 Hz, the plurality of passengers 50A, 50B will not perceive the flicker; and, as perceived by the passengers 50A, 50B, the right eye image and the left eye image of the holographic image 58 will be fused into one image 58.

[0056] This provides an autostereoscopic 3D display by adding binocular perception of 3D depth without the need for special headsets, glasses, anything to interfere with the viewer's vision, or anything to fit into the viewer's eyes. Because no headset is required, autostereoscopic image display is also called "naked eye 3D" or "glasses-free 3D."

[0057] refer to Figure 5In an exemplary embodiment, the beam steering device 68 includes a waveguide 102 having an exit surface 103 having a fixed wavefront curvature suitable for adjusting the focus distance 64 of the image 58. The image 58 is projected into the waveguide 102, then propagates inside the waveguide 102 and is extracted multiple times. The several recirculations of light within the waveguide 102 can expand the image so that the viewer can see the image 58 from the expanded viewing window. In addition to expanding the viewing window, the waveguide 102 can also magnify the original projected image coming out of the PGU 62.

[0058] The waveguide 102 can be a holographic waveguide that uses holographic elements as input coupling elements and output coupling elements in a symmetrical manner with a planar waveguide between the input coupling elements and the output coupling elements, or alternatively, the waveguide 102 can be such that the waveguide geometry maintains the phase of the input coupled light through the waveguide. The waveguide 102 can also be a diffractive waveguide that includes diffractive elements in place of the holographic elements present in a holographic waveguide. Further, the waveguide 102 can be a geometric waveguide that uses only coated surfaces within the waveguide 102 as input and output couplers for light to enter and leave the waveguide 102. The type of waveguide 102 used for a particular application depends on the angular acceptance and spectral transmission / reflection requirements.

[0059] In an exemplary embodiment, the right eye image passes through a right eye collimator 104 before entering the waveguide 102 of the beam steering device 68, as indicated by arrow 106, and the left eye image passes through a left eye collimator 108 before entering the waveguide 102 of the beam steering device 68, as indicated by arrow 110. The right eye collimator 104 and the left eye collimator 108 narrow the image beams (alternatingly, the right eye image and the left eye image) projected by the display 60 and couple the transformed right eye image and left eye image into the waveguide 102.

[0060] The focus distance 64 is controlled by the exit surface 103 of the waveguide 102 by adding a fixed amount of wavefront curvature to the collimated beam exiting the waveguide 102. In another exemplary embodiment, the beam steering device 68 also includes a first lens 112 adapted to further adjust the focus distance 64 of the right eye image, and a second lens 114 adapted to further adjust the focus distance 64 of the left eye image. The first lens 112 acts on the projected right eye image exiting the waveguide 102, as indicated by arrow 116, and the second lens 114 acts on the projected left eye image exiting the waveguide 102, as indicated by arrow 118. In an exemplary embodiment, the first lens 112 and the second lens 114 are liquid crystal lenses adapted to shift the focus distance 64 based on an applied voltage. In another exemplary embodiment, the first lens 112 and the second lens 114 are variable focus liquid lenses adapted to shift the apparent focus distance 64 of the holographic image 58 based on an applied voltage that varies over time.

[0061] In an exemplary embodiment, the beam steering device 68 includes a first beam splitter prism 118 adapted to redirect a right-eye image to the right eye 78R of each passenger in the plurality of passengers 50A, 50B and a second beam splitter prism 120 adapted to redirect a left-eye image to the left eye 78L of each passenger in the plurality of passengers 50B. The first beam splitter prism 118 and the second beam splitter prism 120 are multi-faceted prisms adapted to receive an incident light beam and split it, or to replicate it into a plurality of light beams. Therefore, when the display 60 projects a right-eye image, the light beam of the right-eye image enters the first splitter prism 118, as indicated by arrow 122, and is split or replicated, wherein the right-eye image is directed to the first passenger 50A, as indicated by arrow 124, and the right-eye image is directed to the second passenger 50B, as indicated by arrow 126. Further, when the display 60 projects the left eye image, the light beam of the left eye image enters the second beam splitter prism 120 as indicated by arrow 128 and is split or replicated, wherein the left eye image is directed toward the first passenger 50A as indicated by arrow 130 and the left eye image is directed toward the second passenger 50B as indicated by arrow 132.

[0062] In an exemplary embodiment, the beam steering device 68 further includes a plurality of directional lenses 134A, 134B, 134C, 134D; each of the plurality of directional lenses 134A, 134B, 134C, 134D is adapted to do one of the following: steer the right eye image to the right eye 78R of one of the plurality of passengers 50A, 50B, or steer the left eye image to the left eye 78L of one of the plurality of passengers 50A, 50B. When the beams of the right eye image and the left eye image leave the first beam splitter prism 118 and the second beam splitter prism 120, the plurality of directional lenses 134A, 134B, 134C, 134D in communication with the passenger monitoring system 52 steer the right eye image directly to the right eye 78R of each of the plurality of passengers 50A, 50B, and steer the left eye image directly to the left eye 78L of each of the plurality of passengers 50A, 50B, through the computing engine 56.

[0063] The directional lenses 134A, 134B, 134C, 134D may be any type of lens or device suitable for steering a light beam. In an exemplary embodiment, each of the directional lenses 134A, 134B, 134C, 134D is a liquid crystal lens suitable for redirecting the direction of a light beam passing through the directional lens based on an applied voltage, wherein the computing engine 56 uses data from the passenger monitoring system 52 to adjust the applied voltage and, therefore, adjust the direction of each of the plurality of directional lenses 134A, 134B, 134C, 134D in which the light beam passes.

[0064] In another exemplary embodiment, each of the directional lenses 134A, 134B, 134C, 134D is a micro-electromechanical system device. A micro-mirror device is a device based on small mirrors used in a microscope. These mirrors are micro-electromechanical systems (MEMS), which means that their state is controlled by applying a voltage between two electrodes around the mirror array. Digital micro-mirror devices are used in video projectors; and optical devices and micro-mirror devices are used for light deflection and control. Not only can the mirrors be switched between two states, but their rotation is actually continuous. Therefore, they can be used to control the intensity and direction of incident light. MEMS scanning micro-mirrors are typically composed of a silicon device with a millimeter-scale mirror in the center. The mirrors are typically connected to a flexure so that the mirrors can oscillate in a single or dual axis to project and capture light. The main advantage of using a MEMS device is that the MEMS device is very fast, allowing the direction of redirected incident light to be changed very quickly.

[0065] like Figure 5As shown, the beam steering device 68 includes four directional lenses 134A, 134B, 134C, 134D, one directional lens for the right eye 78R of each passenger in the plurality of passengers 50A, 50B, and one directional lens for the left eye 78L of each passenger in the plurality of passengers 50A, 50B. When the display 60 is projecting a right-eye image, the first directional lens 134A receives the right-eye image from the first beam splitter prism 118 and directs the right-eye image to the right eye 78R of the first passenger 50A, as indicated by arrow 124. The second directional lens 134B receives the right-eye image from the first beam splitter prism 118 and directs the right-eye image to the right eye 78R of the second passenger 50B, as indicated by arrow 126. When the display 60 is projecting a left eye image, the third directional lens 134C receives the left eye image from the second beam splitter prism 120 and directs the left eye image to the left eye 78L of the first passenger 50A, as indicated by arrow 130, and the fourth directional lens 134D receives the left eye image from the second beam splitter prism 120 and directs the left eye image to the left eye 78L of the second passenger 50B, as indicated by arrow 132.

[0066] Reference Figure 6 In another exemplary embodiment, the display 60 includes a right eye SLM 60R and a left eye display 60L. The computation engine 56 is adapted to compute a right eye image and a left eye image and simultaneously encode the right eye image to the right eye display 60R, as indicated by line 98, and encode the left eye image to the left eye display 60L, as indicated by line 100. The right eye display 60R and the left eye display 60L are adapted to simultaneously project the right eye image through the right eye collimator 104 into the waveguide 102 of the beam steering device 68, as indicated by arrow 136, and project the left eye image through the left eye collimator 108 into the waveguide 102 of the beam steering device 68, as indicated by arrow 138.

[0067] As previously described, the right eye image and the left eye image are slightly different perspectives of a single image, such that when the right eye 78R of each of the plurality of passengers 50A, 50B receives the right eye image and the left eye 78L of each of the plurality of passengers 50B receives the left eye image, the passenger's right eye 78R and left eye 78L will fuse the right eye image and the left eye image into a perceived three-dimensional holographic image 58 floating within the vehicle 10. In another exemplary embodiment, the right eye image and the left eye image are the same image, and therefore, each of the plurality of passengers 50A, 50B perceives a two-dimensional holographic image 58 floating within the vehicle 10.

[0068] refer to Figure 7, a method 200 for generating a floating image for a plurality of passengers 50 in a vehicle 10, the method comprising: starting from box 202, monitoring the positions of the heads and eyes 78R, 78L of a plurality of passengers 50A, 50B with a passenger monitoring system 52; moving to box 204, calculating a holographic image 58 with a computing engine 56 in communication with the passenger monitoring system 52, and encoding the holographic image 58 to a display 60 of a picture generation unit (PGU) hologram generator 62; moving to box 206, receiving information related to the positions of the heads and eyes 78R, 78L of the passengers from the passenger monitoring system 52 via the computing engine 56 with a beam steering device 68; moving to box 208, projecting the holographic image 58 to the beam steering device 68 with the display 60; and then moving to box 210, redirecting the projected holographic image 58 to the eyes 78R, 78 of each of the plurality of passengers 50A, 50 with the beam steering device 68 based on the information received from the passenger monitoring system 52.

[0069] In the exemplary embodiment, the method 200 also includes moving to block 212 and encoding the lens functionality into the holographic image 58 with the computing engine 56 based on the information received from the passenger monitoring system 52 .

[0070] In another exemplary embodiment, the holographic image 58 includes a right eye image and a left eye image; and, at block 204, calculating the holographic image 58 with the computing engine 56 further includes: calculating the right eye image and the left eye image with the computing engine 56. At block 212, encoding the holographic image 58 onto a display 60 of a picture generation unit (PGU) hologram generator 62 further includes: alternately encoding the right eye image onto the display 60 with the computing engine 56, and encoding the left eye image onto the display 60 with the computing engine 56, and switching back and forth between encoding the right eye image and encoding the left eye image at a frequency greater than 30 Hz. At box 208, the holographic image 58 is projected onto the beam steering device 68 using the display 60, and the right eye image and the left eye image are alternately projected onto the beam steering device 68 at a frequency greater than 30 Hz and synchronized with the computing engine 56; then, at box 210, the projected holographic image 58 is redirected to the eye 78R, 78L of each passenger in the plurality of passengers 50A, 50B using the beam steering device 68, and the right eye image is directly redirected to the plurality of passengers 50A, 50B using the beam steering device 68. , 50B, and redirecting the left eye image to the left eye 78L of each passenger in the multiple passengers 50A, 50B using the beam steering device 68, wherein the right eye image and the left eye image are slightly different perspectives of a single image, so that when the right eye 78R of each passenger in the multiple passengers 50A, 50B receives the right eye image and the left eye 78L of each passenger in the multiple passengers 50A, 50B receives the left eye image, each passenger in the multiple passengers 50A, 50B perceives a three-dimensional image floating within the vehicle 10.

[0071] In another exemplary embodiment, at box 210, the projected holographic image 58 is redirected to the eyes 78R, 78L of each passenger among the multiple passengers 50A, 50B using the beam steering device 68, and it also includes: moving to box 216, adjusting the focusing distance 64 of the holographic image 58 using the exit surface 103 of the waveguide 102 of the beam steering device 68.

[0072] In another exemplary embodiment, in box 210, the projected holographic image 58 is redirected to the eyes 78R, 78L of each passenger in the multiple passengers 50A, 50B using the beam steering device 68, and it also includes: moving to box 218, adjusting the focusing distance 64 of the right eye image of the holographic image 58 with the first lens 112, and adjusting the focusing distance 64 of the left eye image of the holographic image 58 with the second lens 114.

[0073] In another exemplary embodiment, at box 210, the projected holographic image 58 is redirected to the eyes 78R, 78L of each passenger in the multiple passengers 50A, 50B using the beam steering device 68, and it also includes: moving from box 218 to box 220, using one of the multiple directional lenses 134A, 134B, 134C, 134D to steer the right eye image to the right eye 78R of each passenger in the multiple passengers 50A, 50B, and using one of the multiple directional lenses 134A, 134B, 134C, 134D to steer the left eye image to the left eye 78L of each passenger in the multiple passengers 50A, 50B.

[0074] In another exemplary embodiment, at box 210, the projected holographic image 58 is redirected to the eyes 78R, 78L of each passenger in the multiple passengers 50A, 50B using the beam steering device 68, and also includes: moving from box 218 to box 222, using one of the multiple micro-electromechanical system (MEMS) mirrors to steer the right eye image to the right eye 78R of each passenger in the multiple passengers 50A, 50B, and using one of the multiple micro-electromechanical system mirrors to steer the left eye image to the left eye 78L of each passenger in the multiple passengers 50A, 50B.

[0075] In another exemplary embodiment, the display 60 includes a right eye display 60R and a left eye display 60L; and wherein, at block 212, encoding the holographic image 58 onto the display 60 of the picture generation unit (PGU) hologram generator 62 further includes: simultaneously encoding the right eye image onto the right eye display 60R with the computing engine 56, and encoding the left eye image onto the left eye display 60L with the computing engine 56; and, at block 208, projecting the holographic image 58 onto the beam steering device 68 with the display 60 further includes: simultaneously projecting the right eye image and the left eye image with the right eye display 60R and the left eye display 60L; and, at block 210, redirecting the projected holographic image 58 onto a plurality of passengers 5 with the beam steering device 68 0A, 50B, and further comprising: moving from box 208 to box 224, simultaneously redirecting the right eye image directly to the right eye 78R of each passenger in the multiple passengers 50A, 50, and redirecting the left eye image directly to the left eye 78L of each passenger in the multiple passengers 50A, 50, wherein the right eye image and the left eye image are slightly different perspectives of a single image, so that when the right eye 78R of each passenger in the multiple passengers 50A, 50B receives the right eye image and the left eye 78L of each passenger in the multiple passengers 50A, 50B receives the left eye image, each of the multiple passengers 50A, 50B perceives a three-dimensional image 58 floating within the vehicle.

[0076] The system 11 and method 200 of the present disclosure provide several advantages. These advantages include providing a two-dimensional or three-dimensional holographic image 58 floating within the vehicle 10 at a location in front of the plurality of passengers 50A, 50B.

[0077] The description of the present disclosure is merely exemplary in nature, and variations that do not depart from the gist of the present disclosure are intended to fall within the scope of the present disclosure. These variations should not be regarded as departing from the scheme and scope of the present disclosure.

Claims

1. A system for generating floating images for a plurality of passengers in a vehicle, the system comprising: a passenger monitoring system adapted to monitor the position of the head and eyes of each of the plurality of passengers; a computing engine in communication with the passenger monitoring system, the computing engine being adapted to compute a holographic image and encode the holographic image onto a display of a picture generation unit (PGU) hologram generator; as well as A beam steering device; wherein: the beam steering device being adapted to receive information relating to the position of the head and eyes of each of the plurality of passengers from the passenger monitoring system via the computing engine; as well as The display is adapted to project the holographic image to the beam steering device, and the beam steering device is adapted to redirect the projected holographic image to the eyes of each of the plurality of passengers based on information received from the passenger monitoring system.

2. The system according to claim 1, wherein: The computation engine is further adapted to encode a lens function into the holographic image based on information received from the passenger monitoring system.

3. The system of claim 2, wherein: The holographic image comprises a right-eye image and a left-eye image, and the computing engine is adapted to compute the right-eye image and the left-eye image, and alternately encode the right-eye image onto a display and encode the left-eye image onto a display, switching back and forth between encoding the right-eye image and encoding the left-eye image at a frequency greater than 30 Hz; The display is adapted to alternately project the right eye image and the left eye image onto the beam steering device at a frequency greater than 30 Hz and synchronized with the computing engine; as well as The beam steering device is suitable for redirecting the right eye image directly to the right eye of each of the multiple passengers and redirecting the left eye image directly to the left eye of each of the multiple passengers, wherein the right eye image and the left eye image are slightly different perspectives of a single image, so that when the right eye of each of the multiple passengers receives the right eye image and each of the multiple passengers receives the left eye image, each of the multiple passengers perceives a three-dimensional image floating within the vehicle.

4. The system according to claim 3, wherein: The beam steering device comprises a waveguide having an exit surface with a fixed wavefront curvature, the waveguide being adapted to adjust a focusing distance of the holographic image.

5. The system according to claim 4, wherein: The light beam steering device further includes: a first lens adapted to further adjust the focusing distance of the right-eye image, and a second lens adapted to further adjust the focusing distance of the left-eye image.

6. The system according to claim 4, wherein: The beam steering device includes: a first beam splitter prism, which is suitable for redirecting the right eye image to the right eye of each passenger among the multiple passengers, and a second beam splitter prism, which is suitable for redirecting the left eye image to the left eye of each passenger among the multiple passengers.

7. The system of claim 6, wherein: The beam steering device further comprises a plurality of directional lenses, each of the plurality of directional lenses being adapted to one of the following: directing the right-eye image to a right eye of one of the plurality of passengers; or The left-eye image is directed to a left eye of a passenger among the plurality of passengers.

8. The system according to claim 6, wherein: The beam steering device further comprises a plurality of micro-electromechanical system (MEMS) mirrors, each of the plurality of MEMS mirrors being adapted for one of the following: directing the right-eye image to a right eye of one of the plurality of passengers; or The left-eye image is directed to a left eye of a passenger among the plurality of passengers.

9. The system of claim 6, wherein: The display comprises a right-eye display and a left-eye display; The computing engine is adapted to compute the right-eye image and the left-eye image; and, simultaneously, encoding the right-eye image onto the right-eye display and encoding the left-eye image onto the left-eye display; as well as The right-eye display and the left-eye display are adapted to simultaneously project the right-eye image through the waveguide to the first beam-splitting prism and the left-eye image through the waveguide to the second beam-splitting prism.

10. The system according to claim 1, wherein: The light beam steering device is installed in the vehicle adjacent to passenger seats opposite to the plurality of passengers, or is installed in the vehicle above passenger seats opposite to the plurality of passengers.

Images