Autostereoscopic bonfire display
Through the combination of the passenger monitoring system and the beam steering device, automatic three-dimensional display of passengers in the vehicle is realized, solving the problems of unstable and frequent adjustment of image display in the prior art, and providing a three-dimensional image effect floating in the vehicle.
Patent Information
- Application Number
- CN202311389541.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-05-30
- Filing Date
- 2023-10-24
- Publication Date
- 2024-12-03
AI Technical Summary
The existing in-vehicle entertainment system is difficult to realize the three-dimensional image display floating in the center of the vehicle, and the beam splitter needs to be frequently adjusted to adapt to passenger position changes.
The passenger monitoring system is used to monitor the passenger's head and eye position, calculate the holographic image through the calculation engine and encode it on the spatial light modulator, and redirect the holographic image to the passenger's eye by using the beam steering device to achieve floating two-dimensional or Three-dimensional image display.
It realizes automatic three-dimensional display without headsets, provides three-dimensional images floating in the vehicle, and solves the problems of unstable image display and frequent adjustments in existing systems.
Smart Images

Figure CN119071464A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a system for generating a floating image viewable by passengers within a vehicle. Background Art
[0002] Current in-vehicle entertainment systems typically include a screen or monitor mounted within the vehicle for viewing by the passengers. Some systems include smaller individual screens, with each passenger having a screen for their personal viewing. Known systems incorporate a reverse head-up display architecture that uses a beam splitter that must be attached to a structure within the vehicle cabin and must be constantly readjusted to accommodate changes in height and position of passengers within the vehicle cabin.
[0003] While current systems achieve their intended purposes, a new and improved system is needed to provide occupants of a vehicle with a floating three-dimensional image that appears at a central location within the vehicle. Summary of the invention
[0004] According to several aspects of the present disclosure, a system for generating a floating image for a passenger in a vehicle, the system comprising: a passenger monitoring system adapted to monitor the position of a passenger's head and eyes, a computing engine communicating with the passenger monitoring system, the computing engine adapted to calculate a holographic image and encode the holographic image onto a spatial light modulator (SLM) of a picture generation unit (PGU) hologram generator, and a beam steering device, wherein the beam steering device is adapted to receive information related to the position of the passenger's head and eyes from the passenger monitoring system via the computing engine, and the SLM is adapted to project the holographic image onto the beam steering device, and the beam steering device is adapted to redirect the projected holographic image to the passenger's eyes based on the information received from the passenger monitoring system.
[0005] According to another aspect, the computing engine is further adapted to encode the lens function into the holographic image based on information received from the passenger monitoring system.
[0006] According to another aspect, the holographic image includes a single two-dimensional holographic image, and the beam steering device is adapted to simultaneously redirect the single two-dimensional holographic image directly to both the right eye and the left eye of the passenger, wherein the passenger perceives the two-dimensional holographic image floating within the vehicle in front of the passenger.
[0007] According to another aspect, the holographic image includes a single two-dimensional holographic image, and the beam steering device is adapted to alternately redirect the single two-dimensional holographic image directly only to the passenger's right eye, and then directly only to the passenger's left eye, switching back and forth between the right eye and the left eye at a frequency greater than 30 Hz, wherein the passenger perceives the two-dimensional holographic image floating within the vehicle in front of the passenger.
[0008] According to another aspect, the beam steering device is a micro-electromechanical system (MEMS) mirror.
[0009] According to another aspect, the holographic image includes a right-eye image and a left-eye image; the computing engine is adapted to compute the right-eye image and the left-eye image and alternately encode the right-eye image onto the SLM and encode the left-eye image onto the SLM, switching back and forth between encoding the right-eye image and encoding the left-eye image at a frequency greater than 30 Hz; the SLM is adapted to alternately project the right-eye image and the left-eye image onto a beam steering device at a frequency greater than 30 Hz and synchronized with the computing engine; and the beam steering device is adapted to alternately redirect the right-eye image directly to the passenger's right eye and the left-eye image directly to the passenger's left eye at a frequency greater than 30 Hz and synchronized with the computing engine and the SLM, wherein the right-eye image and the left-eye image are slightly different perspectives of a single image, so that when the passenger's right eye receives the right-eye image and the passenger's left eye receives the left-eye image, the passenger perceives a three-dimensional image floating in the vehicle in front of the passenger.
[0010] According to another aspect, the holographic image includes a right eye image and a left eye image, the SLM includes a right eye SLM and a left eye SLM, the beam steering device includes a right eye reflector and a left eye reflector, the computing engine is adapted to compute the right eye image and the left eye image, and simultaneously encode the right eye image onto the right eye SLM and encode the left eye image onto the left eye SLM, the right eye SLM and the left eye SLM are adapted so that the right eye SLM projects the right eye image onto the right eye reflector, and simultaneously the left eye SLM projects the left eye image onto the left eye reflector, and the right eye reflector is adapted to redirect the right eye image directly to the right eye of the passenger, and simultaneously the left eye reflector is adapted to redirect the left eye image directly to the left eye of the passenger, wherein the right eye image and the left eye image are slightly different perspectives of a single image, so that when the passenger's right eye receives the right eye image and the passenger's left eye receives the left eye image, the passenger perceives a three-dimensional image floating in the vehicle in front of the passenger.
[0011] According to another aspect, the beam redirecting device is mounted in the vehicle adjacent to or above a passenger seat opposite the passenger.
[0012] According to several aspects of the present disclosure, a method for generating a floating image for a passenger in a vehicle includes: monitoring the position of the passenger's head and eyes through a passenger monitoring system, calculating a holographic image through a computing engine that communicates with the passenger monitoring system and encoding the holographic image onto a spatial light modulator (SLM) of a picture generation unit (PGU) hologram generator, receiving information related to the passenger's head and eye positions from the passenger monitoring system through a beam steering device via the computing engine, and projecting the holographic image onto the beam steering device through the SLM, and redirecting the projected holographic image to the passenger's eyes through the beam steering device based on the information received from the passenger monitoring system.
[0013] According to another aspect, the method further includes encoding, by the computing engine, the lens function into the holographic image based on information received from the passenger monitoring system.
[0014] According to another aspect, calculating a holographic image by a computing engine further includes: calculating a single two-dimensional holographic image by a computing engine; and redirecting the projected holographic image to the eyes of a passenger by a beam steering device further includes: redirecting the single two-dimensional holographic image directly to the passenger's right eye and the passenger's left eye simultaneously by a beam steering device, wherein the passenger perceives the two-dimensional holographic image floating in front of the passenger within the vehicle.
[0015] According to another aspect, calculating a holographic image by a computing engine also includes: calculating a single two-dimensional holographic image by a computing engine; and redirecting the projected holographic image to the eyes of a passenger by a beam steering device, further including: redirecting the single two-dimensional holographic image directly to only the right eye of the passenger, and then redirecting it to only the left eye of the passenger alternately by the beam steering device, switching back and forth between the right eye and the left eye at a frequency greater than 30 Hz, wherein the passenger perceives the two-dimensional holographic image floating in the vehicle in front of the passenger.
[0016] According to another aspect, the holographic image includes a right eye image and a left eye image. Furthermore, calculating the holographic image by the computing engine also includes: calculating the right eye image and the left eye image by the computing engine; encoding the holographic image onto the spatial light modulator (SLM) of the picture generation unit (PGU) hologram generator, and also includes: alternately encoding the right eye image onto the SLM by the computing engine, and encoding the left eye image onto the SLM by the computing engine, and switching back and forth between encoding the right eye image and encoding the left eye image at a frequency greater than 30 Hz; projecting the holographic image onto the beam steering device by the SLM, and also includes: alternately encoding the right eye image onto the SLM at a frequency greater than 30 Hz and synchronized with the computing engine. rate, projecting the right eye image and the left eye image to the beam steering device; and redirecting the projected holographic image to the passenger's eyes through the beam steering device, also includes: alternately redirecting the right eye image directly to the passenger's right eye through the beam steering device, and redirecting the left eye image directly to the passenger's left eye through the beam steering device at a frequency greater than 30 Hz and synchronized with the computing engine and the SLM, wherein the right eye image and the left eye image are slightly different perspectives of a single image, so that when the passenger's right eye receives the right eye image and the passenger's left eye receives the left eye image, the passenger perceives a three-dimensional image floating in the vehicle in front of the passenger.
[0017] According to another aspect, the holographic image includes a right eye image and a left eye image, the SLM includes a right eye SLM and a left eye SLM, and the beam steering device includes a right eye reflector and a left eye reflector. Wherein, calculating the holographic image by the computing engine also includes: calculating the right eye image and the left eye image by the computing engine; encoding the holographic image onto a spatial light modulator (SLM) of a hologram generator of a picture generation unit (PGU), and also includes: simultaneously encoding the right eye image onto the right eye SLM by the computing engine, and encoding the left eye image onto the left eye SLM by the computing engine; projecting the holographic image onto the beam steering device by the SLM, and also includes: simultaneously projecting the right eye image onto the right eye reflector by the right eye SLM, and projecting the left eye image onto the left eye reflector by the left eye SLM; and redirecting the projected holographic image to the passenger's eyes by the beam steering device, and also includes: simultaneously redirecting the right eye image directly to the passenger's right eye by the right eye reflector, and redirecting the left eye image directly to the passenger's left eye by the left eye reflector. Among them, the right eye image and the left eye image are slightly different perspectives of a single image, so that when the passenger's right eye receives the right eye image and the passenger's left eye receives the left eye image, the passenger perceives a three-dimensional image floating in front of the passenger within the vehicle.
[0018] According to several aspects of the present disclosure, a vehicle having a system for generating a floating image for a passenger in the vehicle, the system comprising: a passenger monitoring system adapted to monitor the position of the passenger's head and eyes; a computing engine communicating with the passenger monitoring system and adapted to compute a holographic image, and encode the holographic image onto a spatial light modulator (SLM) of a picture generation unit (PGU) hologram generator, and encode a lens function into the holographic image based on information received from the passenger monitoring system; and a beam steering device. The beam steering device is adapted to receive information related to the position of the passenger's head and eyes from the passenger monitoring system via the computing engine; and the SLM is adapted to project the holographic image onto the beam steering device; and the beam steering device is adapted to redirect the projected holographic image to the passenger's eyes based on the information received from the passenger monitoring system.
[0019] Further areas of applicability will become apparent from the description provided herein.It should be understood that the description and specific examples are intended for purposes of illustration only and are not intended to limit the scope of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] The drawings described herein are for illustration purposes only and are not intended to limit the scope of the present disclosure in any way.
[0021] Figure 1 is a schematic diagram of a vehicle according to an exemplary embodiment of the present disclosure;
[0022] Figure 2 is a schematic diagram of a system according to an exemplary embodiment of the present disclosure;
[0023] Figure 3 is a schematic top view of a vehicle cabin, wherein each of four passengers seated in the vehicle cabin may access a system according to an exemplary embodiment of the present disclosure;
[0024] Figure 4 is a front schematic view of two seats in a vehicle, wherein a beam steering device of a system according to an exemplary embodiment is located between the two seats;
[0025] Figure 5 is a schematic diagram of a system according to an exemplary embodiment, wherein the beam steering device is adapted to switch back and forth between the right eye and the left eye of the passenger;
[0026] Figure 6 is a schematic diagram of a system according to an exemplary embodiment, wherein a computing engine is adapted to encode a right-eye image and a left-eye image to an SLM;
[0027] Figure 7is a schematic diagram of a system including a right-eye SLM, a left-eye SLM, a right-eye beam steering device, and a left-eye beam steering device according to an exemplary embodiment; and
[0028] Figure 8 is a schematic flow chart illustrating a method according to an exemplary embodiment of the present disclosure.
[0029] The drawings are not necessarily drawn to scale, and some features may be exaggerated or minimized, for example, to show details of a particular component. In some cases, well-known components, systems, materials, or methods are not described in detail to avoid obscuring the present disclosure. Therefore, the specific structural and functional details disclosed herein should not be interpreted as limiting, but merely as a basis for the claims and as a representative basis for teaching those skilled in the art to apply the present disclosure in various ways. DETAILED DESCRIPTION
[0030] The following description is merely exemplary in nature and is not intended to limit the present disclosure, application or use. In addition, it is not intended to be constrained by any express or implied theory presented in the aforementioned technical field, background technology, content of the invention or the following specific embodiments. It should be understood that throughout the drawings, corresponding reference numerals represent similar or corresponding components and features. As used herein, the term module refers to any hardware, software, firmware, electronic control component, processing logic and / or processor device, individually or in any combination, including but not limited to: an application-specific integrated circuit (ASIC), an electronic circuit, a processor (shared, dedicated or group) and a memory that executes one or more software or firmware programs, a combinational logic circuit, and / or other suitable components that provide the described functions. Although the drawings shown herein depict examples with specific element arrangements, additional intermediate elements, devices, features or components may be present in actual embodiments. It should also be understood that the drawings are merely illustrative and may not be drawn to scale.
[0031] As used herein, the term "vehicle" is not limited to automobiles. Although the present technology is described primarily in conjunction with automobiles herein, the technology is not limited to automobiles. These concepts can be used in a wide variety of applications, such as in conjunction with aircraft, ships, other vehicles, and consumer electronic components.
[0032] According to an exemplary embodiment, Figure 1A vehicle 10 is shown with an associated system 11 for generating floating images for passengers within the vehicle 10 in accordance with various embodiments. Generally speaking, the system 11 for generating floating images for passengers within the vehicle 10 operates in conjunction with other systems within the vehicle 10 to display various information and infotainment content for the passengers. The vehicle 10 generally includes a chassis 12, a body 14, front wheels 16, and rear wheels 18. The body 14 is disposed on the chassis 12 and substantially surrounds the components of the vehicle 10. The body 14 and the chassis 12 may together form a vehicle frame. The front wheels 16 and the rear wheels 18 are each rotatably coupled to the chassis 12 near respective corners of the body 14.
[0033] In various embodiments, the vehicle 10 is an autonomous vehicle, and the system 11 is incorporated into the autonomous vehicle 10 (hereinafter referred to as the autonomous vehicle 10). The autonomous vehicle 10 is, for example, a vehicle that is automatically controlled to transport passengers from one location to another. The autonomous vehicle 10 is depicted as a sedan in the illustrated embodiment, but it should be understood that any other vehicle may also be used, including motorcycles, trucks, sport utility vehicles (SUVs), recreational vehicles (RVs), etc. In an exemplary embodiment, the autonomous vehicle 10 is a so-called Level 4 or Level 5 automation system. The Level 4 system represents "high automation" and refers to the specific driving mode performance of the autonomous driving system in various aspects of dynamic driving tasks, even if the human driver does not respond appropriately to the intervention request. The Level 5 system represents "full automation" and refers to the full-time performance of the autonomous driving system in various aspects of dynamic driving tasks under all road and environmental conditions that the human driver can manage.
[0034] As shown, the autonomous vehicle 10 generally includes a propulsion system 20, a transmission system 22, a steering system 24, a braking system 26, a sensor system 28, an actuator system 30, at least one data storage device 32, a controller 34, and a communication system 36. In an embodiment where the autonomous vehicle 10 is an electric vehicle, the transmission system 22 may not be present. In various embodiments, the propulsion system 20 may include an internal combustion engine, an electric machine such as a traction motor, and / or a fuel cell propulsion system. The transmission system 22 is configured to transmit power from the propulsion system 20 to the front wheels 16 and the rear wheels 18 of the vehicle according to a selectable transmission ratio (speed ratio). According to various embodiments, the transmission system 22 may include a step-ratio automatic transmission, a continuously variable transmission, or other suitable transmissions. The braking system 26 is configured to provide braking torque to the front wheels 16 and the rear wheels 18 of the vehicle. In various embodiments, the braking system 26 may include friction brakes, wire control brakes, regenerative braking systems (such as electric machines), and / or other suitable braking systems. The steering system 24 affects the position of the front wheels 16 and the rear wheels 18. Although depicted as including a steering wheel for illustrative purposes, in some embodiments contemplated within the scope of the present disclosure, the steering system 24 may not include a steering wheel.
[0035] The sensor system 28 includes one or more sensing devices 40a-40n that sense observable conditions of the external environment and / or the internal environment of the autonomous vehicle 10. The sensing devices 40a-40n may include, but are not limited to, radar, lidar, global positioning system, optical camera, thermal camera, ultrasonic sensor, and / or other sensors. The camera may include two or more digital cameras spaced a selected distance from each other, wherein the two or more digital cameras are used to obtain stereo images of the surrounding environment so as to obtain a three-dimensional image. The sensing devices 40a-40n may include sensors that monitor dynamic variables of the vehicle, such as the speed of the vehicle, the acceleration of the vehicle, the number of times the brakes are applied, etc. The actuator system 30 includes one or more actuator devices 42a-42n that control one or more vehicle 10 features, such as, but not limited to, the propulsion system 20, the transmission system 22, the steering system 24, and the braking system 26.
[0036] The vehicle controller 34 includes at least one processor 44 and a computer readable storage device or medium 46. The at least one data processor 44 can be any custom or commercially available processor, a central processing unit (CPU), a graphics processing unit (GPU), an auxiliary processor of several processors associated with the controller 34, a semiconductor-based microprocessor (in the form of a microchip or chipset), a macroprocessor, any combination thereof, or any device generally used to execute instructions. The computer readable storage device or medium 46 can include volatile and non-volatile storage devices such as read-only memory (ROM), random access memory (RAM), and keep alive memory (KAM). KAM is a persistent or non-volatile memory that can be used to store various operating variables when the at least one data processor 44 is powered off. The computer readable storage device or medium 46 can be implemented using any of a variety of known storage devices, such as PROM (programmable read-only memory), EPROM (electrical PROM), EEPROM (electrically erasable PROM), flash memory, or any other electrical, magnetic, optical, or combination storage device capable of storing data (some of which represent executable instructions used by the controller 34 in controlling the vehicle 10).
[0037] The instructions may include one or more separate programs, each of which includes an ordered list of executable instructions for implementing logical functions. When the instructions are executed by at least one processor 44, the instructions receive and process signals from sensor system 28, execute logic, calculations, methods, and / or algorithms for automatically controlling components of autonomous vehicle 10, and generate control signals to actuator system 30 to automatically control components of autonomous vehicle 10 based on the logic, calculations, methods, and / or algorithms. Although Figure 1 Only one controller 34 is shown, but embodiments of the autonomous vehicle 10 may include any number of controllers 34 that communicate via any suitable communication medium or combination of communication mediums and collaborate to process sensor signals, execute logic, calculations, methods and / or algorithms, and generate control signals to automatically control features of the autonomous vehicle 10.
[0038] In various embodiments, one or more instructions of the controller 34 are included in the trajectory planning system, and when executed by at least one data processor 44, the instructions generate trajectory outputs that solve the kinematic constraints and dynamic constraints of the environment. For example, the instructions receive process sensor and map data as input. The instructions perform a graph-based approach with a customized cost function to handle different road scenarios in both cities and highways.
[0039] The communication system 36 is configured to wirelessly communicate information to / from other remote entities 48, such as, but not limited to, other vehicles ("V2V" communications), infrastructure ("V2I" communications), remote systems, remote servers, cloud computers, and / or personal devices. In an exemplary embodiment, the communication system 36 is a wireless communication system configured to communicate via a wireless local area network (WLAN) using the IEEE 802.11 standard or by using cellular data communications. However, additional or alternative communication methods such as dedicated short-range communication (DSRC) channels are also considered to be within the scope of the present disclosure. A DSRC channel refers to a unidirectional or bidirectional short- to medium-range wireless communication channel designed specifically for automotive use, as well as a set of corresponding protocols and standards.
[0040] refer to Figure 2 The system 11 for generating a floating image for a passenger 50 in a vehicle 10 includes a passenger monitoring system 52, which includes a camera 54 adapted to monitor the position of the head and eyes of the passenger 50. The passenger monitoring system 52, commonly referred to as a driver monitoring system or DMS, is a vehicle safety technology based on artificial intelligence (AI) that monitors the attention of the passenger 50 through the camera 54. The purpose of the passenger monitoring system 52 is to identify the passenger and detect the level of alertness through software, and provide alerts in case of drowsiness, distraction, etc. to avoid accidents. The main features of the DMS include driver ID, distraction detection, drowsiness detection, specific activity detection, blink detection, emotion recognition, and eye tracking. The main purpose of the driver monitoring system 52 used in the system 11 of the present disclosure is to monitor the position of the passenger 50's eyes and the direction of the passenger 50's gaze.
[0041] The system 11 also includes a computing engine 56 that communicates with the passenger monitoring system 52 and is adapted to compute a holographic image 58 (phase hologram) and encode the holographic image 58 onto a spatial light modulator (SLM) 60 of a picture generation unit (PGU) hologram generator 62. The SLM 60 is illuminated by a light source (such as, as non-limiting examples: an RGB laser or SLED light source). When illuminated, each of the SLM pixels will generate a wavefront whose phase corresponds to the phase of the position of the hologram encoded at that pixel.
[0042] In an exemplary embodiment, the computing engine 56 is also adapted to encode the lens function into the holographic image 58 based on information received from the passenger monitoring system 52. The passenger monitoring system 52 collects information about the exact position of the passenger's 50 eyes and determines the appropriate distance 64 at which the holographic image 58 should be perceived by the passenger 50. The multiple wavefronts leaving the SLM 60 interfere constructively and destructively with each other, and these wavefronts reveal the image pattern of the holographic image 58 at the appropriate distance 64, which can also be tuned by encoding the lens function into the encoded holographic image. Therefore, two pieces of information are encoded into the holographic image 58, namely the image information and the appropriate distance 64 at which the passenger 50 should perceive the holographic image 58 (i.e., the distance at which these wavefronts come together to form the holographic image 58). The tunability of the appropriate distance 64 enables the system 11 to display a holographic image with a variable virtual image distance. The holographic image with a variable virtual image distance enables the system 11 to project the floating holographic image 58 toward the passenger 50 and to make the floating holographic image 58 appear closer or farther away from the passenger 50 .
[0043] As indicated by arrow 66, light exiting the SLM 60 travels along a straight path until the light encounters a beam steering device 68. In an exemplary embodiment, the beam steering device 68 comprises a single steering mirror mounted on an adjustable gimbal. As indicated by arrow 69, the beam steering device 68 receives information from the passenger monitoring system 52 via the computing engine 56 and redirects the holographic image 58 to the eye(s) of the passenger 50. The corneal lens of the passenger 50 performs a Fourier transform on the hologram which creates an image on the retina of the passenger 50. The holographic image 58 is perceived in front of the passenger 50 at an appropriate distance 64 from the passenger 50 (as specified by the lens function encoded into the holographic image 58).
[0044] In an exemplary embodiment, the beam steering device 68 includes a micro-electromechanical system device. A micro-mirror device is a device based on microscopically small mirrors. These mirrors are micro-electromechanical systems (MEMS), which means that the state of these mirrors is controlled by applying a voltage between two electrodes around the mirror array. Digital micro-mirror devices are used in video projectors and optical and micro-mirror devices for light deflection and control. Not only can these mirrors be switched between two states, but the rotation of these mirrors is actually continuous. Therefore, these mirrors can be used to control the intensity and direction of incident light. MEMS scanning micro-mirrors are typically composed of silicon devices with millimeter-scale mirrors at the center. The mirrors are typically connected to a curved portion so that the mirrors can oscillate in a single or dual axis to project and capture light. The main advantage of using a MEMS device as the beam steering device 68 is that the MEMS device is very fast, allowing the direction of the redirected incident light to be changed very quickly.
[0045] refer to Figure 3 In an exemplary embodiment, a system 11 is provided for each passenger 50 in a vehicle compartment 70 of the vehicle 10. As shown, the vehicle compartment 70 includes a first seat 72A where a first passenger 50A sits, a second seat 72B where a second passenger 50B sits, a third seat 72C where a third passenger 50C sits, and a fourth seat 72D where a fourth passenger 50D sits.
[0046] As shown by arrow 74A, the first passenger monitoring system 54A monitors the position of the eyes of the first passenger 50A. As shown by arrow 76A, the computing engine 56, the first PGU hologram generator 62A and the first beam steering device 68A direct the first holographic image to the eyes of the first passenger 50A. As shown by arrow 74B, the second passenger monitoring system 54B monitors the position of the eyes of the second passenger 50B. As shown by arrow 76B, the computing engine 56, the second PGU hologram generator 62B and the second beam steering device 68B direct the second holographic image to the eyes of the second passenger 50B. As shown by arrow 74C, the third passenger monitoring system 54C monitors the position of the eyes of the third passenger 50C. As shown by arrow 76C, the computing engine 56, the third PGU hologram generator 62C and the third beam steering device 68C direct the third holographic image to the eyes of the third passenger 50C. As shown by arrow 74D, the fourth passenger monitoring system 54D monitors the position of the eyes of the fourth passenger 50D. As indicated by arrow 76D, the computing engine 56, the fourth PGU hologram generator 62D, and the fourth beam steering device 68D direct the fourth holographic image to the eyes of the fourth passenger 50D.
[0047] like Figure 3 As shown, a single computing engine 56 supports the first, second, third and fourth passenger monitoring systems 54A, 54B, 54C, 54D, the first, second, third and fourth PGU hologram generators 62A, 62B, 62C, 62D, and the first, second, third and fourth beam steering devices 68A, 68B, 68C, 68D. It should be understood that the first, second, third and fourth computing engines may be utilized without departing from the scope of the present disclosure.
[0048] Reference again Figure 2 In an exemplary embodiment, the holographic image 58 includes a single two-dimensional holographic image. The single two-dimensional holographic image is a large image, so that the beam steering device 68 is adapted to simultaneously redirect the single two-dimensional holographic image directly to both the right eye 78R of the passenger 50 and the left eye 78L of the passenger 50, wherein the passenger 50 perceives the two-dimensional holographic image floating within the vehicle 10 at an appropriate distance 64 in front of the passenger 50.
[0049] refer to Figure 4In an exemplary embodiment, the beam redirecting device 68 is mounted within the vehicle 10 adjacent to or above the passenger seats 80A, 80B opposite the passenger 50. Figure 4 As shown, the beam steering device 68 is positioned between two seats 80A, 80B, which are directly opposite the seats that the passengers are sitting in. This positions the beam steering device 68 in a horizontal and vertical position, which provides the best opportunity for the beam steering device 68 to redirect the holographic image directly to the eyes 78R, 78L of the passenger 50.
[0050] Reference again Figure 3 , the beam steering devices 68A, 68C are positioned between the second and fourth seats 72B, 72D, and the beam steering devices 68B, 68D are positioned between the first and third seats 72A, 72C. It should be understood that the beam steering devices 68A, 68B, 68C, 68D can also be positioned at a higher upper position in the vehicle 10, above the first, second, third and fourth seats 72A, 72B, 72C, 72D. The main issue when placing the PGU hologram generator 62A, 62B, 62C, 62D and the first, second, third and fourth beam steering devices 68A, 68B, 68C, 68D is to ensure that the passengers 50A, 50B, 50C, 50D sitting on the first, second, third and fourth seats 72A, 72B, 72C, 72D do not block the holographic image from being redirected to other passengers 50A, 50B, 50C, 50D.
[0051] refer to Figure 5 In another exemplary embodiment, the holographic image 58 includes a single two-dimensional holographic image, and the beam steering device 68 is adapted to alternately redirect the single two-dimensional holographic image 58, as indicated by arrow 82, directly only to the right eye 78R of the passenger 50; and then, as indicated by arrow 84, directly only to the left eye 78L of the passenger 50, switching back and forth between the right eye 78R and the left eye 78L at a frequency greater than 30 Hz. This is called sequential time-multiplexing. Sequential time-multiplexing requires that the beam steering device 68 is able to switch the direction of the redirected holographic image back and forth between the right eye 78R and the left eye 78L; and the speed is fast enough to eliminate any perceptible image flicker to the passenger 50 watching when viewing.
[0052] In an exemplary embodiment, the beam steering device 68 is adapted to sequentially redirect the holographic image 58 to the right eye 78R in less than 33 μs, as indicated by arrow 82. After 33 μs, the beam steering device 68 adjusts and begins redirecting the holographic image 58 to the left eye 78L, as indicated by arrow 84. The holographic image 58 is redirected to the left eye 78L in less than 33 μs. This process is repeated by alternating between redirecting the holographic image 58 to the right eye 78R in less than 33 μs and redirecting the holographic image 58 to the left eye 78L in less than 33 μs.
[0053] If the switching frequency between redirecting the holographic image 58 to the right eye 78R and the left eye 78L is greater than 30Hz, the passenger 50 will not perceive the flicker; and the holographic image 58 perceived by the right eye 78R and the left eye 78L of the passenger 50 will be fused into one image perceived by the passenger 50. A frequency of 30Hz translates to switching between the right eye 78R and the left eye 78L every 33μs. For this embodiment, the MEMS beam steering device 68 will work. The gimbal-based beam steering device 68 cannot switch the redirection direction quickly enough to avoid the passenger perceiving the switch. As a non-limiting example, the MEMS beam steering device 68 is able to switch quickly enough so that the passenger will not be aware of the switch and will perceive that they are seeing the holographic image 58 with the right eye 78R and the left eye 78L simultaneously.
[0054] refer to Figure 6 In another exemplary embodiment, the holographic image 58 includes a right eye image and a left eye image. The computing engine 56 is adapted to compute the right eye image and the left eye image and alternately encode the right eye image onto the SLM as shown by line 86 and encode the left eye image onto the SLM as shown by line 88, switching back and forth between encoding the right eye image and encoding the left eye image at a frequency greater than 30 Hz.
[0055] The SLM 60 is adapted to alternately project a right eye image onto the beam steering device 68 as indicated by arrow 90 and a left eye image onto the beam steering device 68 as indicated by arrow 92 at a frequency greater than 30 Hz and synchronized with the computing engine 56. The SLM 60 is synchronized with the computing engine 56, wherein when the computing engine 56 encodes the right eye image onto the SLM 60 as indicated by line 86, the SLM 60 projects the right eye image onto the beam steering device 68 as indicated by arrow 90; and when the computing engine 56 encodes the left eye image onto the SLM 60 as indicated by line 88, the SLM 60 projects the left eye image onto the beam steering device 68 as indicated by arrow 92.
[0056] The beam steering device 68 is adapted to alternately redirect the right eye image directly to the right eye 78R of the passenger 50, as indicated by arrow 94, and redirect the left eye image directly to the left eye 78L of the passenger 50, as indicated by arrow 96, at a frequency greater than 30 Hz and synchronized with the computing engine 56 and the SLM 60. The right eye image and the left eye image are slightly different perspectives of a single image, so that when the right eye 78R of the passenger 50 receives the right eye image and the left eye 78L of the passenger 50 receives the left eye image, the passenger 50 perceives a three-dimensional holographic image 58 floating within the vehicle 10 in front of the passenger 50.
[0057] This provides autostereoscopic 3D display by adding binocular perception of 3D depth without the need for special headsets, glasses, anything that affects the viewer's field of view, or anything for the viewer's eyes. Because no headset is required, autostereoscopic displays are also called "glasses free 3D" or "glassesless 3D".
[0058] The beam steering device 68 is synchronized with the SLM 60 and the computing engine 56, wherein when the computing engine 56 encodes a right eye image to the SLM 60 as shown by line 86, the SLM 60 projects the right eye image to the beam steering device 68 (as shown by arrow 90), and the beam steering device 68 redirects the right eye image to the right eye 78R of the passenger 50 (as shown by arrow 94). In addition, when the computing engine 56 encodes a left eye image to the SLM 60 as shown by line 88, the SLM 60 projects the left eye image to the beam steering device 68 (as shown by arrow 92), and the beam steering device 68 redirects the left eye image to the left eye 78L of the passenger (as shown by arrow 96).
[0059] For this embodiment, as a non-limiting example, the MEMS beam steering device 68 is capable of switching quickly enough that the passenger 50 will not be aware of the switch and will perceive that they are seeing the right eye image and the left eye image with the right eye 78R and the left eye 78L simultaneously, and will fuse the right eye image and the left eye image into a perceived three-dimensional holographic image 58 that floats in front of the passenger 50 within the vehicle 10.
[0060] refer to Figure 7 In another exemplary embodiment, the holographic image 58 includes a right-eye image and a left-eye image, the SLM 60 includes a right-eye SLM 60R and a left-eye SLM 60L, and the beam steering device 68 includes a right-eye reflector 68R and a left-eye reflector 68L.
[0061] The computation engine 56 is adapted to compute right-eye and left-eye images and, simultaneously, encode the right-eye image onto the right-eye SLM 60R as indicated by line 98 and encode the left-eye image onto the left-eye SLM 60L as indicated by line 100. The right-eye SLM 60R and the left-eye SLM 60L are adapted to simultaneously project the right-eye image onto the right-eye mirror 68R as indicated by arrow 102 and project the left-eye image onto the left-eye mirror 68L as indicated by arrow 104.
[0062] As non-limiting examples, both the right eye mirror 68R and the left eye mirror 68L may be gimbal mounted reflectors, MEMS devices, or any other suitable beam steering mechanism. As indicated by arrow 106, the right eye mirror 68R is adapted to redirect the right eye image directly to the right eye 78R of the passenger 50, and, simultaneously, as indicated by arrow 108, the left eye mirror 68L is adapted to redirect the left eye image directly to the left eye 78L of the passenger 50. Wherein the right eye image and the left eye image are slightly different perspectives of a single image, so that when the right eye 78R of the passenger 50 receives the right eye image and the left eye 78L of the passenger 50 receives the left eye image, the passenger's right eye 78R and left eye 78L will fuse the right eye image and the left eye image into a perceived three-dimensional holographic image 58 floating in front of the passenger 50 within the vehicle 10. In another exemplary embodiment, the right eye image and the left eye image are the same image, and thus, the passenger perceives the two-dimensional holographic image 58 floating within the vehicle 10 in front of the passenger 50 .
[0063] refer to Figure 8 , the method 200 for generating a floating image for a passenger 50 in a vehicle 10 includes: starting from box 202, monitoring the position of the head and eyes of the passenger 50 through the passenger monitoring system 52; moving to box 204, calculating a holographic image 58 through a computing engine 56 that communicates with the passenger monitoring system 52; moving to box 206, encoding the holographic image 58 onto a spatial light modulator (SLM) 60 of a picture generation unit (PGU) hologram generator 62.
[0064] Method 200 also includes: moving to box 208, receiving information related to the position of the head and eyes of the passenger 50 from the passenger monitoring system 52 through the beam steering device 68 via the computing engine 56; moving to box 210, projecting the holographic image 58 onto the beam steering device 68 through the SLM 60; moving to box 212, redirecting the projected holographic image 58 to the eyes 78R, 78L of the passenger 50 through the beam steering device 68 based on the information received from the passenger monitoring system 52.
[0065] In the exemplary embodiment, the method 200 also includes moving to block 214 and encoding, via the computing engine 56 , the lens function into the holographic image 58 based on the information received from the passenger monitoring system 52 .
[0066] In another exemplary embodiment, calculating the holographic image 58 by the computing engine 56 at block 204 also includes: calculating a single two-dimensional holographic image by the computing engine 56. And, redirecting the projected holographic image 58 to the eyes 78R, 78L of the passenger 50 by the beam steering device 68 at block 212 also includes: redirecting the single two-dimensional holographic image directly to both the passenger's right eye 78R and the passenger's left eye 78L by the beam steering device 68 simultaneously, wherein the passenger 50 perceives the two-dimensional holographic image floating in front of the passenger 50 within the vehicle 10.
[0067] In another exemplary embodiment, calculating the holographic image 58 by the computing engine 56 at block 204 also includes: calculating a single two-dimensional holographic image by the computing engine 56. And, redirecting the projected holographic image 58 to the eyes 78R, 78L of the passenger 50 by the beam steering device 68 at block 212 also includes: redirecting the single two-dimensional holographic image directly only to the right eye 78R of the passenger 50, and then directly only to the left eye 78L of the passenger 50 by the beam steering device 68, switching back and forth between the right eye 78R and the left eye 78L at a frequency greater than 30 Hz, wherein the passenger 50 perceives the two-dimensional holographic image 58 floating in front of the passenger 50 within the vehicle 10.
[0068] In another exemplary embodiment, the holographic image 58 includes a right eye image and a left eye image. Furthermore, calculating the holographic image 58 by the computing engine 56 at box 204 also includes: calculating the right eye image and the left eye image by the computing engine 56. Encoding the holographic image 58 onto the spatial light modulator (SLM) 60 of the picture generation unit (PGU) hologram generator 62 at box 206 also includes: alternately encoding the right eye image onto the SLM 60 by the computing engine 56, and encoding the left eye image onto the SLM 60 by the computing engine 56, and switching back and forth between encoding the right eye image and encoding the left eye image at a frequency greater than 30 Hz. Projecting the holographic image 58 onto the beam steering device 68 by the SLM 60 at box 210 also includes: alternately projecting the right eye image and the left eye image onto the beam steering device 68 at a frequency greater than 30 Hz and synchronized with the computing engine 56. Redirecting the projected holographic image 58 to the eyes 78R, 78L of the passenger 50 via the beam steering device 68 at block 212 also includes: redirecting the right eye image directly to the right eye 78R of the passenger 50 via the beam steering device 68, and redirecting the left eye image directly to the left eye 78L of the passenger 50 via the beam steering device 68, alternately at a frequency greater than 30 Hz and synchronized with the computing engine 56 and the SLM 60. Wherein the right eye image and the left eye image are slightly different perspectives of a single image, so that when the right eye 78R of the passenger 50 receives the right eye image and the left eye 78L of the passenger 50 receives the left eye image, the passenger 50 perceives a three-dimensional image floating in front of the passenger 50 within the vehicle 10.
[0069] In another exemplary embodiment, the holographic image 58 includes a right eye image and a left eye image, the SLM 60 includes a right eye SLM 60R and a left eye SLM 60L, and the beam steering device 68 includes a right eye mirror 68R and a left eye mirror 68L. The holographic image 58 is calculated by the calculation engine 56 at block 204, and further includes: calculating the right eye image and the left eye image by the calculation engine 56. The holographic image 58 is encoded on the spatial light modulator (SLM) 60 of the picture generation unit (PGU) hologram generator 62 at block 206, and further includes: simultaneously encoding the right eye image on the right eye SLM 60R by the calculation engine 56, and encoding the left eye image on the left eye SLM 60L by the calculation engine 56. Projecting the holographic image 58 to the beam steering device 68 at block 210 by the SLM 60 also includes: simultaneously projecting the right eye image to the right eye mirror 68R by the right eye SLM 60R, and projecting the left eye image to the left eye mirror 68L by the left eye SLM 60L. Redirecting the projected holographic image 58 to the eyes 78R, 78L of the passenger 50 by the beam steering device 68 at block 212 also includes: simultaneously redirecting the right eye image directly to the right eye 78R of the passenger 50 by the right eye mirror 68R, and directing the left eye image directly to the left eye 78L of the passenger 50 by the left eye mirror 68L. Wherein the right eye image and the left eye image are slightly different perspectives of a single image, so that when the right eye 78R of the passenger 50 receives the right eye image and the left eye 78L of the passenger 50 receives the left eye image, the passenger 50 perceives a three-dimensional image floating in front of the passenger 50 within the vehicle 10.
[0070] The system 11 and method 200 of the present disclosure provide several advantages. These advantages include providing a two-dimensional or three-dimensional holographic image floating within the vehicle 10 at a position in front of the passenger 50.
[0071] The description of the present disclosure is merely exemplary in nature, and variations that do not depart from the gist of the present disclosure are intended to fall within the scope of the present disclosure. These variations should not be regarded as departing from the spirit and scope of the present disclosure.
Claims
1. A system for generating a floating image for a passenger in a vehicle, the system comprising: a passenger monitoring system adapted to monitor the position of a passenger's head and eyes; a computing engine in communication with the passenger monitoring system and adapted to compute a holographic image and encode the holographic image onto a spatial light modulator (SLM) of a picture generation unit (PGU) hologram generator; as well as A beam steering device, wherein: the beam steering device being adapted to receive information relating to the position of the passenger's head and eyes from the passenger monitoring system via the computing engine; as well as The SLM is adapted to project the holographic image to the beam steering device, and the beam steering device is adapted to redirect the projected holographic image to the eyes of the passenger based on the information received from the passenger monitoring system.
2. The system according to claim 1, wherein: The computation engine is further adapted to encode a lens function into the holographic image based on the information received from the passenger monitoring system.
3. The system according to claim 2, wherein: The holographic image comprises a single two-dimensional holographic image, and the beam steering device is adapted to simultaneously redirect the single two-dimensional holographic image directly to both the passenger's right eye and the passenger's left eye, wherein the passenger perceives the two-dimensional holographic image floating within the vehicle in front of the passenger.
4. The system according to claim 2, wherein: The holographic image includes a single two-dimensional holographic image, and the beam steering device is adapted to alternately redirect the single two-dimensional holographic image directly only to the passenger's right eye and then only to the passenger's left eye, switching back and forth between the right eye and the left eye at a frequency greater than 30 Hz, wherein the passenger perceives the two-dimensional holographic image floating within the vehicle in front of the passenger.
5. The system according to claim 4, wherein: The beam steering device is a micro-electromechanical system (MEMS) mirror.
6. The system of claim 2, wherein: The holographic image comprises a right-eye image and a left-eye image, the computing engine being adapted to compute the right-eye image and the left-eye image, and alternately encoding the right-eye image onto the SLM and encoding the left-eye image onto the SLM, switching back and forth between encoding the right-eye image and encoding the left-eye image at a frequency greater than 30 Hz; The SLM is adapted to alternately project the right eye image and the left eye image to the beam steering device at a frequency greater than 30 Hz and synchronized with the computing engine; as well as The beam steering device is adapted to alternately redirect the right eye image directly to the passenger's right eye and the left eye image directly to the passenger's left eye at a frequency greater than 30 Hz and synchronized with the computing engine and the SLM, wherein the right eye image and the left eye image are slightly different perspectives of a single image, so that when the passenger's right eye receives the right eye image and the passenger's left eye receives the left eye image, the passenger perceives a three-dimensional image floating within the vehicle in front of the passenger.
7. The system according to claim 6, wherein: The beam steering device is a micro-electromechanical system (MEMS) mirror.
8. The system of claim 2, wherein: The holographic image includes a right-eye image and a left-eye image; The SLM includes a right-eye SLM and a left-eye SLM; The beam steering device includes a right-eye reflector and a left-eye reflector; The computation engine is adapted to compute the right-eye image and the left-eye image and to simultaneously encode the right-eye image onto the right-eye SLM and the left-eye image onto the left-eye SLM; The right-eye SLM and the left-eye SLM are adapted such that the right-eye SLM projects the right-eye image to the right-eye reflector, and simultaneously the left-eye SLM projects the left-eye image to the left-eye reflector; as well as The right-eye reflector is adapted to redirect the right-eye image directly to the passenger's right eye, and, simultaneously, the left-eye reflector is adapted to redirect the left-eye image directly to the passenger's left eye, wherein the right-eye image and the left-eye image are slightly different perspectives of a single image, such that when the passenger's right eye receives the right-eye image and the passenger's left eye receives the left-eye image, the passenger perceives a three-dimensional image floating within the vehicle in front of the passenger.
9. The system according to claim 1, wherein: The light beam steering device is installed in the vehicle near a passenger seat opposite to the passenger or above the seat.
10. A method for generating a floating image for a passenger in a vehicle, the method comprising: monitoring the position of the passenger's head and eyes via a passenger monitoring system; computing a holographic image by a computing engine in communication with the passenger monitoring system and encoding the holographic image onto a spatial light modulator (SLM) of a picture generation unit (PGU) hologram generator; receiving information related to the position of the passenger's head and eyes from the passenger monitoring system via the computing engine through the beam steering device; as well as The holographic image is projected by the SLM to the beam steering device, and the projected holographic image is redirected by the beam steering device to the eyes of the passenger based on the information received from the passenger monitoring system.
