Adaptive display configuration for autonomous driving vehicles

Abstract

A system for generating a floating image for an occupant within a vehicle includes an occupant monitoring system adapted to monitor the position of the head and eyes of the occupant, a computing engine adapted to compute and encode a holographic image to a display of a picture generating unit (PGU) hologram generator, and a display screen positioned for viewing by the occupant, the display screen is adapted to selectively switch between a first mode in which the display screen is adapted to display an image for a passenger to view and a second mode in which the display screen is adapted to serve as a light beam steering device, and when the display screen operates in the second mode, the display is adapted to project a holographic image to the display screen, and when the display screen operates in the second mode, the display is adapted to project the holographic image to the display screen. The display screen redirects the projected holographic image to the eyes of the passenger.

Description

Technical Field

[0001] The present disclosure relates to a system for generating a visible floating image for a passenger in a vehicle. Background Art

[0002] Current in-vehicle entertainment systems typically include a screen or monitor installed in the vehicle for passengers to view. Some systems include a smaller single screen, where each passenger has a screen for their personal viewing. Known systems incorporate a rear-projection head-up display architecture using a beam splitter that must be attached to a structure within the passenger compartment and must be continuously readjusted to accommodate changes in the height and position of passengers within the compartment.

[0003] Although current systems achieve their intended purpose, there is still a need for a new and improved system to provide a floating three-dimensional image located at the center of an autonomous vehicle to passengers inside the vehicle. Summary of the Invention

[0004] According to some aspects of the present disclosure, a system for generating a floating image for a passenger in a vehicle includes: a passenger monitoring system adapted to monitor the position of the passenger's head and eyes, a computing engine in communication with the passenger monitoring system and adapted to compute a holographic image and encode the holographic image to a display of a picture generation unit (PGU) hologram generator, and a display screen positioned for viewing by the passenger, the display screen being adapted to selectively switch between a first mode and a second mode, wherein, in the first mode, the display screen is adapted to display an image for the passenger to view; in the second mode, the display screen is adapted to function as a beam steering device; wherein, when the display screen operates in the second mode, based on information received from the passenger monitoring system, the display is adapted to project the holographic image onto the display screen, and the display screen is adapted to redirect the projected holographic image to the passenger's eyes.

[0005] According to another aspect, the computing engine is further adapted to encode a lens function into the holographic image based on information received from the passenger monitoring system.

[0006] According to another aspect, the display screen includes a selectively reversible electromagnetic coating, wherein when the display screen operates in the first mode, the reversible electromagnetic coating is substantially transparent, and when the display screen operates in the second mode, the reversible electromagnetic coating is reflective.

[0007] According to another aspect, the computing engine is further adapted to compute an adjustable diffraction grating and encode it into the holographic image, wherein the diffraction grating is adapted to selectively adjust the angle of the projected holographic image of the display based on feedback from the passenger monitoring system.

[0008] According to another aspect, the holographic image includes a single two-dimensional holographic image, and when the display screen operates in the second mode, it is adapted to directly redirect the single two-dimensional holographic image simultaneously to the right eye and the left eye of the passenger, wherein the passenger perceives the two-dimensional holographic image floating inside the vehicle in front of the passenger.

[0009] According to another aspect, the holographic image includes a single two-dimensional holographic image, and the diffraction grating is adapted to alternately adjust the angle of the projected holographic image, wherein when the display screen operates in the second mode, it is adapted to alternately redirect the single two-dimensional holographic image directly only to the right eye of the passenger, and then directly only to the left eye of the passenger, switching back and forth between the right eye and the left eye at a frequency greater than 30 Hz, wherein the passenger perceives the two-dimensional holographic image floating inside the vehicle in front of the passenger.

[0010] According to another aspect, the holographic image includes a right-eye image and a left-eye image, the computing engine is adapted to compute the right-eye image and the left-eye image, and alternately encode the right-eye image to the display and the left-eye image to the display, switching back and forth between encoding the right-eye image and encoding the left-eye image at a frequency greater than 30 Hz; the display is adapted to alternately project the right-eye image and the left-eye image onto the display screen through the diffraction grating at a frequency greater than 30 Hz and synchronously with the computing engine; the computing engine is adapted to alternately encode the diffraction grating in the projected right-eye image at a frequency greater than 30 Hz and synchronously with the display to adjust the angle of the projected right-eye image, such that when the display screen operates in the second mode, it redirects the right-eye image directly to the right eye of the passenger, and encode the diffraction grating in the projected left-eye image to adjust the angle of the projected left-eye image, such that when the display screen operates in the second mode, it redirects the left-eye image directly to the left eye of the passenger, wherein the right-eye image and the left-eye image are slightly different perspectives of a single image, such that when the right eye of the passenger receives the right-eye image and the left eye of the passenger receives the left-eye image, the passenger perceives a three-dimensional image floating inside the vehicle in front of the passenger.

[0011] According to another aspect, the holographic image includes a right-eye image and a left-eye image; the display includes a right-eye display and a left-eye display; the computing engine is adapted to calculate the right-eye image and the first adjustable diffraction grating, the left-eye image and the second adjustable diffraction grating, and simultaneously encode the first diffraction grating into the right-eye image, encode the right-eye image into the right-eye display, encode the second diffraction grating into the left-eye image, and encode the left-eye image into the left-eye display; the right-eye display and the left-eye display are adapted to simultaneously project the right-eye image onto the display screen and project the left-eye image onto the display screen; wherein, the first diffraction grating is adapted to adjust the angle of the right-eye image projected by the right-eye display based on the feedback of the passenger monitoring system, so that when the display screen is in the second mode, the right-eye image is directly redirected to the right eye of the passenger, and at the same time, the second diffraction grating is adapted to adjust the angle of the left-eye image projected by the left-eye display based on the feedback of the passenger monitoring system, so that when the display screen is in the second mode, the left-eye image is directly redirected to the left eye of the passenger, wherein the right-eye image and the left-eye image are slightly different perspectives of a single image, so that when the passenger's right eye receives the right-eye image and the passenger's left eye receives the left-eye image, the passenger perceives a three-dimensional image floating in the vehicle in front of the passenger.

[0012] According to another aspect, the display screen is mounted near or above the passenger seat opposite to the passenger in the vehicle.

[0013] According to some aspects of the present disclosure, a method for generating a floating image for a passenger in a vehicle includes: monitoring the position of the passenger's head and eyes through a passenger monitoring system; calculating a holographic image using a computing engine in communication with the passenger monitoring system; encoding a lens function into the holographic image using the computing engine based on information received from the passenger monitoring system; encoding the holographic image into a display of a picture generation unit (PGU) hologram generator; projecting the holographic image onto a display screen using the display, the display screen being positioned for viewing by the passenger and adapted to selectively switch between a first mode and a second mode, wherein, in the first mode, the display screen is adapted to display an image for the passenger to view; in the second mode, the display screen is adapted to be used as a beam steering device; and when the display screen operates in the second mode, redirect the projected holographic image to the passenger's eyes through the display screen based on the information received from the passenger monitoring system.

[0014] According to another aspect, the display screen includes a selectively reversible electromagnetic coating, wherein when the display screen operates in the first mode, the reversible electromagnetic coating is substantially transparent, and when the display screen operates in the second mode, the reversible electromagnetic coating is reflective. The method further includes driving the selectively reversible electromagnetic coating to cause the display screen to operate in the second mode.

[0015] According to another aspect, using a display to project a holographic image onto a display screen positioned for viewing by a passenger further includes using a computing engine to encode an adjustable diffraction grating into the holographic image and using the adjustable diffraction grating to adjust the angle of the holographic image projected by the display based on feedback from a passenger monitoring system.

[0016] According to another aspect, using a computing engine to compute a holographic image further includes using the computing engine to compute a single two-dimensional holographic image; using a display to redirect the projected holographic image to the eyes of the passenger further includes simultaneously redirecting the single two-dimensional holographic image to the right eye and the left eye of the passenger through the display screen, wherein the passenger perceives the two-dimensional holographic image floating within the vehicle in front of the passenger.

[0017] According to another aspect, using a computing engine to compute a holographic image further includes using the computing engine to compute a single two-dimensional holographic image; using an adjustable diffraction grating to adjust the angle of the holographic image projected by the display based on feedback from a passenger monitoring system further includes using the adjustable diffraction grating to alternately adjust the angle of the holographic image projected by the display based on feedback from the passenger monitoring system; using a display to redirect the projected holographic image to the eyes of the passenger further includes using the display screen to alternately redirect the single two-dimensional holographic image directly only to the right eye of the passenger and then directly only to the left eye of the passenger, switching back and forth between the right eye and the left eye at a frequency greater than 30 Hz, wherein the passenger perceives the two-dimensional holographic image floating within the vehicle in front of the passenger.

[0018] According to another aspect, the holographic image includes a right-eye image and a left-eye image. Calculating the holographic image using a computing engine further includes calculating the right-eye image and the left-eye image using the computing engine; encoding the holographic image to the display of a picture generation unit (PGU) hologram generator further includes alternately encoding the right-eye image to the display using the computing engine and encoding the left-eye image to the display using the computing engine, and switching back and forth between encoding the right-eye image and encoding the left-eye image at a frequency greater than 30 Hz; projecting the holographic image onto a display screen using the display further includes alternately projecting the right-eye image and the left-eye image through a diffraction grating onto the display screen at a frequency greater than 30 Hz and synchronously with the computing engine; redirecting the projected holographic image to the passenger's eyes using the display screen further includes alternately encoding the diffraction grating in the projected right-eye image at a frequency greater than 30 Hz and synchronously with the display to adjust the angle of the projected right-eye image such that the display screen directly redirects the right-eye image to the passenger's right eye when operating in a second mode, and encoding the diffraction grating in the projected left-eye image to adjust the angle of the projected left-eye image such that the display screen directly redirects the left-eye image to the passenger's left eye when operating in the second mode, wherein the right-eye image and the left-eye image are slightly different perspectives of a single image such that when the passenger's right eye receives the right-eye image and the passenger's left eye receives the left-eye image, the passenger perceives a three-dimensional image floating within the vehicle in front of the passenger.

[0019] According to another aspect, the holographic image includes a right-eye image and a left-eye image, the display includes a right-eye display and a left-eye display, and the PGU includes a first adjustable diffraction grating in front of the right-eye display and a second adjustable diffraction grating in front of the left-eye display. Wherein, calculating the holographic image using a computing engine further includes using the computing engine to calculate the right-eye image and the first diffraction grating, encoding the first diffraction grating into the right-eye image, using the computing engine to calculate the left-eye image and the second diffraction grating, and encoding the second diffraction grating into the left-eye image; encoding the holographic image into the display of the hologram generator of the Image Generation Unit (PGU) further includes using the computing engine to encode the right-eye image into the right-eye display, while using the computing engine to encode the left-eye image into the left-eye display; projecting the holographic image onto the display screen using the display includes simultaneously using the right-eye display and the left-eye display to project the right-eye image onto the display screen and projecting the left-eye image onto the display screen; redirecting the projected holographic image to the passenger's eyes using the display screen further includes, based on the feedback of the passenger monitoring system, simultaneously adjusting the angle of the projected right-eye image of the right-eye display through the first diffraction grating encoded therein, adjusting the angle of the projected left-eye image of the left-eye display through the second diffraction grating encoded therein based on the feedback of the passenger monitoring system, using the display screen to directly redirect the right-eye image to the passenger's right eye, and using the display screen to directly redirect the left-eye image to the passenger's left eye, wherein the right-eye image and the left-eye image are slightly different perspectives of a single image, such that when the passenger's right eye receives the right-eye image and the passenger's left eye receives the left-eye image, the passenger perceives a three-dimensional image floating inside the vehicle in front of the passenger.

[0020] Further application areas will become apparent from the description provided herein. It should be understood that these descriptions and specific examples are for illustrative purposes only and are not intended to limit the scope of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The drawings described herein are for illustrative purposes only and are not intended to limit the scope of the present disclosure in any way.

[0022] Figure 1 is a schematic diagram of a vehicle according to an exemplary embodiment of the present disclosure;

[0023] Figure 2 is a schematic diagram of two seats inside a vehicle including a system according to an exemplary embodiment;

[0024] Figure 3 is a schematic diagram of two seats inside a vehicle including a system according to an exemplary embodiment, the system including two passenger monitoring systems and two display screens;

[0025] Figure 4is a schematic diagram of a system according to an exemplary embodiment, wherein a diffraction grating and a display screen are adapted to switch back and forth between redirecting an image to a passenger's right eye and a left eye;

[0026] Figure 5 is a schematic diagram of a system according to an exemplary embodiment, wherein a computing engine is adapted to encode a right-eye image and a left-eye image to a display;

[0027] Figure 6 is a schematic diagram of a system according to an exemplary embodiment, the system including a right-eye display and a left-eye display; and

[0028] Figure 7 is a schematic flow chart illustrating a method according to an exemplary embodiment of the present disclosure.

[0029] The drawings are not necessarily drawn to scale, and some features may be exaggerated or minimized to show details of particular components. In some cases, well-known components, systems, materials, or methods are not described in detail to avoid obscuring the present disclosure. Therefore, the specific structural and functional details disclosed herein should not be interpreted as limiting, but merely as a basis for the claims and as a representative basis for teaching those skilled in the art to adopt the present disclosure in different ways. DETAILED DESCRIPTION

[0030] The following description is merely exemplary in nature and is not intended to limit the present disclosure, application or use. In addition, it is not intended to be constrained by any express or implied theory presented in the aforementioned technical field, background technology, content of the invention or the following specific embodiments. It should be understood that throughout the drawings, corresponding reference numerals represent similar or corresponding parts and features. The term "module" used herein refers to any hardware, software, firmware, electronic control component, processing logic and / or processor device, alone or in any combination, including but not limited to: application-specific integrated circuits (ASICs), electronic circuits, processors (shared, dedicated or groups) and memories that execute one or more software or firmware programs, combinational logic circuits and / or other suitable components that provide the described functions. Although the drawings shown herein depict examples with certain element arrangements, additional intermediate elements, devices, features or components may exist in actual embodiments. It should also be understood that the drawings are merely illustrative and may not be drawn to scale.

[0031] The term "vehicle" as used herein is not limited to automobiles. Although the present technology is described primarily in conjunction with automobiles herein, the present technology is not limited to automobiles. These concepts can be used in a variety of applications, such as aircraft, ships, other vehicles, and consumer electronic components.

[0032] According to an exemplary embodiment, Figure 1Vehicle 10 is shown with an associated system 11 for generating a floating image for a passenger within the vehicle 10 according to various embodiments. Generally, the system 11 for generating a floating image for a passenger within the vehicle 10 works in conjunction with other systems within the vehicle 10 to display various information and infotainment content for the passenger. The vehicle 10 generally includes a chassis 12, a body 14, front wheels 16, and rear wheels 18. The body 14 is disposed on the chassis 12 and substantially encloses the components of the vehicle 10. The body 14 and the chassis 12 may together form a frame. The front wheels 16 and the rear wheels 18 are each rotatably coupled to the chassis 12 near respective corners of the body 14.

[0033] In various embodiments, the vehicle 10 is an autonomous vehicle and the system 11 is incorporated into the autonomous vehicle 10 (hereinafter referred to as the autonomous vehicle 10). For example, the autonomous vehicle 10 is a vehicle that is automatically controlled to transport a passenger from one location to another. Although the vehicle 10 is depicted as a passenger vehicle in the illustrated embodiment, it should be understood that any other vehicle may also be used, including motorcycles, trucks, sport utility vehicles (SUVs), recreational vehicles (RVs), etc. In an exemplary embodiment, the autonomous vehicle 10 is a so-called level four or level five automation system. A level four system represents "high automation" and refers to the driving mode specific performance of the autonomous driving system in all aspects of the dynamic driving task, even if the human driver does not appropriately respond to an intervention request. A level five system represents "full automation" and refers to the full-time performance of the autonomous driving system in all aspects of the dynamic driving task under all road and environmental conditions that a human driver can manage.

[0034] As shown, the autonomous vehicle 10 generally includes a propulsion system 20, a transmission system 22, a steering system 24, a braking system 26, a sensor system 28, a drive system 30, at least one data storage device 32, a controller 34, and a communication system 36. In embodiments where the autonomous vehicle 10 is an electric vehicle, the transmission system 22 may be absent. In various embodiments, the propulsion system 20 may include an internal combustion engine, an electric motor such as a traction motor, and / or a fuel cell propulsion system. The transmission system 22 is configured to transfer power from the propulsion system 20 to the front wheels 16 and the rear wheels 18 of the vehicle according to selectable gear ratios. According to various embodiments, the transmission system 22 may include a stepped automatic transmission, a continuously variable transmission, or other suitable transmissions. The braking system 26 is configured to provide braking torque to the front wheels 16 and the rear wheels 18 of the vehicle. In various embodiments, the braking system 26 may include friction brakes, brake-by-wire, a regenerative braking system (such as an electric motor), and / or other suitable braking systems. The steering system 24 affects the position of the front wheels 16 and the rear wheels 18. Although depicted as including a steering wheel for illustrative purposes, in some embodiments contemplated within the scope of the present disclosure, the steering system 24 may not include a steering wheel.

[0035] The sensor system 28 includes one or more sensing devices 40a - 40n that sense observable conditions of the external environment and / or the internal environment of the autonomous vehicle 10. The sensing devices 40a - 40n can include, but are not limited to, radar, lidar, global positioning system, optical cameras, thermal cameras, ultrasonic sensors, and / or other sensors. The cameras can include two or more digital cameras spaced a selected distance apart from each other, where the two or more digital cameras are used to obtain a stereoscopic image of the surrounding environment in order to obtain a three - dimensional image. The sensing devices 40a - 40n can include sensors that monitor dynamic variables of the vehicle, such as the speed of the vehicle, acceleration, the number of times brakes are applied, etc. The drive system 30 includes one or more drive devices 42a - 42n that control one or more functions of the vehicle 10, such as, but not limited to, the propulsion system 20, the transmission system 22, the steering system 24, and the braking system 26.

[0036] The vehicle controller 34 includes at least one processor 44 and a computer - readable storage device or medium 46. The at least one data processor 44 can be any custom or commercially available processor, a central processing unit (CPU), a graphics processing unit (GPU), an auxiliary processor among multiple processors associated with the vehicle controller 34, a semiconductor - based microprocessor (in the form of a microchip or chipset), a macroprocessor, any combination thereof, or any device commonly used to execute instructions. The computer - readable storage device or medium 46 can include, for example, volatile and non - volatile memories such as read - only memory (ROM), random access memory (RAM), and keep - alive memory (KAM). KAM is a persistent or non - volatile memory that can be used to store various operating variables when the at least one data processor 44 is powered down. The computer - readable storage device or medium 46 can be implemented using any of a variety of known storage devices, such as PROM (programmable read - only memory), EPROM (electric PROM), EEPROM (electrically erasable PROM), flash memory, or any other electrical, magnetic, optical, or combination storage device capable of storing data used by the controller 34 in controlling the vehicle 10, where some of the data represents executable instructions.

[0037] These instructions can include one or more separate programs, each program including an ordered list of executable instructions for implementing a logical function. When executed by the at least one processor 44, the instructions receive and process signals from the sensor system 28, execute logic, calculations, methods, and / or algorithms for automatically controlling components of the autonomous vehicle 10, and generate control signals to the drive system 30 to automatically control components of the autonomous vehicle 10 based on the logic, calculations, methods, and / or algorithms. Although Figure 1Only one controller 34 is shown, and embodiments of the autonomous vehicle 10 may include any number of controllers 34 that communicate and cooperate via any suitable communication medium or combination of communication media to process sensor signals, execute logic, calculations, methods, and / or algorithms, and generate control signals to automatically control the functions of the autonomous vehicle 10.

[0038] In various embodiments, one or more instructions of the controller 34 are embodied in a trajectory planning system and, when executed by at least one data processor 44, generate a trajectory output that addresses the kinematic and dynamic constraints of the environment. For example, the instructions receive process sensor and map data as input. These instructions execute graph-based methods and custom cost functions to handle different road scenarios in urban and highway settings.

[0039] The communication system 36 is configured to wirelessly exchange information with other remote entities 48, such as but not limited to other vehicles ("V2V" communication), infrastructure ("V2I" communication), remote systems, remote servers, cloud computers, and / or personal devices. In an exemplary embodiment, the communication system 36 is a wireless communication system configured to communicate via a wireless local area network (WLAN) using the IEEE 802.11 standard or via cellular data communication. However, additional or alternative communication methods such as dedicated short-range communication (DSRC) channels are also considered within the scope of the present disclosure. A DSRC channel refers to a one-way or two-way short-to-medium-range wireless communication channel designed specifically for automotive use, as well as a corresponding set of protocols and standards.

[0040] Reference Figure 2 A system 11 for generating a floating image for a passenger 50 within the vehicle 10 includes a passenger monitoring system 52 that includes a camera 54 adapted to monitor the position of the head and eyes of the passenger 50. The passenger monitoring system 52, commonly referred to as a driver monitoring system or DMS, is an artificial intelligence (AI)-based vehicle safety technology that monitors the attention of the passenger 50 via the camera 54. The purpose of the passenger monitoring system 52 is to identify the passenger and detect the level of vigilance through software and provide alerts in cases of drowsiness, distraction, etc. to avoid accidents. The main functions of the DMS are driver ID, distraction detection, drowsiness detection, specific activity detection, blink detection, emotion recognition, and eye tracking. The main purpose of the driver monitoring system 52 used within the system 11 of the present disclosure is to monitor the position of the eyes and head of the passenger 50 and the direction of the passenger 50's gaze.

[0041] System 11 also includes a computing engine 56 that communicates with system controller 34A and the passenger monitoring system 52. System controller 34A can be the vehicle controller 34 or can be a separate controller that communicates with the vehicle controller and is adapted to support communication between system 11 and other systems within vehicle 10 and receive data from sensors 40a - 40n within vehicle 10. The computing engine is adapted to compute a holographic image 58 (phase hologram) and encode the holographic image 58 to a display 60 of a picture generation unit (PGU) hologram generator 62. The display 60 can be any display adapted to project the holographic image. In an exemplary embodiment, the display 60 includes a spatial light modulator (SLM) illuminated by a light source, for example, as a non - limiting example, an RGB laser or an SLED light source. When illuminated, each SLM pixel will generate a wavefront, the phase of which corresponds to the phase of the position of the hologram encoded at the pixel.

[0042] In an exemplary embodiment, the computing engine 56 is also adapted to encode a lens function into the holographic image 58 based on information received from the passenger monitoring system 52. The passenger monitoring system 52 collects information about the exact position of the eyes of the passenger 50, as shown by line 53, and determines an appropriate distance 64 at which the passenger 50 should perceive the holographic image 58. Multiple wavefronts leaving the SLM of the display 60 interfere constructively and destructively with each other, thus presenting an image pattern of the holographic image 58 at the appropriate distance 64, which can also be adjusted by encoding the lens function into the encoded holographic image. Thus, two pieces of information are encoded into the holographic image 58, namely the image information and the appropriate distance 64 (the distance at which the wavefronts come together to form the holographic image 58) at which the passenger 50 should perceive the holographic image 58. The adjustability of the appropriate distance 64 allows system 11 to display a holographic image with a variable virtual image distance. A holographic image with a variable virtual image distance allows system 11 to project a floating holographic image 58 to the passenger 50 and enables the floating holographic image 58 to appear closer or farther from the passenger 50.

[0043] The light leaving the display 60 travels along a straight - line path, as shown by arrow 66, until it encounters the display screen 68. In an exemplary embodiment, the display screen 68 is one of the known types of display screens used inside the vehicle 10 and is typically connected to the infotainment system within the vehicle 10 to provide video entertainment for the passengers 50 within the vehicle 10. The display screen 68 is positioned for viewing by the passenger 50 and is typically positioned above or near the seat opposite the passenger 50. As Figure 2As shown, passenger 50 is sitting in the first seat 70A inside the passenger compartment of the autonomous vehicle 10, and the display screen 68 is located above the second seat 70B opposite the first seat 70A. The display screen 68 can be mounted on the structural components of the seats inside the passenger compartment or on the structural components of the vehicle 10 itself. For example, it can be mounted on the roof of the vehicle 10 and hang down for the passenger 50 to view. Similar to the prior art, the display screen 68 can be retracted or folded up when not in use.

[0044] The display screen 68 is adapted to operate in a first mode, in which the display screen 68 displays images and videos for the passenger 50 to view. The display screen 68 is also adapted to operate in a second mode, in which the display screen 68 serves as a beam steering device. The display screen is adapted to selectively switch between operating in the first mode and the second mode. When operating in the second mode, the display screen 68 becomes reflective, and at the same time, the holographic image projected by the display 60, as shown by line 66, hits the display screen 68 and is redirected (reflected) to the passenger's eyes 50, as shown by line 72. The Fourier transform of the passenger's 50 corneal lens hologram generates an image on the passenger's 50 retina. The holographic image 58 is perceived in front of the passenger 50 at an appropriate distance 64 from the passenger 50, as specified by the lens function encoded into the holographic image 58.

[0045] In an exemplary embodiment, the display screen 68 includes a selectively reversible electromagnetic coating 74. When the display screen 68 operates in the first mode, the reversible electromagnetic coating 74 is substantially transparent, and when the display screen 68 operates in the second mode, the reversible electromagnetic coating 74 is reflective. In an exemplary embodiment, the reversible electromagnetic coating 74 is an electrochemically optically modulating device with a reversible transformation. In the first mode, the reversible electromagnetic coating 74 can act as a transparent glass, where the display screen 68 can be used as an ordinary display screen 68, and the reversible electromagnetic coating 74 can act as a mirror. In the second mode, the holographic image projected by the display 60 is reflected to the passenger 50, as shown by arrow 72.

[0046] In an exemplary embodiment, the electrochromic coating 74 includes an electrolyte solution filled between two transparent electrodes within metal ions. The potential applied between the two electrodes controls the amount of metal deposited on the electrodes and thus controls the reflectivity / transmittance of the electrochromic coating 74. A negative potential on the first electrode relative to the second electrode causes ionic particles to deposit on the first electrode and dissolve from the second electrode, which makes the electrochromic coating 74 reflective. The reflectivity can be as high as 100%. Reversing the polarity of the potential causes metal ions to deposit on the second electrode and dissolve from the first electrode. As a result, the reflectivity of the electrochromic coating 74 decreases, possibly to zero, and the electrochromic coating 74 becomes substantially transparent. The system controller 34A communicating with the display screen 68 via the computing engine 56 can selectively switch the display screen 68 between a first operating mode and a second operating mode by controlling the voltage applied to the electrochromic coating 74.

[0047] In an exemplary embodiment, the PGU 62 includes an adjustable diffraction grating 76 encoded into the holographic image 58, wherein the angle of the projected holographic image 58 is adjusted by the diffraction grating 76 encoded therein. The adjustable diffraction grating 76 is calculated by the computing engine 56 based on the feedback of the passenger monitoring system 52 and encoded into the holographic image 58 by the computing engine 56 to selectively adjust the angle of the projected holographic image of the display 60. The passenger monitoring system 52 identifies the positions and orientations of the heads and eyes 78R and 78L of the passengers 50. The system controller 34A and the computing engine 56 calculate the angle of incidence at which the projected holographic image must strike the display screen 68 based on the data of the passenger monitoring system 52 and the position and orientation of the display screen 68 so that the projected holographic image will be reflected by the display screen 68 to the eyes 78R and 78L of the passengers 50. This information is used by the system controller 34A and the computing engine 56 to selectively calculate the diffraction grating 76, thereby adjusting the angle of the projected holographic image to ensure that the holographic image is correctly reflected by the display screen 68 to the eyes 78R and 78L of the passengers 50.

[0048] Reference Figure 3, in an exemplary embodiment, system 11 is used by multiple passengers 50A and 50B within vehicle 10. As shown, the passenger compartment includes a first seat 70A where the first passenger 50A is seated and a second seat 70B where the second passenger 50B is seated. The camera 54A of the first passenger monitoring system 52A monitors the position of the eyes of the first passenger 50A, as indicated by arrow 53A. The computing engine 56, the first PGU hologram generator 62A, and the first display 68A direct the first holographic image towards the eyes of the first passenger 50A, as indicated by arrows 66A and 72A. The second passenger monitoring system 54B monitors the position of the eyes of the second passenger 50B, as indicated by arrow 53B. The computing engine 56, the second PGU hologram generator 62B, and the second display 68B direct the second holographic image towards the eyes of the second passenger 50B, as indicated by arrows 66B and 72B.

[0049] As Figure 3 shown, a single computing engine 56 supports the first and second passenger monitoring systems 54A, 54B, the first and second PGU hologram generators 62A, 62B, and the first and second displays 68A, 68B. It should be understood that multiple computing engines may be used without departing from the scope of the present disclosure.

[0050] Referring again to Figure 2 , in an exemplary embodiment, the holographic image 58 includes a single two-dimensional holographic image. The single two-dimensional holographic image is a large image such that the display 68 is adapted to directly and simultaneously redirect the single two-dimensional holographic image towards the right eye 78R and the left eye 78L of the passenger 50. Therein, the passenger 50 perceives the two-dimensional holographic image floating within the vehicle 10 at an appropriate distance 64 in front of the passenger 50.

[0051] Referring to Figure 4, in another exemplary embodiment, the holographic image 58 includes a single two-dimensional holographic image, and the adjustable diffraction grating 76 is adapted to alternately adjust the angle of the projected holographic image. The system 11 switches back and forth between projecting a single two-dimensional holographic image whose angle is adjusted by the diffraction grating 76 from the display 60 and the display screen 68, as shown by the arrow 80, wherein the display screen 68 redirects the single two-dimensional holographic image 58 only directly to the right eye 78R of the passenger 50, as shown by the arrow 82, and then projects the single two-dimensional holographic image from the display 60, whose angle is adjusted by the diffraction grating 76, and projects it onto the display screen 68, as shown by the arrow 84, wherein the display screen 68 redirects the single two-dimensional holographic image 58 only directly to the left eye 78L of the passenger 50, as shown by the arrow 86. The system 11 switches back and forth between the right eye 78R and the left eye 78L at a frequency greater than 30 Hz. This is called sequential time-division multiplexing. Sequential time-division multiplexing requires the computing engine to be able to calculate the diffraction grating and encode the diffraction grating within the holographic image so as to alternately adjust the angle of the projected holographic image of the display 60 between the right eye 78R and the right eye 78R fast enough to eliminate any perceptible image flicker for the viewing passenger 50.

[0052] In an exemplary embodiment, the computing engine alternately calculates and encodes the diffraction grating 76 to sequentially adjust the angle of the projected holographic image 58 such that the display screen 68 redirects the holographic image to the right eye 78R, as shown by the arrows 80 and 82, in less than 33 milliseconds. After 33 milliseconds, the computing engine recalculates and encodes the diffraction grating 76, and the diffraction grating 76 adjusts the angle of the projected holographic image 58 such that the display screen 68 redirects the holographic image to the left eye 78L, as shown by the arrows 84 and 86. The holographic image 58 is redirected to the left eye 78L in less than 33 milliseconds. This process is repeated by alternating between redirecting the holographic image 58 to the right eye 78R (in less than 33 milliseconds) and redirecting the holographic image 58 to the left eye 78L (in less than 33 milliseconds).

[0053] If the switching frequency between redirecting the holographic image 58 to the right eye 78R and the left eye 78L is greater than 30 Hz, the passenger 50 will not feel the flicker, and the holographic image 58 perceived by the right eye 78R and the left eye 78L of the passenger 50 will fuse into one image as perceived by the passenger 50. A frequency of 30 Hz is equivalent to switching between the right eye 78R and the left eye 78L once every 33 milliseconds.

[0054] Reference Figure 5, in another exemplary embodiment, the holographic image 58 includes a right-eye image and a left-eye image. The computing engine 56 is adapted to compute the right-eye image and the left-eye image, and alternately encode the right-eye image to the display 60 of the PGU 62, as shown by line 88, and encode the left-eye image to the display 60 of the PGU 62, as shown by line 90, switching back and forth between encoding the right-eye image and encoding the left-eye image at a frequency greater than 30 Hz.

[0055] The display 60 is adapted to alternately project the right-eye image to the display screen 68 at a frequency greater than 60 Hz and in synchronization with the computing engine 56, as shown by arrow 92, and project the left-eye image to the display screen 68, as shown by arrow 94. The diffraction grating 76 is adapted to alternately adjust the angle of the projected right-eye image at a frequency greater than 30 Hz and in synchronization with the computing engine 56 and the display 60 such that when the display screen 68 is in the second mode, the right-eye image is directly redirected to the right eye 78R of the passenger 50, and adjust the angle of the projected left-eye image such that when the display screen 68 is in the second mode, the left-eye image is redirected to the left eye 78L of the passenger 50.

[0056] The diffraction grating 76, the display 60, and the computing engine 56 are all synchronized with each other. When the computing engine 56 encodes the right-eye image to the display 60, as shown by line 88, the display 60 projects the right-eye image whose angle is adjusted by the diffraction grating 76 to the display screen 68, as shown by the arrow 92, and the display screen 68 redirects the right-eye image to the right eye 78R of the passenger 50, as shown by line 96. When the computing engine 56 encodes the left-eye image to the display 60, as shown by line 90, the display 60 projects the left-eye image whose angle is adjusted by the diffraction grating 76 to the display screen 68, as shown by arrow 94, and the display screen 68 redirects the left-eye image to the left eye 78L of the passenger 50, as shown by line 98.

[0057] The right-eye image and the left-eye image are slightly different perspectives of a single image such that when the right eye 78R of the passenger 50 receives the right-eye image and the left eye 78L of the passenger 50 receives the left-eye image, the passenger 50 perceives a three-dimensional holographic image 58 floating within the vehicle 10 in front of the passenger 50.

[0058] An autostereoscopic three-dimensional display is provided by adding binocular perception of three-dimensional depth without using special head-mounted devices, glasses, things that affect the viewer's vision, or any items that fit over the viewer's eyes. Since no head-mounted device is required, the autostereoscopic display is also referred to as "naked-eye 3D" or "glasses-free 3D".

[0059] Reference Figure 6, in another exemplary embodiment, the holographic image 58 includes a right-eye image and a left-eye image, and the PGU 62 includes a right-eye display 60R and a left-eye display 60L. The computing engine 56 is adapted to compute the right-eye image and the left-eye image, and simultaneously encode the right-eye image to the right-eye display 60R, as shown by line 100, and encode the left-eye image to the left-eye display 60L, as shown by line 102.

[0060] The right-eye image includes a first adjustable diffraction grating 76R encoded therein, and the left-eye image includes a second adjustable diffraction grating 76L encoded therein. The right-eye display 60R and the left-eye display 60L are adapted to project the right-eye image adjusted by the angle of the first diffraction grating 76R onto the display screen 68, as shown by arrow 104, while projecting the left-eye image adjusted by the angle of the second diffraction grating 76L onto the display screen 68, as shown by arrow 106.

[0061] The first diffraction grating 76R is computed by the computing engine 56 to selectively adjust the angle of the projected right-eye image of the right-eye display 60R based on the feedback of the passenger monitoring system 52, so that when the display screen 68 is in the second mode, the right-eye image is directly redirected to the right eye 78R of the passenger 50, as shown by arrow 108. At the same time, the second diffraction grating 76L is computed by the computing engine 56 to selectively adjust the angle of the projected left-eye image of the left-eye display 60L based on the feedback of the passenger monitoring system 52, so that when the display screen 68 is in the second mode, the left-eye image is directly redirected to the left eye 78L of the passenger 50, as shown by arrow 110.

[0062] The right-eye image and the left-eye image are slightly different perspectives of a single image, such that when the right eye 78R of the passenger 50 receives the right-eye image and the left eye 78L of the passenger 50 receives the left-eye image, the right eye 78R and the left eye 78L of the passenger fuse the right-eye image and the left-eye image into a perceived three-dimensional holographic image 58 floating within the vehicle 10 in front of the passenger 50. In another exemplary embodiment, the right-eye image and the left-eye image are the same image, and thus, the passenger perceives a two-dimensional holographic image 58 floating within the vehicle 10 in front of the passenger 50.

[0063] Reference Figure 7 , a method 200 for generating a floating image for a passenger 50 within a vehicle 10 includes, starting from block 202, monitoring the position of the head and eyes of the passenger 50 using a passenger monitoring system 52, proceeding to block 204, computing a holographic image 58 using a computing engine 56 in communication with the passenger monitoring system 52, proceeding to block 206, encoding a lens function into the holographic image 58 using the computing engine 56 based on information received from the passenger monitoring system 52, and proceeding to block 208, encoding the holographic image 58 to the display 60 of a picture generation unit (PGU) hologram generator 62.

[0064] Proceeding to block 210, method 200 further includes using display 60 to project holographic image 58 onto display screen 68, which is positioned for viewing by passenger 50 and is adapted to selectively switch between a first mode and a second mode, wherein in the first mode, display screen 68 is adapted to display an image for viewing by passenger 50; and in the second mode, display screen 68 is adapted to function as a beam steering device.

[0065] Proceeding to block 212, method 200 further includes, when display screen 68 operates in the second mode, redirecting the projected holographic image 58 through display screen 68 to the eyes 78R and 78L of passenger 50 based on information received from passenger monitoring system 52.

[0066] In an exemplary embodiment, display screen 68 includes a selectively reversible electromagnetic coating 74, wherein when display screen 68 operates in the first mode, the reversible electromagnetic coating 74 is substantially transparent, and when display screen 68 operates in the second mode, the reversible electromagnetic coating 74 is reflective. Method 200 further includes, proceeding to block 214, driving the selectively reversible electromagnetic coating 74 to cause display screen 68 to operate in the second mode.

[0067] In another exemplary embodiment, using display 60 to project holographic image 58 onto display screen 68 positioned for viewing by the passenger at block 210 further includes selectively adjusting the angle of the projected holographic image 58 of display 60 based on feedback from passenger monitoring system 52 using tunable diffraction grating 76 encoded within holographic image 58.

[0068] In another exemplary embodiment, using computing engine 56 to compute holographic image 58 at block 204 further includes using computing engine 56 to compute a single two-dimensional holographic image, and using display screen 68 to redirect the projected holographic image 58 to the eyes 78R and 78L of passenger 50 at block 212 further includes directly and simultaneously redirecting the single two-dimensional holographic image 58 through display screen 68 to the right eye 78R and the left eye 78L of passenger 50, wherein passenger 50 perceives the two-dimensional holographic image 58 floating within vehicle 10 in front of passenger 50.

[0069] In another exemplary embodiment, calculating the holographic image 58 using the computing engine 56 at block 204 further includes calculating a single two-dimensional holographic image using the computing engine 56; selectively adjusting the angle of the projected holographic image 58 of the display screen 60 using the tunable diffraction grating 76 encoded within the holographic image 58 based on the feedback of the passenger monitoring system 52 at block 216 further includes alternately adjusting the angle of the projected holographic image 58 of the display screen 60 using the tunable diffraction grating 76 encoded within the holographic image 58 based on the feedback of the passenger monitoring system 52; redirecting the projected holographic image 58 to the eyes 78R and 78L of the passenger 50 using the display screen 68 at block 212 further includes alternately using the beam steering device 68 to directly redirect the single two-dimensional holographic image only to the right eye 78R of the passenger 50, and then only to the left eye 78L of the passenger 50, switching back and forth between the right eye 78R and the left eye 78L at a frequency greater than 30 Hz, wherein the passenger 50 perceives the two-dimensional holographic image 58 floating within the vehicle 10 in front of the passenger 50.

[0070] In another exemplary embodiment, the holographic image 58 includes a right-eye image and a left-eye image, and calculating the holographic image 58 using the computing engine 56 at block 204 further includes calculating the right-eye image and the left-eye image using the computing engine 56. Encoding the holographic image 58 into the display 60 of the picture generation unit (PGU) hologram generator 62 at block 208 further includes alternately encoding the right-eye image into the display 60 using the computing engine 56 and encoding the left-eye image into the display 60 using the computing engine 56, and switching back and forth between encoding the right-eye image and encoding the left-eye image at a frequency greater than 30 Hz. Projecting the holographic image 58 onto the display screen 68 using the display 60 at block 210 further includes alternately projecting the right-eye image and the left-eye image onto the display screen 68 at a frequency greater than 30 Hz and synchronized with the computing engine 56.

[0071] Redirecting the projected holographic image 58 to the eyes 78R and 78L of the passenger 50 using the display screen 68 at block 212 further includes alternately adjusting the angle of the projected right-eye image using the diffraction grating 76 encoded within the holographic image 58 at a frequency greater than 30 Hz and synchronized with the computing engine 56 and the display 60, using the display screen 68 to directly redirect the right-eye image to the right eye 78R of the passenger 50, adjusting the angle of the projected left-eye image using the diffraction grating 76 encoded within the holographic image 58, and using the display screen 68 to directly redirect the left-eye image to the left eye 78L of the passenger 50. The right-eye image and the left-eye image are slightly different perspectives of a single image, such that when the right eye 78R of the passenger 50 receives the right-eye image and the left eye 78L of the passenger 50 receives the left-eye image, the passenger 50 perceives a three-dimensional image floating within the vehicle 10 in front of the passenger 50.

[0072] In another exemplary embodiment, the holographic image 58 includes a right-eye image and a left-eye image, the display 60 includes a right-eye display 60R and a left-eye display 60L, the right-eye image includes a first adjustable diffraction grating 76R encoded therein, and the left-eye image includes a second adjustable diffraction grating 76L encoded therein. Calculating the holographic image 58 using the computing engine 56 at block 204 further includes calculating the right-eye image and the left-eye image using the computing engine 56. Encoding the holographic image 58 to the display 60 of the Picture Generation Unit (PGU) hologram generator 62 at block 208 further includes encoding the right-eye image to the right-eye display 60R using the computing engine 56 while encoding the left-eye image to the left-eye display 60L using the computing engine 56. Projecting the holographic image 58 to the display screen 68 using the display 60 at block 210 further includes projecting the right-eye image adjusted by the angle of the first diffraction grating 76R to the display screen 68 using the right-eye display 60R and the left-eye display 60L, while projecting the left-eye image adjusted by the angle of the second diffraction grating 76L to the display screen 68.

[0073] Redirecting the projected holographic image 58 to the eyes 78R and 78L of the passenger 50 using the display screen 68 at block 212 further includes adjusting the angle of the projected right-eye image of the right-eye display 60R based on the feedback of the passenger monitoring system 52 using the first diffraction grating 76R, adjusting the angle of the projected left-eye image of the left-eye display 60L based on the feedback of the passenger monitoring system 52 using the second diffraction grating 76L, redirecting the right-eye image directly to the right eye 78R of the passenger 50 using the display screen 68, and redirecting the left-eye image directly to the left eye 78L of the passenger 50 using the display screen 68, wherein the right-eye image and the left-eye image are slightly different perspectives of a single image, such that when the right eye 78R of the passenger 50 receives the right-eye image and the left eye 78L of the passenger 50 receives the left-eye image, the passenger 50 perceives a three-dimensional image floating within the vehicle 10 in front of the passenger 50.

[0074] The systems 11 and methods 200 of the present disclosure have several advantages. These include providing a two-dimensional or three-dimensional holographic image floating at a position in front of the passenger 50 within the vehicle 10. Further, the systems of the present disclosure allow for the modification of existing display screens within the vehicle using an electrochemical coating, thereby allowing the display screen to be used in a first mode or a second mode.

[0075] The description of the present disclosure is merely exemplary in nature, and variations that do not depart from the gist of the present disclosure are intended to fall within the scope of the present disclosure. These variations should not be regarded as departing from the spirit and scope of the present disclosure.

Claims

1. A system for generating a floating image for a passenger in a vehicle, comprising: A passenger monitoring system adapted to monitor the positions of the passenger's head and eyes; A computing engine in communication with the passenger monitoring system and adapted to compute a holographic image and encode the holographic image to a display of a picture generation unit (PGU) hologram generator; And A display screen positioned for the passenger to view, the display screen being adapted to selectively switch between a first mode and a second mode, wherein, in the first mode, the display screen is adapted to display an image for the passenger to view; in the second mode, the display screen is adapted to function as a beam steering device; Wherein, when the display screen operates in the second mode, based on information received from the passenger monitoring system, the display is adapted to project the holographic image onto the display screen, and the display screen is adapted to redirect the projected holographic image to the passenger's eyes.

2. The system according to claim 1, wherein, The computing engine is further adapted to encode a lens function into the holographic image based on information received from the passenger monitoring system.

3. The system according to claim 2, wherein, The display screen includes a selectively reversible electromagnetic coating, wherein, when the display screen operates in the first mode, the reversible electromagnetic coating is substantially transparent, and when the display screen operates in the second mode, the reversible electromagnetic coating is reflective.

4. The system according to claim 2, wherein The computing engine is further adapted to compute an adjustable diffraction grating and encode it into the holographic image, wherein the diffraction grating is adapted to selectively adjust the angle of the projected holographic image of the display based on feedback from the passenger monitoring system.

5. The system according to claim 4, wherein The holographic image includes a single two-dimensional holographic image, and when the display screen operates in the second mode, the display screen is adapted to directly and simultaneously redirect the single two-dimensional holographic image to the passenger's right eye and the passenger's left eye, wherein the passenger perceives the two-dimensional holographic image floating in the vehicle in front of the passenger.

6. The system according to claim 4, wherein, The holographic image includes a single two-dimensional holographic image, and the diffraction grating is adapted to alternately adjust the angle of the projected holographic image, wherein when the display screen operates in the second mode, the display screen is adapted to alternately redirect the single two-dimensional holographic image directly only to the passenger's right eye and then only to the passenger's left eye, switching back and forth between the right eye and the left eye at a frequency greater than 30 Hz, wherein the passenger perceives the two-dimensional holographic image floating in the vehicle in front of the passenger.

7. The system according to claim 4, wherein: The holographic image includes a right-eye image and a left-eye image, the computing engine is adapted to compute the right-eye image and the left-eye image, and alternately encode the right-eye image to the display and encode the left-eye image to the display, switching back and forth between encoding the right-eye image and encoding the left-eye image at a frequency greater than 30 Hz; The display is adapted to alternately project the right-eye image and the left-eye image through the diffraction grating onto the display screen at a frequency greater than 30 Hz and in synchronization with the computing engine; And The computing engine is adapted to alternately encode a diffraction grating within the projected right-eye image at a frequency greater than 30 Hz and synchronized with the display to adjust the angle of the projected right-eye image such that the display screen redirects the right-eye image directly to the passenger's right eye when operating in the second mode, and to encode a diffraction grating within the projected right-eye image to adjust the angle of the projected left-eye image such that the display screen redirects the left-eye image directly to the passenger's left eye when operating in the second mode, wherein the right-eye image and the left-eye image are slightly different perspectives of a single image such that when the passenger's right eye receives the right-eye image and the passenger's left eye receives the left-eye image, the passenger perceives a three-dimensional image floating within the vehicle in front of the passenger.

8. The system according to claim 2, wherein: The holographic image includes a right-eye image and a left-eye image; The display includes a right-eye display and a left-eye display; The computing engine is adapted to calculate the right-eye image and a first adjustable diffraction grating, the left-eye image and a second adjustable diffraction grating, and simultaneously encode the first diffraction grating into the right-eye image, encode the right-eye image into the right-eye display, encode the second diffraction grating into the left-eye image, and encode the left-eye image into the left-eye display; The right-eye display and the left-eye display are adapted to simultaneously project the right-eye image onto the display screen and project the left-eye image onto the display screen; And wherein the first diffraction grating is adapted to adjust the angle of the projected right-eye image of the right-eye display based on feedback from the passenger monitoring system such that the display screen directly redirects the right-eye image to the passenger's right eye when in the second mode, while the second diffraction grating is adapted to adjust the angle of the projected left-eye image of the left-eye display based on feedback from the passenger monitoring system such that the display screen redirects the left-eye image directly to the passenger's left eye when in the second mode, wherein the right-eye image and the left-eye image are slightly different perspectives of a single image such that when the passenger's right eye receives the right-eye image and the passenger's left eye receives the left-eye image, the passenger perceives a three-dimensional image floating within the vehicle in front of the passenger.

9. The system according to claim 1, wherein The display screen is mounted near or above the passenger seat opposite the passenger within the vehicle.

10. A method for generating a floating image for a passenger within a vehicle, comprising: Monitoring the position of the passenger's head and eyes by a passenger monitoring system; Calculating a holographic image using a computing engine in communication with the passenger monitoring system; Encoding a lens function into the holographic image using the computing engine based on information received from the passenger monitoring system; Encoding the holographic image into a display of a picture generation unit (PGU) hologram generator; Use the display to project the holographic image onto a display screen, which is positioned for viewing by the passenger and adapted to selectively switch between a first mode and a second mode. In the first mode, the display screen is adapted to display an image for the passenger to view; in the second mode, the display screen is adapted to function as a beam steering device; and When the display screen operates in the second mode, the projected holographic image is redirected to the passenger's eyes through the display screen based on the information received from the passenger monitoring system.

Images