Directional video and audio communication

Abstract

A system within a vehicle for communicating with a person in the vicinity of the vehicle includes a perception system in communication with a system controller and adapted to detect the presence of a person; a monitoring system adapted to monitor the position of the head and eyes of a person; a holographic image generator comprising a visual computing engine adapted to compute a holographic image and encode the holographic image onto a spatial light modulator of a picture generation unit, and a beam steering device adapted to receive information from a monitoring system relating to a position of a person's head and eyes, and the display is adapted to project the holographic image into the beam steering device, and the beam steering device is adapted to redirect the projected holographic image into the human eye.

Description

Technical Field

[0001] The present disclosure relates to a system in a vehicle for generating floating images and audio for a person near the vehicle. Background Art

[0002] Current in-vehicle entertainment systems typically include screens or monitors installed inside the vehicle for passengers to view. Some systems include smaller individual screens where each passenger has a screen for their personal viewing. Some systems include external screens for displaying to people outside the vehicle. Known systems incorporate a rear-view head-up display architecture using a beam splitter that must be attached to a structure inside the vehicle cabin and requires constant readjustment to accommodate changes in the height and position of passengers inside the cabin.

[0003] While current systems achieve their intended purpose, there is a need for a new and improved system to generate floating images and audio for a person near the vehicle. Summary of the Invention

[0004] According to several aspects of the present disclosure, a system in a vehicle for communicating with a person near the vehicle includes a sensing system that communicates with a system controller and is adapted to detect the presence of a person near the vehicle; a monitoring system that communicates with the system controller and is adapted to monitor the position of the person's head and eyes; and a holographic image generator including a vision computing engine and a beam steering device, wherein the vision computing engine communicates with the system controller and the monitoring system and is adapted to compute a holographic image and encode the holographic image onto a display of a Picture Generation Unit (PGU), the beam steering device is adapted to receive information related to the position of the person's head and eyes from the monitoring system via the vision computing engine, and the display is adapted to project the holographic image onto the beam steering device, and the beam steering device is adapted to redirect the projected holographic image to the person's eyes based on the information received from the monitoring system.

[0005] According to another aspect, the system further includes: an audio communication system adapted to support audio communication between the vehicle and the person, and the audio communication system includes a directional speaker that communicates with the system controller and is adapted to provide a directional audio output to the person; an audio computing engine that communicates with a visual speech recognition algorithm from the monitoring system, the audio computing engine being adapted to use the visual speech recognition algorithm that communicates with the data received from the monitoring system to visually interpret the speech communication from the person; and a microphone that communicates with the system controller and is adapted to receive the speech communication from the person.

[0006] According to another aspect, the vision computing engine is further adapted to encode a lens function into the holographic image based on the information received from the monitoring system.

[0007] According to another aspect, the holographic image includes a single two-dimensional holographic image, and the beam steering device is adapted to simultaneously redirect the single two-dimensional holographic image directly to the right eye and the left eye of a person. Wherein the person perceives the two-dimensional holographic image floating inside the vehicle in front of the person.

[0008] According to another aspect, the holographic image includes a single two-dimensional holographic image, and the beam steering device is adapted to alternately redirect the single two-dimensional holographic image directly only to the right eye of a person and then only to the left eye of the person, switching back and forth between the right eye and the left eye at a frequency greater than 30 Hz. Wherein the person perceives the two-dimensional holographic image floating in front of the person.

[0009] According to another aspect, the holographic image includes a right-eye image and a left-eye image. The visual computing engine is adapted to compute the right-eye image and the left-eye image, and alternately encode the right-eye image onto a display and the left-eye image onto the display, switching back and forth between encoding the right-eye image and encoding the left-eye image at a frequency greater than 30 Hz. The display is adapted to alternately project the right-eye image and the left-eye image onto the beam steering device at a frequency greater than 30 Hz and in synchronization with the visual computing engine. And the beam steering device is adapted to alternately redirect the right-eye image directly to the right eye of person 50 and the left-eye image directly to the left eye of the person at a frequency greater than 30 Hz and in synchronization with the visual computing engine and the display. Wherein the right-eye image and the left-eye image are slightly different perspectives of a single image, such that when the person's right eye receives the right-eye image and the person's left eye receives the left-eye image, the person perceives a three-dimensional image floating in front of the person.

[0010] According to another aspect, the beam steering device is one of a microelectromechanical system (MEMS) mirror, a dual galvanometer mirror, a pair of rotating Risley prisms, or a one-dimensional scanning mirror combined with a rotating polygon mirror.

[0011] According to another aspect, the holographic image includes a right-eye image and a left-eye image. The display includes a right-eye display and a left-eye display. The beam steering device includes right glasses and left glasses. The visual computing engine is adapted to compute the right-eye image and the left-eye image, simultaneously encode the right-eye image onto the right-eye display, and encode the left-eye image onto the left-eye display. The right-eye display and the left-eye display are adapted to simultaneously project the right-eye image onto the right glasses and the left-eye image onto the left glasses. The right glasses are adapted to redirect the right-eye image directly to the right eye of the person, and simultaneously, the left glasses are adapted to redirect the left-eye image directly to the left eye of the person. Wherein the right-eye image and the left-eye image are slightly different perspectives of a single image, such that when the person's right eye receives the right-eye image and the person's left eye receives the left-eye image, the person perceives a three-dimensional image floating in front of the person.

[0012] According to another aspect, the beam steering device is adapted to alternately redirect the holographic image only to a first person near the vehicle and then only to a second person near the vehicle, switching back and forth between the first and second persons at a frequency greater than 30 Hz, wherein the first person perceives the holographic image floating in front of the first person while the second person perceives the holographic image floating in front of the second person; and the audio communication system is adapted to alternately support audio communication between the vehicle and the first person and then support audio communication between the vehicle and the second person, switching back and forth between the audio communication with the first person and the audio communication with the second person.

[0013] According to another aspect, the holographic image includes a first image and a second image, the visual computing engine is adapted to compute the first image and the second image, and alternately encode the first image onto the display and encode the second image onto the display, switching back and forth between encoding the first image and encoding the second image at a frequency greater than 30 Hz; the display is adapted to alternately project the first image and the second image onto the beam steering device at a frequency greater than 30 Hz and in synchronization with the visual computing engine; and the beam steering device is adapted to alternately redirect the first image directly to a first person near the vehicle and the second image directly to a second person near the vehicle at a frequency greater than 30 Hz and in synchronization with the visual computing engine and the display.

[0014] According to several aspects of the present disclosure, a method of communicating with a person near a vehicle includes detecting the presence of a person near the vehicle using a sensing system that communicates with a system controller; monitoring the position of the person's head and eyes using a monitoring system; computing a holographic image using a visual computing engine of a holographic image generator that communicates with the monitoring system and encoding the holographic image onto a display of a picture generation unit (PGU); using a beam steering device to receive information related to the position of the person's head and eyes from the monitoring system via the visual computing engine; and projecting the holographic image onto the beam steering device using the display; and, based on the information received from the monitoring system, redirecting the projected holographic image to the person's eyes using the beam steering device.

[0015] According to another aspect, the method further includes providing an audio output directed to the person using a directional speaker that communicates with the system controller, supporting audio communication between the vehicle and the person using an audio communication system, using an audio computing engine that communicates with the monitoring system, using a visual speech recognition algorithm that communicates with the data received from the monitoring system and visually interprets the speech communication from the person, and receiving the speech communication from the person using a microphone that communicates with the system controller.

[0016] According to another aspect, the method further includes encoding a lens function into the holographic image using the visual computing engine based on the information received from the monitoring system.

[0017] According to another aspect, calculating a holographic image using a visual computing engine further includes calculating a single two-dimensional holographic image using the visual computing engine; and redirecting the holographic image projected onto a person's eyes using a beam steering device further includes using the beam steering device to directly and simultaneously redirect the single two-dimensional holographic image to the person's right eye and the person's left eye, wherein the person perceives the two-dimensional holographic image floating in front of the person.

[0018] According to another aspect, calculating a holographic image using a visual computing engine further includes calculating a single two-dimensional holographic image using the visual computing engine; and redirecting the holographic image projected onto a person's eyes using a beam steering device further includes using the beam steering device to directly and alternately redirect the single two-dimensional holographic image only to the person's right eye and then only to the person's left eye, switching between the right eye and the left eye at a frequency greater than 30 Hz, wherein the person perceives the two-dimensional holographic image floating in front of the person.

[0019] According to another aspect, the holographic image includes a right-eye image and a left-eye image; calculating the holographic image using a visual computing engine further includes calculating the right-eye image and the left-eye image using the visual computing engine; encoding the holographic image onto a display of a picture generation unit (PGU) further includes alternately encoding the right-eye image onto the display using the visual computing engine and encoding the left-eye image onto the display using the visual computing engine, switching back and forth between encoding the right-eye image and encoding the left-eye image at a frequency greater than 30 Hz; projecting the holographic image onto the beam steering device using the display further includes alternately projecting the right-eye image and the left-eye image onto the beam steering device at a frequency greater than 30 Hz and synchronized with the visual computing engine; and redirecting the projected holographic image to the person's eyes using the beam steering device further includes alternately using the beam steering device to directly redirect the right-eye image to the person's right eye and using the beam steering device to directly redirect the left-eye image to the person's left eye at a frequency greater than 30 Hz and synchronized with the visual computing engine and the display, wherein the right-eye image and the left-eye image are slightly different perspectives of a single image, such that when the person's right eye receives the right-eye image and the person's left eye receives the left-eye image, the person perceives a three-dimensional image floating in front of the person.

[0020] According to another aspect, the holographic image includes a right-eye image and a left-eye image, the display includes a right-eye display and a left-eye display, and the beam steering device includes right glasses and left glasses, wherein the visual computing engine calculates the holographic image further including calculating the right-eye image and the left-eye image using the visual computing engine; encoding the holographic image onto the display of the Picture Generation Unit (PGU) further includes simultaneously encoding the right-eye image onto the right-eye display using the visual computing engine and encoding the left-eye image onto the left-eye display using the visual computing engine; projecting the holographic image onto the beam steering device using the display further includes simultaneously using the right-eye display and the left-eye display to project the right-eye image onto the right glasses and project the left-eye image onto the left glasses; and redirecting the projected holographic image to the person's eyes using the beam steering device further includes simultaneously using the right glasses to directly redirect the right-eye image to the person's right eye and using the left glasses to directly redirect the left-eye image to the person's left eye, wherein the right-eye image and the left-eye image are slightly different perspectives of a single image, such that when the person's right eye receives the right-eye image and the person's left eye receives the left-eye image, the person perceives a three-dimensional image floating in front of the person.

[0021] According to another aspect, redirecting the projected holographic image to the person's eyes using the beam steering device further includes using the beam steering device to alternately redirect the holographic image only to a first person near the vehicle and then only to a second person near the vehicle at a frequency greater than 30 Hz and in synchronization with the visual computing engine and the display, switching back and forth between the first person and the second person at a frequency greater than 30 Hz; and supporting audio communication between the vehicle and the person using the audio communication system further includes alternately supporting audio communication between the vehicle and the first person and then supporting audio communication between the vehicle and the second person, switching back and forth between supporting audio communication with the first person and supporting audio communication with the second person.

[0022] According to another aspect, the holographic image includes a first image and a second image, and calculating the holographic image using a vision computing engine further includes calculating the first image and the second image using the vision computing engine; encoding the holographic image into the display of a picture generation unit (PGU) further includes alternately encoding the first image into the display using the vision computing engine and encoding the second image into the display using the vision computing engine, and switching back and forth between encoding the first image and encoding the second image at a frequency greater than 30 Hz; projecting the holographic image onto a beam steering device using the display further includes alternately projecting the first image and the second image onto the beam steering device at a frequency greater than 30 Hz and synchronized with the vision computing engine; and redirecting the projected holographic image to a person's eyes using the beam steering device further includes alternately redirecting the first image directly to a first person near the vehicle and redirecting the second image directly to a second person near the vehicle using the beam steering device at a frequency greater than 30 Hz and synchronized with the vision computing engine and the display.

[0023] Further application areas will become apparent from the description provided herein. It should be understood that these descriptions and specific examples are for illustrative purposes only and are not intended to limit the scope of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] The drawings described herein are for illustrative purposes only and are not intended to limit the scope of the present disclosure in any way.

[0025] Figure 1 is a schematic diagram of a vehicle according to an exemplary embodiment of the present disclosure;

[0026] Figure 2 is a schematic diagram of a vehicle and a person near the vehicle;

[0027] Figure 3 is a schematic block diagram of a system according to an exemplary embodiment of the present disclosure;

[0028] Figure 4 is a schematic diagram of a system according to an exemplary embodiment, in which the beam steering device is adapted to project simultaneously onto a person's right eye and left eye;

[0029] Figure 5 is a schematic diagram of a system according to an exemplary embodiment, in which the beam steering device is adapted to switch back and forth between a passenger's right eye and left eye;

[0030] Figure 6 is a schematic diagram of a system according to an exemplary embodiment, in which the computing engine is adapted to encode a right eye image and a left eye image into the display;

[0031] Figure 7is a schematic diagram of a system including a right-eye display, a left-eye display, a right-eye beam steering device, and a left-eye beam steering device according to an exemplary embodiment;

[0032] Figure 8 is a schematic diagram of a system according to an exemplary embodiment, wherein a beam splitting device alternately redirects a holographic image projected by a display between a first person and a second person;

[0033] Figure 9 is a schematic diagram of a system in which a display alternately projects a first image and a second image to the display, and the display alternately redirects the first image to a first person and redirects the second image to a second person according to an exemplary embodiment.

[0034] Figure 10 is a schematic flow chart illustrating a method according to an exemplary embodiment of the present disclosure.

[0035] The drawings are not necessarily drawn to scale, and some features may be exaggerated or minimized to show details of particular components. In some cases, well-known components, systems, materials, or methods are not described in detail to avoid obscuring the present disclosure. Therefore, the specific structural and functional details disclosed herein should not be interpreted as limiting, but merely as a basis for the claims and as a representative basis for teaching those skilled in the art to adopt the present disclosure in different ways. DETAILED DESCRIPTION

[0036] The following description is merely exemplary in nature and is not intended to limit the present disclosure, application or use. In addition, it is not intended to be constrained by any express or implied theory presented in the aforementioned technical field, background technology, content of the invention or the following specific embodiments. It should be understood that throughout the drawings, corresponding reference numerals represent similar or corresponding parts and features. As used herein, the term "module" refers to any hardware, software, firmware, electronic control component, processing logic and / or processor device, individually or in any combination, including but not limited to: application specific integrated circuits (ASICs), electronic circuits, processors (shared, dedicated or groups) and memories that execute one or more software or firmware programs, combinational logic circuits and / or other suitable components that provide the described functions. Although the drawings shown herein depict examples with certain element arrangements, additional intermediate elements, devices, features or components may be present in actual embodiments. It should also be understood that the drawings are merely illustrative and may not be drawn to scale.

[0037] As used herein, the term "vehicle" is not limited to automobiles. Although this article mainly describes the present technology in conjunction with automobiles, the present technology is not limited to automobiles. These concepts can be used in a variety of applications, such as aircraft, ships, other vehicles and consumer electronic components.

[0038] According to an exemplary embodiment, Figure 1 A vehicle 10 according to various embodiments is shown, which vehicle 10 has an associated system 11 for generating a floating image and audio for a person 50 near the vehicle 10. Generally, the system 11 works in conjunction with other systems within the vehicle 10 to display various information and infotainment content for an individual near the vehicle. The vehicle 10 typically includes a chassis 12, a body 14, front wheels 16, and rear wheels 18. The body 14 is disposed on the chassis 12 and substantially encloses the components of the vehicle 10. The body 14 and the chassis 12 may together form a frame. The front wheels 16 and the rear wheels 18 are each rotatably coupled to the chassis 12 near respective corners of the body 14.

[0039] In various embodiments, the vehicle 10 is an autonomous vehicle and the system 11 is incorporated into the autonomous vehicle 10 (hereinafter referred to as the autonomous vehicle 10). The autonomous vehicle 10 is, for example, a vehicle that is automatically controlled to transport passengers from one location to another. Although the vehicle 10 is depicted as a passenger car in the illustrated embodiment, it should be understood that any other vehicle may also be used, including motorcycles, trucks, sport utility vehicles (SUVs), recreational vehicles (RVs), etc. In an exemplary embodiment, the autonomous vehicle 10 is a so-called level four or level five automation system. A level four system represents "high automation" and refers to an autonomous driving system that performs the performance of a specific driving mode in all aspects of a dynamic driving task, even if a human driver does not appropriately respond to an intervention request. A level five system represents "full automation" and refers to an autonomous driving system that performs full-time in all aspects of a dynamic driving task under all road and environmental conditions that a human driver can manage.

[0040] As shown in the figure, an autonomous vehicle 10 generally includes a propulsion system 20, a transmission system 22, a steering system 24, a braking system 26, a sensor system 28, an actuator system 30, at least one data storage device 32, a controller 34, and a wireless communication module 36. In an embodiment where the autonomous vehicle 10 is an electric vehicle, the transmission system 22 may be absent. In various embodiments, the propulsion system 20 may include an internal combustion engine, an electric motor such as a traction motor, and / or a fuel cell propulsion system. The transmission system 22 is configured to transfer power from the propulsion system 20 to the front wheels 16 and the rear wheels 18 of the vehicle according to selectable gear ratios. According to various embodiments, the transmission system 22 may include a stepped automatic transmission, a continuously variable transmission, or other suitable transmissions. The braking system 26 is configured to provide braking torque to the front wheels 16 and the rear wheels 18 of the vehicle. In various embodiments, the braking system 26 may include friction brakes, brake-by-wire, regenerative braking systems (such as electric motors), and / or other suitable braking systems. The steering system 24 affects the positions of the front wheels 16 and the rear wheels 18. Although depicted for illustrative purposes as including a steering wheel, in some embodiments contemplated within the scope of the present disclosure, the steering system 24 may not include a steering wheel.

[0041] The sensor system 28 includes one or more sensing devices 40a - 40n that sense observable conditions of the external environment and / or the internal environment of the autonomous vehicle 10. The sensing devices 40a - 40n may include, but are not limited to, radar, lidar, global positioning system, optical cameras, thermal cameras, ultrasonic sensors, and / or other sensors. The cameras may include two or more digital cameras spaced a selected distance apart, where the two or more digital cameras are used to obtain a stereoscopic image of the surrounding environment in order to obtain a three-dimensional image. The sensing devices 40a - 40n may include sensors that monitor dynamic variables of the vehicle, such as the speed of the vehicle, acceleration, the number of times brakes are applied, and the like. The actuator system 30 includes one or more actuator devices 42a - 42n that control one or more features of the vehicle 10, such as, but not limited to, the propulsion system 20, the transmission system 22, the steering system 24, and the braking system 26.

[0042] The vehicle controller 34 includes at least one processor 44 and a computer-readable storage device or medium 46. The at least one data processor 44 can be any custom or commercially available processor, a central processing unit (CPU), a graphics processing unit (GPU), an auxiliary processor among multiple processors associated with the vehicle controller 34, a semiconductor-based microprocessor (in the form of a microchip or chipset), a macroprocessor, any combination thereof, or any device commonly used to execute instructions. The computer-readable storage device or medium 46 can include, for example, volatile and non-volatile storage devices such as read-only memory (ROM), random access memory (RAM), and keep-alive memory (KAM). KAM is a persistent or non-volatile memory that can be used to store various operating variables when the at least one data processor 44 is powered off. The computer-readable storage device or medium 46 can be implemented using any of a variety of known storage devices, such as PROM (programmable read-only memory), EPROM (electrically programmable read-only memory), EEPROM (electrically erasable read-only memory), flash memory, or any other electrical, magnetic, optical, or combination storage device capable of storing data, some of which represents executable instructions used by the controller 34 in controlling the vehicle 10.

[0043] These instructions can include one or more separate programs, each program including an ordered list of executable instructions for implementing logical functions. When the instructions are executed by the at least one processor 44, signals from the sensor system 28 are received and processed, logic, calculations, methods, and / or algorithms for automatically controlling components of the autonomous vehicle 10 are executed, and control signals are generated to the actuator system 30 to automatically control components of the autonomous vehicle 10 based on the logic, calculations, methods, and / or algorithms. Although Figure 1 only one controller 34 is shown in, embodiments of the autonomous vehicle 10 can include any number of controllers 34 that communicate and cooperate through any suitable communication medium or combination of communication media to process sensor signals, execute logic, calculations, methods, and / or algorithms, and generate control signals to automatically control the functions of the autonomous vehicle 10.

[0044] In various embodiments, one or more instructions of the vehicle controller 34 are embodied in a trajectory planning system and, when executed by the at least one data processor 44, generate a trajectory output that addresses the kinematic and dynamic constraints of the environment. For example, the instructions receive process sensor and map data as input. These instructions execute graph-based methods and custom cost functions to handle different road scenarios in urban and highway settings.

[0045] The wireless communication module 36 is configured to wirelessly communicate with other remote entities 48, such as but not limited to other vehicles (“V2V” communication), infrastructure (“V2I” communication), remote systems, remote servers, cloud computers, and / or personal devices. In an exemplary embodiment, the wireless communication module is configured to communicate using the IEEE 802.11 standard or via a wireless local area network (WLAN) using cellular data communication. However, additional or alternative communication methods such as dedicated short range communication (DSRC) channels are also considered to be within the scope of the present disclosure. A DSRC channel refers to a one-way or two-way short-range to medium-range wireless communication channel designed for automotive use, as well as a corresponding set of protocols and standards.

[0046] Reference Figure 2 , the system 11 is adapted to project a holographic image directly into the eyes of a person 50 near the vehicle 10, where only the person 50 can see the holographic image. In addition, the system 11 is adapted to provide directional audio to the person 50.

[0047] Reference Figure 3 and Figure 4 , shows a system 11 for generating a floating image of a person near the vehicle 10. The system 11 includes a system controller 34A that communicates with a plurality of sensing devices (onboard sensors) 40a - 40n. The system controller 34A can be the vehicle controller 34, or the system controller 34A can be a separate controller that communicates with the vehicle controller 34. The system also includes a perception system 38 that uses data from sensors 40a - 40n within the vehicle 10 to identify the presence of a person 50 near the vehicle 10. The person 50 can be a pedestrian walking or standing within a predetermined distance of the vehicle 10. Alternatively, the person 50 can be an individual located near the vehicle. Additionally, the person 50 can be an animal along the road on which the vehicle 10 is traveling, where the system 11 is used to warn / scare the animal to prevent a potential vehicle / animal collision.

[0048] The system also includes a monitoring system 52, which includes a camera 54 adapted to monitor the position of the head and eyes of the person 50. The monitoring system 52 is an artificial intelligence (AI)-based vehicle safety technology that monitors the head and eyes of a person in a very similar way to how a driver monitoring system monitors a driver's attention. The main feature of the monitoring system 52 is to detect and identify the person 50 and monitor the head and eyes of the person 50. The main purpose of the monitoring system 52 used within the system 11 of the present disclosure is to monitor the position of the eyes of the person 50 and the direction of the person 50's gaze. Once the sensing system detects the presence of the person 50, the system controller 34A uses the images from the monitoring system 52 and the data received via the wireless communication module 36 to identify the person 50 and determine whether communication with the person 50 should be initiated and what type of communication with the person 50 should be initiated. Data related to the identity of the person 50 can be received via wireless communication with a personal device 100 (such as a mobile phone) used by the person 50 or via wireless communication with the vehicle 102 in which the person 50 is located.

[0049] The system 11 also includes a holographic image generator 55, which includes a visual computing engine 56 that communicates with the monitoring system 52, is adapted to compute a holographic image 58 (phase hologram), and encodes the holographic image 58 onto a display 60 of a picture generation unit (PGU) 62. In an exemplary embodiment, the display 60 includes a spatial light modulator (SLM). It should be understood that other types of displays 60 may be incorporated into the system 11 without departing from the novel features of the present disclosure. The display 60 is illuminated by a light source, for example, as a non-limiting example, by an RGB laser or an SLED light source. When illuminated, each SLM pixel will generate a wavefront whose phase corresponds to the phase of the position of the hologram encoded at the pixel.

[0050] In an exemplary embodiment, the visual computing engine 56 is also adapted to encode a lens function into the holographic image 58 based on information received from the monitoring system 52. The monitoring system 52 collects information about the precise position of the eyes of the person 50 and determines an appropriate distance 64 at which the person 50 should perceive the holographic image 58. The multiple wavefronts leaving the display 60 interfere constructively and destructively with each other, thus revealing the image pattern of the holographic image 58 at the appropriate distance 64, which can also be adjusted by encoding the lens function into the encoded holographic image. Therefore, two pieces of information are encoded into the holographic image 58, namely the image information and the appropriate distance 64 at which the person 50 should perceive the holographic image 58 (the distance at which the wavefronts come together to form the holographic image 58). The adjustability of the appropriate distance 64 allows the system 11 to display a holographic image 58 with a variable virtual image distance. A holographic image with a variable virtual image distance allows the system 11 to project a floating holographic image 58 onto the person 50 and enables the floating holographic image 58 to appear closer or farther away from the person 50.

[0051] The light leaving the display 60 travels along a straight path, as shown by arrow 66, until it encounters the beam steering device 68. In an exemplary embodiment, the beam steering device 68 includes a single steering mirror mounted on an adjustable gimbal that receives information from the monitoring system 52 via the vision computing engine 56 and redirects the holographic image 58 into the eye of the person 50, as shown by arrow 69. The corneal crystalline Fourier transform hologram of the person 50 creates an image on the retina of the person 50. The holographic image 58 is perceived in front of the person 50 at an appropriate distance 64 from the person 50, as specified by the lens function encoded into the holographic image 58.

[0052] In an exemplary embodiment, the beam steering device 68 includes a microelectromechanical system device. The micromirror device is a device based on microscopic mirrors. These mirrors are microelectromechanical systems (MEMS), which means that their state is controlled by applying a voltage between two electrodes surrounding the mirror array. In other embodiments, the beam steering device 68 includes MEM technology based on electromagnetic design. The beam steering device 68 can be any suitable scanning mirror technology, for example, as a non-limiting example, a dual galvanometer mirror, a rotating Risley prism pair, or a one-dimensional scanning mirror combined with a rotating polygon mirror.

[0053] Digital micromirror devices are used in video projectors and in optical and mirror devices for light deflection and control. The mirrors can not only switch between two states, their rotation is actually continuous, or linear, where the angular scan is constant or resonant, where the angular scan is sinusoidal. Thus, it can be used to control the intensity and direction of the incident light. MEMS scanning micromirrors typically consist of silicon devices with a millimeter-sized mirror at the center. The mirror is usually connected to a flexure that enables it to oscillate on a single axis or biaxially to project or capture light. The main advantage of using a MEMS device as the beam steering device 68 is that the MEMS device is very fast, allowing the direction of the redirected incident light to be changed very quickly.

[0054] System 11 also includes an audio communication system 114 that is adapted to support audio communication between vehicle 10 and person 50. The audio communication system 114 includes a directional speaker 116 that communicates with system controller 34A and is adapted to provide an audio output directed to person 50, as shown by arrow 118. The audio communication system 114 also includes an audio computing engine 120 that communicates with monitoring system 52. The audio computing engine 120 is adapted to use a visual speech recognition algorithm 122 that communicates with data received from monitoring system 52 to visually interpret verbal communication received from person 50. The visual speech recognition algorithm 122 detects the oral expression of person 50 by tracking the lip movements of person 50 and uses machine learning techniques to recognize speech from person 50 in real time. Finally, the audio communication system 114 includes a microphone 124 that communicates with system controller 34A and is adapted to receive verbal communication from person 50, as shown by arrow 126.

[0055] Referring again to Figure 4 , in an exemplary embodiment, the holographic image 58 includes a single two-dimensional holographic image 58. The single two-dimensional holographic image 58 is a large image such that the beam steering device 68 is adapted to simultaneously and directly redirect the single two-dimensional holographic image to the right eye 78R of person 50 and the left eye 78L of person 50, where person 50 perceives the two-dimensional holographic image 58 floating in front of person 50, between vehicle 10 and person 50, and at an appropriate distance 64 from person 50.

[0056] Referring to Figure 5 , in another exemplary embodiment, the holographic image 58 includes a single two-dimensional holographic image, and the beam steering device 68 is adapted to directly and alternately redirect the single two-dimensional holographic image 58 only to the right eye 78R of person 50, as shown by arrow 82, and then only to the left eye 78L of person 50, as shown by arrow 84, switching back and forth between the right eye 78R and the left eye 78L at a frequency greater than 30 Hz. This is referred to as sequential time division multiplexing. Sequential time division multiplexing requires the beam steering device 68 to be able to switch the direction of the redirected holographic image 58 back and forth between the right eye 78R and the left eye 78L fast enough to eliminate any image flicker perceivable by viewer 50.

[0057] In an exemplary embodiment, the beam steering device 68 is adapted to sequentially redirect the holographic image 58 to the right eye 78R, as shown by arrow 82, in less than 33 μs. After 33 μs, the beam steering device 68 is adjusted and begins to redirect the holographic image 58 to the left eye 78L, as shown by arrow 84. The holographic image 58 is redirected to the left eye 78L in less than 33 μs. This process is repeated, alternately redirecting the holographic image 58 to the right eye 78R in less than 33 μs and redirecting the holographic image 58 to the left eye 78L in less than 33 μs.

[0058] If the switching frequency between redirecting the holographic image 58 to the right eye 78R and the left eye 78L is greater than 30 Hz, the person 50 will not perceive flicker, and the holographic image 58 perceived by the right eye 78R and the left eye 78L of the person 50 will be fused into a single image, as perceived by the person 50. A frequency of 30 Hz translates to switching between the right eye 78R and the left eye 78L every 33 μs. For this embodiment, the MEMS beam steering device 68 will operate. A gimbal-based or galvanometer-based beam steering device 68 cannot switch the redirecting direction fast enough to avoid the person 50 being aware of the switch. As a non-limiting example, the MEMS beam steering device 68 can switch fast enough such that the person 50 is not aware of the switch and will perceive that they are simultaneously seeing the holographic image 58 with the right eye 78R and the left eye 78L. Any beam steering device 68 that can switch fast enough, such as a fast steering mirror system, is adapted for this application.

[0059] Referring Figure 6 to another exemplary embodiment, the holographic image 58 includes a right eye image and a left eye image. The visual computing engine 56 is adapted to compute the right eye image and the left eye image and alternately encode the right eye image onto the display 60, as shown by line 86, and encode the left eye image onto the display 60, as shown by line 88, switching back and forth between encoding the right eye image and encoding the left eye image at a frequency greater than 30 Hz.

[0060] The display 60 is adapted to project the right eye image onto the beam steering device 68, as shown by arrow 90, and project the left eye image onto the beam steering device 68, as shown by arrow 92, at a frequency greater than 30 Hz and in synchronization with the visual computing engine 56. The display 60 is synchronized with the visual computing engine 56, wherein when the visual computing engine 56 encodes the right eye image onto the display 60, as shown by line 86, the display 60 projects the right eye image onto the beam steering device 68, as shown by arrow 90, and when the visual computing engine 56 encodes the left eye image onto the display 60, as shown by line 88, the display 60 projects the left eye image onto the beam steering device 68, as shown by arrow 92.

[0061] The beam steering device 68 is adapted to alternately redirect the right-eye image directly to the right eye 78R of the person 50, as shown by arrow 94, and the left-eye image directly to the left eye 78L of the person 50, as shown by arrow 96, at a frequency greater than 30 Hz and in synchronization with the vision computing engine 56 and the display 60. The right-eye image and the left-eye image are slightly different perspectives of a single image such that when the right eye 78R of the person 50 receives the right-eye image and the left eye 78L of the person 50 receives the left-eye image, the person 50 perceives a three-dimensional holographic image 58 floating in front of him or her.

[0062] An autostereoscopic three-dimensional display is provided by adding binocular perception of three-dimensional depth without using special head-mounted devices, glasses, things that affect the viewer's vision, or any items that fit over the viewer's eyes. Since no head-mounted device is required, the autostereoscopic display is also referred to as "naked-eye 3D" or "glasses-free 3D".

[0063] The beam steering device 68 is synchronized with the display 60 and the vision computing engine 56, where when the vision computing engine 56 encodes the right-eye image into the display 60, as shown by line 86, the display 60 projects the right-eye image onto the beam steering device 68, as shown by arrow 90, and the beam steering device 68 redirects the right-eye image to the right eye 78R of the person 50, as shown by arrow 94. Additionally, when the vision computing engine 56 encodes the left-eye image into the display 60, as shown by line 88, the display 60 projects the left-eye image onto the beam steering device 68, as shown by arrow 92, and the beam steering device 68 redirects the left-eye image to the left eye 78L of the person 50, as shown by arrow 96.

[0064] For this embodiment, as a non-limiting example, the MEMS beam steering device 68 is capable of switching fast enough such that the person 50 will not be aware of the switch and will perceive that they are simultaneously seeing the right-eye image and the left-eye image with their right eye 78R and left eye 78L, and fusing the right-eye image and the left-eye image into a perceived three-dimensional holographic image 58 floating in front of the person 50.

[0065] Reference Figure 7 , in another exemplary embodiment, the holographic image 58 includes a right-eye image and a left-eye image, the display 60 includes a right-eye display 60R and a left-eye display 60L, and the beam steering device 68 includes a right-eye glass 68R and a left-eye glass 68L.

[0066] The visual computing engine 56 is adapted to compute the right-eye image and the left-eye image and, simultaneously, encode the right-eye image onto the right-eye display 60R, as shown by line 98, and encode the left-eye image onto the left-eye display 60L, as shown by line 100. The right-eye display 60R and the left-eye display 60L are adapted to simultaneously project the right-eye image onto the right eyeglass 68R, as shown by arrow 102, and project the left-eye image onto the left eyeglass 68L, as shown by arrow 104.

[0067] As a non-limiting example, both the right eyeglass 68R and the left eyeglass 68L can be gimbal-mounted mirrors, MEMS devices, or any other suitable beam control mechanism. The right eyeglass 68R is adapted to redirect the right-eye image directly to the right eye 78R of the person 50, as shown by arrow 106, and, simultaneously, the left eyeglass 68L is adapted to redirect the left-eye image directly to the left eye 78L of the person 50, as shown by arrow 108, wherein the right-eye image and the left-eye image are slightly different perspectives of a single image such that when the right eye 78R of the person 50 receives the right-eye image and the left eye 78L of the person 50 receives the left-eye image, the right eye 78R and the left eye 78L of the person will fuse the right-eye image and the left-eye image into a perceived three-dimensional holographic image 58 floating in front of the person 50. In another exemplary embodiment, the right-eye image and the left-eye image are the same image, and thus the person 50 perceives a two-dimensional holographic image 58 floating in front of him or her.

[0068] Reference Figure 8 Referring, in another exemplary embodiment, the beam steering device 68 is adapted to redirect the holographic image 58 directly and alternately only to a first person 50A near the vehicle 10, as shown by arrow 128, and then only to a second person 50B near the vehicle 10, as shown by arrow 130, switching back and forth between the first person 50A and the second person 50B at a frequency greater than 30 Hz. This is referred to as sequential time-division multiplexing. Sequential time-division multiplexing requires the beam steering device 68 to be able to switch the direction of the redirected holographic image 58 back and forth between the first person 50A and the second person 50B fast enough to eliminate any image flicker perceivable by the first viewer 50A and the second viewer 50B.

[0069] The system can use sequential time-division multiplexing to project an image to more than two people at a time. The controlling factor is the frame rate capability of the holographic image generator 55. At a speed of 200 - 250 frames per second, the system may be able to support time-division multiplexed images for up to three or four individuals, with each person 50 perceiving a continuous and stable image floating in front of them. A higher frame rate will support time-division multiplexing for more individuals.

[0070] In an exemplary embodiment, the beam steering device 68 is adapted to sequentially redirect the holographic image 58 to the first person 50A, as shown by arrow 128, in less than 33 μs. After 33 μs, the beam steering device 68 is adjusted and begins redirecting the holographic image 58 to the second person 50B, as shown by arrow 130. The holographic image 58 is redirected to the second person 50B in less than 33 μs. This process is repeated, alternately redirecting the holographic image 58 to the first person 50A in less than 33 μs and redirecting the holographic image 58 to the second person 50B in less than 33 μs.

[0071] If the switching frequency between redirecting the holographic image 58 to the first person 50A and the second person 50B is greater than 30 Hz, the first person 50A and the second person 50B will not perceive flicker. As described above, for this embodiment, the MEMS beam steering device 68 will operate.

[0072] The audio communication system 114 is adapted to alternately support audio communication between the vehicle 10 and the first person 50A, as shown by arrow 144, and then support audio communication between the vehicle 10 and the second person 50B, as shown by arrow 146, switching back and forth between audio communication with the first person 50A and audio communication with the second person 50B at a frequency fast enough to provide simultaneous, directional, and discrete communication with multiple persons 50.

[0073] Multiple holographic image generators 55 may also be incorporated into the system 11 to allow the system 11 to support communication between the vehicle 10 and multiple individuals. As described above, time division multiplexing allows a single holographic image generator 55 to project an image to multiple individuals. Using multiple holographic image generators will further expand the number of persons with whom the system can support simultaneous communication.

[0074] Reference Figure 9 , in another exemplary embodiment, the holographic image 58 includes a first image 58A and a second image 58B. The visual computing engine 56 is adapted to compute the first image 58A and the second image 58B and alternately encode the first image 58A to the display 60, as shown by line 132, and encode the second image 58B to the display 60, as shown by line 134, switching back and forth between encoding the first image 58A and encoding the second image 58B at a frequency greater than 30 Hz.

[0075] The display 60 is adapted to alternately project a first image 58A onto the beam steering device 68 at a frequency greater than 30 Hz and in synchronization with the vision computing engine 56, as shown by arrow 136, and project a second image 58B onto the beam steering device 68, as shown by arrow 138. The display 60 is synchronized with the vision computing engine 56, wherein when the vision computing engine 56 encodes the first image 58A into the display 60, as shown by line 132, the display 60 projects the first image 58A onto the beam steering device 68, as shown by arrow 136, and when the vision computing engine 56 encodes the second image 58B into the display 60, as shown by line 134, the display 60 projects the second image 58B onto the beam steering device 68, as shown by arrow 138.

[0076] The beam steering device 68 is adapted to alternately redirect the first image 58A directly to the first person 50A at a frequency greater than 30 Hz and in synchronization with the vision computing engine 56 and the display 60, as shown by arrow 140, and redirect the second image 58B directly to the second person 50B, as shown by arrow 142.

[0077] The beam steering device 68 is synchronized with the display 60 and the vision computing engine 56, wherein when the vision computing engine 56 encodes the first image 58A into the display 60, as shown by line 132, the display 60 projects the first image 58A onto the beam steering device 68, as shown by arrow 136, and the beam steering device 68 redirects the first person image 58A to the first person 50A, as shown by arrow 140. In addition, when the vision computing engine 56 encodes the second image 58B into the display 60, as shown by line 134, the display 60 projects the second image 58B onto the beam steering device 68, as shown by arrow 138, and the beam steering device 68 redirects the second image 58B to the second person 50B, as shown by arrow 142.

[0078] For this embodiment, by way of non-limiting example, the MEMS beam steering device 68 is capable of switching fast enough such that the first person 50A and the second person 50B are not aware of the alternation.

[0079] The system 11 described herein provides the advantage of allowing the vehicle 10 to communicate directly and privately with a target individual, where the projected image is visible only to the target individual and the audible message is directed to the target individual through the directional speaker 116, and the audible message is heard only by the target individual. The system 11 can be located at various positions on the vehicle 10, and the vehicle 10 has a plurality of holographic image generators 55 and a plurality of audio communication systems 114 located at the front, sides, and rear of the vehicle 10, facilitating communication with people in front of, beside, and behind the vehicle 10. Possible use cases of the system 11 include, but are not limited to: communication between a taxi or police car and a passenger / pedestrian standing on the roadside or sidewalk near the road, communication between an autonomous vehicle and a pedestrian, and communication such as exchanging credentials at an entrance gate or a security checkpoint.

[0080] Reference Figure 8 , a method 200 for generating a floating image for a person 50 inside the vehicle 10 includes, starting at block 202, using a sensing system 38 that communicates with a system controller 34A to detect the presence of a person 50 near the vehicle 10, moving to block 204, using a monitoring system 52 to monitor the position of the head and eyes of the person 50, moving to block 206, using a visual computing engine 56 of a holographic image generator 55 that communicates with the monitoring system 52 to provide a holographic image 58, and moving to block 208, encoding the holographic image 58 into a display 60 of a picture generation unit (PGU) 62.

[0081] Moving to block 210, the method 200 further includes using a beam steering device 68 to receive information related to the position of the head and eyes of the person 50 from the monitoring system 52 via the visual computing engine 56, and moving to block 212, using the display 60 to project the holographic image 58 onto the beam steering device 68, and moving to block 214, based on the information received from the monitoring system 52, using the beam steering device 68 to redirect the projected holographic image 58 to the eyes 78R, 78L of the person 50.

[0082] In an exemplary embodiment, the method 200 further includes, moving to block 216, by, moving to block 218, using a directional speaker 116 that communicates with a system controller 34A to provide a directional audio output to the person 50 to support audio communication between the vehicle 10 and the person 50, moving to block 220, using an audio computing engine 120 that communicates with the monitoring system 52, and using a visual speech recognition algorithm 122 that communicates with the data received from the monitoring system 52 to visually interpret the speech communication from the person 50, and moving to block 222, using a microphone 124 that communicates with a system controller 34A to receive the speech communication from the person 50.

[0083] In an exemplary embodiment, method 200 further includes moving to block 224 and encoding lens functionality into the holographic image 58 using the vision computing engine 56 based on information received from the monitoring system 52.

[0084] In another exemplary embodiment, calculating the holographic image 58 using the vision computing engine 56 at block 206 further includes calculating a single two-dimensional holographic image using the vision computing engine 56; and at block 214, redirecting the holographic image 58 to the eyes 78R, 78L of the person 50 using the beam steering device 68 further includes directly and simultaneously redirecting the single two-dimensional holographic image to the right eye 78R of the person and the left eye 78L of the person, wherein the person 50 perceives the two-dimensional holographic image floating in front of the person 50.

[0085] In another exemplary embodiment, calculating the holographic image 58 using the vision computing engine 56 at block 206 further includes calculating a single two-dimensional holographic image using the vision computing engine 56, and at block 214, redirecting the holographic image 58 to the eyes 78R, 78L of the person 50 using the beam steering device 68 further includes alternately redirecting the single two-dimensional holographic image directly only to the right eye 78R of the person 50 and then only to the left eye 78L of the person 50, switching back and forth between the right eye 78R and the left eye 78L at a frequency greater than 30 Hz, wherein the person 50 perceives the two-dimensional holographic image 58 floating in front of the person 50.

[0086] In another exemplary embodiment, the holographic image 58 includes a right-eye image and a left-eye image, and calculating the holographic image 58 using the vision computing engine 56 at block 206 further includes calculating the right-eye image and the left-eye image using the vision computing engine 56. Encoding the holographic image 58 to the display 60 of the Picture Generation Unit (PGU) hologram generator 62 at block 208 further includes alternately encoding the right-eye image to the display 60 using the vision computing engine 56 and encoding the left-eye image to the display 60 using the vision computing engine 56, and switching back and forth between encoding the right-eye image and encoding the left-eye image at a frequency greater than 30 Hz. Projecting the holographic image 58 to the beam steering device 68 using the display 60 at block 212 further includes alternately projecting the right-eye image and the left-eye image to the beam steering device 68 at a frequency greater than 30 Hz and in synchronization with the vision computing engine 56. Redirecting the projected holographic image 58 to the eyes 78R, 78L of the person 50 using the beam steering device 68 at block 214 further includes alternately redirecting the right-eye image directly to the right eye 78R of the person 50 and redirecting the left-eye image directly to the left eye 78L of the person 50 using the beam steering device 68 at a frequency greater than 30 Hz and in synchronization with the vision computing engine 56 and the display 60, wherein the right-eye image and the left-eye image are slightly different perspectives of a single image, such that when the right eye 78R of the person 50 receives the right-eye image and the left eye 78L of the person 50 receives the left-eye image, the person 50 perceives a three-dimensional image floating in front of the person 50.

[0087] In another exemplary embodiment, the holographic image 58 includes a right-eye image and a left-eye image, the display 60 includes a right-eye display 60R and a left-eye display 60L, and the beam steering device 68 includes a right-eye glass 68R and a left-eye glass 68L. Calculating the holographic image 58 using the vision computing engine 56 at block 206 further includes calculating the right-eye image and the left-eye image using the vision computing engine 56. Encoding the holographic image 58 onto the display 60 of the Picture Generation Unit (PGU) 62 at block 208 further includes simultaneously encoding the right-eye image onto the right-eye display 60R using the vision computing engine 56, and displaying the left-eye image onto the left-eye display 60L using the vision computing engine 56. Projecting the holographic image 58 onto the beam steering device 68 using the display 60 at block 212 further includes simultaneously projecting the right-eye image onto the right-eye glass 68R and projecting the left-eye image onto the left-eye glass 68L using the right-eye display 60R and the left-eye display 60L. Redirecting the projected holographic image 58 to the eyes 78R, 78L of the person 50 using the beam steering device 68 at block 214 further includes simultaneously redirecting the right-eye image directly to the right eye 78R of the person 50 using the right-eye glass 68R, and redirecting the left-eye image directly to the left eye 78L of the person 50 using the left-eye glass 68L, wherein the right-eye image and the left-eye image are slightly different perspectives of a single image, such that when the right eye 78R of the person 50 receives the right-eye image and the left eye 78L of the person 50 receives the left-eye image, the person 50 perceives a three-dimensional image floating in front of the person 50.

[0088] In another exemplary embodiment, redirecting the projected holographic image 58 to the eyes of the person 50 using the beam steering device 68 at block 214 further includes using the beam steering device 68 to alternately redirect only the holographic image 58 to a first person 50A near the vehicle 10, and then only to a second person 50B near the vehicle 10, at a frequency greater than 30 Hz and in synchronization with the vision computing engine 56 and the display 60, switching back and forth between the first person 50A and the second person 50B at a frequency greater than 30 Hz. Supporting audio communication between the vehicle 10 and the person 50 using the audio communication system 114 at block 216 further includes alternately supporting audio communication between the vehicle 10 and the first person 50A, and then supporting audio communication between the vehicle 10 and the second person 50B, switching back and forth between supporting audio communication with the first person 50A and supporting audio communication with the second person 50B at a frequency greater than 30 Hz.

[0089] In another exemplary embodiment, the holographic image 58 includes a first image 58A and a second image 58B, and calculating the holographic image 58 at block 206 using the vision computing engine 56 further includes calculating the first image 58A and the second image 58B using the vision computing engine 56. Encoding the holographic image 58 onto the display 60 of the Picture Generation Unit (PGU) 62 at block 208 further includes alternately encoding the first image 58A onto the display 60 using the vision computing engine 56 and encoding the second image 58B onto the display 60 using the vision computing engine 56, and switching back and forth between encoding the first image 58A and encoding the second image 58B at a frequency greater than 30 Hz. Projecting the holographic image 58 onto the beam steering device 68 using the display 60 at block 212 further includes alternately projecting the first image 58A and the second image 58A onto the beam steering device 68 at a frequency greater than 30 Hz and in synchronization with the vision computing engine 56. Redirecting the projected holographic image 58 to the eyes of the person 50 using the beam steering device 68 at block 214 further includes alternately redirecting the first image 58A directly to the first person 50A near the vehicle 10 and redirecting the second image 58B directly to the second person 50B near the vehicle 10 using the beam steering device 68 at a frequency greater than 30 Hz and in synchronization with the vision computing engine 56 and the display 60.

[0090] The system 11 and method 200 of the present disclosure have several advantages. These advantages include supporting two-way video and audio communication between the vehicle 10 and the target person 50.

[0091] The description of the present disclosure is merely exemplary in nature, and variations that do not depart from the gist of the present disclosure are intended to fall within the scope of the present disclosure. These variations should not be regarded as departing from the spirit and scope of the present disclosure.

Claims

1. A system for communicating with a person near a vehicle inside the vehicle, comprising: A sensing system that communicates with a system controller and is adapted to detect the presence of a person near the vehicle; A monitoring system that communicates with the system controller and is adapted to monitor the positions of the person's head and eyes; And A holographic image generator, comprising: A visual computing engine that communicates with the system controller and the monitoring system and is adapted to compute a holographic image and encode the holographic image onto a display of a Picture Generation Unit (PGU); and A beam steering device, wherein: The beam steering device is adapted to receive, from the monitoring system via the visual computing engine, information related to the positions of the person's head and eyes; and The display is adapted to project the holographic image onto the beam steering device, and the beam steering device is adapted to redirect the projected holographic image to the person's eyes based on the information received from the monitoring system.

2. The system according to claim 1, further comprising an audio communication system that is adapted to support audio communication between the vehicle and the person, and the audio communication system comprises: A directional speaker that communicates with the system controller and is adapted to provide a directional audio output to the person; An audio computing engine that communicates with the monitoring system and is adapted to use a visual speech recognition algorithm that communicates with data received from the monitoring system to visually interpret speech communication from the person; And A microphone that communicates with the system controller and is adapted to receive speech communication from the person.

3. The system according to claim 2, wherein The visual computing engine is further adapted to encode a lens function into the holographic image based on information received from the monitoring system.

4. The system according to claim 3, wherein, The holographic image comprises a single two-dimensional holographic image, and the beam steering device is adapted to simultaneously redirect the single two-dimensional holographic image directly to the person's right eye and the person's left eye, wherein the person perceives the two-dimensional holographic image floating inside the vehicle in front of the person.

5. The system according to claim 3, wherein, The holographic image comprises a single two-dimensional holographic image, and the beam steering device is adapted to alternately redirect the single two-dimensional holographic image directly only to the person's right eye and then only to the person's left eye, switching back and forth between the right eye and the left eye at a frequency greater than 30 Hz, wherein the person perceives the two-dimensional holographic image floating in front of the person.

6. The system according to claim 3, wherein, The holographic image comprises a right-eye image and a left-eye image, the visual computing engine is adapted to compute the right-eye image and the left-eye image, and alternately encode the right-eye image onto the display and encode the left-eye image onto the display, switching back and forth between encoding the right-eye image and encoding the left-eye image at a frequency greater than 30 Hz; The display is adapted to project the right-eye image and the left-eye image alternately onto the beam steering device at a frequency greater than 30 Hz and synchronized with the vision computing engine; and The beam steering device is adapted to redirect the right-eye image directly to the right eye of the person 50 and the left-eye image directly to the left eye of the person at a frequency greater than 30 Hz and synchronized with the vision computing engine and the display, wherein the right-eye image and the left-eye image are slightly different perspectives of a single image, such that when the person's right eye receives the right-eye image and the person's left eye receives the left-eye image, the person perceives a three-dimensional image floating in front of the person.

7. The system according to claim 3, wherein, The beam steering device is one of a microelectromechanical system (MEMS) mirror, a dual galvanometer mirror, a pair of rotating Risley prisms, or a one-dimensional scanning mirror combined with a rotating polygon mirror.

8. The system according to claim 3, wherein, The holographic image includes a right-eye image and a left-eye image; The display includes a right-eye display and a left-eye display; The beam steering device includes a right-eye glasses and a left-eye glasses; The vision computing engine is adapted to compute the right-eye image and the left-eye image, and simultaneously encode the right-eye image onto the right-eye display and the left-eye image onto the left-eye display; The right-eye display and the left-eye display are adapted to simultaneously project the right-eye image onto the right-eye glasses and the left-eye image onto the left-eye glasses; and The right-eye glasses are adapted to direct the right-eye image directly to the right eye of the person, and simultaneously, the left-eye glasses are adapted to direct the left-eye image directly to the left eye of the person, wherein the right-eye image and the left-eye image are slightly different perspectives of a single image, such that when the person's right eye receives the right-eye image and the person's left eye receives the left-eye image, the person perceives a three-dimensional image floating in front of the person.

9. The system according to claim 3, wherein The beam steering device is adapted to redirect the holographic image alternately only to a first person near the vehicle and then only to a second person near the vehicle, switching back and forth between the first person and the second person at a frequency greater than 30 Hz, wherein the first person perceives the holographic image floating in front of the first person while the second person perceives the holographic image floating in front of the second person; and The audio communication system is adapted to alternately support audio communication between the vehicle and the first person and then support audio communication between the vehicle and the second person, switching back and forth between the audio communication with the first person and the audio communication with the second person.

10. The system according to claim 3, wherein, The holographic image includes a first image and a second image, and the visual computing engine is adapted to compute the first image and the second image, and alternately encode the first image onto the display and encode the second image onto the display, switching back and forth between encoding the first image and encoding the second image at a frequency greater than 30 Hz; The display is adapted to alternately project the first image and the second image onto the beam steering device at a frequency greater than 30 Hz and in synchronization with the visual computing engine; and The beam steering device is adapted to alternately redirect the first image directly to a first person near the vehicle and redirect the second image to a second person near the vehicle at a frequency greater than 30 Hz and in synchronization with the visual computing engine and the display.

Images