Enabling vehicle display interaction and personalization

Abstract

A system for enabling vehicle display interaction includes a vehicle display server in communication with a plurality of sensors adapted to track the head and eye position and movement of users within the vehicle, detect the positions of users within the vehicle and when users change their seating positions, detect when a user enters and exits the vehicle, recognize and interpret facial and gesture inputs from users, capture images from users, and receive audio inputs from users within the vehicle, haptic feedback devices adapted to provide haptic feedback to the users, and a user display system for viewing and interaction by users, wherein the vehicle display server is adapted to identify an identity of a user seated within the vehicle, select user-specific content,to be displayed to the user on the user display system, and to automatically display the user-specific content on the user display system for viewing by the user.

Description

[0001] This description relates to a system for enabling interaction and personalization with a display within a vehicle.

[0002] Current in-vehicle entertainment systems generally feature a screen or monitor mounted within the vehicle for viewing by passengers. Some systems include smaller individual screens, with each passenger having a screen for their own personal viewing. Current systems are primarily designed for individual users and do not account for shared or multi-display vehicle compartments, where content is determined based on the user's identity. Furthermore, shared screens do not account for users occupying different seating positions within a vehicle or moving from one vehicle to another.In such cases, the user must manually stop the displayed content at the current seating position or within the current vehicle and then manually restart the displayed content at the new seating position or in a different vehicle.

[0003] DE 10 2021 117 985 A1 describes a system and method for determining the user identity of a vehicle occupant and identifying a corresponding user profile to provide customized settings for the user. The user's seat or position is determined, and settings are applied depending on which seat is occupied by the user. Vehicle settings are updated when additional vehicle occupants enter the vehicle.

[0004] US 2024 / 0 109 413 A1 describes various systems and methods for content adaptation based on seating position or occupant position in a vehicle. An example implementation for content adaptation based on seating position in a vehicle includes obtaining sensor data, wherein the sensor data includes a seating position of a seat in the vehicle; identifying audiovisual content for output to a human occupant in the vehicle; identifying an occupant position of the human occupant based on the seating position for a user experience of the audiovisual content output; and initiating one or more adjustments to the output of the audiovisual content in the vehicle via an output device based on the identified human occupant position.

[0005] DE 11 2017 007 713 T5 describes systems and methods for vehicle occupancy management. In one implementation, a method receives a current vehicle image representing a current vehicle interior. An occupancy management system detects at least one passenger in the vehicle based on the current vehicle image and determines the passenger's seat location. A seat map is generated that identifies the passenger's seat location in the vehicle.

[0006] DE 10 2022 201 100 A1 describes a method for using a vehicle multimedia system with a mobile device that is connected to the vehicle multimedia system for data transmission, comprising: receiving position and / or distance signals from a key unit, determining, based on the position and / or distance signals, whether the key unit is located inside or outside the vehicle, and controlling the vehicle multimedia system for use with the mobile device when it has been determined that the key unit is located inside the vehicle.

[0007] US 2016 / 0 075 233 A1 describes a method for automatically controlling a vehicle infotainment system, comprising: detecting, by one or more sensors of a vehicle, whether a user of the vehicle is in the vehicle when a door event of the vehicle occurs and controlling, by a control unit of the vehicle, an infotainment system of the vehicle to pause multimedia data being played in the infotainment system when the one or more sensors detect that the user is not in the vehicle.

[0008] DE 10 2022 128 099 A1 describes a system for generating a centrally located floating image display for a plurality of passengers located within a vehicle, including a plurality of displays configured to project a graphic light image, a plurality of beam splitters, wherein a beam splitter is individually associated with each of the plurality of displays, wherein each beam splitter is configured to receive a graphic light image from the associated one of the plurality of displays and to reflect the graphic light image to one of the plurality of passengers, wherein each of the plurality of passengers perceives a floating image at a central location within the vehicle.

[0009] US 2023 / 0 408 841 A1 describes a system for generating a centrally located, floating three-dimensional image display for a plurality of passengers located in a vehicle, comprising at least one display capable of projecting a multiplexed image, a plurality of beam splitters. A beam splitter is individually assigned to each of the plurality of passengers, and at least one passenger interface. Each beam splitter is capable of receiving an image from the at least one display and reflecting the image to the associated one of the plurality of passengers. Each of the plurality of passengers perceives the image floating at a central location within the vehicle. The at least one passenger interface is capable of enabling the plurality of passengers to receive annotated information and provide input to the system.

[0010] DE 20 2023 107 282 U1 describes an interactive entertainment system for a vehicle, comprising a control unit configured to perform the following steps: receiving vehicle environment data acquired by at least one vehicle exterior sensor of the vehicle; determining, based on the vehicle environment data, at least one object property of at least one object located in the vehicle environment; receiving a user input from at least one vehicle occupant for the at least one object, which determines an estimated object property of the at least one object; comparing the determined object property and the estimated object property to determine user feedback; outputting the user feedback to the at least one vehicle occupant.

[0011] US 2011 / 0 002 038 A1 describes a three-dimensional 3D image generating device comprising a mounting housing, an image source device, a plurality of transparent reflective lenses, and a top plate. Reflection principles are used to reflect a plurality of image sources of the image source device onto the transparent reflective lenses, which are tilted at a 45-degree angle, allowing a viewer to view a 3D image suspended in midair from any angle. The 3D image generating device provides a vivid 3D perception of the image to enhance the product's value.

[0012] DE 10 2023 121 807 A1 describes a system for generating a floating three-dimensional image display in a vehicle comprising an image chamber comprising a first display configured to project a first image, a first reflector associated with the first display and a first occupant, a second display configured to project a second image, a second reflector associated with the second display and a second occupant, and a transparent display arranged between the first reflector and the first occupant and between the second reflector and the second occupant, wherein the first reflector is configured to reflect the first image from the first display to the first occupant, and the second reflector is configured to reflect the second image from the second display to the second occupant, and the transparent display is configured toto display information to the first and second occupants within an image plane arranged in front of the perceived first and second images.

[0013] While current systems serve their intended purpose, it is an object of the invention to provide a new and improved system for enabling personalization and interaction via a vehicle display.

[0014] The object of the invention is achieved by means of a system for enabling vehicle display interaction, comprising a vehicle display server positioned within a vehicle and communicating with a plurality of sensors positioned within the vehicle and adapted to track the head and eye position and movement of users sitting in a plurality of seating positions within the vehicle, detecting the locations of users within the vehicle and when users change their seating positions within the vehicle, detecting when a user enters and exits the vehicle, detecting and interpreting facial and gesture inputs from users within the vehicle, capturing images of users within the vehicle, and receiving audio inputs from users within the vehicle. The system further comprises haptic feedback devices,which are positioned within the vehicle and adapted to provide haptic feedback to users seated within the vehicle, and, a user display system positioned within the vehicle for viewing and interaction by users seated within the plurality of seating positions within the vehicle, wherein the vehicle display server is adapted to identify an identity of a user seated at one of the plurality of seating positions within the vehicle using the plurality of sensors positioned within the vehicle, computer vision algorithms, and stored data, and to select user-specific content to be displayed for the user on the user display system using the identity of the user seated at one of the plurality of seating positions within the vehicle,and automatically display the user-specific content on the user display system for viewing by the user seated at one of the plurality of seating positions within the vehicle. When a user seated at a first seating position within the vehicle moves to a second seating position within the vehicle, the vehicle display server is adapted to detect, with the plurality of sensors positioned within the vehicle, when the user leaves the first seating position within the vehicle, pause the user-specific content currently displayed on the user display system for the first seating position, and detect, with the plurality of sensors positioned within the vehicle, when the user is seated at the second seating position within the vehicle.and resume displaying the user-specific content on the user display system for the second seating position. The user display system comprises a single display system comprising at least one display for projecting an image, a plurality of reflectors, each reflector associated with one of the plurality of seating positions within the vehicle and adapted to reflect a projected image to the associated seating position of the plurality of seating positions such that a user sitting in the associated seating position from the plurality of seating positions within the vehicle perceives the image floating at a central location within the vehicle, and a transparent cylindrical touchscreen display positioned and adapted between the plurality of seating positions within the vehicle and the plurality of reflectors.display user-specific content for users at each of the plurality of seating positions within the vehicle and receive inputs from each of the users at each of the plurality of seating positions within the vehicle. The user display system comprising the single display system further comprises an image chamber comprising at least the one display, a reflector of the plurality of reflectors (38A, 38B, 38C, 38D) individually associated with each of the plurality of seating positions within the vehicle and adapted to reflect the image to the associated seating position of the plurality of seating positions within the vehicle such that a user sitting on the associated seating position of the plurality of seating positions within the vehicle perceives the image floating at a central location within the vehicle, transparent panels adapted to enablethat the image reflected by the reflector of the plurality of reflectors passes outward from the image chamber toward a user sitting at the associated seating position of the plurality of seating positions within the vehicle, and fixed plates adapted to prevent light from entering the image chamber behind the reflector of the plurality of reflectors (38A, 38B, 38C, 38D), and, wherein the transparent cylindrical touchscreen display is positioned between the plurality of reflectors of the image chamber and the plurality of seating positions within the vehicle and is adapted to display information to users sitting at the plurality of seating positions within the vehicle within an image plane positioned in front of the perceived image floating at the central location within the vehicle. The image chamber comprises a first display adapted to project a first three-dimensional image,and a first reflector of the plurality of reflectors individually associated with the first display and a second display adapted to project a second three-dimensional image, and a second reflector of the plurality of reflectors individually associated with the second display. The imaging chamber includes fixed, overlapping plates adapted to prevent light from entering the imaging chamber behind the first and second reflectors. First fixed plates of the overlapping plates, arranged on either side adjacent to the first reflector, are adapted to move together with the first reflector and a first display when the first reflector and the first display rotate about a vertical central axis. Second fixed plates of the overlapping plates, arranged on either side adjacent to the second reflector, are adaptedto move together with the second reflector and the second display when the second reflector and the second display rotate about the vertical central axis. The first fixed plates overlap the second fixed plates to allow relative movement of the first fixed plates with respect to the second fixed plates and to ensure that ambient light is prevented from entering the image chamber behind the first and second reflectors at all times.

[0015] According to one embodiment, the vehicle display server is adapted to detect, using the plurality of sensors positioned within the vehicle, when a user viewing the user display system looks away from the user display system, pause the user-specific content displayed on the user display system, detect, using the plurality of sensors positioned within the vehicle, when the user looks back at the user display system, and resume displaying the user-specific content on the user display system.

[0016] According to another embodiment, the system further comprises a cloud-based host server communicating with the vehicle display server within the vehicle via a wireless communication network, wherein the cloud-based host server further communicates with at least one remote vehicle, wherein the remote vehicle has a vehicle display server communicating with the cloud-based host server, a plurality of sensors, haptic feedback devices, a plurality of seating positions, and a user display system identical to the corresponding features of the vehicle.

[0017] According to a further embodiment, when a user seated within the vehicle leaves the vehicle and moves to one of the at least one remote vehicles, the vehicle display server within the vehicle is adapted to detect, with the plurality of sensors positioned within the vehicle, when the user leaves the vehicle and to pause user-specific content currently displayed on the user display system within the vehicle, and the vehicle display server within the one of the at least one remote vehicles is adapted to detect, with the plurality of sensors positioned within the one of the at least one remote vehicles, when the user enters the one of the at least one remote vehicle using the plurality of sensors positioned in the one of the at least one remote vehicle,of computer vision algorithms and stored data to identify an identity of the user, to obtain, via communication with the host server, information relating to the user-specific content that the user viewed within the vehicle before exiting the vehicle, and to automatically resume displaying the user-specific content on the user display system in the one of the at least one remote vehicle into which the user entered.

[0018] According to a further embodiment, the host server is adapted to coordinate the vehicle display server and the user display system positioned within the vehicle and viewed by a first user with a vehicle display server and a user display system positioned within one of the at least one remote vehicle and viewed by a second user, and to facilitate communication and interaction between the first user and the second user.

[0019] According to a further embodiment, the host server is in communication with a user's personal device, and when the user is viewing user-specific content on the user display system within the vehicle and the user exits the vehicle, the host server is adapted to detect, with the plurality of sensors positioned within the vehicle, via communication with the vehicle display server within the vehicle, when the user exits the vehicle, automatically pause the user-specific content currently being displayed on the user display system within the vehicle, and automatically resume displaying the user-specific content on the user's personal device,and when the user is viewing the user-specific content on the personal device and the user enters the vehicle, the host server is adapted to detect, with the plurality of sensors positioned within the vehicle, via communication with the vehicle display server within the vehicle, when the user enters the vehicle, automatically prompt the user with the option to selectively pause the user-specific content currently being displayed on the personal device, and resume displaying the user-specific content on the user display system within the vehicle.

[0020] According to a further embodiment, for the user display system comprising a single display system, the plurality of reflectors comprises a plurality of transparent beam splitters, wherein a transparent beam splitter is individually associated with each of the plurality of seating positions within the vehicle, wherein each beam splitter is adapted to receive an image from the at least one display and reflect the image to the associated seating position of the plurality of seating positions, wherein a user seated at the associated seating position of the plurality of seating positions within the vehicle perceives the image floating at a central location within the vehicle.

[0021] According to a further embodiment, the user display system is adapted to monitor a position of a head and eyes of a user using the plurality of sensors within the vehicle, display information at a specific location on the transparent cylindrical touchscreen display based on a position of the user's head and eyes, and display information at a specific location on the transparent cylindrical touchscreen display based on the position of the user's head and eyes relative to the perceived image, such that the information displayed on the transparent cylindrical touchscreen display is correctly positioned relative to the perceived image.

[0022] According to a further embodiment, when the identity of the user seated at the location within the vehicle is used to select user-specific content, the vehicle display server is adapted to access stored historical data of previous content viewed by the user, to select user-specific content based on contextual information, to prompt the user to selectively continue viewing content that the user previously viewed on another user display system, and to prompt a user to selectively view content that is already being viewed by other users within the same vehicle.

[0023] To understand the functions of the claimed system, a method is described below which includes the steps corresponding to the functions of the claimed system. The method for enabling vehicle display interaction with a vehicle display server positioned within a vehicle and in communication with a plurality of sensors positioned within the vehicle includes tracking head and eye position and movement of users sitting within a plurality of seating positions within the vehicle, detecting positions of users within the vehicle and when users change seating positions within the vehicle, detecting when a user enters and exits the vehicle, detecting and interpreting facial and gesture inputs from users within the vehicle, capturing images of users within the vehicle,and receiving audio inputs from users within the vehicle, providing, with haptic feedback devices positioned within the vehicle and in communication with the vehicle display server, haptic feedback to users seated within the vehicle, and identifying, using the plurality of sensors positioned within the vehicle, computer vision algorithms, and stored data, an identity of a user seated at one of the plurality of seating positions within the vehicle, selecting, using the identity of the user seated at one of the plurality of seating positions within the vehicle, user-specific content to be displayed on the user display system for the user seated at one of the plurality of seating positions, and automatically displaying the user-specific content with the user display system,positioned within the vehicle for viewing and interaction by a user seated in one of a variety of seating positions.

[0024] Further areas of application will become apparent from the present description. It is understood that the description and specific examples are for illustrative purposes only. Fig. 1 is a schematic view of a system; Fig. 2 is a schematic view of the Fig. 1, wherein the vehicle display system comprises a plurality of individual touchscreen displays; Fig. 3 is a schematic plan view of a vehicle with a system; Fig. 4 is a schematic side view of a vehicle display system including a display, a plurality of beamsplitters, and a cylindrical touchscreen display; Fig. 5 is a schematic side view of a vehicle display system having an imaging chamber including a display, a plurality of reflectors, and a cylindrical touchscreen display; Fig. 6 is a schematic plan view of the Fig. 5 shown image chamber; Fig. 7 is a schematic side view of the Fig. 5, which illustrates how the reflectors and displays of the imaging chamber move up and down and rotate; Fig. 8 is a schematic plan view of the Fig. 6, wherein a user at the second seating position has moved and, in response, the second reflector and the second display have rotated an angular distance to maintain alignment with the user at the second seating position; Fig. 9 is a schematic view showing how a user views an image and annotation information through an associated beam splitter and a transparent touchscreen display; and Fig. 10 is a flowchart showing a method.

[0025] The illustrations are not necessarily to scale, and some features may be exaggerated or reduced in size, for example, to show details of particular components. In some cases, well-known components, systems, materials, or methods have not been described in detail in order not to obscure the present description. Therefore, specific structural and functional details described herein are not to be construed as limiting, but merely as a basis for the claims and as a representative basis for teaching one skilled in the art how to variously apply the present description.

[0026] Furthermore, there is no intention to be bound by any expressed or implied theory presented in the preceding technical field, background, brief summary, or the following detailed description. It should be understood that throughout the drawings, corresponding reference characters designate like or corresponding parts and features.As used herein, the term module refers to any hardware, software, firmware, electronic control component, processing logic, and / or processor device, individually or in any combination, including, without limitation, an application-specific integrated circuit (ASIC), an electronic circuit, a processor (common, dedicated, or group) and memory executing one or more software or firmware programs, a combined logic circuit, and / or other suitable components that provide the described functionality. Although the figures shown herein represent an example with particular arrangements of elements, in actual embodiments, additional intervening elements, devices, features, or components may be present. It should also be understood that the figures are illustrative only and are not drawn to scale.

[0027] The term "vehicle" used herein is not limited to motor vehicles. While the present technology is primarily described in the context of motor vehicles, it is not limited to motor vehicles. The concepts can be used in a wide variety of applications, including aircraft, watercraft, other vehicles, and consumer electronic components.

[0028] Referring to Fig. 1, a system 10 for enabling vehicle display interaction includes a vehicle display server 12 positioned within a vehicle 14 and communicating with a plurality of sensors 16 positioned within the vehicle 14. The plurality of sensors 16 sense observable conditions of the external environment and the internal environment of the vehicle 14. The plurality of sensors 16 may include, but are not limited to, radars, lidars, global positioning systems, optical cameras, thermal cameras, ultrasonic sensors, pressure sensors, and / or other sensors. The cameras may include two or more digital cameras spaced apart from each other, where the two or more digital cameras are used to obtain stereoscopic images of the environment to create a three-dimensional image or map. The plurality of sensors 16 are used to determine information about the environment of the vehicle 14.In one exemplary embodiment, the plurality of sensors 16 includes at least one engine speed sensor, an engine torque sensor, an electric drive motor voltage and / or current sensor, an accelerator pedal position sensor, a coolant temperature sensor, a cooling fan speed sensor, and a transmission oil temperature sensor. In another exemplary embodiment, the plurality of sensors 16 further includes sensors for determining information about the environment of the vehicle 14, such as an ambient air temperature sensor, a barometric pressure sensor, and / or a still and / or video camera positioned to view the environment in front of the vehicle 14. In another exemplary embodiment, at least one of the plurality of sensors 16 is capable of measuring distances in the environment of the vehicle 14.

[0029] In one non-limiting example, where the plurality of sensors 16 includes a camera, the plurality of sensors 16 measures distances using an image processing algorithm configured to process images from the camera and determine distances between objects. In another non-limiting example, the plurality of sensors 16 includes a stereoscopic camera with distance measurement capabilities. In one example, at least one of the plurality of sensors 16 is mounted inside the vehicle 14, for example, in a headliner of the vehicle 14, looking through the windshield of the vehicle 14.In another example, at least one of the plurality of sensors 16 is a camera mounted outside the vehicle 14, for example, on a roof of the vehicle 14, that has a view of the surroundings of the vehicle 14 and is adapted to collect information (images) related to the surroundings outside the vehicle 14.

[0030] In an exemplary embodiment, the plurality of sensors 16 includes cameras and sensors adapted to capture images of users 18 seated in the vehicle 14 and to detect / monitor their movements. Such sensors 16 may include pressure sensors in a plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14 to determine whether a user 18 is seated in a particular seating position 20A, 20B, 20C, 20D within the vehicle 14. Such sensors 16 may also include cameras adapted to capture images of users 18 within the vehicle 14 and, using computer vision algorithms and software, use such captured images to determine the movement of users 18 within the vehicle 14 and the identity of users 18 within the vehicle 14.Such sensors 16 may be integrated into monitoring systems adapted to monitor the eyes and head orientation / movement of users 18 within the vehicle 14 to determine the gaze direction of a user 18 or to determine whether a user 18 is not fully paying attention or is distracted. It is understood that various additional types of sensor units, such as LiDAR sensors, ultrasonic sensors, radar sensors, and / or time-of-flight sensors, are within the scope of the present description.

[0031] In an exemplary embodiment, the vehicle 14 includes a plurality of seating positions 20A, 20B, 20C, 20D adapted to accommodate a user 18 seated therein. Referring to Fig. 1, Fig. 2 and Fig. 3, the vehicle 14, as shown, includes a first seating position 20A, a second seating position 20B, a third seating position 20C, and a fourth seating position 20D. It should be understood that the vehicle 14 may include more or fewer than four seating positions. The plurality of sensors 16 includes at least a first occupant monitoring camera 22A for monitoring the head and eye position and movement of a user 18 sitting in the first seating position 20A, a second occupant monitoring camera 22B for monitoring the head and eye position and movement of a user 18 sitting in the second seating position 20B, a third occupant monitoring camera 22C for monitoring the head and eye position and movement of a user 18 sitting in the third seating position 20C, and a fourth occupant monitoring camera 22D for monitoring the head and eye position and movement of a user 18 sitting in the fourth seating position 20D within the vehicle 14.

[0032] The first, second, third, and fourth occupant monitoring cameras 22A, 22B, 22C, 22D are adapted, along with other sensors within the vehicle 14, to continuously track the head and eye position and movement of users 18 sitting in the plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14, and to detect the locations of users 18 within the vehicle 14 and when users 18 change seating positions within the vehicle 14.The first, second, third, and fourth occupant monitoring cameras 22A, 22B, 22C, 22D and / or others of the plurality of sensors 16 within the vehicle 14 are adapted to detect when a user 18 enters and exits the vehicle 14, recognize and interpret facial and gesture inputs from users 18 within the vehicle 14, capture images of users 18 within the vehicle 14, and receive audio inputs from users 18 within the vehicle 14, wherein the plurality of sensors 16 includes at least one microphone 24 within the vehicle 14.

[0033] The images, audio signals, and data collected by the plurality of sensors 16, 22A, 22B, 22C, 22D, 24 are transmitted back to the vehicle display server 12. The vehicle display server 12 is a non-generalized electronic control device including a preprogrammed digital computer or processor, a memory or non-transitory computer-readable medium used to store data such as control logic, software applications, instructions, computer code, data, lookup tables, and so on, and a transceiver (or input / output ports). The computer-readable medium includes any type of medium adapted to be accessed by a computer, such as read-only memory (ROM), random access memory (RAM), a hard disk drive, a compact disc (CD), a digital video disc (DVD), or any other type of storage.A "non-transitory" computer-readable medium excludes wired, wireless, optical, or other communication connections that carry transitory electrical or other signals. A non-transitory computer-readable medium includes both media on which data can be permanently stored and media on which data can be stored and later overwritten, such as a rewritable optical disk or an erasable storage device. Computer code includes all types of program code, including source code, object code, and executable code.

[0034] The vehicle display server 12 is also in communication with haptic feedback devices 26A, 26B, 26C, 26D positioned within the vehicle 14 and adapted to provide haptic feedback to users 18 seated within the vehicle 14. The haptic feedback devices 26A, 26B, 26C, 26D may be actuators mounted within surfaces of the interior of the vehicle 14 or the vehicle seats and adapted to provide feedback that can be felt by a user.As illustrated, the vehicle includes first haptic feedback devices 26A adapted to provide haptic feedback to a user 18 seated in the first seating position 20A, second haptic feedback devices 26B adapted to provide haptic feedback to a user 18 seated in the second seating position 20B, third haptic feedback devices 26C adapted to provide haptic feedback to a user 18 seated in the third seating position 20C, and fourth haptic feedback devices 26D adapted to provide haptic feedback to a user 18 seated in the fourth seating position 20D within the vehicle 14.

[0035] The vehicle display server 12 is further in communication with a user display system 28 positioned within the vehicle 14 for viewing and interaction by users 18 seated in the plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14. The user display system 28 provides video and audio output to the users 18 within the vehicle 14, allowing the users 18 to view media accounts, watch movies, view enhanced images of the environment outside the vehicle 14, or play games with other users 18 within the vehicle 14 or within other remote vehicles.

[0036] In an exemplary embodiment, the user display system 28 comprises either 1) a plurality of individual display screens 30A, 30B, 30C, 30D adapted to display information and receive inputs from a user 18, wherein a single display screen 30A, 30B, 30C, 30D is associated with each of the plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14, or 2) the user display system 28 comprises a single display system 32 having at least one display 34 for projecting an image 36, a plurality of reflectors 38A, 38B, 38C, 38D, wherein each of the plurality of reflectors 38A, 38B, 38C, 38D is associated with one of the plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14 and is adapted to reflect a projected image 36 to the associated seating position of the plurality of seating positions 20A, 20B, 20C, 20D such that a user 18,seated at the associated seating position from the plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14, perceiving the image 36 floating at a central location within the vehicle 14, and a transparent cylindrical touchscreen display 40 positioned between the plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14 and the plurality of reflectors 38A, 38B, 38C, 38D and adapted to display user-specific content for users 18 at each of the plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14 and to receive inputs from each of the users 18 at each of the plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14.

[0037] As in Fig. 2, the user display system 28 in an exemplary embodiment includes a plurality of individual display screens 30A, 30B, 30C, 30D adapted to display information and receive inputs from a user 18. As shown in Fig. 2, the vehicle 14 includes the first, second, third, and fourth seating positions 20A, 20B, 20C, 20D, and a first individual display screen 30A is associated with the first seating position 20A for viewing by a user 18 seated in the first seating position 20A, a second individual display screen 30B is associated with the second seating position 20B for viewing by a user 18 seated in the second seating position 20B, a third individual display screen 30C is associated with the third seating position 20C for viewing by a user 18 seated in the third seating position 20C, and a fourth individual display screen 30D is associated with the fourth seating position 20D for viewing by a user 18 seated in the fourth seating position 20D.As the users 18 move within the vehicle 14 and are seated at the first, second, third, and fourth seating positions 20A, 20B, 20C, 20D, and possibly at positions between the first, second, third, and fourth seating positions 20A, 20B, 20C, 20D, the system 10 uses the plurality of sensors 16, including the first, second, third, and fourth occupant monitoring cameras 22A, 22B, 22C, 22D, to determine which of the plurality of individual display screens 30A, 30B, 30C, 30D is best positioned to provide visibility for a particular user 18 based on the precise position of the user 18 relative to the plurality of individual display screens 30A, 30B, 30C, 30D and the eye position and view angle of the user 18 relative to the plurality of individual Display screens 30A, 30B, 30C, 30D.

[0038] The first, second, third, and fourth individual display screens 30A, 30B, 30C, 30D are adapted to display visual content for the users 18 and to enable the users 18 to provide inputs to the system 10. In an exemplary embodiment, the first, second, third, and fourth individual display screens 30A, 30B, 30C, 30D include touchscreen functions that enable a user 18 to interact with the system 10 and the displayed content by manually touching the first, second, third, and fourth individual display screens 30A, 30B, 30C, 30D. It is understood that the first, second, third, and fourth individual display screens 30A, 30B, 30C, 30D are Fig. 2 may be any known type of display screen adapted for use within a vehicle 14, with or without touchscreen features, without departing from the scope of the present description.

[0039] Again referring to Fig. 1 and on Fig. 3, in a further exemplary embodiment, the user display system 28 comprises a single display system 32 comprising at least one display 34 for projecting an image 36, a plurality of reflectors 38A, 38B, 38C, 38D, wherein each of the plurality of reflectors 38A, 38B, 38C, 38D is associated with one of the plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14 and is adapted to reflect a projected image 36 onto the associated seating position of the plurality of seating positions 20A, 20B, 20C, 20D such that a user 18 seated at the associated seating position of the plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14 perceives the image 36 projected at a central location within the vehicle 14, and a transparent cylindrical touchscreen display 40 that is movable between the plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14 and the plurality of reflectors 38A, 38B, 38C,38D and adapted to display user-specific content for users 18 at each of the plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14 and to receive inputs from each of the users 18 at each of the plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14.

[0040] With reference to Fig. 3 and Fig. 4, the user display system 28, 32, in an exemplary embodiment, includes at least one display 34 adapted to project a plurality of three-dimensional images, and a plurality of reflectors 38A, 38B, 38C, 38D, wherein the reflectors 38A, 38B, 38C, 38D are transparent beamsplitters. A reflector / beamsplitter 38A, 38B, 38C, 38D is individually associated with each of the plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14. For a detailed description herein, Fig. 4 is a schematic side view of only the first seating position 20A and the second seating position 20B of the Fig. 1 and Fig. 3 illustrated vehicle 14. The plurality of three-dimensional images can be generated by means of a holographic process, pre-calculated and encoded in a hologram generator 42 within the at least one display 34.

[0041] The transparent cylindrical touchscreen display 40 is disposed between the first, second, third, and fourth seating positions 20A, 20B, 20C, 20D and the perceived image 36 floating at the central location within the vehicle 14. The transparent cylindrical touchscreen display 40 is adapted to allow the users 18 seated in the first, second, third, and fourth seating positions 20A, 20B, 20C, 20D to receive annotated information and provide input to the system 10. As illustrated, the transparent cylindrical touchscreen display 40 surrounds the floating image 36 and is thus located between the eyes of the users 18 seated in the first, second, third, and fourth seating positions 20A, 20B, 20C, 20D and the perceived image 36 floating at the central location within the vehicle 14.In an exemplary embodiment, the transparent cylindrical touchscreen display 40 is an organic light-emitting diode (OLED). It should be understood that the transparent cylindrical touchscreen display 40 may also be other types of transparent touchscreen displays known in the art.

[0042] The transparent cylindrical touchscreen display 40 is adapted to present visible displayed information only to a user 18 sitting in one of the first, second, third and fourth seating positions 20A, 20B, 20C, 20D, wherein the displayed content, for example, for a user sitting in the first seating position 20A, is only visible to the user 18 sitting in the first seating position 20A and is different from the content displayed for other seating positions within the vehicle 14.

[0043] Again referring to Fig. 4, the at least one display 34 is adapted to project the plurality of three-dimensional images onto one of the plurality of reflectors / beamsplitters (38A, 38B, 38C, 38D), as indicated by arrows 44. Each of the plurality of reflectors / beamsplitters 38A, 38B, 38C, 38D is adapted to receive one of the plurality of three-dimensional images from the display 34 and to reflect the one of the plurality of three-dimensional images from the display 34 to a user 18 seated at one of the plurality of seating positions 20A, 20B, 20C, 20D, as indicated by arrows 46. Users at each of the plurality of seating positions 20A, 20B, 20C, 20D perceive the floating image 36 at a location centrally located within the vehicle 14, as indicated by lines 48.

[0044] Each of the plurality of reflectors / beamsplitters 38A, 38B, 38C, 38D and the transparent cylindrical touchscreen display 40 is transparent, whereby a user 18 can see through the reflector / beamsplitter 38A, 38B, 38C, 38D and the transparent cylindrical touchscreen display 40, as indicated at 48. This allows the users 18 to perceive the floating image 36 at a distance beyond the reflectors / beamsplitters 38A, 38B, 38C, 38D, and further allows the users 18 to see through the reflectors / beamsplitters 38A, 38B, 38C, 38D and view the interior of the vehicle compartment and other users therein.

[0045] As in Fig. 4, the reflector / beam splitter 38A is illustrated, with the reflector / beam splitter 38A being movable between a retracted position 50 and an extended position 52. In an exemplary embodiment, the reflector / beam splitter 38A is attached to a support shaft 54A that depends from the roof 28 of the vehicle compartment. In the retracted position 50, the reflector / beam splitter 38A is positioned adjacent the display 34 and parallel to the roof 56 of the vehicle compartment. The reflector / beam splitter 38A is pivotable relative to the support shaft 54A, as indicated by arrow 58, and the support shaft 54A is vertically extendable up and down, as indicated by arrow 60. From the retracted position 50, the reflector / beam splitter 38A is pivoted downward and the support shaft 54A is extended downward to bring the reflector / beam splitter 38A into the extended position 52 for use.In the extended position 52, the reflector / beam splitter 38A is in operative proximity to the display 34 and to a user 18 sitting in the first seating position 20A.

[0046] In Fig. 4, the reflector / beam splitter 38B is shown mounted on an armrest 62 adjacent the user 18 seated in the second seating position 20B. The reflector / beam splitter 38B is attached to a support shaft 54B attached to the armrest 62. The reflector / beam splitter 38B, which is mounted on the armrest 62, can also be moved from a retracted to an extended position (not shown). In one embodiment, the reflector / beam splitter 38B is stowed within the armrest 62 when in the retracted position.

[0047] In one exemplary embodiment, the orientation of each of the plurality of reflectors / beam splitters 38A, 38B, 38C, 38D is fixed. Thus, when the reflectors / beam splitters 38A, 38B, 38C, 38D are in the extended position 52, the angular orientation vertically and horizontally relative to the support shaft 54A, 54B is fixed. Alternatively, in another exemplary embodiment, the orientation of each of the plurality of reflectors / beam splitters 38A, 38B, 38C, 38D is adjustable. The reflector / beam splitter 38A, 38B, 38C, 38D may be pivotally mounted on the support shaft 54A, 54B, wherein the reflector / beam splitter 38A, 38B, 38C, 38D is horizontally pivotable, as indicated by arrow 64, and further the reflector / beam splitter 38A, 38B, 38C, 38D may be pivotally mounted on the support shaft 54A, 54B, wherein the beam splitter 38A, 38B, 38C, 38D is vertically pivotable.The adjustability of the reflector / beam splitter 38A, 38B, 38C, 38D allows the reflector / beam splitter 38A, 38B, 38C, 38D to be positioned according to the position of the user 18 sitting in the associated seating position of the plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14 and the height of the user 18, thereby ensuring that the system 10 can be customized to accommodate users of different sizes and seating position / orientation preferences. Furthermore, the adjustability of the orientation of the reflector / beam splitter 38A, 38B, 38C, 38D allows the perceived position of the floating image 36 to be adjusted according to the user's preferences.

[0048] In an exemplary embodiment, each of the plurality of reflectors / beamsplitters 38A, 38B, 38C, 38D is in communication with the occupant monitoring cameras 22A, 22B, 22C, 22D associated with each of the seating positions 20A, 20B, 20C, 20D, wherein an orientation of each of the plurality of reflectors / beamsplitters 38A, 38B, 38C, 38D automatically changes in response to movement of the head and eyes of a user 18 seated in the associated seating position 20A, 20B, 20C, 20D.

[0049] Further details about the Fig. The user display system 28, 32 shown in Figure 4 are described in U.S. patent application Serial No. 17 / 842,272, Publication No. US 2023 / 0 408 841 A1, filed June 16, 2022, entitled “MULTI-PERSPECTIVE THREE-DIMENSIONAL FLOATING IMAGE DISPLAY WITH TOUCH FUNCTION.”

[0050] With reference to Fig. 3 and Fig. 5, the user display system 28 comprising a single display system 32 in a further exemplary embodiment further comprises an image chamber 66 comprising the at least one display 34 adapted to project an image 36, and a plurality of reflectors 38A, 38B, 38C, 38D, wherein a reflector is individually associated with each of the plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14 and is adapted to reflect the image 36 to the associated seating position of the plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14, such that a user 18 seated at the associated seating position of the plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14 perceives the image 36 projected at a central location within the vehicle 14 floats.The imaging chamber 66 includes transparent panels 68 adapted to allow the image 36 reflected by the reflectors 38A, 38B, 38C, 38D to pass outward from the imaging chamber 66 toward a user 18 seated at the associated seating position from the plurality of seating positions 20A, 20B, 20C, 20D. The imaging chamber 66 further includes fixed panels 70 adapted to prevent light from entering the imaging chamber 66 behind the reflectors 38A, 38B, 38C, 38D.

[0051] The transparent cylindrical touchscreen display 40 is positioned between the reflectors 38A, 38B, 38C, 38D of the imaging chamber 66 and the plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14 and is adapted to display information for users 18 seated at the plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14 within an image plane 48, 50 positioned in front of the perceived image 36 floating at the central location within the vehicle 14.

[0052] Fig. 5 shows the imaging chamber 66, which includes a first display 34A adapted to project a first three-dimensional image 36A, and a first reflector 38A individually associated with the first display 34A and a user 18 in the first seating position 20A, and a second display 34B adapted to project a second three-dimensional image 36B, and a second reflector 38B individually associated with the second display 34B and a user 18 in the second seating position 20B. As in Fig. 5, the user display system 28, 32 is shown for the purpose of description only with the first and second seating positions 20A, 20B and the first and second displays 34A, 34B and the first and second reflectors 38A, 38B. It is understood that the user display system 28, 32 can be adapted to accommodate any number of users 18 and corresponding seating positions 20A, 20B, 20C, 20D, as in Fig. 3 shown.

[0053] As in Fig. 3, the vehicle includes first, second, third, and fourth seating positions 20A, 20B, 20C, 20D. Each reflector 38A, 38B, 38C, 38D is adapted to be viewed by a user 18 seated in one of the first, second, third, and fourth seating positions 20A, 20B, 20C, 20D. Each reflector 38A, 38B, 38C, 38D is adapted to receive an image 36 from the associated display 34 and reflect the image 36 to the associated seating position 20A, 20B, 20C, 20D for viewing by a user 18 seated therein. The user 18 perceives the image 36 floating at a central location within the image chamber 66.

[0054] Again referring to Fig. 5, the first reflector 38A is adapted to receive the first image 36A from the first display 34A, as indicated by arrows 72, and to reflect the first image 36A to the user 18 within the first seating position 20A, as indicated by arrows 74, wherein the user 18 within the first seating position 20A perceives the first image 36A floating at a central location within the imaging chamber 66, as indicated by arrows 76. The second reflector 38B is adapted to receive the second image 36B from the second display 34B, as indicated by arrows 78, and to reflect the second image 36B to the user 18 in the second seating position 20B, as indicated by arrows 80, wherein the user 18 in the second seating position 20B perceives the second image 36B suspended at the central location within the imaging chamber 66, as indicated by arrows 82.

[0055] Again referring to Fig. 3, each of the users 18 seated at the first, second, third, and fourth seating positions 20A, 20B, 20C, 20D perceives an image 36 reflected to them by the respective associated reflectors 38A, 38B, 38C, 38D, and the users 18 perceive the image 36 reflected to them within the image chamber 66, as indicated by lines 84. Each of the displays 34 can project the same image 36 onto each of the reflectors 38A, 38B, 38C, 38D and thus onto each of the users at the first, second, third, and fourth seating positions 20A, 20B, 20C, 20D. Alternatively, each of the displays 34 may display a different perspective of the same image or a completely different image for each of the reflectors 38A, 38B, 38C, 38D.In this way, the system 10 is able to present the same floating image 36 to all seating positions 20A, 20B, 20C, 20D so that the users 18 can see it simultaneously, or alternatively, each user 18 at each seating position 20A, 20B, 20C, 20D can see a different perspective of the floating image 36 or a completely different three-dimensional image.

[0056] The transparent cylindrical touchscreen display 40 is positioned between the plurality of seating positions 20A, 20B, 20C, 20D and the reflectors 38A, 38B, 38C, 38D. The transparent cylindrical touchscreen display 40 is adapted to display information to the users 18 within an image plane 84, 86 positioned in front of the perceived first and second images 36A, 36B floating at the central location within the image chamber 66. The transparent cylindrical touchscreen display 40 presents information to the user 18 seated in the first seating position 20A, appearing in a first image plane 84, wherein the information displayed to the user 18 in the first seating position 20A on the transparent cylindrical touchscreen display 40 appears in front of the image 36A perceived by the user 18 in the first seating position 20A in the image chamber 66.The transparent cylindrical touchscreen display 40 presents information to the user 18 in the second seating position 20B, appearing in a second image plane 86, wherein the information displayed to the user 18 in the second seating position 20B on the transparent cylindrical touchscreen display 40 appears in front of the image 36B perceived by the user 18 in the second seating position 20B in the image chamber 66.

[0057] The transparent cylindrical touchscreen display 40 is adapted to allow users 18 seated in the plurality of seating positions 20A, 20B, 20C, 20D to receive annotated information and provide input to the system 10. The transparent cylindrical touchscreen display 40 surrounds the imaging chamber 66 and is thereby located between the eyes of the users 18 seated in the plurality of seating positions 20A, 20B, 20C, 20D and the perceived image 36, 36A, 36B floating at the central location within the imaging chamber 66.

[0058] The transparent cylindrical touchscreen display 40 is adapted to present visible displayed information only to the user 18 sitting in a seating position 20A, 20B, 20C, 20D directly in front of a portion of the transparent cylindrical touchscreen display 40. The transparent cylindrical touchscreen display 40 is configured such that the displayed information is only displayed on a first side, the outward-facing cylindrical surface, of the transparent cylindrical touchscreen display 40. A second side, the inward-facing cylindrical surface, of the transparent cylindrical touchscreen display 40 does not display any information and therefore allows the other users 18 to see through the transparent cylindrical touchscreen display 40 when viewed by the other users 18.

[0059] In an exemplary embodiment, the transparent cylindrical touchscreen display 40 is an autostereoscopic display adapted to display stereoscopic or three-dimensional images by adding a binocular perception of three-dimensional depth without the use of a special headgear, glasses, anything that obstructs the viewer's vision, or anything for the viewer's eyes. Because no headgear is required, autostereoscopic displays are also referred to as "glasses-free 3D" or "glasses-free 3D."

[0060] As in Fig. 6, the transparent plates 68 of the image chamber 66 allow the users 18 to see their associated reflector 38A, 38B, 38C, 38D. As shown, the image chamber 66 includes a first transparent plate 68A adapted to allow the first image 36A reflected by the first reflector 38A to pass outwardly from the image chamber 66 toward the user 18 seated in the first seating position 20A, as indicated by the arrows 74 in Fig. 5. Furthermore, the image chamber 66 includes a second transparent plate 68B adapted to allow the second image 36B reflected by the second reflector 38B to pass outwardly from the image chamber 66 toward the user 18 seated in the second seating position 20B, as indicated by the arrows 80 in Fig. 5 is displayed.

[0061] The imaging chamber 66 also includes fixed plates 70 adapted to prevent light from entering the imaging chamber 66 from behind the first and second reflectors 38A, 38B. The imaging chamber 66 functions similarly to a Pepper's Ghost Chamber, wherein the image of an object is perceived by a viewer within a reflective surface adjacent to the actual image. As described above, in the present specification, the image presented by a display that is not within the field of view of a passenger 18 is reflected by a reflector 38A, 38B, 38C, 38D toward the user 18, such that the user 18 "sees" the image 36 within the imaging chamber 66 and perceives the image 36 as floating behind the reflective surface of the reflector 38A, 38B, 38C, 38D. When the image chamber 66 is exposed to ambient light behind the reflectors 38A, 38B, 38C, 38D, the image 36 cannot be seen by the users 18.Therefore, the fixed plates 70 of the image chamber 66 are adapted to prevent light from entering the image chamber 66 behind the first and second reflectors 38A, 38B. As shown in . Fig. 6, the imaging chamber 66 includes fixed, overlapping plates 70A, 70B adapted to prevent light from entering the imaging chamber 66 behind the first and second reflectors 38A, 38B.

[0062] According to Fig. 7, the user display system 28, 32, in an exemplary embodiment, is selectively movable vertically up and down along a vertical central axis 88, as indicated by arrow 90. Furthermore, each display and associated reflectors 38A, 38B, 38C, 38D are uniformly and selectively rotatable about the vertical central axis 88, as indicated by arrows 92. This allows the system 10 to adapt to different locations of the passengers 18 within the vehicle 14.

[0063] As in Fig. 8, the first reflector 38A and the first display 34A are rotatable about the vertical central axis 88, as indicated by arrow 94. The second reflector 38B and the second display 34B are rotatable about the vertical central axis 88, as indicated by arrow 96. As shown in Fig. 5, the users 18 are seated in the first and second seating positions 20A, 20B directly opposite each other, and the first reflector 38A and the first display 34A are arranged 180 degrees apart from the second reflector 38B and the second display 34B. As shown in Fig. 8, the position of the head of the user 18 in the second seating position 20B has moved, and the second reflector 38B and the second display 34B have been rotated by an angular distance 98 to ensure that the user 18 in the second seating position 20B perceives the image 36B from the second display 34B and the second reflector 38B.

[0064] In an exemplary embodiment, the first fixed plates 70A, disposed on either side adjacent to the first reflector 38A, are adapted to move together with the first reflector 38A and the first display 34A when the first reflector 38A and the first display 34A rotate about the vertical center axis 88. The second fixed plates 70B, disposed on either side adjacent to the second reflector 38B, can move together with the second reflector 38B and the second display 34B when the second reflector 38B and the second display 34B rotate about the vertical center axis 88. The first fixed plates 70A overlap the second fixed plates 70B to allow relative movement of the first fixed plates 70A with respect to the second fixed plates 70B and to ensure that ambient light is prevented at all times from entering the imaging chamber 66 behind the first and second reflectors 38A, 38B.

[0065] In an exemplary embodiment, each of the displays 34, 34A, 34B and the associated reflectors 38A, 38B, 38C, 38D are in communication with the occupant monitoring cameras 22A, 22B, 22C, 22D, wherein the orientation of each display 34, 34A, 34B and the associated reflector 38A, 38B, 38C, 38D automatically changes in response to the movement of the head and eyes of a user 18 detected by the occupant monitoring cameras 22A, 22B, 22C, 22D.

[0066] In an exemplary embodiment, the user display system 28, 32 receives data from the first occupant monitoring camera 22A relating to the position of the head and eyes of the user sitting in the first seating position 20A. The first display 34A and the first reflector 38A are adapted to rotate in response to the movement of the head and eyes of the user 18 based on the data received from the first occupant monitoring camera 22A. The user display system 28, 32 also receives data from the second occupant monitoring camera 22B relating to the position of the head and eyes of the user sitting in the second seating position 20B. The second display 34B and the second reflector 38B are adapted to rotate in response to the movement of the head and eyes of the user 18 based on the data received from the second occupant monitoring camera 22B.In addition to rotating the first display 34A and first reflector 38A and the second display 34B and second reflector 38B, the user display system 28, 32 can move up and down along the vertical central axis 88 in response to the movement of the head and eyes of the users 18 in the first and second seating positions 20A, 20B, as shown in FIG. Fig. 7 shown.

[0067] Further details about the Fig. The user display system shown in Figures 5-8 are described in U.S. patent application Ser. No. 18 / 153,767, US 2024 / 0 241 389 A1, filed January 12, 2023, entitled “ADAPTIVE INTERACTIVE CAMPFIRE DISPLAY,” which is hereby incorporated by reference in its entirety into the present specification.

[0068] In another exemplary embodiment, the system 10 includes acoustic devices, such as at least one microphone 24, for enabling a user 18 to provide acoustic input to the system 10. The system 10 may include a microphone 24 adapted to receive acoustic input from each user 18 within the vehicle 14, and / or a microphone 24 specifically associated with one of the first, second, third, and fourth seating positions 20A, 20B, 20C, 20D and adapted to receive acoustic input only from the user 18 seated within the associated first, second, third, and fourth seating positions 20A, 20B, 20C, 20D.

[0069] In an exemplary embodiment, the user display system 28 is adapted to accept input from a user 18 based solely on the contact between the user 18 and the user display system 28. For example, if a user 18 extends their hand to touch the touchscreen display 40 with their fingertip, the touchscreen display 40 accepts the input based solely on the point of contact between the fingertip of the passenger 18 and the transparent touchscreen display 40.

[0070] In another exemplary embodiment, the system 10 is adapted to accept input from a user 18 based on the contact between the user 18 and the touchscreen display 40 and based on the position of a contact point between the user 18 and the touchscreen display 40 relative to the perceived image 36. For example, the occupant monitoring cameras 22A, 22B, 22C, 22D track the movement and position of the eyes and head of the user 18. The touchscreen display 40 displays information perceived by the user 18 relative to the floating image 36, as described above. When the user 18 touches the touchscreen display 40, the user 18 perceives that they are touching the floating image 36.The user display system 10 uses parallax compensation to correlate the actual point of contact between the user's 18 fingertip on the touchscreen display 40 with the location on the floating image 36 that the user 18 perceives as touching.

[0071] The user display system 28 can display several different blocks of annotated information on the touchscreen display 40 relative to a floating image 36. As the user's head and eyes move, the user's head and eyes are positioned at a different distance and angle relative to the touchscreen display 40, thereby changing the perceived position of the displayed information relative to the image 36. By utilizing parallax compensation techniques such as those described in U.S. Patent No. 1,0318,043 B2 to Seder et al., which is hereby incorporated by reference, the user display system 28 ensures that when the user 18 touches the touchscreen display 40, the user display system 28 correctly identifies the intended piece of annotated information that the user 18 selects.

[0072] In another exemplary embodiment, the user display system 28 is adapted to accept input from a user 18 based on gestures of the user 18 when the user 18 is not touching the touchscreen display 40. For example, when the user 18 moves a hand or points at an object displayed on the touchscreen display 40, or at an object inside the vehicle compartment or outside the vehicle 14.

[0073] With further reference to Fig. 5 and using the embodiment of the user display system 28, 32 shown therein, the user display system 28, in an exemplary embodiment, includes a first gesture sensor 110 adapted to monitor the position and movement of the arms, hands, and fingers 114 of the user 18 seated in the first seating position 20A and to collect data related to the gestures performed by the user 18. The first gesture sensor 110 is integrated into or with the first occupant monitoring camera 22A and may include a separate camera and / or motion sensors adapted to detect the position and movement of the arms, hands, and fingers of the user 18 seated in the first seating position 20A.Furthermore, the user display system 28 includes a second gesture sensor 112 adapted to monitor the position and movement of the arms, hands, and fingers of the user 18 seated in the second seating position 20B and to capture data related to the gestures performed by the user 18. The second gesture sensor 112 is integrated into or with the second occupant monitoring camera 22B and may include a separate camera and / or motion sensors adapted to capture the position and movement of the arms, hands, and fingers of the user 18 seated in the second seating position 20B.

[0074] The vehicle display server uses the data collected by the first and second gesture sensors 110, 112 to recognize the gestures made by the users 14A, 14B within the vehicle, using computer vision and computer learning algorithms and parallax compensation techniques to interpret such gestures and identify input data.

[0075] In an exemplary embodiment, the vehicle display server 12 is adapted to recognize the identity of a user 18 seated in one of the plurality of seating positions 20A, 20B, 20C, 20D in the vehicle 14 using the plurality of sensors 16 positioned in the vehicle 14, computer vision algorithms, and stored data. Once the vehicle display server 12 has identified the user 18, the vehicle display server 12 selects user-specific content to display for the user 18 on the user display system 28. The user-specific content may include applications or accounts that the user 18 has previously registered for and regularly accesses with the system 10. For example, a user 18 regularly watches a streamed news service when using the system 10 in the vehicle 14.Thus, when the vehicle display server 12 identifies the user 18, the vehicle display server 12 selects the streamed news service as user-specific content that can be displayed to the user 18. The user-specific content can also include contextual content; for example, if local weather services forecast very severe weather in the near future, the vehicle display server 12 can mark weather information services as user-specific content to be displayed to the user 18 to inform the user of the impending severe weather.User-specific content may also be based on probabilistic calculations using a machine learning algorithm as to what content the user 18 desires based on stored data, taking into account the time of day / night, the destination, the number of passengers in the vehicle with the user 18, the identity of the other passengers in the vehicle 14, and so on.

[0076] Once the vehicle display server 12 has selected user-specific content to be displayed for the user 18 using the identity of the user 18, the vehicle display server 12 automatically displays the user-specific content on the user display system 28 for the seating position 20A, 20B, 20C, 20D where the user 18 is seated. The automatic display of user-specific content depends on the system 10 identifying the user 18 and the user 18 being registered with the system 10 and agreeing to the terms and conditions associated with using the system 10. If the system 10 identifies the user 18 as a registered user of the system 10, the system will automatically initiate the display of user-specific content selected for that user 18.The vehicle display server 12 may display multiple options of different items included in the user-specific content, or automatically prioritize different items of user-specific content based on probabilistic calculations and display the item with the highest ranking. For example, a user 18 may be watching a movie on the user display system 28 within the vehicle 14 when the vehicle 14 arrives at a destination, at which point the user 18 finishes viewing the movie and exits the vehicle 14. When the user 18 returns to the vehicle 14, the vehicle display server 12 prioritizes the movie and automatically resumes displaying the movie for the user 18 on the user display system 28 aligned with the seating position 20A, 20B, 20C, 20D in which the user 18 is seated.

[0077] In an exemplary embodiment, when a user 18 seated at the first seating position 20A in the vehicle 14 moves to the second seating position 20B in the vehicle 14, the vehicle display server 12 is adapted to communicate with the plurality of sensors 16 positioned in the vehicle 14, such as the first occupant monitoring camera 22A, to detect when the user 18 leaves the first seating position 20A in the vehicle 14. When the vehicle display server 12 detects that the user 18 has left the first seating position 20A, the vehicle display server 12 automatically pauses the user-specific content currently being displayed on the user display system 28 for the first seating position 20A.When the vehicle display server 12 detects, with the plurality of sensors 16 positioned within the vehicle 14, such as the second occupant monitoring camera 22B, that the user 18 is seated at the second seating position 20B within the vehicle 14, the vehicle display server 12 automatically continues displaying the user-specific content on the user display system 28 directed toward the second seating position 20B.

[0078] For example, if a user 18 is viewing content specific to that user 18 on the user display system 28 at a particular seating position and additional passengers enter the vehicle 14, necessitating re-arranging the user 18 and the other passengers in the vehicle 14, the vehicle display server 12 automatically detects when the user 18 moves and automatically resumes the user's content when the user 18 selects a new seating position in the vehicle 14.

[0079] In another exemplary embodiment, the vehicle display server 12 is adapted to detect, using the plurality of sensors 16 positioned in the vehicle 14, when a user 18 viewing the user display system 28 looks away from the user display system 28, pause the user-specific content displayed on the user display system 28, detect, using the plurality of sensors 16 positioned in the vehicle 14, when the user 18 looks back at the user display system 28, and resume displaying the user-specific content on the user display system 28.For example, if a user 18, seated in the first seating position 20A within the vehicle 14, is viewing user-specific content on the user display system 28 and looks away from the user display system 28 to observe a situation outside the vehicle 14, the vehicle display server 12 automatically detects, using the plurality of sensors 16 positioned within the vehicle 14, such as the first occupant monitoring system 22A, that the user is looking away. The vehicle display server 12 then pauses the user-specific content displayed on the user display system 28, such as a movie that the user 18 is currently watching, until the vehicle display server 12 detects, using the first occupant monitoring camera 22A, that the user 18 is looking back at the user display system 28, at which point the vehicle display server 12 resumes the movie.

[0080] As in Fig. 1, the system 10 further includes a cloud-based host server 120 that communicates with the vehicle display server 12 in the vehicle 14 via a wireless communication network 122. The cloud-based host server 120 is also in communication with at least one remote vehicle 124, the remote vehicle 124 having a vehicle display server 12' in communication with the cloud-based host server 120, a plurality of sensors 16', haptic feedback devices 26A', 26B', 26C', 26D', a plurality of seating positions 20A', 20B', 20C', 20D', and a user display system 28' substantially identical to the corresponding features of the vehicle 14.

[0081] In an exemplary embodiment, when a user 18 seated in the vehicle 14 exits the vehicle 14 and moves to one of the at least one remote vehicle 124, the vehicle display server 12 within the vehicle 14 is adapted to detect, with the plurality of sensors 16 positioned within the vehicle 14, such as the occupant monitoring cameras 22A, 22B, 22C, 22D, when the user 18 exits the vehicle 14 and to pause the user-specific content currently being displayed on the user display system 28 within the vehicle 14. The vehicle display server 12' within the at least one remote vehicle 124 is adapted to detect, with the plurality of sensors 16' positioned within the at least one remote vehicle 124, when the user 18 enters the at least one remote vehicle 124.The vehicle display server 12' uses the plurality of sensors 16' positioned in the at least one remote vehicle 124, computer vision algorithms, and stored data to identify the user 18. The vehicle display server 12' in the one of the at least one remote vehicle 124 then receives information regarding the user-specific content that the user 18 viewed in the vehicle 14 prior to exiting the vehicle 14 from the host server 120 via communication with the vehicle display server 12 within the vehicle 14.At this time, the vehicle display server 12' in the one of the at least one remote vehicle 124 automatically resumes displaying the user-specific content on the user display system 28' in the one of the at least one remote vehicle 124 into which the user 18 has entered, at the seating position 20A', 20B', 20C', 20D' in the one of the at least one remote vehicle 124 in which the user 18 is seated.

[0082] In this way, a user 18 can continue to interact with user-specific content during a trip because the user-specific content automatically follows the user 18. For example, a user 18 is playing an interactive game with other players located at a remote location. The user 18 begins the game while driving in their personal vehicle 14 en route to a ride-sharing location, where the user 18 exits their personal vehicle 14 and enters an autonomous ride-sharing vehicle 124. The system 10 automatically pauses the display on the user display system 28 within the personal vehicle 14 and interrupts the game when the user 18 exits their personal vehicle 14.Once the user 18 enters the autonomous ride-sharing vehicle 124 and selects a seating position 20A', 20B', 20C', 20D' within the autonomous ride-sharing vehicle 124, the vehicle display server 12' within the autonomous ride-sharing vehicle 124 will resume play with the other players and display the game on the user display system 28' within the autonomous ride-sharing vehicle 124.

[0083] The host server is adapted to coordinate the vehicle display server 12 and user display system 28 located in the vehicle 14 and viewed by a first user 18 with a vehicle display server 12' and user display system 28' located in one of the at least one remote vehicle 124 and viewed by a second user 18', and to facilitate communication and interaction between the first user 18 and the second user 18'. In this manner, the host server 120 provides for coordinated interaction between the first user 18 and the second user 18' when watching the same movie, playing an interactive game together, or participating in multi-party audio and / or video conversations.

[0084] In an exemplary embodiment, the host server is in communication with a personal device 126 of a user 18. For example, a user 18 registered to use the system 10 may have an app that enables the personal device 126, such as a phone or tablet, to connect to the system 10. Thus, when the user 18 is viewing user-specific content on the user display system 28 in the vehicle 14 and the user 18 exits the vehicle 14, the host server 120 is adapted to receive data from the plurality of sensors 16 positioned in the vehicle 14, via communication with the vehicle display server 12 in the vehicle 14 when the user 18 exits the vehicle 14, and to automatically pause the user-specific content currently being displayed on the user display system 28 in the vehicle 14.When the personal device 126 is connected to the system 10, the host server 120 automatically resumes display of the custom content on the personal device 126 of the user 18 after the user 18 exits the vehicle 14. The host server 120 also provides the user 18 with the ability to selectively exit the custom content or to pause the custom content without resuming it on the personal device 126.Similarly, when the user 18 is viewing user-specific content on the personal device 126 and the user 18 enters the vehicle 14, the host server 120 can detect, with data obtained from the plurality of sensors 16 positioned in the vehicle 14 via communication with the vehicle display server 12 in the vehicle 14, when the user 18 enters the vehicle 14 and automatically prompt the user 18 to selectively pause the user-specific content currently being displayed on the personal device 126 and resume displaying the user-specific content on the user display system 28 in the vehicle 14.

[0085] In an exemplary embodiment, the plurality of sensors 16 within the vehicle, specifically the first, second, third, and fourth occupant monitoring cameras 22A, 22B, 22C, 22D, are adapted to monitor the head and eye position of each of the users 18 seated in the plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14. For each seating position 20A, 20B, 20C, 20D, the vehicle display server 12 is adapted to display information at a specific location on the transparent touchscreen display 40 of the user display system 28 based on a head and eye position of the user 18.In another exemplary embodiment, the vehicle display server 12 is adapted to display, for each of the plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14, information at a particular location on the transparent touchscreen display 40 of the user display system 28 based on the position of the head and eyes of the user 18 relative to the perceived image 36 floating at the central location within the vehicle 14, such that for each of the plurality of seating positions 20A, 20B, 20C, 20D, information displayed on the transparent touchscreen display 40 of the user display system 28 is properly positioned with respect to the perceived image 36 as viewed by the user 18 seated in the seating position 20A, 20B, 20C, 20D.

[0086] Fig. Figure 9 shows a schematic view of a user 18 viewing a user display system 28 comprising an associated reflector 38, a transparent touchscreen display 40, and a floating image 36, wherein the user 18 perceives the floating image 36 at a distance in front of the reflector 38. As shown, the user display system 28 includes a transparent touchscreen display 40 integrated into the reflector 38 for each individual user 18. These principles similarly apply to a user display system 28 with individual reflectors and a transparent cylindrical touchscreen display 40.

[0087] The transparent touchscreen display 40 displays information related to the floating image 36 at a suitable location on the transparent touchscreen display 40 so that the user 18 sees the information at a suitable location related to the floating image 36. As shown in Fig. 9, the floating image 36 shows a skyline, more specifically, three buildings, a first building 128, a second building 130 and a third building 132. The transparent touchscreen display (or the transparent cylindrical touchscreen display) 40 displays first building information 134, second building information 136 and third building information 138.

[0088] The first building information 134 appears in a text field and may contain information about the first building 128, as well as the ability for the user 18 to touch the first building information text field 134 to obtain additional information about the first building 128. The first building information text field 134 may contain, for example, the name of the first building 128 and the street address. The passenger 18 may touch the first building information text field 134, and additional information will appear on the transparent touchscreen display 40, such as the date the first building 128 was built, the type of building (office, church, arena, etc.), or statistics such as height, capacity, etc.The second building information 136 and the third building information 138 also appear in text fields containing similar information and the ability for the user 18 to touch the text fields for the second or third building information 136, 138 to obtain additional information about the second and third buildings 130, 132.

[0089] The occupant monitoring cameras 22A, 22B, 22C, 22D track the position of the head 18H and the eyes 18E of the user 18 and position the text fields of the first, second and third building information 134, 136, 138 at a location on the transparent touchscreen display 40 such that when the user 18 views the floating image 36 through the reflector / beam splitter 38 and the transparent touchscreen display (transparent cylindrical touchscreen display) 40, the text fields of the first, second and third building information 134, 136, 138 are in the correct locations relative to the floating image 36.For example, the transparent touchscreen display (transparent cylindrical touchscreen display) 40 positions the first building information 134 in the user's line of sight, as indicated by the dashed line 140, so that the first building information 134 is perceived by the user 18 at a location immediately adjacent to the first building 128, as indicated at 134'.Accordingly, the transparent touchscreen display (transparent cylindrical touchscreen display) 40 positions the second building information 136 in the user's line of sight, as indicated by the dashed line 142, and the third building information 138 in the user's line of sight, as indicated by the dashed line 144, so that the second and third building information 136, 138 are perceived by the user 18 at a location superimposed on the building, in the case of the second building 130, as indicated at 136', and at a location immediately adjacent to the building, in the case of the third building 132, as indicated at 138'.

[0090] The occupant monitoring cameras 22A, 22B, 22C, 22D continuously track the movement of the head 18H and the eyes 18E of the user 18 and adjust the position in which the first, second and third building information 1234, 136, 138 are displayed on the transparent touchscreen display (transparent cylindrical touchscreen display) 40 to ensure that the user 18 always perceives the first, second and third building information 134, 136, 138 at the correct locations 134', 136', 138' relative to the floating image 36.

[0091] In an exemplary embodiment, the vehicle display server 12 is adapted, when using the identity of the user seated in the vehicle 14 to select user-specific content to be displayed to the user, to access stored historical data of previous content viewed by the user 18, such data being stored in the vehicle display server 12 in the vehicle 14 and / or in a cloud-based database 146 in and / or in communication with the host server 120. The vehicle display server 12 may further prompt the user 18 to selectively continue viewing content that the user 18 was previously viewing on another user display system and / or prompt a user 18 to selectively view content already being viewed by other users within the same vehicle 14.

[0092] With reference to Fig.10 includes a method 200 for using a system for enabling vehicle display interaction with a vehicle display server 12 positioned within a vehicle 14 and in communication with a plurality of sensors 16 positioned within the vehicle 14, beginning at block 202, tracking the head and eye position and movement of users 18 seated within a plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14, proceeding to block 204, detecting the positions of the users 18 within the vehicle 14 and when the users 18 change seating positions 20A, 20B, 20C, 20D within the vehicle 14, proceeding to block 206, detecting when a user 18 enters and exits the vehicle 14, proceeding to block 208, detecting and interpreting facial and Gesture inputs from users 18 inside the vehicle 14, proceed to block 210,Capturing images of users 18 within the vehicle 14, and proceeding to block 212, receiving audio inputs from users within the vehicle.

[0093] Moving from block 212 to block 214, the method 200 further includes providing haptic feedback with haptic feedback devices 26A, 26B, 26C, 26D positioned within the vehicle 14 and in communication with the vehicle display server 12 to users 18 seated within the vehicle 14. Moving to block 216, identifying an identity of a user 18 seated at one of the plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14 using the plurality of sensors 16 positioned within the vehicle 14, computer vision algorithms, and stored data. Moving to block 218, selecting, using the identity of the user 18 seated at one of the plurality of seating positions 20A, 20B, 20C, 20D inside the vehicle 14, of a user-specific content to be displayed on a user display system 28 for the user 18,seated at one of the plurality of seating positions 20A, 20B, 20C, 20D, and, proceeding to block 220, automatically displaying the user-specific content with the user display system 28 positioned within the vehicle 14 for viewing and interaction by a user 18 seated at one of the plurality of seating positions 20A, 20B, 20C, 20D.

[0094] In an exemplary embodiment, the method 200 further includes, when a user 18 seated at the first position 20A within the vehicle 14 moves to the second position 20B within the vehicle 14, proceeding to block 222, detecting, with the vehicle display server 12 and the plurality of sensors 16 positioned within the vehicle 14, when the user 18 leaves the first seating position 20A within the vehicle 14, proceeding to block 224, stopping, with the vehicle display server 12, the user-specific content currently displayed on the user display system 28 for the user 18 at the first seating position 20A, proceeding to block 226, detecting, with the vehicle display server 12 and the plurality of sensors 16 positioned within the vehicle 14, when the user 18 leaves the second seating position 20A within the vehicle 14 sits, and, proceed to Block 228, resume,with the vehicle display server 12, the display of the user-specific content on the user display system 28 for the user 18 at the second seating position 20B.,

[0095] In another exemplary embodiment, displaying the user-specific content on the user display system 28 in block 220 further comprises either displaying user-specific content on a user display system 28 comprising a plurality of individual display screens 30A, 30B, 30C, 30D adapted to display information and receive inputs from a user 18, wherein a single display screen 30A, 30B, 30C, 30D is associated with each of the plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14, or displaying user-specific content on a user display system 28 comprising a single display system 32 including at least one display 34 for projecting an image 36, a plurality of reflectors 38A, 38B, 38C, 38D, wherein each reflector 38A, 38B, 38C, 38D is associated with and adapted to one of the plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14,to reflect a projected image 36 to the associated seating position of the plurality of seating positions 20A, 20B, 20C, 20D such that a user 18 sitting at the associated seating position of the plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14 perceives the image 36 floating at a central location within the vehicle 14, and a transparent cylindrical touchscreen display 40 positioned between the plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14 and the plurality of reflectors 38A, 38B, 38C, 38D and adapted to display user-specific content for users 18 at each of the plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14 and inputs from each of the users 18 at each of the plurality of seating positions 20A, 20B, 20C, 20D within the vehicle 14.

[0096] In another exemplary embodiment, the method 200 includes, with the vehicle display server 12, proceeding to block 230, identifying, using the plurality of sensors 16 positioned within the vehicle 14, when a user 18 viewing the user display system 28 looks away from the user display system 28, proceeding to block 232, pausing user-specific content displayed on the user display system 28, proceeding to block 234, identifying, using the plurality of sensors 16 positioned within the vehicle 14, when the user 18 looks back at the user display system 28, and proceeding to block 236, resuming display of the user-specific content on the user display system 28.

[0097] In another exemplary embodiment, wherein the system 10 further comprises a cloud-based host server 120 that communicates with the vehicle display server 12 within the vehicle 14 via a wireless communication network 122, wherein the cloud-based host server 120 further communicates with at least one remote vehicle 124, wherein the remote vehicle 124 has a vehicle display server 12' that communicates with the cloud-based host server 120, a plurality of sensors 16', haptic feedback devices 26A', 26B', 26C', 26D', a plurality of seating positions 20A', 20B', 20C', 20D', and a user display system 28' that is substantially identical to the corresponding features of the vehicle 14, the method 200 further comprises, when a user 18 seated within the vehicle 14 14 and moves to one of the at least one remote vehicle 124, proceed to block 238, detect,with the vehicle display server 12 and the plurality of sensors 16 positioned within the vehicle 14 when the user 18 exits the vehicle 14, proceeding to block 240, stopping, with the vehicle display server 12 within the vehicle 14, user-specific content currently displayed on the user display system 28 within the vehicle 14, proceeding to block 242, detecting, with the vehicle display server 12' and the plurality of sensors 16' positioned within the one of the at least one remote vehicle 124 when the user 18 enters the one of the at least one remote vehicle 124, proceeding to block 244, identifying, using the vehicle display server 12' and the plurality of sensors 16' positioned within the one of the at least one remote vehicle 124, computer vision algorithms and stored data, an identity of the user 18, Continue to Block 246,Obtaining, with the vehicle display server 12' within the one of the at least one remote vehicle 124, via communication with the host server 120, information relating to the user-specific content that the user 18 viewed within the vehicle 14 prior to exiting the vehicle 14, and, proceeding to block 248, automatically resuming display of the user-specific content on the user display system 28' within the one of the at least one remote vehicle 124 into which the user 18 has entered.

[0098] In another exemplary embodiment, the method 200 further comprises, proceeding to block 250, coordinating, with the host server 120, the vehicle display server 12 and the user display system 28 positioned within the vehicle 14 and viewed by a first user 18 seated in the vehicle 14, with the vehicle display server 12' and the user display system 28' positioned within one of the at least one remote vehicle 124 and viewed by a second user 18, and, proceeding to block 252, facilitating, with the host server 120, communication and interaction between the first user 18 within the vehicle 14 and the second user 18 within the remote vehicle 124.

[0099] In another exemplary embodiment, wherein the host server 120 is in communication with a personal device 126 of a user 18, the method 200 further includes, when the user 18 is viewing user-specific content on the user display system 28 within the vehicle 14 and the user 18 exits the vehicle 14, proceeding to block 254, detecting, with the host server 120 and the plurality of sensors 16 positioned within the vehicle 14, via communication with the vehicle display server 12 within the vehicle 14 when the user 18 exits the vehicle 14, proceeding to block 256, automatically pausing, with the host server 120, the user-specific content currently displayed on the user display system 28 within the vehicle 14, and proceeding to block 258, automatically resuming, with the host server 120,the display of the user-specific content on the personal device 126 of the user 18, and when the user is viewing user-specific content on the personal device 126 and the user 18 enters the vehicle 14, the method 200 further includes, proceeding to block 260, detecting with the host server 120 and the plurality of sensors 16 positioned within the vehicle 14, via communication with the vehicle display server 12 within the vehicle 14, when the user 18 enters the vehicle 14, and, proceeding to block 262, automatically prompting, with the host server 120, the user 18 with the option to selectively pause the user-specific content currently being displayed on the personal device 126 and resume displaying the user-specific content on the user display system 28 within the vehicle 14.

[0100] A system and method of the present description offers several advantages. These include providing a floating image perceived by passengers at a central location within the vehicle interior. This provides a campfire-like viewing atmosphere where all passengers can view a common floating image or each passenger can view their own floating image. Furthermore, a system according to the present description offers the ability to display annotations and information not embedded in the virtual image and to ensure that such annotations and information are perceived by a passenger at a convenient location relative to the virtual image and in a plane between the passenger and the floating image.The system enables interaction between multiple users located in the same or different vehicles, and provides for the automatic identification of a user and the selection / display of content specific to that user, specifically tailored to the seating position within a vehicle the user is sitting in. The system also enables such selected user-specific content to follow a user as they move from one seating position to another within a vehicle or as they transfer from one vehicle to another.

Claims

[1] System (10) for enabling vehicle display interaction, comprising: a vehicle display server (12) positioned inside a vehicle (14) and communicating with: a large number of sensors (16) positioned inside the vehicle (14) and suitable to: to track the head and eye position and movement of users (18) seated within a variety of seating positions (20A, 20B, 20C, 20D) inside the vehicle (14); to detect the locations of the users (18) within the vehicle (14) and when the users (18) change the seating positions (20A, 20B, 20C, 20D) within the vehicle (14); to detect when a user (18) enters and leaves the vehicle (14); To recognize and interpret facial and gesture input from users (18) inside the vehicle (14); To take pictures of users (18) inside the vehicle (14); To receive audio input from users (18) inside the vehicle (14); haptic feedback devices (26A, 26B, 26C, 26D) positioned inside the vehicle (14) and suitable for providing haptic feedback to users (18) seated inside the vehicle (14); and a user display system (28) positioned inside the vehicle (14) for viewing and interaction by users (18) seated within the multiple seating positions (20A, 20B, 20C, 20D) inside the vehicle (14); where the vehicle display server (12) is adapted: to identify the identity of a user (18) seated in one of the multiple seating positions (20A, 20B, 20C, 20D) within the vehicle (14) using the multiple sensors (16) positioned within the vehicle (14), computer vision algorithms and stored data; using the identity of the user (18) seated in one of the multiple seating positions (20A, 20B, 20C, 20D) within the vehicle (14), to select user-specific content to be displayed to the user (18) on the user display system (28); and to automatically display the user-specific content on the user display system (28) for viewing by the user (18) who is seated within one of the multiple seating positions (20A, 20B, 20C, 20D) inside the vehicle (14); wherein, when a user (18) sitting in a first seating position (20A) inside the vehicle (14) moves to a second seating position (20B) inside the vehicle (14), the vehicle display server (12) is adapted: to detect, with the multitude of sensors (16) positioned inside the vehicle (14), when the user (18) leaves the first seating position (20A) inside the vehicle (14); to pause the user-specific content currently displayed on the user display system (28) for the first seating position (20A); to detect, with the multitude of sensors (16) positioned inside the vehicle (14), when the user (18) is seated in the second seat position (20B) inside the vehicle (14); and to resume displaying the user-specific content on the user display system (28) for the second seating position (20B); the user display system including: a single display system (32), comprising: at least one display (34) for projecting an image (36); a plurality of reflectors (38A, 38B, 38C, 38D), each reflector (38A, 38B, 38C, 38D) being associated with one of the plurality of seating positions (20A, 20B, 20C, 20D) within the vehicle (14) and adapted to reflect a projected image (36) onto the associated seating position of the plurality of seating positions (20A, 20B, 20C, 20D), such that a user (18) sitting in the associated seating position of the plurality of seating positions (20A, 20B, 20C, 20D) within the vehicle (14) perceives the image (36) hovering at a central location within the vehicle (14); and a transparent cylindrical touchscreen display (40) positioned between the multiple seating positions (20A, 20B, 20C, 20D) within the vehicle (14) and the multiple reflectors (38A, 38B, 38C, 38D) and adapted to display user-specific content for users (18) at each of the multiple seating positions (20A, 20B, 20C, 20D) within the vehicle (14) and to receive input from each of the users (18) at each of the multiple seating positions (20A, 20B, 20C, 20D) within the vehicle (14); the user display system (28), which comprises the individual display system (32), further comprising: comprising a picture chamber (66): at least one display (34); a reflector of the plurality of reflectors (38A, 38B, 38C, 38D) that is individually associated with each of the plurality of seating positions (20A, 20B, 20C, 20D) within the vehicle (14) and is adapted to reflect the image (36) to the associated seating position of the plurality of seating positions (20A, 20B, 20C, 20D) within the vehicle (14), so that a user (18) sitting in the associated seating position of the plurality of seating positions (20A, 20B, 20C, 20D) within the vehicle (14) perceives the image (36) that floats at a central location within the vehicle (14); transparent plates (68) adapted to allow the image (36) reflected from the reflector of the plurality of reflectors (38A, 38B, 38C, 38D) to pass from the image chamber (66) outwards towards a user (18) sitting at the associated seat position of the plurality of seat positions (20A, 20B, 20C, 20D); and solid plates (70) adapted to prevent light from entering the image chamber (66) behind the reflector of the plurality of reflectors (38A, 38B, 38C, 38D); and wherein the transparent cylindrical touchscreen display (40) is positioned and adapted between the plurality of reflectors (38A, 38B, 38C, 38D) of the image chamber (66) and the plurality of seating positions (20A, 20B, 20C, 20D) within the vehicle (14) to display information for users (18) seated at the plurality of seating positions (20A, 20B, 20C, 20D) within the vehicle (14) within an image plane (48, 50) positioned in front of the perceived image (36) floating at the central location within the vehicle (14); wherein the image chamber (66) comprises a first display (34A) adapted to project a first three-dimensional image (36A), and a first reflector (38A) of the plurality of reflectors (38A, 38B, 38C, 38D) individually associated with the first display (34A), and a second display (34B) adapted to project a second three-dimensional image (36B), and a second reflector (38B) of the plurality of reflectors (38A, 38B, 38C, 38D) individually associated with the second display (34B); wherein the image chamber (66) comprises fixed, overlapping plates (70A, 70B) adapted to prevent light from entering the image chamber (66) behind the first and second reflectors (38A, 38B); wherein first fixed plates (70A) of the overlapping plates (70A, 70B) arranged on both sides next to the first reflector (38A) are adapted to move together with the first reflector (38A) and the first display (34A) when the first reflector (38A) and the first display (34A) rotate about a vertical central axis (88); wherein second fixed plates (70B) of the overlapping plates (70A, 70B), which are arranged on both sides next to the second reflector (38B), are adapted to move together with the second reflector (38B) and the second display (34B) when the second reflector (38B) and the second display (34B) rotate about the vertical central axis (88); and wherein the first fixed plates (70A) overlap the second fixed plates (70B) to allow relative movement of the first fixed plates (70A) with respect to the second fixed plates (70B) and to ensure that ambient light is prevented at all times from entering the image chamber (66) behind the first and second reflectors (38A, 38B).

Images