Implementing vehicle display interaction and personalization
By identifying users and adjusting the displayed content through vehicle display servers and sensors, combined with haptic feedback and a cloud-based host server, the system solves the problems of insufficient personalization and interactivity in existing vehicle entertainment systems, enabling automatic switching of user-specific content and shared use of multiple display cabins.
Patent Information
- Application Number
- CN202410679827.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2024-04-17
- Filing Date
- 2024-05-29
- Publication Date
- 2025-10-24
AI Technical Summary
Existing in-vehicle entertainment systems lack personalization and interactivity, cannot automatically switch displayed content when users move seats or between vehicles, and do not consider the shared use of multi-monitor cabins.
The system uses a vehicle display server to communicate with multiple sensors, identifies the user, and automatically adjusts the displayed content. It also uses a haptic feedback device to provide feedback and combines a cloud-based host server to coordinate multiple display systems inside and outside the vehicle, enabling automatic switching and interaction of user-specific content.
It enables automatic switching of displayed content as users move between seats or vehicles, improving the personalization and interactivity of the user experience and supporting the shared use of multiple monitor carriages.
Smart Images

Figure CN120832013A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present disclosure relates to a system for enabling interaction and personalization with displays within a vehicle. BACKGROUND
[0002] Current in-vehicle entertainment systems typically include a screen or display mounted within the vehicle for viewing by passengers. Some systems include smaller individual screens, where each passenger has a screen for their personal viewing. Current systems are primarily designed for individual users and do not account for shared or multi-display cabin scenarios, where content is determined based on the identity of the user. Further, shared displays do not account for situations where a user moves to a different seat within the vehicle or from one vehicle to another. In such situations, the user must manually terminate the display content at the current seat or within the current vehicle and then manually restart the display content at the new seat or within the different vehicle.
[0003] While current systems achieve their intended purpose, there remains a need for a new and improved system to enable personalization and interaction through vehicle displays. SUMMARY
[0004] According to several aspects of the present disclosure, a system for enabling vehicle display and interaction includes a vehicle display server located within a vehicle and in communication with a plurality of sensors located within the vehicle and adapted to track head and eye position and movement of users seated in a plurality of seats within the vehicle, detect location of users within the vehicle and when a user changes seats within the vehicle, detect when a user enters and exits the vehicle, detect and interpret facial and gesture input from users within the vehicle, capture images of users within the vehicle, and receive audio input from users within the vehicle; a haptic feedback device located within the vehicle and adapted to provide haptic feedback to users seated within the vehicle; and a user display system located within the vehicle for viewing and interaction by users seated in a plurality of seats within the vehicle; the vehicle display server adapted to identify an identity of a user seated in one of the plurality of seats within the vehicle using the plurality of sensors located within the vehicle, computer vision algorithms, and stored data; select user-specific content to be displayed for the user on the user display system using the identity of the user seated in one of the plurality of seats within the vehicle; and automatically display the user-specific content on the user display system for viewing by the user seated in one of the plurality of seats within the vehicle.
[0005] According to another aspect, when a user seated in a first seat within the vehicle moves to a second seat within the vehicle, the vehicle display server is adapted to detect, using the plurality of sensors located within the vehicle, when the user leaves the first seat within the vehicle, pause the user-specific content currently being displayed on the user display system of the first seat, detect, using the plurality of sensors located within the vehicle, when the user is seated in the second seat within the vehicle, and resume displaying the user-specific content on the user display system of the second seat.
[0006] According to another aspect, the user display system comprises one of: a plurality of individual display screens adapted to display information and receive input from a user, one individual display screen associated with each of the plurality of seats within the vehicle; or a single display system comprising: at least one display for projecting an image; a plurality of reflectors, each reflector associated with one of the plurality of seats within the vehicle and adapted to reflect the projected image to the associated one of the plurality of seats such that a user seated in the associated one of the plurality of seats within the vehicle perceives the image floating in a central location within the vehicle; and a transparent cylindrical touch screen display located between the plurality of seats within the vehicle and the plurality of reflectors and adapted to display user-specific content for a user seated in each of the plurality of seats within the vehicle and receive input from each user seated in each of the plurality of seats within the vehicle.
[0007] According to another aspect, the vehicle display server is adapted to identify, using the plurality of sensors located within the vehicle, when a user viewing the user display system looks away from the user display system; pause the user-specific content being displayed on the user display system; identify, using the plurality of sensors located within the vehicle, when the user looks back to the user display system; and resume displaying the user-specific content on the user display system.
[0008] According to another aspect, the system further comprises a cloud-based host server in communication with the vehicle display server within the vehicle over a wireless communication network, the cloud-based host server further in communication with at least one remote vehicle having a vehicle display server in communication with the cloud-based host server, a plurality of sensors, a haptic feedback device, a plurality of seats, and a user display system substantially identical to the corresponding features of the vehicle.
[0009] According to another aspect, when a user seated within a vehicle exits the vehicle and moves to one of at least one remote vehicle, a vehicle display server within the vehicle is adapted to detect when the user exits the vehicle using a plurality of sensors located within the vehicle, and to pause user-specific content that is currently being displayed on a user display system within the vehicle; a vehicle display server within one of at least one remote vehicle is adapted to detect when the user enters the one of at least one remote vehicle using a plurality of sensors located within the one of at least one remote vehicle; to identify the identity of the user using the plurality of sensors, computer vision algorithms, and stored data located within the one of at least one remote vehicle; to obtain information related to the user-specific content that the user was viewing in the vehicle prior to exiting the vehicle by communicating with a host server; and to automatically resume displaying the user-specific content on a user display system within the one of at least one remote vehicle that the user entered.
[0010] According to another aspect, a host server is adapted to coordinate a vehicle display server and a user display system located within a vehicle and being viewed by a first user with a vehicle display server and a user display system located within one of at least one remote vehicle and being viewed by a second user, and to facilitate communication and interaction between the first user and the second user.
[0011] According to another aspect, a host server communicates with a personal device of a user, when the user is viewing user-specific content on a user display system within a vehicle and the user exits the vehicle, the host server is adapted to detect when the user exits the vehicle using a plurality of sensors located within the vehicle by communicating with a vehicle display server within the vehicle, to automatically pause the user-specific content that is currently being displayed on the user display system within the vehicle, and to automatically resume displaying the user-specific content on the personal device of the user; when the user is viewing the user-specific content on the personal device and the user enters the vehicle, the host server is adapted to detect when the user enters the vehicle using a plurality of sensors located within the vehicle by communicating with a vehicle display server within the vehicle, and to automatically prompt the user to selectively pause the user-specific content that is currently being displayed on the personal device and to resume displaying the user-specific content on a user display system within the vehicle using an option.
[0012] According to another aspect, for a user display system comprising a single display system, the plurality of reflectors comprises a plurality of transparent beam splitters, one transparent beam splitter being individually associated with each of a plurality of seats within the vehicle, each beam splitter being adapted to receive an image from the at least one display and to reflect the image to an associated one of the plurality of seats, wherein a user seated in the associated one of the plurality of seats within the vehicle perceives the image as floating at a central location within the vehicle.
[0013] According to another aspect, for a user display system comprising a single display system, further comprising: an image chamber comprising: at least one display adapted to project an image; a reflector associated with each of a plurality of seats within a vehicle and adapted to reflect the image to an associated one of the plurality of seats within the vehicle such that a user seated in the associated one of the plurality of seats perceives the image as floating at a central location within the vehicle; a transparent portion adapted to allow the image reflected by the reflector to pass outwardly from the image chamber to the user seated in the associated one of the plurality of seats; and a solid portion adapted to prevent light from entering the image chamber behind the reflector; and a transparent cylindrical touchscreen display located between the reflector of the image chamber and the plurality of seats within the vehicle and adapted to display information to the user seated in the plurality of seats within the vehicle in an image plane in front of the perceived image floating at the central location within the vehicle.
[0014] According to another aspect, the user display system is adapted to monitor the position of the user's head and eyes using a plurality of sensors within the vehicle; display information at a particular location on the transparent cylindrical touchscreen display based on the position of the user's head and eyes; and display information at a particular location on the transparent cylindrical touchscreen display based on the position of the user's head and eyes relative to the perceived image such that the information displayed on the transparent cylindrical touchscreen display is correctly positioned relative to the perceived image.
[0015] According to another aspect, when using the identity of a user seated in a location within a vehicle to select user-specific content to display for the user, the vehicle display server is adapted to access historical stored data of content viewed by the user, select user-specific content based on contextual information, prompt the user to selectively resume viewing content that the user previously viewed on a different user display system, and prompt the user to selectively view content that other users within the same vehicle have already viewed.
[0016] According to aspects of the present disclosure, a method for implementing vehicle displays and interactions includes: tracking head and eye position and movement of users seated in a plurality of seats within a vehicle, detecting location of users within the vehicle and when users change seats within the vehicle, detecting when users enter and exit the vehicle, detecting and interpreting facial and gesture input from users within the vehicle, capturing images of users within the vehicle, and receiving audio input from users within the vehicle, with a vehicle display server located within the vehicle and in communication with a plurality of sensors located within the vehicle; providing haptic feedback to users seated within the vehicle with haptic feedback devices located within the vehicle and in communication with the vehicle display server; and identifying an identity of a user seated in one of a plurality of seats within the vehicle using a plurality of sensors located within the vehicle, computer vision algorithms, and stored data; selecting user-specific content to be displayed on a user display system for the user seated in one of a plurality of seats within the vehicle using the identity of the user seated in one of a plurality of seats within the vehicle; and automatically displaying the user-specific content with a user display system located within the vehicle for viewing and interaction by the user seated in one of a plurality of seats within the vehicle.
[0017] According to another aspect, when a user seated in a first location within a vehicle moves to a second location within the vehicle, the method further includes detecting when the user exits a first seat within the vehicle, pausing user-specific content currently being displayed on a first user display system for the user located in the first seat with a vehicle display server located within the vehicle and a plurality of sensors, detecting when the user is seated in a second seat within the vehicle with the vehicle display server located within the vehicle and the plurality of sensors, and resuming display of the user-specific content on a user display system for the user seated in the second seat with the vehicle display server.
[0018] According to another aspect, displaying user-specific content on a user display system further comprises one of: displaying user-specific content on a user display system, the user display system comprising a plurality of individual display screens, the plurality of individual display screens adapted to display information and receive input from a user, one individual display screen associated with each of a plurality of seats within the vehicle; or displaying user-specific content on a user display system, the user display system comprising a single display system, the single display system comprising: at least one display for projecting an image; a plurality of reflectors, each reflector associated with one of a plurality of seats within the vehicle and adapted to reflect the projected image to the associated one of the plurality of seats such that a user seated in the associated one of the plurality of seats within the vehicle perceives the image as floating in a central location within the vehicle; and a transparent cylindrical touch screen display located between the plurality of seats within the vehicle and the plurality of reflectors and adapted to display user-specific content for the user in each of the plurality of seats within the vehicle and receive input from each user in each of the plurality of seats within the vehicle.
[0019] According to another aspect, the method further comprises: using the vehicle display server, using a plurality of sensors located within the vehicle to identify when a user viewing the user display system looks away from the user display system; pausing the user-specific content being displayed on the user display system; using the plurality of sensors located within the vehicle to identify when the user looks back to the user display system; and resuming displaying the user-specific content on the user display system.
[0020] According to another aspect, the system further includes a cloud-based host server in communication with the vehicle display server within the vehicle over a wireless communication network, the cloud-based host server is further in communication with at least one remote vehicle having a vehicle display server, a plurality of sensors, a haptic feedback device, a plurality of seats, and a user display system substantially identical to the corresponding features of the vehicle in communication with the cloud-based host server. The method further includes detecting when the user sitting within the vehicle exits the vehicle using the vehicle display server and the plurality of sensors located within the vehicle; pausing the user-specific content currently being displayed on the user display system within the vehicle using the vehicle display server located within the vehicle; detecting when the user enters one of the at least one remote vehicle using the vehicle display server and the plurality of sensors located within the one of the at least one remote vehicle; identifying the identity of the user using the vehicle display server and the plurality of sensors, computer vision algorithms, and stored data located within the one of the at least one remote vehicle; obtaining information related to the user-specific content the user was viewing in the vehicle prior to exiting the vehicle using the vehicle display server located within the one of the at least one remote vehicle by communicating with the host server; and automatically resuming display of the user-specific content on the user display system within the one of the at least one remote vehicle the user entered.
[0021] According to another aspect, the method further includes coordinating, using the host server, the vehicle display server and the user display system located within the vehicle and being viewed by a first user sitting within the vehicle with the vehicle display server and the user display system located within one of the at least one remote vehicle and being viewed by a second user, and facilitating communication and interaction between the first user and the second user using the host server.
[0022] According to another aspect, wherein the host server is in communication with a personal device of the user, the method further comprises, when the user is watching user-specific content on the user display system within the vehicle and the user exits the vehicle, detecting, with the host server and the plurality of sensors located within the vehicle, when the user exits the vehicle by communicating with a vehicle display server within the vehicle, automatically pausing, with the host server, the user-specific content that is currently being displayed on the user display system within the vehicle, and automatically resuming, with the host server, displaying the user-specific content on the personal device of the user; when the user is watching the user-specific content on the personal device and the user enters the vehicle, detecting, with the host server and the plurality of sensors located within the vehicle, when the user enters the vehicle by communicating with the vehicle display server within the vehicle, and automatically prompting, with the host server, the user to select to selectively pause the user-specific content that is currently being displayed on the personal device and resume displaying the user-specific content on the user display system within the vehicle.
[0023] Further areas of applicability will become apparent from the description provided herein. It should be understood that the description and specific examples are intended for purposes of illustration only and are not intended to limit the scope of the present disclosure. BRIEF DESCRIPTION OF DRAWINGS
[0024] The drawings described herein are for illustrative purposes only and are not intended to limit the scope of the present disclosure in any way.
[0025] Figure 1 is a schematic illustration of a system in accordance with example embodiments of the present disclosure;
[0026] Figure 2 is a schematic illustration of a system as shown in Figure 1 , wherein the vehicle display system includes a plurality of individual touchscreen displays;
[0027] Figure 3 is a top view schematic illustration of a vehicle having a system in accordance with the present disclosure;
[0028] Figure 4 is a side view schematic illustration of a vehicle display system having a display, a plurality of beam splitters, and a cylindrical touchscreen display;
[0029] Figure 5 is a side view schematic illustration of a vehicle display system having a display, an image chamber including a plurality of reflectors, and a cylindrical touchscreen display;
[0030] Figure 6 is a top view schematic illustration of an image chamber as shown in Figure 5 ;
[0031] Figure 7 is a top view schematic illustration of an image chamber as shown in Figure 5A schematic side view of an image room is shown, illustrating how the reflector and display of the image room move up and down and rotate;
[0032] Figure 8 Yes Figure 6 A schematic top view of an image room is shown wherein a user at a second seat moves and, in response, a second reflector and a second display have a rotation and angular distance to maintain alignment with the user at the second seat;
[0033] Figure 9 is a schematic diagram showing a user viewing an image and annotation information through an associated beam splitter and a transparent touch screen display; and
[0034] Figure 10 is a flowchart illustrating a method according to an exemplary embodiment of the present disclosure.
[0035] The drawings are not necessarily drawn to scale, and certain features may be exaggerated or minimized to show details of particular components. In some cases, well-known components, systems, materials, or methods have not been described in detail to avoid obscuring the present disclosure. Therefore, the specific structural and functional details disclosed herein should not be construed as limiting, but merely as a basis for the claims and as a representative basis for teaching one skilled in the art to employ the present disclosure in various ways. DETAILED DESCRIPTION
[0036] The following description is merely exemplary in nature and is not intended to limit the present disclosure, application or use. In addition, there is no intention to be bound by any express or implied theory presented in the aforementioned technical field, background technology, summary of the invention or the following specific embodiments. It should be understood that throughout the drawings, corresponding reference numerals represent similar or corresponding components and features. The term "module" as used herein refers to any hardware, software, firmware, electronic control component, processing logic and / or processor device, alone or in any combination, including but not limited to: application specific integrated circuits (ASICs), electronic circuits, processors (shared, dedicated or groups) and memories that execute one or more software or firmware programs, combinational logic circuits and / or other suitable components that provide the described functions. Although the drawings shown herein depict examples with certain element arrangements, additional intermediate elements, devices, features or components may exist in actual embodiments. It should also be understood that the drawings are merely illustrative and may not be drawn to scale.
[0037] The term "vehicle" as used herein is not limited to automobiles. Although this technology is primarily described in conjunction with automobiles, it is not limited to automobiles. These concepts can be used in a variety of applications, such as aircraft, ships, other vehicles, and consumer electronics.
[0038] refer to Figure 1A system 10 for implementing vehicle displays and interactions includes a vehicle display server 12 located within a vehicle 14 and in communication with a plurality of sensors 16 located within the vehicle 14. The plurality of sensors 16 sense observable conditions of the external and internal environments of the vehicle 14. The plurality of sensors 16 may include, but are not limited to, radar, lidar, global positioning systems, optical cameras, thermal cameras, ultrasonic sensors, pressure sensors, and / or other sensors. The cameras may include two or more digital cameras spaced a distance apart, wherein the two or more digital cameras are configured to obtain stereo images of the surrounding environment to create a three-dimensional image or map. The plurality of sensors 16 are configured to determine information about the environment surrounding the vehicle 14. In an exemplary embodiment, the plurality of sensors 16 include at least one of a motor speed sensor, a motor torque sensor, an electric drive motor voltage and / or current sensor, an accelerator pedal position sensor, a coolant temperature sensor, a cooling fan speed sensor, and a transmission oil temperature sensor. In another exemplary embodiment, the plurality of sensors 16 further include sensors for determining information about the environment surrounding the vehicle 14, such as an ambient air temperature sensor, an air pressure sensor, and / or a camera positioned to view the environment in front of the vehicle 14. In another exemplary embodiment, at least one of the plurality of sensors 16 is capable of measuring distances in the environment surrounding the vehicle 14 .
[0039] In a non-limiting example, where the plurality of sensors 16 include cameras, the plurality of sensors 16 measure distance using an image processing algorithm configured to process images from the cameras and determine distances between objects. In another non-limiting example, the plurality of sensors 16 include stereo cameras with distance measurement capabilities. In one example, at least one of the plurality of sensors 16 is fixed inside the vehicle 14, for example, fixed in the roof lining of the vehicle 14 and can be viewed through the windshield of the vehicle 14. In another example, at least one of the plurality of sensors 16 is a camera fixed outside the vehicle 14 (for example, fixed on the roof of the vehicle 14), which can see the environment around the vehicle 14 and is suitable for collecting information (images) related to the environment outside the vehicle 14.
[0040] In example embodiments, the plurality of sensors 16 include cameras and sensors adapted to capture images of the user 18 seated within the vehicle 14 and to detect / monitor movements of the user 18 seated within the vehicle 14. These sensors 16 can include pressure sensors positioned within a plurality of seats 20A, 20B, 20C, 20D within the vehicle 14 to determine whether the user 18 is seated within a particular seat 20A, 20B, 20C, 20D within the vehicle 14. These sensors 16 can also include cameras adapted to capture images of the user 18 within the vehicle 14 and, using computer vision algorithms and software, use these captured images to determine movements of the user 18 within the vehicle 14 and the identity of the user 18 within the vehicle 14. These sensors 16 can be incorporated into a monitoring system adapted to monitor the eye and head orientation / movements of the user 18 within the vehicle 14 to determine the gaze direction of the user 18 or when the user 18 is not fully alert or distracted. It should be appreciated that various additional types of sensing devices, such as LiDAR sensors, ultrasonic ranging sensors, radar sensors, and / or time-of-flight sensors are within the scope of the present disclosure.
[0041] In example embodiments, the vehicle 14 includes a plurality of seats 20A, 20B, 20C, 20D adapted to accommodate users 18 seated therein. Referring to Figure 1 , Figure 2 and Figure 3 As shown, the vehicle 14 includes a first seat 20A, a second seat 20B, a third seat 20C, and a fourth seat 20D. It should be appreciated that the vehicle 14 can include more or less than four seats. The plurality of sensors 16 includes at least a first occupant monitoring camera 22A to monitor head and eye position and movement of the user 18 seated in the first seat 20A, a second occupant monitoring camera 22B to monitor head and eye position and movement of the user 18 seated in the second seat 20B, a third occupant monitoring camera 22C to monitor head and eye position and movement of the user 18 seated in the third seat 20C, and a fourth occupant monitoring camera 22D to monitor head and eye position and movement of the user 18 seated in the fourth seat 20D within the vehicle 14.
[0042] The first, second, third, and fourth occupant monitoring cameras 22A, 22B, 22C, 22D are adapted to continuously track head and eye position and movement of the users 18 seated in the plurality of seats 20A, 20B, 20C, 20D within the vehicle 14 along with other sensors within the vehicle 14 and detect the location of the users 18 within the vehicle 14 and when the users 18 change seats within the vehicle 14. The first, second, third, and fourth occupant monitoring cameras 22A, 22B, 22C, 22D and / or other sensors of the plurality of sensors 16 within the vehicle 14 are adapted to detect when the users 18 enter and exit the vehicle 14, detect and interpret facial and hand gesture inputs from the users 18 within the vehicle 14, capture images of the users 18 within the vehicle 14, and receive audio inputs from the users 18 within the vehicle 14, wherein the plurality of sensors 16 includes at least one microphone 24 within the vehicle 14.
[0043] The images, audio, and data collected by the plurality of sensors 16, 22A, 22B, 22C, 22D, 24 are transmitted back to the vehicle display server 12. The vehicle display server 12 is a non-generic electronic control device having a preprogrammed digital computer or processor, memory or non-transitory computer readable medium for storing control logic, software applications, instructions, computer code, data, lookup tables, and the like, and a transceiver [or input / output port]. Computer readable media includes any type of media capable of being accessed by a computer, such as read only memory (ROM), random access memory (RAM), hard drives, compact discs (CDs), digital video discs (DVDs), or any other type of memory. A "non-transitory" computer readable medium excludes wired, wireless, optical, or other communication links laying transitory signals or other signals. Non-transitory computer readable media includes media that can be permanently stored as well as media that can store and subsequently be rewritten, such as rewritable compact discs or erasable memory devices. Computer code includes any type of program code, including source code, object code, and executable code.
[0044] The vehicle display server 12 is also in communication with haptic feedback devices 26A, 26B, 26C, 26D located within the vehicle 14 and is adapted to provide haptic feedback to the users 18 seated within the vehicle 14. The haptic feedback devices 26A, 26B, 26C, 26D can be actuators mounted within the interior of the vehicle 14 or within the surface of the vehicle seats and are adapted to provide feedback that can be felt by the users. As shown, the vehicle includes a first haptic feedback device 26A adapted to provide haptic feedback to the users 18 seated in the first seat 20A, a second haptic feedback device 26B adapted to provide haptic feedback to the users 18 seated in the second seat 20B, a third haptic feedback device 26C adapted to provide haptic feedback to the users 18 seated in the third seat position 20C, and a fourth haptic feedback device 26D adapted to provide haptic feedback to the users 18 seated in the fourth seat 20D within the vehicle 14.
[0045] The vehicle display server 12 is also in communication with a user display system 28 located within the vehicle 14 for viewing and interaction by the users 18 seated in the plurality of seats 20A, 20B, 20C, 20D within the vehicle 14. The user display system 28 provides video output and audio output to the users 18 within the vehicle 14, allowing the users 18 to view media accounts, watch movies, view augmented images of the environment outside of the vehicle 14, or play games with other users 18 within the vehicle 14 or within other remote vehicles.
[0046] In an exemplary embodiment, the user display system 28 comprises one of: 1) a plurality of individual display screens 30A, 30B, 30C, 30D adapted to display information and receive input from the user 18, one individual display screen 30A, 30B, 30C, 30D being associated with each of a plurality of seats 20A, 20B, 20C, 20D within the vehicle 14, or 2) the user display system 28 comprises a single display system 32 comprising at least one display 34 for projecting an image 36, a plurality of reflectors 38A, 38B, 38C, 38D, each of the plurality of reflectors 38A, 38B, 38C, 38D being associated with one of the plurality of seats 20A, 20B, 20C, 20D within the vehicle 14 and adapted to reflect the projected image 36 to the associated one of the plurality of seats 20A, 20B, 20C, 20D such that the user 18 seated in the associated one of the plurality of seats 20A, 20B, 20C, 20D within the vehicle 14 perceives the image 36 floating in a central location within the vehicle 14; a transparent cylindrical touch screen display 40 located between the plurality of seats 20A, 20B, 20C, 20D and the plurality of reflectors 38A, 38B, 38C, 38D within the vehicle 14 and adapted to display user specific content for the user 18 in each of the plurality of seats 20A, 20B, 20C, 20D within the vehicle 14 and to receive input from each of the users 18 in each of the plurality of seats 20A, 20B, 20C, 20D within the vehicle 14.
[0047] With reference to Figure 2 In an exemplary embodiment, the user display system 28 comprises a plurality of individual display screens 30A, 30B, 30C, 30D adapted to display information and receive input from the user 18. As shown in FIG. 1, each of the plurality of individual display screens 30A, 30B, 30C, 30D is associated with one of the plurality of seats 20A, 20B, 20C, 20D within the vehicle 14. In an exemplary embodiment, the plurality of individual display screens 30A, 30B, 30C, 30D are touch screen display screens. In an exemplary embodiment, the plurality of individual display screens 30A, 30B, 30C, 30D are transparent touch screen display screens. Figure 2As shown, the vehicle 14 includes a first seat 20A, a second seat 20B, a third seat 20C, and a fourth seat 20D, a first individual display 30A is associated with the first seat 20A for viewing by a user 18 seated in the first seat 20A, a second individual display 30B is associated with the second seat 20B for viewing by a user 18 seated in the second seat 20B, a third individual display 30C is associated with the third seat 20C for viewing by a user 18 seated in the third seat 20C, and a fourth individual display 30D is associated with the fourth seat 20D for viewing by a user 18 seated in the fourth seat 20D. As the users 18 move about within the vehicle 14 and are seated in the first seat 20A, the second seat 20B, the third seat 20C, and the fourth seat 20D, and possibly in positions between the first seat 20A, the second seat 20B, the third seat 20C, and the fourth seat 20D, the system 10 will use the plurality of sensors 16, including the first occupant monitoring camera 22A, the second occupant monitoring camera 22B, the third occupant monitoring camera 22C, and the fourth occupant monitoring camera 22D, to determine which of the plurality of individual displays 30A, 30B, 30C, 30D is best positioned for viewing by a particular user 18 based on the precise location of the user 18 relative to the plurality of individual displays 30A, 30B, 30C, 30D and the eye position and gaze angle of the user 18 relative to the plurality of individual displays 30A, 30B, 30C, 30D.
[0048] The first individual display 30A, the second individual display 30B, the third individual display 30C, and the fourth individual display 30D are adapted to display visual content for the users 18 and to allow the users 18 to provide input to the system 10. In an exemplary embodiment, the first individual display 30A, the second individual display 30B, the third individual display 30C, and the fourth individual display 30D include touch screen functionality that allows the users 18 to interact with the system 10 and the displayed content by manually touching the first individual display 30A, the second individual display 30B, the third individual display 30C, and the fourth individual display 30D. It will be appreciated that the first individual display 30A, the second individual display 30B, the third individual display 30C, and the fourth individual display 30D can be any known type of display suitable for use within the vehicle 14 with or without touch screen features without departing from the scope of the present disclosure. Figure 2 The first individual display 30A, the second individual display 30B, the third individual display 30C, and the fourth individual display 30D of the exemplary embodiment shown can be any known type of display suitable for use within the vehicle 14 with or without touch screen features.
[0049] Referring again to Figure 1 and Figure 3In another exemplary embodiment, the user display system 28 includes a single display system 32 that includes at least one display 34 for projecting an image 36, a plurality of reflectors 38A, 38B, 38C, 38D, each of the plurality of reflectors 38A, 38B, 38C, 38D being associated with one of the plurality of seats 20A, 20B, 20C, 20D within the vehicle 14 and adapted to reflect the projected image 36 to the associated one of the plurality of seats 20A, 20B, 20C, 20D such that a user 18 seated in the associated one of the plurality of seats 20A, 20B, 20C, 20D within the vehicle 14 perceives the image 36 floating at a central location within the vehicle 14, and a transparent cylindrical touch screen display 40 located between the plurality of seats 20A, 20B, 20C, 20D and the plurality of reflectors 38A, 38B, 38C, 38D within the vehicle 14 and adapted to display user specific content for the user 18 seated in each of the plurality of seats 20A, 20B, 20C, 20D within the vehicle 14 and to receive input from each of the users 18 seated in each of the plurality of seats 20A, 20B, 20C, 20D within the vehicle 14.
[0050] Reference is made to Figure 3 and Figure 4 In an exemplary embodiment, the user display system 28, 32 includes at least one display 34 adapted to project a plurality of three-dimensional images and a plurality of reflectors 38A, 38B, 38C, 38D, wherein the reflectors 38A, 38B, 38C, 38D are transparent beam splitters. One reflector / beam splitter 38A, 38B, 38C, 38D is associated with each of the plurality of seats 20A, 20B, 20C, 20D within the vehicle 14. For the detailed description herein, Figure 4 is Figure 1 and Figure 3 A side view schematic illustration of only the first seat 20A and the second seat 20B of the vehicle 14 shown in FIG. 1 is shown in FIG. 2. The plurality of three-dimensional images can be generated by a holographic method, pre-computed and encoded into a hologram generator 42 within the at least one display 34.
[0051] A transparent cylindrical touch screen display 40 is positioned between the first seat 20A, second seat 20B, third seat 20C, and fourth seat 20D and the perception image 36 floating at a central location within the vehicle 14. The transparent cylindrical touch screen display 40 is adapted to allow the users 18 seated in the first seat 20A, second seat 20B, third seat 20C, and fourth seat 20D to receive annotation information and provide input to the system 10. As shown, the transparent cylindrical touch screen display 40 surrounds the floating image 36 and is thereby positioned between the eyes of the users 18 seated in the first seat 20A, second seat 20B, third seat 20C, and fourth seat 20D and the perception image 36 floating at a central location within the vehicle 14. In an exemplary embodiment, the transparent cylindrical touch screen display 40 is an organic light emitting diode (OLED). It should be appreciated that the transparent cylindrical touch screen display 40 can be other types of transparent touch screen displays known in the art.
[0052] The transparent cylindrical touch screen display 40 is adapted to present visual display information to only the user 18 seated in one of the first seat 20A, second seat 20B, third seat 20C, and fourth seat 20D, wherein, for example, the content displayed for the user seated in the first seat 20A is only visible to the user 18 seated in the first seat 20A and is different from the content displayed for the other seats within the vehicle 14.
[0053] Referring again to Figure 4 The at least one display 34 is adapted to project a plurality of three-dimensional images to one of the plurality of reflectors / beamsplitters 38A, 38B, 38C, 38D, as indicated by arrow 44. Each of the plurality of reflectors / beamsplitters 38A, 38B, 38C, 38D is adapted to receive one of the plurality of three-dimensional images from the display 34 and reflect the one of the plurality of three-dimensional images from the display 34 to the user 18 seated in one of the plurality of seats 20A, 20B, 20C, 20D, as indicated by arrow 46. The user positioned at each of the plurality of seats 20A, 20B, 20C, 20D perceives the floating image 36 at a central location within the vehicle 14, as indicated by line 48.
[0054] Each of the plurality of reflectors / beam splitters 38A, 38B, 38C, 38D and the transparent cylindrical touch screen display 40 are transparent, wherein the user 18 can see through the reflectors / beam splitters 38A, 38B, 38C, 38D and the transparent cylindrical touch screen display 40, as shown at 48. This allows the user 18 to perceive the floating image 36 at a distance beyond the reflectors / beam splitters 38A, 38B, 38C, 38D, and further allows the user 18 to see through the reflectors / beam splitters 38A, 38B, 38C, 38D and be able to see the interior of the vehicle cabin and other users therein.
[0055] like Figure 4 , the reflector / beam splitter 38A is shown, wherein the reflector / beam splitter 38A is movable between a retracted position 50 and an extended position 52. In the exemplary embodiment, the reflector / beam splitter 38A is mounted on a support shaft 54A that extends downward from the roof 28 of the vehicle compartment. In the retracted position 50, the reflector / beam splitter 38A is positioned adjacent to the display 34 and parallel to the roof 56 of the vehicle compartment. The reflector / beam splitter 38A is pivoted relative to the support shaft 54A, as indicated by arrow 58, and the support shaft 54A is vertically extendable up and down, as indicated by arrow 60. The reflector / beam splitter 38A is pivoted downward from the retracted position 50, and the support shaft 54A is extended downward to place the reflector / beam splitter 38A in the extended position 52 for use. When in the extended position 52, the reflector / beam splitter 38A is operatively positioned adjacent to the display 34 and the user 18 seated in the first seat 20A.
[0056] Reference again Figure 4 , shows a reflector / beam splitter 38B, wherein the reflector / beam splitter 38B is mounted on an armrest 62 near the user 18 sitting in the second seat 20B. The reflector / beam splitter 38B is connected to a support shaft 54B, which is connected to the armrest 62. Although not shown, the reflector / beam splitter 38B supported on the armrest 62 can also be moved from a retracted position to an extended position. In an exemplary embodiment, when in the retracted position, the reflector / beam splitter 38B is stowed within the armrest 62.
[0057] In an example embodiment, the orientation of each of the plurality of reflectors / dichroics 38A, 38B, 38C, 38D is fixed. Thus, when the reflectors / dichroics 38A, 38B, 38C, 38D are in the extended position 52, the vertical and horizontal angular orientation relative to the support shafts 54A, 54B is fixed. Alternatively, in another example embodiment, the orientation of each of the plurality of reflectors / dichroics 38A, 38B, 38C, 38D is adjustable. The reflectors / dichroics 38A, 38B, 38C, 38D can be pivotally mounted to the support shafts 54A, 54B, where the reflectors / dichroics 38A, 38B, 38C, 38D pivot horizontally, as indicated by arrow 64, and further, the reflectors / dichroics 38A, 38B, 38C, 38D can be pivotally mounted to the support shafts 54A, 54B, where the dichroics 38A, 38B, 38C, 38D pivot vertically. The adjustability of the reflectors / dichroics 38A, 38B, 38C, 38D allows the reflectors / dichroics 38A, 38B, 38C, 38D to be positioned according to the position of the user 18 seated in the associated one of the plurality of seats 20A, 20B, 20C, 20D in the vehicle 14, and according to the height of the user 18, ensuring that the system 10 can be customized to accommodate users of different sizes and seating / preference preferences. Additionally, the adjustability of the orientation of the reflectors / dichroics 38A, 38B, 38C, 38D allows the perceived location of the floating image 36 to be adjusted according to the user’s preference.
[0058] In an example embodiment, each of the plurality of reflectors / dichroics 38A, 38B, 38C, 38D is in communication with an occupant monitoring camera 22A, 22B, 22C, 22D associated with each of the seats 20A, 20B, 20C, 20D, where the orientation of each of the plurality of reflectors / dichroics 38A, 38B, 38C, 38D is automatically changed in response to head and eye movement of the user 18 seated in the associated seat 20A, 20B, 20C, 20D.
[0059] With respect to Figure 4For further disclosure details of the user display system 28, 32 shown in FIG. 1, see U.S. Patent Application Serial No. 17 / 842,272, filed June 16, 2022, entitled “MULTI-PERSPECTIVE THREE-DIMENSIONAL FLOATING IMAGE DISPLAY WITH TOUCH FUNCTION,” Publication No. US-2023-0408841-A1, which is incorporated by reference in its entirety into the present disclosure.
[0060] Referring to Figure 3 and Figure 5 In another exemplary embodiment, the user display system 28 including the single display system 32 further includes an image chamber 66 including the at least one display 34 adapted to project the image 36 and a plurality of reflectors 38A, 38B, 38C, 38D individually associated with each of the plurality of seats 20A, 20B, 20C, 20D within the vehicle 14 and adapted to reflect the image 36 to the associated one of the plurality of seats 20A, 20B, 20C, 20D within the vehicle 14 such that the user 18 seated in the associated one of the plurality of seats 20A, 20B, 20C, 20D within the vehicle 14 perceives the image 36 floating in the central location within the vehicle 14. The image chamber 66 includes a transparent portion 68 adapted to allow the image 36 reflected by the reflectors 38A, 38B, 38C, 38D to pass outwardly from the image chamber 66 to the user 18 seated in the associated one of the plurality of seats 20A, 20B, 20C, 20D. The image chamber 66 further includes a solid portion 70 adapted to prevent light from entering the image chamber 66 behind the reflectors 38A, 38B, 38C, 38D.
[0061] The transparent cylindrical touch screen display 40 is located between the reflectors 38A, 38B, 38C, 38D of the image chamber 66 and the plurality of seats 20A, 20B, 20C, 20D within the vehicle 14 and is adapted to display information to the user 18 seated in the plurality of seats 20A, 20B, 20C, 20D within the vehicle 14 into the image planes 48, 50 in front of the perceived image 36 floating in the central location within the vehicle 14.
[0062] Referring to Figure 5, the image chamber 66 includes a first display 34A adapted to project a first three-dimensional image 36A and a first reflector 38A associated with the first display 34A and a user 18 in the first seat 20A, respectively, and a second display 34B adapted to project a second three-dimensional image 36B and a second reflector 38B associated with the second display 34B and a user 18 in the second seat 20B, respectively. As shown in Figure 5 for purposes described herein, the user display system 28, 32 is shown as having only the first and second seats 20A, 20B and the first and second displays 34A, 34B and the first and second reflectors 38A, 38B. It will be appreciated that the user display system 28, 32 can be adapted to accommodate any suitable number of users 18 and corresponding seats 20A, 20B, 20C, 20D, as shown in Figure 3 .
[0063] Referring to Figure 3 , the vehicle includes first, second, third, and fourth seats 20A, 20B, 20C, 20D. Each reflector 38A, 38B, 38C, 38D is adapted to be viewed by a user 18 seated in one of the first, second, third, and fourth seats 20A, 20B, 20C, 20D. Each reflector 38A, 38B, 38C, 38D is adapted to receive an image 36 from an associated display 34 and reflect the image 36 to the associated seat 20A, 20B, 20C, 20D for viewing by a user 18 seated thereon. The user 18 perceives the image 36 floating in a central location within the image chamber 66.
[0064] Referring again to Figure 5 , the first reflector 38A is adapted to receive a first image 36A from the first display 34A, as indicated by arrow 72, and reflect the first image 36A to a user 18 in the first seat 20A, as indicated by arrow 74, where the user 18 in the first seat 20A perceives the first image 36A floating in a central location within the image chamber 66, as indicated by arrow 76. The second reflector 38B is adapted to receive a second image 36B from the second display 34B, as indicated by arrow 78, and reflect the second image 36B to a user 18 in the second seat 20B, as indicated by arrow 80, where the user 18 in the second seat 20B perceives the second image 36B floating in a central location within the image chamber 66, as indicated by arrow 82.
[0065] Referring again to Figure 3Each user 18 sitting in the first seat 20A, the second seat 20B, the third seat 20C, and the fourth seat 20D perceives the image 36 reflected to them by the respective associated reflector 38A, 38B, 38C, 38D, and the user 18 perceives the image 36 reflected to them within the image room 66, as indicated by line 84. Each display 34 can project the same image 36 to each reflector 38A, 38B, 38C, 38D, and thus to each user in the first seat 20A, the second seat 20B, the third seat 20C, and the fourth seat 20D. Alternatively, each display 34 can display a different perspective of the same image, or a completely different image, to each reflector 38A, 38B, 38C, 38D. Thus, the system 10 is capable of presenting the same floating image 36 to all seats 20A, 20B, 20C, 20D, so that the users 18 can view simultaneously, or alternatively, each user 18 in each seat 20A, 20B, 20C, 20D can view a different perspective of the floating image 36 or a completely different three-dimensional image.
[0066] A transparent cylindrical touch screen display 40 is positioned between the plurality of seats 20A, 20B, 20C, 20D and the reflectors 38A, 38B, 38C, 38D. The transparent cylindrical touch screen display 40 is adapted to display information to the users 18 within the image planes 84, 86, which are in front of the perceived first image 36A and second image 36B floating in the center of the image room 66. The transparent cylindrical touch screen display 40 presents information to the user 18 sitting in the first seat 20A appearing in the first image plane 84, wherein the information displayed on the transparent cylindrical touch screen display 40 to the user 18 in the first seat 20A appears in front of the image 36A perceived by the user 18 in the first seat 20A within the image room 66. The transparent cylindrical touch screen display 40 presents information to the user 18 sitting in the second seat 20B appearing in the second image plane 86, wherein the information displayed on the transparent cylindrical touch screen display 40 to the user 18 in the second seat 20B appears in front of the image 36B perceived by the user 18 in the second seat 20B within the image room 66.
[0067] The transparent cylindrical touch screen display 40 is adapted to allow the users 18 sitting in the plurality of seats 20A, 20B, 20C, 20D to receive annotation information and provide input to the system 10. The transparent cylindrical touch screen display 40 surrounds the image room 66, and thus is positioned between the eyes of the users 18 sitting in the plurality of seats 20A, 20B, 20C, 20D and the perceived images 36, 36A, 36B floating in the center of the image room 66.
[0068] The transparent cylindrical touch screen display 40 is adapted to present visible display information to only the user 18 seated in the seat 20A, 20B, 20C, 20D directly in front of the portion of the transparent cylindrical touch screen display 40. The nature of the transparent cylindrical touch screen display 40 is such that the displayed information is only displayed on the first side of the transparent cylindrical touch screen display 40, i.e., the outward facing cylindrical surface. The second side of the transparent cylindrical touch screen display 40, i.e., the inward facing cylindrical surface, does not display information, thus allowing the other users 18 to see through the transparent cylindrical touch screen display 40 when viewed by the other users 18.
[0069] In one exemplary embodiment, the transparent cylindrical touch screen display 40 is an autostereoscopic display that is adapted to display stereoscopic or three-dimensional images by adding binocular perception of three-dimensional depth without the use of special headgear, glasses, something that affects the viewer's vision, or anything for the viewer's eyes. Because no headgear is required, autostereoscopic displays are also referred to as "glasses-free 3D" or "glasses-less 3D."
[0070] Referring to Figure 6 , the transparent portion 68 of the image chamber 66 allows the user 18 to see its associated reflector 38A, 38B, 38C, 38D. As shown, the image chamber 66 includes a first transparent portion 68A that is adapted to allow the first image 36A reflected by the first reflector 38A to pass outwardly from the image chamber 66 to the user 18 seated in the first seat 20A, as indicated by arrow 74 in Figure 5 . In addition, the image chamber 66 includes a second transparent portion 68B that is adapted to allow the second image 36B reflected by the second reflector 38B to pass outwardly from the image chamber 66 to the user 18 seated in the second seat 20B, as indicated by arrow 80 in Figure 5 .
[0071] The image chamber 66 also includes a solid portion 70 that is adapted to prevent light from entering the image chamber 66 behind the first reflector 38A and the second reflector 38B. The function of the image chamber 66 is very similar to a Pepper's Ghost Chamber, wherein a viewer perceives an image of an object within a reflective surface adjacent to the actual image. As described above, in the present disclosure, an image presented by a display that is not within the field of view of the passenger 18 is reflected to the user 18 by the reflectors 38A, 38B, 38C, 38D, such that the user 18 "sees" the image 36 within the image chamber 66 and perceives the image 36 as floating behind the reflective surfaces of the reflectors 38A, 38B, 38C, 38D. If the image chamber 66 behind the reflectors 38A, 38B, 38C, 38D is exposed to ambient light, the user 18 will not see the image 36. Therefore, the solid portion 70 of the image chamber 66 is adapted to prevent light from entering the image chamber 66 behind the first and second reflectors 38A, 38B. Reference Figure 6 , the image chamber 66 includes solid overlapping panels 70A, 70B that are adapted to prevent light from entering the image chamber 66 behind the first and second reflectors 38A, 38B.
[0072] refer to Figure 7 In the exemplary embodiment, the user display systems 28, 32 are selectively movable vertically up and down along the vertical center axis 88, as indicated by arrow 90. In addition, each display and associated reflector 38A, 38B, 38C, 38D are integrally and selectively rotatable about the vertical center axis 88, as indicated by arrow 92. This allows the system 10 to adapt to different positions of the passenger 18 within the vehicle 14.
[0073] refer to Figure 8 , the first reflector 38A and the first display 34A can rotate about the vertical center axis 88, as shown by arrow 94. The second reflector 38B and the second display 34B can rotate about the vertical center axis 88, as shown by arrow 96. Figure 5 As shown, the user 18 is seated on a first seat 20A and a second seat 20B directly opposite each other, and the first reflector 38A and the first display 34A are positioned 180 degrees from the second reflector 38B and the second display 34B. Figure 8 As shown, the head position of the user 18 in the second seat 20B has moved, and the second reflector 38B and the second display 34B have been rotated an angular distance 98 to ensure that the user 18 in the second seat 20B perceives the image 36B from the second display 34B and the second reflector 38B.
[0074] In an example embodiment, the first solid panel 70A positioned adjacent the first reflector 38A on either side is adapted to move integrally with the first reflector 38A and the first display 34A as the first reflector 38A and the first display 34A rotate about the vertical center axis 88. The second solid panel 70B positioned adjacent the second reflector 38B on either side is adapted to move integrally with the second reflector 38B and the second display 34B as the second reflector 38B and the second display 34B rotate about the vertical center axis 88. The first solid panel 70A overlaps the second solid panel 70B to allow relative movement of the first solid panel 70A with respect to the second solid panel 70B and to ensure that ambient light is always blocked from entering the image chamber 66 behind the first and second reflectors 38A, 38B.
[0075] In an example embodiment, each of the displays 34, 34A, 34B and associated reflectors 38A, 38B, 38C, 38D are in communication with the occupant monitoring cameras 22A, 22B, 22C, 22D, wherein the orientation of each display 34, 34A, 34B and associated reflector 38A, 38B, 38C, 38D is automatically changed in response to movement of the head and eyes of the user 18 detected by the occupant monitoring cameras 22A, 22B, 22C, 22D.
[0076] In an example embodiment, the user display system 28, 32 receives data from the first occupant monitoring camera 22A related to the position of the head and eyes of a user seated in the first seat 20A. The first display 34A and the first reflector 38A are adapted to rotate in response to movement of the head and eyes of the user 18 based on receiving data from the first occupant monitoring camera 22A. The user display system 28, 32 also receives data from the second occupant monitoring camera 22B related to the position of the head and eyes of a user seated in the second seat 20B. The second display 34B and the second reflector 38B are adapted to rotate in response to movement of the head and eyes of the user 18 based on receiving data from the second occupant monitoring camera 22B. In addition to the rotation of the first display 34A and the first reflector 38A and the second display 34B and the second reflector 38B, the user display system 28, 32 is also adapted to move up and down the vertical center axis 88 in response to movement of the head and eyes of the user 18 within the first and second seats 20A, 20B, as shown in Figure 7
[0077] With regard to Figures 5-8 For further disclosure details of the user display system shown in FIG. 1, see U.S. Patent Application Serial No. 18 / 153,767, filed January 12, 2023, entitled “ADAPTIVE INTERACTIVE CAMPFIRE DISPLAY,” which is incorporated by reference in its entirety into this disclosure.
[0078] In another example embodiment, the system 10 includes an audio device, e.g., at least one microphone 24, to allow the user 18 to provide audible input to the system 10. The system 10 can include a microphone 24 adapted to receive sound input from any user 18 within the vehicle 14 and / or a microphone 24 specifically associated with one of the first seat 20A, the second seat 20B, the third seat 20C, and the fourth seat 20D and adapted to only pick up sound input from the user 18 seated in the associated one of the first seat 20A, the second seat 20B, the third seat 20C, and the fourth seat 20D.
[0079] In an example embodiment, the user display system 28 is adapted to accept input from the user 18 based only on contact between the user 18 and the user display system 28. For example, when the user 18 extends a fingertip to touch the touchscreen display 40, the touchscreen display 40 takes input based only on the point of contact between the passenger 18’s fingertip and the transparent touchscreen display 40.
[0080] In another example embodiment, the system 10 is adapted to accept input from the user 18 based on contact between the user 18 and the touchscreen display 40 and based on the location of the point of contact between the user 18 and the touchscreen display 40 relative to the perceived image 36. For example, the occupant monitoring cameras 22A, 22B, 22C, 22D track the eye and head movements and positions of the user 18. The touchscreen display 40 displays information that the user 18 perceives relative to the floating image 36, as described above. When the user 18 touches the touchscreen display 40, the user 18 perceives that they are touching the floating image 36. The user display system 10 uses parallax compensation to correlate the actual point of contact between the user 18’s fingertips on the touchscreen display 40 to the location on the floating image 36 that the user 18 perceives that they are touching.
[0081] The user display system 28 can display a plurality of different blocks of annotation information related to the floating image 36 on the touchscreen display 40. As the head and eye of the user 18 move, the user's head and eyes will be positioned at different distances and angles relative to the touchscreen display 40, changing the perceived location of the displayed information relative to the image 36. By using parallax compensation techniques such as those disclosed in U.S. Patent No. 10,318,043 to Seder et al., which is incorporated herein by reference, the user display system 28 ensures that the user display system 28 correctly identifies the intended annotation information that the user 18 is selecting when the user 18 touches the touchscreen display 40.
[0082] In another example embodiment, the user display system 28 is adapted to accept input from the user 18 based on gestures made by the user 18 without the user 18 touching the touchscreen display 40. For example, when the user 18 moves a hand or points at an object displayed on the touchscreen display 40 or at an object within the cabin or outside of the vehicle 14.
[0083] Referring again to Figure 5 , using the embodiment of the user display system 28, 32 displayed therein, in an example embodiment, the user display system 28 includes a first gesture sensor 110 that is adapted to monitor the position and movement of the arms, hands, and fingers 114 of the user 18 seated in the first seat 20A and collect data related to gestures made by the user 18. The first gesture sensor 110 is incorporated into or merged with the first occupant monitoring camera 22A and can include a separate camera and / or motion sensor that is adapted to detect the position and movement of the arms, hands, and fingers of the user 18 seated in the first seat 20A. In addition, the user display system 28 includes a second gesture sensor 112 that is adapted to monitor the position and movement of the arms, hands, and fingers of the user 18 seated in the second seat 20B and collect data related to gestures made by the user 18. The second gesture sensor 112 is incorporated into or merged with the second occupant monitoring camera 22B and can include a separate camera and / or motion sensor that is adapted to detect the position and movement of the arms, hands, and fingers of the user 18 seated in the second seat 20B.
[0084] The vehicle display server uses the data collected by the first and second gesture sensors 110, 112 to identify gestures made by the users 14A, 14B within the vehicle, using computer vision and computer learning algorithms and parallax compensation techniques to interpret such gestures and identify the input data.
[0085] In an example embodiment, the vehicle display server 12 is adapted to use a plurality of sensors 16 located within the vehicle 14, computer vision algorithms, and stored data to identify the identity of a user 18 sitting in one of a plurality of seats 20A, 20B, 20C, 20D within the vehicle 14. Once the vehicle display server 12 identifies the user 18, the vehicle display server 12 selects user-specific content to be displayed to the user 18 on the user display system 28. The user-specific content can include an application or account that the user 18 has previously registered for and regularly accesses using the system 10. For example, when the user 18 is using the system 10 within the vehicle 14, the user 18 regularly watches a streaming news service. Thus, when the vehicle display server 12 identifies the user 18, the vehicle display server 12 will select the streaming news service as user-specific content that can be displayed to the user 18. The user-specific content can also include context-based content, for example, if a local weather service is forecasting a severe storm in the near future, the vehicle display server 12 can flag a weather information service as user-specific content to be displayed to the user 18 to inform the user of the impending severe weather. The user-specific content can also be based on a probability calculation of what content the user 18 can want using a machine learning algorithm based on stored data, taking into account the time of day / night, the destination, the number of passengers in the vehicle with the user 18, the identity of other passengers within the vehicle 14, etc.
[0086] Once the vehicle display server 12 has selected user-specific content to be displayed to the user 18 using the identity of the user 18, the vehicle display server 12 automatically displays the user-specific content on the user display system 28 for the seat 20A, 20B, 20C, 20D that the user 18 is sitting in. The automatic display of the user-specific content will depend on the system 10 identifying the user 18, and the user 18 registering with the system 10 and agreeing to the terms and conditions associated with the use of the system 10. If the system 10 identifies the user 18 as a registered user of the system 10, the system will automatically initiate the display of the user-specific content selected for that user 18. The vehicle display server 12 can display a plurality of options for various items included in the user-specific content, or can automatically prioritize different items of the user-specific content and display the highest ranked item based on a probability calculation. For example, when the vehicle 14 reaches a destination, the user 18 can be watching a movie on the user display system 28 within the vehicle 14, where the user 18 terminates the display of the movie and exits the vehicle 14. When the user 18 returns to the vehicle 14, the vehicle display server 12 will prioritize the movie and automatically resume the display of the movie for the user 18 on the user display system 28, which is directed to the seat 20A, 20B, 20C, 20D that the user 18 is sitting in.
[0087] In an example embodiment, when a user 18 seated in a first seat 20A within a vehicle 14 moves to a second seat 20B within the vehicle 14, the vehicle display server 12 is adapted to detect when the user 18 leaves the first seat 20A within the vehicle 14 using a plurality of sensors 16 located within the vehicle 14, such as a first occupant monitoring camera 22A. When the vehicle display server 12 detects that the user 18 has left the first seat 20A, the vehicle display server 12 automatically pauses the user-specific content that is currently being displayed on the user display system 28 for the user of the first seat 20A. When the vehicle display server 12 detects when the user 18 is seated in the second seat 20B within the vehicle 14 using a plurality of sensors 16 located within the vehicle 14, such as a second occupant monitoring camera 22B, the vehicle display server 12 automatically resumes displaying the user-specific content on the user display system 28, which is directed to the second seat 20B.
[0088] Thus, for example, when a user 18 is watching a particular user content for the user 18 on the user display system 28 at a particular seat, and when other passengers within the vehicle 14 get in, requiring the user 18 and the other passengers within the vehicle 14 to adjust, the vehicle display server 12 automatically detects when the user 18 moves, and automatically resumes the user's content when the user 18 selects a new seat within the vehicle 14.
[0089] In another example embodiment, the vehicle display server 12 is adapted to identify when a user 18 viewing a user display system 28 looks away from the user display system 28 using a plurality of sensors 16 located within the vehicle 14; pause the user-specific content being displayed on the user display system 28; identify when the user 18 looks back at the user display system 28 using a plurality of sensors 16 located within the vehicle 14; and resume displaying the user-specific content on the user display system 28. Thus, for example, when a user 18 seated in a first seat 20A within a vehicle 14 is watching a user-specific content on the user display system 28 and looks away from the user display system 28 to observe conditions outside the vehicle 14, the vehicle display server 12 automatically detects that the user is looking away using a plurality of sensors 16 located within the vehicle 14, such as a first occupant monitoring system 22A. The vehicle display server 12 then pauses the user-specific content being displayed on the user display system 28, such as a movie that the user 18 is watching, until the vehicle display server 12 detects that the user 18 has looked back at the user display system 28 using the first occupant monitoring camera 22A, at which time the vehicle display server 12 resumes the movie.
[0090] Referring again to Figure 1, the system 10 further includes a cloud-based host server 120 in communication with the vehicle display server 12 within the vehicle 14 over a wireless communication network 122. The cloud-based host server 120 is also in communication with at least one remote vehicle 124 having a vehicle display server 12', a plurality of sensors 16', haptic feedback devices 26A', 26B', 26C', 26D', a plurality of seats 20A', 20B', 20C', 20D', and a user display system 28' substantially identical to the corresponding features of the vehicle 14 in communication with the cloud-based host server 120.
[0091] In an exemplary embodiment, when the user 18 seated within the vehicle 14 exits the vehicle 14 and moves to one of the at least one remote vehicle 124, the vehicle display server 12 within the vehicle 14 is adapted to detect when the user 18 exits the vehicle 14 using the plurality of sensors 16 (e.g., occupant monitoring cameras 22A, 22B, 22C, 22D) located within the vehicle 14 and to pause the user-specific content that is currently being displayed on the user display system 28 within the vehicle 14. The vehicle display server 12' within one of the at least one remote vehicle 124 is adapted to detect when the user 18 enters the one of the at least one remote vehicle 124 using the plurality of sensors 16' located within the one of the at least one remote vehicle 124. The vehicle display server 12' within the one of the at least one remote vehicle 124 uses the plurality of sensors 16', computer vision algorithms, and stored data to identify the user 18. The vehicle display server 12' within the one of the at least one remote vehicle 124 then obtains information related to the user-specific content that the user 18 was viewing in the vehicle 14 prior to exiting the vehicle 14 by the host server 120 communicating with the vehicle display server 12 within the vehicle 14. At this point, on the seat 20A', 20B', 20C', 20D' of the one of the at least one remote vehicle 124 that the user 18 sat in, the vehicle display server 12' within the one of the at least one remote vehicle 124 automatically resumes displaying the user-specific content on the user display system 28' within the one of the at least one remote vehicle 124 that the user 18 entered.
[0092] This allows the user 18 to continue interacting with the user-specific content throughout the journey by having the user-specific content automatically follow the user 18. For example, the user 18 is playing an interactive game with other remote players. The user 18 begins playing the game while en route to a ride-share parking lot in their private vehicle 14, where the user 18 exits their private vehicle 14 and enters an autonomous ride-share vehicle 124. The system 10 will automatically pause the display on the user display system 28 in the private vehicle 14 and pause the game when the user 18 exits their private vehicle 14. Once the user 18 enters the autonomous ride-share vehicle 124 and selects a seat 20A', 20B', 20C', 20D' within the autonomous ride-share vehicle 124, the vehicle display server 12' within the autonomous ride-share vehicle 124 will resume the game with the other players and display the game on the user display system 28' within the autonomous ride-share vehicle 124.
[0093] The host server is adapted to coordinate the vehicle display server 12 and user display system 28 located within the vehicle 14 and being viewed by the first user 18 with the vehicle display server 12' and user display system 28' located within one of the at least one remote vehicle 124 and being viewed by the second user 18', and facilitate communication and interaction between the first user 18 and the second user 18'. In this way, the host server 120 provides coordinated interaction between the first user 18 and the second user 18' as they view the same movie, play an interactive game together, or participate in a multi-participant audio and / or video conversation.
[0094] In an example embodiment, the host server communicates with the personal device 126 of the user 18. For example, a user 18 registered to use the system 10 can have an application that allows linking of a personal device 126, such as a phone or tablet, to the system 10. Thus, when the user 18 is watching user-specific content on the user display system 28 within the vehicle 14 and the user 18 exits the vehicle 14, the host server 120 is adapted to receive data from the plurality of sensors 16 located within the vehicle 14 of when the user 18 exits the vehicle 14 by communicating with the vehicle display server 12 within the vehicle 14 and automatically pause the user-specific content that is currently being displayed on the user display system 28 within the vehicle 14. If the personal device 126 is connected with the system 10, the host server 120 will automatically resume displaying the user-specific content on the personal device 126 of the user 18 after the user 18 exits the vehicle 14. The host server 120 will also provide the user 18 with the option to selectively terminate the user-specific content or pause the user-specific content without resuming on the personal device 126. Similarly, when the user 18 is watching user-specific content on the personal device 126 and the user 18 enters the vehicle 14, the host server 120 is adapted to detect when the user 18 enters the vehicle 14 using data received from the plurality of sensors 16 located within the vehicle 14 by communicating with the vehicle display server 12 within the vehicle 14 and automatically prompt the user 18 with the option to selectively pause the user-specific content that is currently being displayed on the personal device 126 and resume displaying the user-specific content on the user display system 28 within the vehicle 14.
[0095] In an example embodiment, the plurality of sensors 16 within the vehicle, and in particular the first occupant monitoring camera 22A, the second occupant monitoring camera 22B, the third occupant monitoring camera 22C, and the fourth occupant monitoring camera 22D, are adapted to monitor the position of the head and eyes of each user 18 seated in the plurality of seats 20A, 20B, 20C, 20D within the vehicle 14. For each seat 20A, 20B, 20C, 20D, the vehicle display server 12 is adapted to display information at a particular location on the transparent touchscreen display 40 of the user display system 28 based on the position of the head and eyes of the user 18. In another example embodiment, for each of the plurality of seats 20A, 20B, 20C, 20D within the vehicle 14, the vehicle display server 12 is adapted to display information at a particular location on the transparent touchscreen display 40 of the user display system 28 based on the position of the head and eyes of the user 18 relative to the perception image 36 floating in a central location within the vehicle 14, such that for each of the plurality of seats 20A, 20B, 20C, 20D, the information displayed on the transparent touchscreen display 40 of the user display system 28 is properly positioned relative to the perception image 36 as viewed by the user 18 seated within the seat 20A, 20B, 20C, 20D.
[0096] Referring Figure 9 In the schematic view of the user display system 28 including the associated reflector 38, transparent touch screen display 40, and floating image 36 that the user 18 views, the user 18 perceives the floating image 36 at a distance in front of the reflector 38. As shown, the user display system 28 includes the transparent touch screen display 40 incorporated into the reflector 38 for each individual user 18. These principles similarly apply to a user display system 28 incorporating individual reflectors and transparent cylindrical touch screen displays 40.
[0097] The transparent touch screen display 40 displays information related to the floating image 36 at an appropriate location on the transparent touch screen display 40 that the user 18 sees at an appropriate location relative to the floating image 36. As Figure 9 shown, the floating image 36 has a skyline, and more particularly, a skyline of three buildings, namely a first building 128, a second building 130, and a third building 132. The transparent touch screen display (or transparent cylindrical touch screen display) 40 displays first building information 134, second building information 136, and third building information 138.
[0098] The first building information 134 appears in a text box and can contain information about the first building 128 as well as an option to allow the user 18 to touch the first building information 134 text box to obtain additional information about the first building 128. For example, the first building information 134 text box can contain the name and street address of the first building 128. The user 18 can choose to touch the first building information 134 text box where additional information will appear on the transparent touch screen display 40, such as the date of construction of the first building 128, the type of building (office, church, arena, etc.), or statistical data such as height, capacity, etc. The second building information 136 and third building information 138 also appear in text boxes containing similar information as well as an option for the user 18 to touch the second building information 136 or third building information 138 text box to receive additional information about the second and third buildings 130, 132.
[0099] The occupant monitoring cameras 22A, 22B, 22C, 22D track the position of the head 18H and eyes 18E of the user 18 and position the first building information 134, second building information 136, and third building information 138 text boxes at locations on the transparent touch screen display 40 so that the user 18 sees the first building information 134, second building information 136, and third building information 138 text boxes in the proper locations relative to the floating image 36 when the user views the floating image 36 through the reflector / splitter 38 and the transparent touch screen display (transparent cylindrical touch screen display) 40. For example, the transparent touch screen display (transparent cylindrical touch screen display) 40 positions the first building information 134 in the user's line of sight as shown by the dashed line 140 so that the user 18 perceives the first building information 134 at a location adjacent to the first building 128 as shown by 134'. Correspondingly, the transparent touch screen display (transparent cylindrical touch screen display) 40 positions the second building information 136 in the user's line of sight as shown by the dashed line 142 and the third building information 138 in the user's line of sight as shown by the dashed line 144 so that the user 18 perceives the second building information 136 superimposed at the location of the second building 130 as shown by 136' and perceives the third building information 138 at a location adjacent to the third building 132 as shown by 138'.
[0100] The occupant monitoring cameras 22A, 22B, 22C, 22D continue to track the movement of the head 18H and eyes 18E of the user 18 and adjust the position of the first building information 134, second building information 136, and third building information 138 displayed on the transparent touch screen display (transparent cylindrical touch screen display) 40 to ensure that the user 18 always perceives the first building information 134, second building information 136, and third building information 138 at the correct locations 134', 136', 138' relative to the floating image 36.
[0101] In exemplary embodiments, when the identity of the user seated within the vehicle 14 is used to select user-specific content to be displayed for the user, the vehicle display server 12 is adapted to access historical stored data of content viewed by the user 18, which is stored within the vehicle display server 12 within the vehicle 14 and / or within the host server 120 and / or within a cloud-based database 146 in communication with the host server 120. The vehicle display server 12 can also prompt the user 18 to selectively restore viewing of content previously viewed by the user 18 on a different user display system and / or to selectively view content that has been previously viewed by other users within the same vehicle 14.
[0102] Reference Figure 10A method 200 of using a system that enables vehicle displays and interactions includes, with a vehicle display server 12 located within a vehicle 14 and in communication with a plurality of sensors 16 located within the vehicle 14, tracking head and eye position and movement of users 18 seated in a plurality of seats 20A, 20B, 20C, 20D within the vehicle 14, from block 202; moving to block 204, detecting the location of the users 18 within the vehicle 14 and when the users 18 change seats 20A, 20B, 20C, 20D within the vehicle 14; moving to block 206, detecting when the users 18 enter and exit the vehicle 14; moving to block 208, detecting and interpreting facial and gesture inputs from the users 18 within the vehicle 14; moving to block 210, capturing images of the users 18 within the vehicle 14; and moving to block 212, receiving audio inputs from the users within the vehicle.
[0103] From block 212, the method 200 further includes, with haptic feedback devices 26A, 26B, 26C, 26D located within the vehicle 14 and in communication with the vehicle display server 12, providing haptic feedback to the users 18 seated within the vehicle 14; moving to block 216, using a plurality of sensors 16 located within the vehicle 14, computer vision algorithms, and stored data to identify the identity of the users 18 seated in one of the plurality of seats 20A, 20B, 20C, 20D within the vehicle 14; moving to block 218, using the identity of the users 18 seated in one of the plurality of seats 20A, 20B, 20C, 20D within the vehicle 14 to select user-specific content to be displayed on a user display system 28 for the user seated in one of the plurality of seats 20A, 20B, 20C, 20D; and moving to block 220, with the user display system 28 located within the vehicle 14, automatically displaying the user-specific content for viewing and interaction by the user 18 seated in one of the plurality of seats 20A, 20B, 20C, 20D.
[0104] In an example embodiment, the method 200 further includes, when a user 18 seated in a first seat 20A within the vehicle 14 moves to a second seat 20B within the vehicle 14, moving to block 222, with the vehicle display server 12 and the plurality of sensors 16 located within the vehicle, detecting when the user 18 exits the first seat 20A within the vehicle 14; moving to block 224, with the vehicle display server 12, pausing the user-specific content that is currently being displayed on the user display system 28 for the user 18 of the first seat 20A; moving to block 226, with the vehicle display server 12 and the plurality of sensors located within the vehicle, detecting when the user 18 is seated in the second seat 20B within the vehicle 14; and moving to block 228, with the vehicle display server 12, resuming display of the user-specific content on the user display system for the user 18 of the second seat 20B.
[0105] In another example embodiment, displaying the user-specific content on the user display system 28 at block 220 further comprises one of: displaying the user-specific content on the user display system 28, the user display system 28 comprising a plurality of individual display screens 30A, 30B, 30C, 30D, the plurality of individual display screens 30A, 30B, 30C, 30D adapted to display information and receive input from the user 18, one individual display screen 30A, 30B, 30C, 30D associated with each of a plurality of seats 20A, 20B, 20C, 20D within the vehicle 14; or displaying the user-specific content on the user display system 28, the user display system 28 comprising a single display system 32, the single display system 32 comprising: at least one display 34, the display 34 for projecting an image 36; a plurality of reflectors 38A, 38B, 38C, 38D, each reflector 38A, 38B, 38C, 38D associated with one of a plurality of seats 20A, 20B, 20C, 20D within the vehicle 14 and adapted to reflect the projected image 36 to the associated one of the plurality of seats 20A, 20B, 20C, 20D such that the user 18 seated in the associated one of the plurality of seats 20A, 20B, 20C, 20D within the vehicle 14 perceives the image 36 floating in a central location within the vehicle 14; and a transparent cylindrical touchscreen display 40, the transparent cylindrical touchscreen display 40 located between the plurality of seats 20A, 20B, 20C, 20D and the plurality of reflectors 38A, 38B, 38C, 38D within the vehicle 14 and adapted to display the user-specific content for the user seated in each of the plurality of seats 20A, 20B, 20C, 20D within the vehicle 14 and receive input from each user 18 seated in each of the plurality of seats 20A, 20B, 20C, 20D within the vehicle 14.
[0106] In another example embodiment, the method 200 comprises, using the vehicle display server 12, moving to block 230, using the plurality of sensors 16 located within the vehicle 14 to identify when the user 18 viewing the user display system 28 looks away from the user display system 28; moving to block 232, pausing the user-specific content being displayed on the user display system 28; moving to block 234, using the plurality of sensors 16 located within the vehicle 14 to identify when the user 18 looks back at the user display system 28; and moving to block 236, resuming display of the user-specific content on the user display system 28.
[0107] In another example embodiment, the system 10 further includes a cloud-based host server 120 in communication with the vehicle display server 12 within the vehicle 14 over a wireless communication network 122, the cloud-based host server 120 is further in communication with at least one remote vehicle 124 having a vehicle display server 12', a plurality of sensors 16', haptic feedback devices 26A', 26B', 26C', 26D', a plurality of seats 20A', 20B', 20C', 20D', and a user display system 28' substantially identical to the corresponding features of the vehicle 14 in communication with the cloud-based host server 120. The method 200 further includes, when the user 18 seated within the vehicle 14 exits the vehicle and moves to one of the at least one remote vehicle 124, moving to block 238 detecting when the user 18 exits the vehicle 14 using the vehicle display server 12 and the plurality of sensors 16 located within the vehicle; moving to block 240 pausing the user-specific content currently being displayed on the user display system 28 within the vehicle 14 using the vehicle display server 12 located within the vehicle 14; moving to block 242 detecting when the user 18 enters the one of the at least one remote vehicle 124 using the vehicle display server 12' and the plurality of sensors 16' located within the one of the at least one remote vehicle 124; moving to block 244 identifying the identity of the user 18 using the vehicle display server 12' and the plurality of sensors 16', computer vision algorithms, and stored data located within the one of the at least one remote vehicle 124; moving to block 246 using the vehicle display server 12' located within the one of the at least one remote vehicle 124, obtaining information related to the user-specific content the user 18 was viewing within the vehicle 14 prior to exiting the vehicle 14 by communicating with the host server 120; and moving to block 248 automatically resuming display of the user-specific content on the user display system 28' within the one of the at least one remote vehicle 124 that the user 18 entered.
[0108] In another example embodiment, the method 200 further includes moving to block 250 using the host server 120 to coordinate the vehicle display server 12 and the user display system 28 located within the vehicle 14 and being viewed by a first user 18 seated within the vehicle 14 with the vehicle display server 12' and the user display system 28' located within the one of the at least one remote vehicle 124 and being viewed by a second user 18; and moving to block 252 using the host server 120 to facilitate communication and interaction between the first user 18 located within the vehicle 14 and the second user 18 located within the remote vehicle 124.
[0109] In another example embodiment, where the host server 120 is in communication with the personal device 126 of the user 18, the method 200 further includes, when the user 18 is viewing the user-specific content on the user display system 28 within the vehicle 14 and the user 18 exits the vehicle 14, moving to block 254, detecting when the user 18 exits the vehicle 14 with the host server 120 and the plurality of sensors 16 located within the vehicle 14 by communicating with the vehicle display server 12 within the vehicle 14; moving to block 256, automatically pausing the user-specific content that is currently being displayed on the user display system 28 within the vehicle 14 with the host server 120; and moving to block 258, automatically resuming display of the user-specific content on the personal device 126 of the user 18 with the host server 120; and when the user 18 is viewing the user-specific content on the personal device 126 and the user 18 enters the vehicle 14, the method 200 further includes, moving to block 260, detecting when the user 18 enters the vehicle 14 with the host server 120 and the plurality of sensors 16 located within the vehicle 14 by communicating with the vehicle display server 12 within the vehicle 14; and moving to block 262, automatically prompting the user 18 with the host server 120 to selectively pause the user-specific content that is currently being displayed on the personal device 126 with the option to resume display of the user-specific content on the user display system 28 within the vehicle 14.
[0110] The system and method of the present disclosure has several advantages. These advantages include providing floating images perceived by passengers located in a central location within the vehicle cabin. This provides a campfire-like viewing atmosphere in which passengers can all see a common floating image or each passenger can see a unique floating image. In addition, the system according to the present disclosure provides the functionality of displaying annotations and information that are not embedded within the virtual image and ensures that the passengers are able to perceive these annotations and information in the appropriate location relative to the virtual image and on a plane between the passengers and the floating image. The system enables interaction between multiple users located within the same vehicle or within different vehicles and provides automatic identification of the users and selection / display of user-specific content to the users and display specifically in the seat in the vehicle in which the user is seated. The system also enables the user-specific content so selected to follow the user as the user moves from seat to seat within a vehicle or from one vehicle to a different vehicle.
[0111] The description of the present disclosure is merely exemplary in nature and variations that do not depart from the spirit of the present disclosure are intended to be within the scope of the present disclosure. Such variations are not to be regarded as a departure from the spirit and scope of the present disclosure.
Claims
1. A system for enabling vehicle display and interaction, comprising: a vehicle display server located within a vehicle and in communication with: a plurality of sensors located within the vehicle and adapted to: track head and eye position and movement of users seated in a plurality of seats within the vehicle; detect the location of users within the vehicle and when a user changes seats within the vehicle; detect when a user enters and exits the vehicle; detect and interpret facial and gesture input from users within the vehicle; capture images of users within the vehicle; receive audio input from users within the vehicle; haptic feedback devices located within the vehicle and adapted to provide haptic feedback to users seated within the vehicle; and a user display system located within the vehicle for viewing and interaction by users seated in the plurality of seats within the vehicle; the vehicle display server adapted to: use the plurality of sensors located within the vehicle, computer vision algorithms, and stored data to identify the identity of a user seated in one of the plurality of seats within the vehicle; use the identity of a user seated in one of the plurality of seats within the vehicle to select user-specific content to display for the user on the user display system; and automatically display the user-specific content on the user display system for viewing by the user seated in one of the plurality of seats within the vehicle. when a user seated in a first seat within the vehicle moves to a second seat within the vehicle, the vehicle display server adapted to:
2. The system of claim 1, wherein, use the plurality of sensors located within the vehicle to detect when the user exits the first seat within the vehicle; pause the user-specific content currently being displayed on the user display system of the first seat; use the plurality of sensors located within the vehicle to detect when the user is seated in the second seat within the vehicle; and resume displaying the user-specific content on the user display system of the second seat. the user display system comprising one of: a plurality of individual display screens adapted to display information and receive input from users, one individual display screen associated with each of the plurality of seats within the vehicle; or 3. The system of claim 2, wherein, a single display system comprising: at least one display for projecting images; a plurality of reflectors, each reflector associated with one of the plurality of seats within the vehicle and adapted to reflect projected images to the associated one of the plurality of seats such that a user seated in the associated one of the plurality of seats within the vehicle perceives the images as floating in a central location within the vehicle; and a transparent cylindrical touch screen display located between the plurality of seats and the plurality of reflectors within the vehicle and adapted to display user-specific content for a user in each of the plurality of seats within the vehicle and to receive input from each user in each of the plurality of seats within the vehicle.
4. The system of claim 3, wherein, the vehicle display server is adapted to: identify, using the plurality of sensors located within the vehicle, when a user viewing the user display system is looking away from the user display system; pause the user-specific content being displayed on the user display system; identify, using the plurality of sensors located within the vehicle, when a user is looking back at the user display system; and resume displaying the user-specific content on the user display system.
5. The system of claim 4, further comprising a cloud-based host server in communication with the vehicle display server within the vehicle over a wireless communication network, the cloud-based host server further in communication with at least one remote vehicle having a vehicle display server in communication with the cloud-based host server, a plurality of sensors, haptic feedback devices, a plurality of seats, and a user display system substantially identical to the corresponding features of the vehicle.
6. The system of claim 5, wherein, when a user seated within the vehicle exits the vehicle and moves to one of the at least one remote vehicle, the vehicle display server within the vehicle is adapted to: detect, using the plurality of sensors located within the vehicle, when a user exits the vehicle; and pause the user-specific content currently being displayed on the user display system within the vehicle; the vehicle display server within one of the at least one remote vehicle is adapted to: detect, using the plurality of sensors located within one of the at least one remote vehicle, when a user enters one of the at least one remote vehicle; identify the identity of the user using the plurality of sensors, computer vision algorithms, and stored data located within one of the at least one remote vehicle; obtain, by communication with the host server, information related to the user-specific content the user was viewing in the vehicle prior to exiting the vehicle; and automatically resume displaying the user-specific content on the user display system within one of the at least one remote vehicle the user entered. the host server is adapted to coordinate the vehicle display server and the user display system located within the vehicle and being viewed by a first user with a vehicle display server and a user display system located within one of the at least one remote vehicle and being viewed by a second user, and to facilitate communication and interaction between the first user and the second user.
7. The system of claim 6, wherein, the host server is in communication with a personal device of a user, and further wherein:
8. The system of claim 7, wherein, When the user is viewing user-specific content on the user display system within the vehicle and the user exits the vehicle, the host server is adapted to: detect when the user exits the vehicle using the plurality of sensors located within the vehicle in communication with the vehicle display server within the vehicle; automatically pause the user-specific content that is currently being displayed on the user display system within the vehicle; and automatically resume displaying the user-specific content on the user's personal device; and When the user is viewing user-specific content on the user's personal device and the user enters the vehicle, the host server is adapted to: detect when the user enters the vehicle using the plurality of sensors located within the vehicle in communication with the vehicle display server within the vehicle; automatically prompt the user to selectively: pause the user-specific content that is currently being displayed on the user's personal device; and resume displaying the user-specific content on the user display system within the vehicle.
9. The system of claim 3, wherein, For the user display system comprising a single display system, the plurality of reflectors comprises a plurality of transparent beam splitters, one transparent beam splitter being individually associated with each of the plurality of seats within the vehicle, each beam splitter being adapted to receive an image from the at least one display and reflect the image to an associated one of the plurality of seats, wherein a user seated in the associated one of the plurality of seats within the vehicle perceives the image as floating in a central location within the vehicle.
10. The system of claim 3, wherein, For the user display system comprising a single display system, further comprising: an image chamber, the image chamber comprising: at least one display, the at least one display being adapted to project an image; a reflector, the reflector being individually associated with each of the plurality of seats within the vehicle and being adapted to reflect the image to an associated one of the plurality of seats within the vehicle such that a user seated in the associated one of the plurality of seats within the vehicle perceives the image as floating in a central location within the vehicle; a transparent portion, the transparent portion being adapted to allow the image reflected by the reflector to pass outwardly from the image chamber to a user seated in the associated one of the plurality of seats; and a solid portion, the solid portion being adapted to prevent light from entering the image chamber behind the reflector; and a transparent cylindrical touchscreen display, the transparent cylindrical touchscreen display being located between the reflector of the image chamber and the plurality of seats within the vehicle and being adapted to display information to a user seated in the plurality of seats within the vehicle in an image plane in front of the perceived image floating in a central location within the vehicle.
Citation Information
Patent Citations
Dynamic adjustment of touch sensitive area in a display assembly
US10318043B2
Adaptive interactive campfire display
US12393049B2
Multi-perspective three-dimensional floating image display with touch function
US20230408841A1