Vehicle, having a VR device, and VR device for a vehicle
Patent Information
- Application Number
- DE102022125542
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-10-04
- Publication Date
- 2025-03-20
- Estimated Expiration
- 2042-10-04
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[0001] The invention relates to a vehicle having a VR device and a VR device for a vehicle.
[0002] A VR device allows a user to participate in a simulation of a virtual environment, also known as virtual reality (VR). The user can interact with this virtual environment, which is also known as the metaverse or cyberspace, via the VR device. For example, the user can move virtually within the virtual environment and communicate with other participants in the virtual environment. For this purpose, the participants can be represented in the virtual environment, for example, as so-called avatars. Simple embodiments of a VR device comprise a conventional computer screen and allow the user to interact using the computer's mouse, keyboard, and webcam. However, these embodiments only allow the user a low degree of immersion in the virtual world, which is referred to in the field as immersion.By using a headset with an integrated display and gaze detection, immersion in the virtual environment simulation can be increased, making it more realistic for the user. In addition to communication or leisure activities, virtual environments can also be used for training purposes or for machine design.
[0003] Advanced VR devices based on the current state of the art enable maximum immersion by providing a haptic experience of the virtual environment, involving the user's entire body. These VR devices, for example, feature resting and / or holding devices in which the user sits during the simulation.
[0004] The VR devices in question are described, for example, in the following publications.
[0005] US Pat. No. 6,135,928 A discloses equipment for using virtual reality. The equipment includes an input system for a virtual reality application that enables natural human locomotion.
[0006] TW 201223602 A discloses a system and a method for simulating an equilibrium game.
[0007] WO 95 / 12188 A1 discloses a motion simulation device. A motion simulation device that offers the user full freedom of movement in coordination with their senses of sight, hearing, and touch. The motion simulation device consists of a generally spherical capsule against which a series of rollers rests for support. At least one of the rollers is a multidirectional active roller that frictionally engages the spherical capsule, causing the spherical capsule to rotate in any direction. The user using the motion simulation device interacts with a virtual reality system to provide the user with the electronic simulation of physical reality and the physical input through the device.
[0008] However, due to their complexity, advanced VR devices are generally only designed for stationary operation, so the use of these advanced VR devices is limited to rooms in real estate.
[0009] This makes it impossible, for example, to participate in a virtual world with the currently highest level of immersion while driving a vehicle. Thus, travel time cannot be used to interact with the virtual world.
[0010] The document US 6 179 619 B1 shows the use of VR glasses in roller coasters.
[0011] The publication US 2019 / 0 179 408 A1 shows a rotatable VR chair whose current spatial orientation can be measured for the adaptation of VR content.
[0012] The document US 2020 / 0 111 381 A1 shows a seating arrangement that is movable around six spatial axes.
[0013] It is an object of the invention to enable the provision of a virtual environment with the highest possible degree of reality in a vehicle.
[0014] The problem is solved by the subject matter of the independent patent claims. Advantageous developments of the invention result from the features of the dependent patent claims, the following description, and the figures.
[0015] A first aspect of the invention relates to a vehicle having at least one VR device for simulating a virtual environment. In other words, the invention comprises a vehicle, which may be, for example, a passenger car, a ship, an aircraft, a train, or a transport capsule. The VR device is configured to simulate the virtual environment for at least one vehicle occupant and to present the virtual environment to the vehicle occupant. The VR device has a seating arrangement for accommodating the at least one vehicle occupant. In other words, the VR device comprises the seating arrangement in which the at least one vehicle occupant can stay during the simulation of the virtual environment. In other words, the seating arrangement is designed such that the at least one vehicle occupant can stay in the seating arrangement.The accommodation facility can also be provided for accommodating multiple vehicle occupants in order to present the virtual environment to them. The accommodation facility can, for example, comprise an open or closed chamber that can be entered by the at least one vehicle occupant, for example, through a door. The VR device has a control device that is configured to recreate the virtual environment and provide graphical representation data of the virtual environment. The representation data can comprise graphical descriptions of the virtual environment, which can, for example, be displayed on a screen of a graphical output device. In other words, the control device of the VR device is configured to generate the graphical representation data that enable a graphical representation of the virtual environment by the graphical output device of the VR device.
[0016] The VR device has the graphical output device, which is configured to display the graphical image data of the virtual environment to the at least one vehicle occupant in the accommodation facility. In other words, the graphical output device is intended to display the virtual environment to the at least one vehicle occupant during the simulation, according to the graphical image data of the virtual environment. The graphical output device can, for example, comprise a screen arranged in the accommodation facility or an arrangement comprising a projector and a projection surface in the accommodation facility.
[0017] It is provided that the graphical output device comprises a Cave Automatic Virtual Environment of the accommodation facility. In other words, the graphical output device of the VR device has a chamber configured to present the graphical image data to at least one vehicle occupant in the accommodation facility, wherein the vehicle occupant is at least partially enclosed by the chamber.
[0018] Additionally or alternatively, the graphical output device comprises virtual reality glasses. In other words, the graphical output device comprises a headset configured to provide the graphical image data to the at least one vehicle occupant via a display in front of the eyes of the at least one vehicle occupant. Such a display is also known as a head-mounted display.
[0019] The invention provides the advantage of enabling participation in a virtual environment with a high degree of immersion during transportation by a vehicle.
[0020] One aspect of the invention provides that the resting facility is gimballed to the vehicle. In other words, the VR device has a gimballed bearing configured to mount the resting facility gimballed to the vehicle. The gimballed mounting of the resting facility offers the advantage that rotational movements of the vehicle can be at least partially compensated for by the gimballed bearing and thus are not transmitted to the resting facility, or are transmitted only to a limited extent. This can, for example, make it possible to enable rotational movements of the resting facility in order to make the virtual simulation realistic, or to minimize the influence of the vehicle's rotational movements on the resting facility.
[0021] One aspect of the invention provides that the VR device has a shoe interface configured to receive movements of the at least one vehicle occupant detected by VR shoes and provide them to the control device. In other words, the VR device comprises the shoe interface, which makes it possible to use the VR device with VR shoes. The VR interface can be wired and / or wireless. The VR shoes can comprise sensors configured to detect positions and / or movements of the legs and / or feet of the vehicle occupant and to transmit the detected positions and / or movements to the shoe interface.
[0022] One aspect of the invention provides that the vehicle is configured for autonomous driving. In other words, it is provided that the vehicle can drive autonomously. The vehicle can, for example, have an environment detection device configured to detect the environment of the vehicle. The vehicle can have an electronic vehicle guidance unit configured to guide the vehicle based on the vehicle environment detected by the environment detection device. The vehicle guidance unit can, for example, be configured to guide the vehicle with an autonomy level four or five. This results in the advantage that the at least one vehicle occupant can be guided independently to their destination by the vehicle.
[0023] The invention also includes further developments which result in additional advantages.
[0024] A further development of the invention provides that the seating device is designed as a sphere. In other words, it is intended that the at least one vehicle occupant is located in the seating device designed as a sphere. It can preferably be provided that the at least one vehicle occupant is arranged in a sitting or standing position provided by a holding device with their head in a center of the sphere. Designing the seating device as a sphere offers the advantage that the vehicle occupant can be provided with a 360-degree panoramic view without corners and / or edges.
[0025] A further development of the invention provides that the graphic output device is configured to adapt and display the graphic image data according to an adaptation method depending on the viewing direction of the at least one vehicle occupant and the geometry of the seating arrangement, thereby simulating a cylindrical or spherical projection for the at least one vehicle occupant. For example, it can be provided that the seating arrangement has corners and edges which, if screens of the graphic output device were arranged on a side of the seating arrangement facing the vehicle occupant, would lead to distortions or offsets in the image from the perspective of the vehicle occupant.The output device can adjust or interpret the graphic image data in such a way that these distortions or displacements are compensated, so that the vehicle occupant has the impression of being in a spherical or cylindrical seating arrangement. The position of the eyes can be used to determine a projection center.
[0026] A further development of the invention provides that the seating device has a seat that is configured to detect rotational movements of the vehicle occupant and / or to perform rotational movements depending on specifications of the control device. The seat can, for example, be mounted so as to be rotatable about at least one axis and have sensors that can detect an orientation and / or rotational movements of the seat. This makes it possible for the at least one vehicle occupant to rotate on the seat and for the corresponding rotational movement to be detected so that it can be simulated in the virtual environment. It can also be provided that the chair additionally or alternatively has a motor unit that is configured to drive the chair to perform rotational movements.The motor unit can, for example, be controlled by the control device to simulate rotational movements in the virtual environment by real rotational movements of the chair.
[0027] A further development of the invention provides that the restraint device has a carrying belt device that is designed to hold the at least one vehicle occupant in a standing position in the restraint device. In other words, the restraint device is designed to enable the at least one vehicle occupant to stand safely within the restraint device while driving by means of the carrying belt device. For example, it can be provided that the carrying belt device has a belt harness that is to be worn by the at least one vehicle occupant during use. The at least one vehicle occupant can be fixed to the restraint device by the belt harness via straps of the carrying belt device. This further development offers the advantage that the user does not have to be in a sitting position while using the virtual environment.
[0028] A further development of the invention provides that the resting facility has a walking base device that is designed to simulate and / or detect a walking movement of the vehicle occupant on a surface. In other words, the walking base device, on which the vehicle occupant can stand and perform walking movements, is arranged in the resting facility. The walking base device can, for example, have a rotatably mounted ball such that the at least one vehicle occupant can cause the ball to rotate by walking movements on a surface of the ball. The walking base device can also have a surface in which several rotatably mounted balls or rollers can be arranged, on which the at least one vehicle occupant can perform the walking movements. Alternatively, the walking base device can have a treadmill.The walking ground device can have actuators to transfer forces to the feet of the vehicle occupant and thus simulate ground movement. The walking ground device can have sensors configured to detect the walking movement of the vehicle occupant. The sensors can, for example, detect a rotational movement of the ball or rollers, which is caused by a movement of foot surfaces over the balls or rollers, and determine a walking speed based on the rotational movement. The walking speed can be provided to the control device, which can then shift a field of view in the virtual environment. This offers the advantage that at least one vehicle occupant can perform the walking movement in the resting facility, which can also advantageously be simulated in the virtual environment.
[0029] A further development of the invention provides that the VR device has a loudspeaker device for outputting three-dimensional surround sound in the seating arrangement. In other words, the seating arrangement has the loudspeaker device, which is configured to emit sounds from different directions to the vehicle user in order to thus generate the three-dimensional surround sound. It can be provided that several loudspeaker units of the loudspeaker device are arranged in the seating arrangement. The loudspeaker units can be arranged in predetermined directions relative to an intended location of the at least one vehicle occupant in order to simulate sound sources arranged in the virtual environment around the vehicle occupant. This results in the advantage that three-dimensional surround sound of the virtual environment can be simulated in the seating arrangement.
[0030] A further development of the invention provides that the VR device has a detection device configured to detect movements and / or gestures of the vehicle occupant. The detection device can, for example, have one or more camera units directed at the at least one vehicle occupant in order to record the at least one vehicle occupant. The detection device can be configured to evaluate the recordings and to identify at least predetermined movements and / or predetermined gestures in the recordings of the at least one vehicle occupant. This results in the advantage that gestures and / or movements of the vehicle occupant can be detected and recreated in the virtual environment.
[0031] The vehicle according to the invention is preferably designed as a motor vehicle, in particular as a passenger car or truck, or as a passenger bus.
[0032] A second aspect of the invention relates to a VR device for arrangement in a vehicle. The VR device has a seating arrangement for accommodating at least one vehicle occupant. The VR device has a control device configured to simulate a virtual environment and provide graphical representation data of the virtual environment. The VR device has a graphical output device configured to display the graphical representation data of the virtual environment to the at least one vehicle occupant in the seating arrangement. It is provided that the graphical output device comprises a Cave Automatic Virtual Environment of the seating arrangement.
[0033] The control device can comprise a data processing device or a processor device. For this purpose, the processor device can comprise at least one microprocessor and / or at least one microcontroller and / or at least one FPGA (Field Programmable Gate Array) and / or at least one DSP (Digital Signal Processor). Furthermore, the processor device can comprise program code configured to control the VR device when executed by the processor device. The program code can be stored in a data memory of the processor device.
[0034] The invention also includes further developments of the VR device according to the invention that have features already described in connection with the further developments of the vehicle according to the invention. For this reason, the corresponding further developments of the VR device according to the invention are not described again here.
[0035] The invention also encompasses combinations of the features of the described embodiments. The invention therefore also encompasses implementations that each comprise a combination of the features of several of the described embodiments, unless the embodiments are described as mutually exclusive.
[0036] Exemplary embodiments of the invention are described below. Shown are: Fig. 1 is a schematic diagram of a vehicle having a VR device; Fig. 2 shows a further schematic representation of a vehicle having a VR device; and Fig. 3 is another schematic representation of a vehicle having a VR device.
[0037] The exemplary embodiments explained below are preferred embodiments of the invention. In the exemplary embodiments, the described components of the embodiments each represent individual features of the invention that can be considered independently of one another, each of which also develops the invention independently of one another. Therefore, the disclosure is intended to encompass combinations of the features of the embodiments other than those shown. Furthermore, the described embodiments can also be supplemented by further features of the invention already described.
[0038] In the figures, the same reference symbols designate elements with the same function.
[0039] Fig. 1 shows a schematic representation of a vehicle having a VR device.
[0040] The vehicle 1 can be, for example, a truck or a passenger car. The vehicle 1 can have the VR device 2 to enable at least one vehicle occupant 4 of the vehicle 1 to participate in and / or interact with a virtual environment, in particular while the at least one vehicle occupant 4 is being transported by the vehicle 1. The VR device 2 can have at least one seating device 3, which can be intended to provide the at least one vehicle occupant 4 with a location for participating in the virtual environment. The seating device 3 can have a hollow sphere or a chamber of any shape in which the vehicle occupant 4 can stay during the journey.To enable the vehicle occupant 4 to maintain a comfortable posture while driving, the VR device 2 can have a holding device 20, which can, for example, have a seat 24 on which the vehicle occupant 4 can be located. To provide the virtual environment, the VR device 2 can have a control device 5, which can include a processor. The control device 5 can be provided to generate simulation data, which can, for example, include graphical image data 6. The control device 5 can have a communication unit in order to be able to communicate with a server or control devices 5 of other VR devices 2. This allows, for example, interaction data to be exchanged via the communication unit. The graphical image data 6 can be generated for output by a graphical output device 7 of the VR device 2.The graphic output device 7 can be configured to display graphic representations of the virtual environment described in the graphic image data 6 to at least one vehicle occupant 4. The output device 7 can comprise, for example, one screen or multiple screens. The screen or screens can be arranged, for example, on an inner surface of the seating facility 3 and preferably provide a 360-degree field of view around the vehicle occupant 4 for display. This can provide the vehicle occupant 4 with a panoramic view. The graphic output device 7 can comprise a Cave Automatic Virtual Environment 8 of the seating facility 3. The VR device 2 can also have a loudspeaker device 14, which can be configured to play back audio files provided by the control device 5.The loudspeaker device 14 can comprise a plurality of loudspeaker units, which can be arranged at different positions within the accommodation facility 3. As a result, the loudspeaker device 14 can be configured to provide three-dimensional surround sound in the accommodation facility 3.
[0041] To enable the vehicle occupant 4 to interact with the virtual environment, the VR device 2 can have a detection device 15, which can be configured to detect movements or gestures of the vehicle occupant 4. The detection device 15 can, for example, comprise a plurality of camera units 16. The movements and gestures detected by the detection device 15 can be transmitted by the detection device 15 to the control device 5 as detection data 18. The detection device 15 can also comprise microphones 17 to detect voice outputs of the vehicle occupant 4. The voice outputs can also be provided to the control device 5 as detection data 18. The control device 5 can process the detection data 18 and take it into account when generating the virtual environment.The seat 24 can be configured to detect rotational movements 25 which the vehicle occupant 4 performs with the seat 24. .
[0042] Additionally or alternatively, the seat 24 can be configured to perform rotational movements 25. This allows the control device 5 to simulate, for example, rotational movements 25 of the vehicle occupant 4 with the seat 24 in the virtual environment. To be able to detect foot movements, the VR device 2 can have a shoe interface 23, which allows the vehicle occupant 4 to use VR shoes 21. Movements detected by the VR shoes 21 can be provided to the control device 5 via the shoe interface 23.
[0043] The new idea involves the introduction of mobile, autonomous transport capsules, which may have a spherical seating arrangement 3, which may be equipped with a 360-degree monitor on the inside. A vehicle occupant 4, who is located inside the vehicle 1, can thus be shown a digital image in all directions. The vehicle occupant 4 sits in the Fig. 1, in the center of the sphere on the rotatable seat 24. The seat 24 can be designed to be rotatable, which can be linked to the interaction in a virtual world. The rotational movements 25 of the legs and / or feet of the vehicle occupant 4 can be recorded via so-called VR shoes 21. Recorded movements can be transmitted by the VR shoes 21 to a shoe interface 23 of the VR device 2. The shoe interface 23 can provide the recorded movements to the recording device 15, which can transmit corresponding recording data 18 to the control device 5. The movements can also be interpreted as control data 19 and describe running and / or walking commands.
[0044] Digital content, or content from the virtual environment, can be displayed on a 360-degree screen of the output device 7. Optionally, for easier implementation, the seating device 3 can also be rectangular. Since the head of the vehicle occupant 4 can be located within the rotation axis of the seat 24, the view in a rectangular space can be distorted for the vehicle occupant 4 in such a way that the vehicle occupant 4 has the impression that they are actually experiencing what they are seeing. The virtual experience can be completed with 3D sound. Gestures and / or movements of the vehicle occupant 4 could be recorded by a recording device 15, for example by means of the camera units 16. This can, for example, generate control data 19 for controlling the control device 5 by the recording device 15 depending on predetermined gestures.A keyboard, mouse, or other input device for controlling the control device 5 by the vehicle occupant 4 would thus be unnecessary. The vehicle occupant 4 would then have their hands free to use them for gesture control. Optionally, controllers in the hands can also be used to interact with the virtual environment. Voice control is also possible, and this can be detected by the microphones 17 of the detection device 15.
[0045] Fig. Figure 2 shows another schematic representation of a vehicle having a VR device.
[0046] The VR device 2 shown can be used as in Fig. 1 have a spherical shaped seating arrangement 3. The Fig. The holding device 20 shown in Figure 2 can have a carrying strap device 10, which can comprise straps 12, which can be fastened, for example, to an upper side of the seating device 3. The straps 12 can hold a harness 11, which the vehicle occupant 4 can put on to use the VR device 2. The vehicle occupant 4 can thus stand during the simulation of the virtual environment by the VR device 2. The vehicle occupant 4 can also perform a walking movement based on a walking surface device 13 provided in the seating device 3, which can be detected by the detection device 15. The detection device 15 can, for example, have motion sensors on a sphere of the walking surface device 13, on which the vehicle occupant 4 can be located, which can detect a movement of the sphere and thereby determine a walking path of the vehicle occupant 4.The detected walking movement can be provided to the control device 5 as detection data 18.
[0047] Provision of seat 24 as in Fig. 1 would also have the disadvantage that the vehicle occupant 4 is sitting. This means that they cannot perform walking movements while standing on the seat 24. In this case, it is therefore not possible for them to perform a walking movement, which is detected by the detection device 15 and transmitted to the control device 5 in order to map the walking movement in the virtual environment. For example, the vehicle occupant 4 cannot actually walk through the virtual environment and cannot interact with the virtual environment in a naturally perceived manner. For this reason, the VR device 2 can have the holding device 20 for the vehicle occupant 4, which can fix the vehicle occupant 4 in a hanging pose in the center of the seating facility 3. The holding device 20 can comprise a carrying belt device 10. The belts 12 can be attached to the vehicle occupant 4 via a chest and / or hip belt 12.To ensure that the vehicle occupant 4 is secured during braking and acceleration, the belts 12 can prevent hip displacement in two or three spatial directions. Optionally, the restraint device 3, configured as a transport ball, can be gimbal-mounted on the vehicle 1 to filter out vehicle movements, resulting in even greater immersion in the virtual environment. To further enhance the customer's immersion in the virtual environment, a walking surface device 13, configured as a sensor ball or sensor plate, can be provided for the feet of the vehicle occupant 4. This walking surface can serve the purpose of enabling the vehicle occupant 4 to walk in the virtual environment using the usual leg movement.The walking surface device 13 can be designed so that the vehicle occupant 4 can perform the normal natural walking movements, which can be converted into a digital movement in the virtual environment.
[0048] Fig. 3 shows another schematic representation of a vehicle having a VR device.
[0049] In Fig. 3, VR glasses 9 are provided for the vehicle occupant 4. Thus, the provision of one or more monitors within the accommodation facility 3 can be omitted or only optional. The combination of VR glasses 9, suspended support of the vehicle occupant 4 by means of the holding device 20, and a sensor ball / sensor plate for walking movements ensures excellent immersion in the virtual environment while traveling.
[0050] In the illustrated figure, the VR device 2 can have VR glasses 9, which can be configured to display graphic images to the vehicle occupant 4. The VR device 2 can have a mounting device 22, which can be configured to mount the seating device 3, for example, gimbal-mounted on the vehicle 1. This can compensate for rotational movements of the vehicle 1, for example.
[0051] Given the current state of technology, it's virtually impossible to move around in a new kind of metaverse while using a means of transport. Virtual environments are 100% stationary, such as in a home office. Today, one can move around the metaverse either via conventional monitors (2D) or via VR headsets (3D).
[0052] Overall, the examples show how effective use of travel time for working, playing or maintaining social contacts can be enabled in a virtual environment.
Claims
[1] Vehicle (1) comprising a VR device (2), wherein the VR device (2), - a resting facility (3) for accommodating at least one vehicle occupant (4), - a control device (5) which is designed to simulate a virtual environment and to provide graphical image data (6) of the virtual environment, - a graphic output device (7) which is designed to display the graphic image data (6) of the virtual environment to the at least one vehicle occupant (4) in the accommodation facility (3), wherein the graphic output device (7) comprises a Cave Automatic Virtual Environment (8) of the accommodation device (3) and / or the graphic output device (7) comprises VR glasses (9) and wherein the vehicle (1) is set up for autonomous driving, wherein a) the resting facility (3) is mounted on the vehicle (1) in a cardanic manner; and / or b) the VR device (2) has a shoe interface (23) which is designed to receive movements of the at least one vehicle occupant (4) detected by VR shoes (21) and to provide them to the control device (5). [2] Vehicle (1) according to claim 1, characterized by that the accommodation device (3) is designed as a sphere. [3] Vehicle (1) according to claim 1, characterized by in that the graphic output device (7) is designed to adapt and display the graphic image data (6) according to an adaptation method depending on a viewing direction of the at least one vehicle occupant (4) and a geometry of the accommodation device (3), whereby a cylindrical or spherical projection is reproduced for the at least one vehicle occupant (4). [4] Vehicle (1) according to one of the preceding claims, characterized by in that the resting device (3) has a chair (24) which is designed to detect rotational movements (25) of the vehicle occupant (4) and / or to carry out rotational movements (25) depending on specifications of the control device (5). [5] Vehicle (1) according to one of the preceding claims, characterized by that the accommodation facility (3) has a carrying belt device (10) which is designed to hold the at least one vehicle occupant (4) in a standing position in the accommodation facility (3). [6] Vehicle (1) according to one of the preceding claims, characterized by that the accommodation device (3) has a walking surface device (13) which is designed to simulate and / or detect a walking movement of the vehicle occupant (4) on a surface. [7] Vehicle (1) according to one of the preceding claims, characterized bythat the vehicle (1) comprises a loudspeaker device (14) for outputting a three-dimensional surround sound in the accommodation facility (3). [8] Vehicle (1) according to one of the preceding claims, characterized by that the vehicle (1) has a detection device (15) which is designed to detect movements and / or predetermined gestures of the vehicle occupant (4). [9] VR device (2) for arrangement in a vehicle (1), wherein the VR device (2) - a resting facility (3) for accommodating at least one vehicle occupant (4), - a control device (5) which is designed to simulate a virtual environment and to provide graphical image data (6) of the virtual environment, - a graphic output device (7) which is designed to display the graphic image data (6) of the virtual environment to the at least one vehicle occupant (4) in the accommodation facility (3), characterized by , that the graphic output device (7) comprises a Cave Automatic Virtual Environment (8) of the accommodation device (3).
Citation Information
Patent Citations
System and method for simulating a balance ability game
TW201223602A
Virtual Reality Apparatus
US20190179408A1
Dynamically Equivalent Simulator for Vehicle Rotational Motions
US20200111381A1
Virtual reality equipment
US6135928A
Game machine for moving object
US6179619B1