Reduction of motion sickness when using AR / VR devices in vehicles

Abstract

A motor vehicle with at least one playback device (20) for the visual display of content to a user of the motor vehicle, wherein the playback device (20) is wearable by the user in such a way that the content displayed by the playback device (20) can only be displayed to that user. According to the invention, the playback device (20) is suitable and designed to simulate, in addition to the content, at least one first dynamic light source, which is also visually perceptible to the user, and / or the playback device has at least one integrated dynamic light source (24).

Description

[0001] The present invention relates to a motor vehicle with a playback device for displaying content and, in particular, image information.

[0002] It is known from the state of the art that occupants of motor vehicles use optical devices such as mobile phones but also so-called AR (Augmented Reality) or VR (Virtual Reality) glasses, especially for their entertainment while driving.

[0003] It is known in the prior art that the use of these devices can cause motion sickness (travel sickness) when activities are carried out in a moving vehicle, in particular activities such as reading, using a smartphone, reversing, and especially when using the aforementioned AR / VR devices.

[0004] It is therefore also known that dynamic light sources are used, for example, on the inside of doors, to create a pleasant driving environment and to reduce or prevent the risk of motion sickness. These dynamic light sources can affect the individual user, for example, of a smartphone or even a book, in such a way as to reduce the risk of motion sickness.

[0005] US Patent 9,547,173 B2 describes a method for rendering virtual reality inside a vehicle. This method uses data from the vehicle.

[0006] US patent 11,718,203 B1 discloses a method for preventing or reducing motion sickness. This method also uses data from a navigation system.

[0007] AR / VR glasses have the advantage of enabling a very complete simulation or reproduction of information and / or content to a user.

[0008] However, the use of AR / VR glasses has the disadvantage that, for example, such side stripes or dynamic light sources in the vehicle are no longer visible to the user, and thus the risk of motion sickness still exists.

[0009] The present invention therefore aims to minimize the risk of motion sickness when using AR / VR glasses. Furthermore, the invention aims to provide a simple and cost-effective alternative for reducing the risk of motion sickness in vehicles that do not have the devices described above for preventing or reducing motion sickness.

[0010] This is achieved according to the invention by the subject matter of the independent claims. Advantageous embodiments and further developments are the subject matter of the dependent claims.

[0011] A motor vehicle according to the invention has at least one playback device for the visual playback of content to a user of the motor vehicle, wherein the playback device is portable by the user in such a way that the content output by the playback device can only be output to the user.

[0012] The user of the motor vehicle could be, for example, a passenger (in a conventional vehicle) or the driver in an autonomous vehicle. Preferably, the playback device has a playback area that is suitable and intended for displaying the aforementioned content to the user.

[0013] According to the invention, the playback device is suitable and intended to simulate, in addition to the content, at least one first dynamic light source which is also visually perceptible to the user.

[0014] A dynamic light source is defined as one in which at least one property of the light source changes over time. Specifically, this refers to a light source that changes its position. While it is possible to simulate a circular or point-like light source, the light source can also have other geometric shapes, such as rectangular or strip-shaped.

[0015] As mentioned, the light source is preferably simulated, i.e., preferably reproduced within an image.

[0016] However, it would also be possible (additionally or alternatively) for at least one and preferably a plurality of light sources to be integrated into the playback device, which are dynamically designed (and in particular are able to generate a running light).

[0017] In this design, for example, one or more LED strips could be integrated into the playback device, which are perceptible to the user and thus preferably achieve the same effect as the aforementioned LED strips on the inside of the vehicle doors.

[0018] In particular, this simulation is suitable for simulating dynamic LED light sources, which are normally located in vehicle interiors.

[0019] Preferably, the vehicle has at least two and particularly preferably several of the aforementioned playback devices.

[0020] In particular, the playback device is suitable for simulating at least one chasing light effect. This could, for example, involve the simulation of a "wandering" LED, i.e., the simulation of LEDs arranged, for instance, within a line and lighting up one after the other.

[0021] The content may preferably consist of video content, in particular video games, films or informational presentations, such as reproductions of texts or images.

[0022] Preferably, the first dynamic light source is a virtual light source, specifically a part of the displayed image. This design has the advantage of requiring no additional hardware.

[0023] In another preferred embodiment, the brightness and / or intensity of the light source can be changed and / or adjusted by the user. It is also preferred that the position of the simulated light source can be changed to allow adaptation to different fields of vision of the user.

[0024] It is also possible that the intensity, brightness, and / or color of the light source changes depending on the content being displayed. For example, if the content being displayed is darker, the light source can also be displayed darker or with lower intensity.

[0025] Particularly preferred is the ability to adjust the color of the (simulated or physically present) light source. For example, it can be selected that white light is simulated and / or reproduced, or light of other colors, such as red light or the like. In a preferred embodiment, the intensity and / or brightness and / or color of the light source can be changed depending on the driving situation. For example, the color of the light source can change from white to red when a hazardous situation arises.

[0026] In a further preferred embodiment, the intensity and / or brightness and / or color of at least one light source, and preferably individually for each light source, can be changed depending on the vehicle's surroundings, preferably an emergency vehicle located in the vehicle's surroundings, for example, an ambulance and / or a police and / or fire department vehicle. It is also conceivable that a (time-varying) intensity and / or brightness and / or color gradient can be changed by an emergency vehicle located in the vehicle's surroundings, for example, an ambulance and / or a police and / or fire department vehicle.

[0027] Preferably, a change can be triggered by a road user appearing in the vehicle's vicinity, such as an emergency vehicle (for example, an ambulance and / or a police and / or fire department vehicle). Such triggering can preferably occur via the transmission of V2X communication data (V2X stands for "Vehicle-to-X," encompassing vehicle-to-vehicle communication data and vehicle-to-infrastructure communication data). This communication data can include information about the vehicle's role (e.g., emergency vehicle) and its operational status (e.g., flashing lights or siren activated in a police / ambulance vehicle).

[0028] For example, when information relating to an emergency vehicle and / or its operational status is being recorded, the operational status of the emergency vehicle can be visualized and / or displayed using at least one light source. The light source can be controlled in such a way that the light output is flashing and preferably in a color appropriate to the emergency vehicle (e.g., blue light for police vehicles).

[0029] Vehicle-to-vehicle communication data may include, for example, communication data transmitted in particular according to the ETSI ITS G5 communication technology.

[0030] Vehicle-to-vehicle communication data may include, for example, sensor data (or derived quantities) that were recorded and / or collected and / or generated by an (onboard sensor) environment detection device of the road user sending the vehicle-to-vehicle communication data.

[0031] For example, so-called "Collective Perception Messages" (CPM) can be used as such vehicle-to-vehicle communication data. In particular, such CPM messages can contain information about the kinematic dynamics and position, as well as other attributes of objects (e.g., vehicles, pedestrians, animals, and others) that are detected by environmental perception devices (especially those of the road user sending the vehicle-to-vehicle communication data), such as radar, lidar, and camera(s), to which the transmitting road user has access. The Collective Perception Message (CPM) enables, in particular, the interoperable exchange of basic information about the transmitting road user (necessary for interpreting the transmitted data), their sensory capabilities, the perceived objects, and / or road-related perception areas.

[0032] The vehicle-to-vehicle communication data is preferably in the form of so-called "Cooperative Awareness Messages" (CAMs). This vehicle-to-vehicle communication data is used to cyclically or periodically inform nearby communication partners (such as other road users) of its presence (by sending the CAM message).

[0033] Preferably, the transmitted vehicle-to-vehicle communication data additionally or alternatively includes information relating to the role of the road user (e.g., special vehicle, ordinary passenger vehicle, etc.). This offers the advantage that data can be collected directly regarding the behavior of special vehicles or other road users in the vicinity of special vehicles.

[0034] In another preferred embodiment, the playback device also allows playback of audio content. For example, films and video games can be played back.

[0035] Furthermore, it is possible, for example, that the playback device simulates or displays a 2D bar. However, as mentioned above, such a 2D bar can also be integrated into the playback device.

[0036] Preferably, the playback device imitates a speed or light elements, which preferably move along a bar, or it simulates light elements moving along a bar.

[0037] Furthermore, it is also possible that the brightness of the virtual light source is or becomes adjusted to the ambient brightness. It is also possible that the light source and / or the virtual light source is changed depending on a driving situation, such as driving uphill.

[0038] Therefore, within the scope of the invention, it is proposed that physical dynamic light sources, some of which are located on the inner sides of prior art doors, be transferred to the AR / VR device as virtual dynamic light sources. Alternatively, it is also conceivable that such physical dynamic light sources are integrated into the playback device.

[0039] As mentioned above, the reason for this is that most AR / VR devices obscure the physical, dynamic light sources installed in the vehicle. If the vehicle does not have any physical light sources installed, the invention allows these to be generated or replaced cost-effectively using virtual light sources (or light sources already present in the display device).

[0040] Dynamic light sources, such as light strips that match or adjust to the driving speed, are preferred, particularly in the periphery of the playback device or AR / VR device. These can reduce motion sickness when using the respective devices.

[0041] In a further preferred embodiment, the display device simulates at least one light source moving along a predetermined, and in particular a straight, line. The predetermined line is specifically a straight line. It is also conceivable that the predetermined line is a curved line running in three-dimensional space. In this context, it is particularly important to understand that the light for displaying the predetermined line is emitted by the display device in such a way that the emitted light for displaying the predetermined line has the same optical effect on the user as if the displayed predetermined line were running in three-dimensional space.

[0042] Alternatively, the playback device can also be equipped with a plurality of light sources, which are preferably arranged along a line and in particular a straight line.

[0043] In another preferred embodiment, the display device covers at least part of the user's field of vision. Particularly preferably, the display device covers more than 70% of the user's field of vision, preferably at least 80%, preferably at least 90%. However, it would also be possible for the display device to completely obscure the user's field of vision.

[0044] In another preferred embodiment, the playback device is an augmented reality headset and / or a virtual reality (AR / VR) playback device. In particular, the playback device is an AR / VR playback device and, more specifically, AR / VR headset.

[0045] Preferably, the content output by the playback device is controllable by the motor vehicle and / or a control unit of the motor vehicle. It is also particularly preferred that the simulation of the dynamic light source and / or the integrated dynamic light source is controlled by a control unit of the motor vehicle.

[0046] In another preferred embodiment, the playback device has a playback area that outputs the content to the user, and the first dynamic light source is, or preferably is, depicted or simulated in a peripheral region of this playback area. Alternatively, the integrated dynamic light source can also be arranged in or at a peripheral region of the playback area.

[0047] This simulates the presence of a corresponding light source in the vehicle, such as a running light.

[0048] In another preferred embodiment, the dynamic light source can be switched off. For example, a user who is not prone to motion sickness can switch off the light source if they find it distracting. Preferably, parameters of the light source, such as its color or intensity, are also adjustable by the user.

[0049] The playback device is particularly preferably suited and designed to simulate a second dynamic, especially virtual, light source. Alternatively or additionally, the playback device may include at least one second integrated dynamic light source.

[0050] Preferably, this second virtual (or physical) light source also moves along a line. Preferably, this output occurs in (or on) a second edge region of the playback device, and particularly in an edge region opposite the first edge region.

[0051] For example, LED light sources can be simulated for a user at the right or left edge of the display area, or corresponding light sources can be located in these edge areas. This means that these simulations are preferably located at the lateral edges of the display area.

[0052] The information is preferably output to the user between the two virtual (or physical) light sources, or can be output accordingly. It would be possible for both light sources or both simulations to behave similarly and / or be synchronized with each other.

[0053] In a further preferred embodiment, the dynamic light source (or physical light sources) is controllable and / or controlled depending on the vehicle's speed. This allows the simulated (or physical) light source(s) to move faster at higher speeds than at lower speeds. Therefore, it is particularly preferred that the display device is in communication with a control unit of the vehicle.

[0054] In a further preferred embodiment, the display device is suitable and designed to output a backlight to the user. In particular, this (especially simulated) backlight is controllable and / or is controlled depending on a sensor of the vehicle external to the display device. Backlight is understood to mean, in particular, that the light emitted by the (at least one) light source is perceived by the user only in their peripheral field of vision (as background).

[0055] This sensor could be, for example, an outdoor camera or a (light-sensitive) outdoor sensor. Preferably, this backlighting can be displayed and / or simulated via a screen on the playback device. However, it would also be conceivable for the playback device to have additional light sources, such as LEDs, to generate backlighting.

[0056] Therefore, it is proposed that dynamic ambient lighting be used preferentially, which in particular integrates the outside world (achieved, for example, through external cameras or sensors) into the vehicle or the glasses. For this purpose, representative colors are preferably used to increase both driving safety and the driving experience. Ambient lighting here is understood to mean, in particular, that this emitted light is perceptible to the user in the periphery or (only) in the outer field of vision.

[0057] For example, safety can be increased, especially with regard to objects that are in the blind spot; for instance, when overtaking a colored car, the color can be displayed as dynamic ambient lighting.

[0058] Furthermore, it would be possible, for example, to use green ambient lighting when driving through the forest or blue ambient lighting when driving by the sea.

[0059] Therefore, the integration of the physical dynamic light sources on the inside of the doors as virtual dynamic light sources into the AR / VR devices is proposed (and / or the provision of physical light sources integrated into these devices). This represents a cost-effective alternative to existing solutions (for example, installing the physical dynamic light sources on the inside of the vehicle doors) and has the added advantage of preventing nausea even while using such devices in a vehicle.

[0060] As mentioned, an appealing design can be achieved, which is adapted to the surroundings using ambient lighting and is determined in particular by external sensors. Furthermore, driving safety can also be increased.

[0061] The present invention further relates to a playback device for the visual playback of content to a user of a motor vehicle, wherein the playback device is portable by the user in such a way that the content output by the playback device can be output exclusively to that user.

[0062] According to the invention, the playback device is suitable and intended to simulate, in addition to the content, at least one first dynamic light source which is also visually perceptible to the user, or the playback device has at least one integrated dynamic light source and preferably a plurality of integrated light sources.

[0063] Preferably, the playback device has a communication interface to communicate with a control unit of the motor vehicle.

[0064] Preferably, the playback device includes a monitor or display which is used to play back the content.

[0065] Preferably, the content is also dynamic. In a further advantageous embodiment, the playback device completely obscures the user's field of vision.

[0066] The present invention is further directed to a method for the visual reproduction of content to a user of a motor vehicle by means of a reproduction device and in particular a reproduction device of the type described above, wherein the reproduction device is carried by the user in such a way that the content output by the reproduction device is output exclusively to that user.

[0067] According to the invention, the playback device simulates, in addition to the content, a first dynamic light source, which is also visually perceptible to the user. Additionally or alternatively, a plurality of light sources integrated into the playback device emit dynamic light (and in particular, light moving along a line).

[0068] The procedure therefore proposes that a virtual light source be simulated or that a multitude of physical light sources emit dynamic light, and in particular running light. Preferably, these light outputs are used to reduce the risk of motion sickness.

[0069] In particular, this involves simulating light sources that might be located, for example, on the inner surfaces of doors in such vehicles. Specifically, this dynamic light source is displayed to the user in a peripheral area of ​​the screen. This simulation is displayed, or can be displayed, in an area that the user can perceive with or from their peripheral vision, or in the peripheral areas of their field of vision.

[0070] It is preferably possible to change the position of this simulation, especially to allow adaptation to different fields of vision of users.

[0071] This dynamic light source is particularly preferred if it is controlled, at least temporarily, based on a parameter characteristic of a vehicle's driving situation. This parameter could be, for example, the vehicle's speed, acceleration, uphill or downhill travel, or cornering during which lateral acceleration occurs. It is also conceivable that the light is emitted in such a way as to create a three-dimensional representation of a curve (or such a perception by the user). This could, for instance, convey or visualize uphill and / or downhill travel, or topographical information related to the route traversed by the vehicle, to the user.

[0072] Preferably, the playback device is configured, suitable, and / or intended to execute the method described above, as well as all process steps already described above in connection with the method, either individually or in combination. Conversely, the method can be equipped with all features described in connection with the playback device, either individually or in combination.

[0073] The vehicle in question may in particular be a (motorized) road vehicle.

[0074] A vehicle can be a motor vehicle, which is in particular a driver-operated vehicle ("driver only"), a semi-autonomous vehicle, an autonomous vehicle (for example, at autonomy levels 3, 4, or 5 (according to the SAE J3016 standard)), or a self-driving vehicle. Autonomy level 5 refers to fully automated vehicles. The vehicle can also be a driverless transport system. In this case, the vehicle can be driven by a driver or drive autonomously. Furthermore, in addition to a road vehicle, the vehicle can also be an air taxi, an aircraft, or another means of transport or vehicle type, such as an aircraft, watercraft, or rail vehicle.

[0075] The present invention has been described in relation to a vehicle. However, the present invention is also transferable to methods and systems in general for machine vision (e.g., also in an infrastructure). The applicant reserves the right to also claim related subject matter. Further advantages and embodiments can be seen from the attached drawing:

[0076] It shows: Fig. 1 A schematic representation to illustrate the invention.

[0077] Fig.Figure 1 shows a schematic representation to illustrate the present invention. Reference numeral 1 refers to a motor vehicle. This motor vehicle 1 has a control device 2 for controlling the motor vehicle. In addition, this control device is preferably also suitable for controlling a display device 20 and preferably also for outputting data to it, for example, data that is characteristic of a driving situation.

[0078] Reference numeral 4 designates a sensor device suitable and intended for acquiring data characteristic of the vehicle's environment, such as brightness or color perception. Preferably, this sensor device is a camera or a sensor sensitive to brightness and / or color.

[0079] The playback device 20, which, as mentioned above, is preferably an AR / VR headset, has a playback area 28 through which content can be output to a user.

[0080] In one embodiment, a simulated light source is emitted to the user in a peripheral area 22 of this display area 28. In another embodiment, a plurality of light sources 24 are provided (particularly in a peripheral area of ​​the display device 20), which are also designed as light strips. These light sources can also be arranged in an area of ​​the temples of the display device, in particular such that they are still perceptible to the user at the edge of their field of vision.

[0081] Reference numeral 26 indicates a communication interface by means of which the playback device 20 can communicate with the motor vehicle.

[0082] The applicant reserves the right to claim all features disclosed in the application documents as essential to the invention, provided they are novel individually or in combination compared to the prior art. It is further noted that the individual figures also describe features which may be advantageous on their own. A person skilled in the art will immediately recognize that a particular feature described in a figure may be advantageous even without incorporating other features from that figure. Furthermore, a person skilled in the art will recognize that advantages may also arise from a combination of several features shown in individual or different figures. Reference symbol list 1 vehicle 2 Steuerungseinrichtung 4 Kamera / Sensor 20 Wiedergabeeinrichtung 22 simulierte dynamische Lichtquelle 24 physische dynamische Lichtquelle 26 Kommunikationsschnittstelle 28 Playback area for content QUOTES INCLUDED IN THE DESCRIPTION

[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature

[0000] US 9,547,173 B2

[0005] US 11,718,203 B1

[0006]

Claims

[1] Motor vehicle (1) with at least one playback device (20) for the visual playback of content to a user of the motor vehicle (1), wherein the playback device (20) is portable by the user in such a way that the content output by the playback device (20) can be output exclusively to the user, characterized by that the playback device (20) is suitable and intended to simulate, in addition to the content, at least one first dynamic light source which is also visually perceptible to the user, and / or the playback device has at least one integrated dynamic light source (24). [2] Motor vehicle (1) according to claim 1, characterized by , that the playback device (20) simulates at least one light source moving along a predetermined line, wherein the predetermined line is in particular a straight line and / or a curved line running in three-dimensional space. [3] Motor vehicle according to claim 1, characterized by , that the playback device (20) obscures at least part of the user's field of vision. [4] Motor vehicle according to at least one of the preceding claims, characterized by that the playback device (20) is an Augmented Reality and / or Virtual Reality (AR / VR) playback device (20). [5] Motor vehicle according to at least one of the preceding claims, characterized by , that the playback device (20) has a playback area which outputs the content to the user and the first dynamic light source (22) can be output in an edge area of ​​this playback area and / or is located in or on an edge area of ​​this playback area. [6] Motor vehicle according to at least one of the preceding claims, characterized by , that the dynamic light source (22) is controllable depending on the speed of the motor vehicle (1). [7] Motor vehicle according to at least one of the preceding claims, characterized by , that the playback device (20) is further suitable and intended to output a backlight to the user, wherein this backlight is preferably controllable depending on a sensor (4) of the motor vehicle (1) which is external to the playback device. [8] Playback device (20) for the visual display of content to a user of a motor vehicle (1), wherein the playback device (20) is portable by the user in such a way that the content displayed by the playback device (20) can only be displayed to the user, characterized bythat the playback device (20) is suitable and intended to simulate, in addition to the content, at least one first dynamic light source (22) which is also visually perceptible to the user, or the playback device (20) has at least one integrated dynamic light source (24), wherein the playback device (20) preferably has a communication interface (26) to communicate with a control device (2) of the motor vehicle. [9] Method for visually displaying content to a user of the motor vehicle by means of a display device, wherein the display device is worn by the user in such a way that the content displayed by the display device is displayed exclusively to that user, characterized by, that the playback device, in addition to the content, simulates at least one first dynamic light source which is also visually perceptible to the user and / or that a multitude of light sources integrated into the playback device emit dynamic light. [10] Method according to the preceding claim, characterized by that the dynamic light source is controlled at least temporarily depending on a parameter characteristic of a driving situation of the vehicle.

Images