Mobile sensor device for a head-mounted visual output device usable in a vehicle and method for operating a display system
Patent Information
- Application Number
- DE102017208881
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2017-05-05
- Filing Date
- 2017-05-24
- Publication Date
- 2025-02-06
- Estimated Expiration
- 2037-05-24
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
The invention relates to a mobile sensor device for a head-portable visual output device usable in a vehicle and to a method for operating a display system having a mobile sensor device. The invention also relates to a display system having a mobile sensor device and at least one visual output device that is portable on the head.In the future, in vehicles, there will be increasingly deployed emery technologies such as virtual reality glasses and the like. An application scenario to be assumed here is that vehicle occupants wish to consume classic media contents such as movies, console games and the like during travel or surf on the Internet, for example, which usually takes place on a flat display surface. The problem of so-called simulator skill may arise here. This problem, which is also referred to as travel malaise, motion malaise or kinetosis, arises from contradictions between sensory impressions which relate firstly to the spatial position and movement of the body and secondly to visual perception. If, therefore, the contents displayed, for example, by means of virtual reality glasses do not match the movement perceived by the vehicle occupant during travel in a motor vehicle, the vehicle occupant may become nausea.A suitable means for eliminating or at least attenuating this effect is the representation of a structure moving with the direction vector of the vehicle in question, for example in a peripheral field of view of a wearer of virtual reality glasses or else augmented reality glasses. For example, one looks at a type of central screen, wherein structures are adequately blended in for vehicle movement around this central screen.US 2007 / 0 034 212 A1 shows a sensor device which can be mounted in a vehicle and can detect movements of the vehicle and transmit movement data relating thereto to a display device. The contents displayed by means of the display device are adapted to the movement data in order to reduce the risk of chinetosis.US 2007 / 0 042 709 A1 shows a portable audio device which has the shape of a cup and can be arranged in a cup holder of a motor vehicle.It is the object of the present invention to prevent the occurrence of a chinetosis in a vehicle occupant in a particularly simple and reliable manner or at least to reduce the risk of an occurrence of a chinetosis which carries a visual output device on the head.This object is achieved by a mobile sensor device for a head-portable visual output device usable in a vehicle and by a method for operating a display system having a mobile sensor device having the features of the independent claims. Advantageous embodiments with expedient and non-trivial developments of the invention are specified in the dependent claims.The mobile sensor device for a head-mounted visual output device that can be used in a vehicle comprises a detection device for detecting vehicle movements of the vehicle and an interface for transmitting data relating to the vehicle movement to the head-mounted visual output device.The invention is based on the realization that vehicles, in particular older vehicles, are often not equipped with a programming interface, usually abbreviated to API, via which data relating to vehicle movements of the vehicle can be transmitted, for example, to electronic smart glasses or provided for them. The mobile sensor device is a self-contained small hardware box which can detect vehicle movements of the vehicle when the sensor device is arranged in the vehicle in question. Via the interface of the mobile sensor device, the latter can then transmit data relating to the vehicle movements to the visual output device which can be worn on the head and which a vehicle occupant has put on while driving with the vehicle.By means of the mobile sensor device, data relating to the vehicle movements of the relevant vehicle can thus be provided in a particularly simple manner for a visual output device which can be worn on the head. According to the procedure described at the beginning, the visual output device that can be worn on the head can then display structures in a peripheral display field that correspond to the detected movement of the vehicle, in addition to the actual contents, such as media contents, depending on the data provided that describe the vehicle movement of the vehicle. This makes it possible to easily and reliably prevent a wearer of the visual output device from getting bad during travel with a vehicle.In particular, it is possible by means of the mobile sensor device to use, in any vehicles, such as motor vehicles or other vehicles, a head-worn visual output device, such as electronic smart glasses, for displaying a wide variety of information and media contents, without a wearer of the visual output device thereby becoming nausea. A user of the visual output device merely needs to carry the mobile sensor device, which detects the vehicle movements and supplies data relating thereto to the visual output device, which can then, as already described, ensure that a wearer of the visual output device does not become nausea during the movement with the vehicle and when the visual output device is mounted.It is also provided according to the invention that the detection device has at least one sensor for detecting the vehicle movements. In addition, it is also possible for the detection device to be able to provide all data relating to the vehicle movement completely independently. This is advantageous in particular when no interfaces are present at all on the vehicle side in order to couple the mobile sensor device to the motor vehicle for detecting the vehicle movements.An advantageous embodiment of the invention provides that the detection device is designed to detect a direction of movement of the vehicle. Preferably, the detection device is also designed to detect accelerations of the vehicle. These can be detected in any spatial direction. For example, during a trip with a motor vehicle, it is possible to detect in which direction the motor vehicle is moving and whether it is being accelerated or braked. Cornering and thus ensuing transverse accelerations can likewise be detected. Moreover, the detection device is preferably designed to detect a position of the vehicle. The detection device can have a GPS module for this purpose, for example. Thus, when operating the head-mounted visual output device, not only the movements of the vehicle but also the position of the vehicle can be taken into account, in order to superimpose environmental information relating to the current position of the vehicle, for example. This may also help reduce the risk of a chinetosis occurring. The GPS module can be designed, for example, in the form of an antenna which can be fastened on the outside of a vehicle, for example in the form of a magnetic roof antenna or the like. The GPS data may be transmitted, for example, over a Bluetooth connection to the remaining sensor device located in the vehicle. In addition, the antenna should also be able to be attached magnetically-if not actively-elegantly to the remaining sensor device which can be arranged in the vehicle. Thus, the antenna and the remaining sensor device can be transported together particularly easily. In addition, it is also possible for the antenna to have a clip, by means of which the antennas serving as GPS receivers can be fastened to a window of a vehicle. By means of the GPS module which can be attached to the outside of a vehicle, particularly exact position data can be provided.A further advantageous embodiment of the invention provides that the detection device has a data interface which can be coupled to the vehicle for detecting the vehicle movements. The detection device can have, for example, a corresponding plug, which can be inserted into a vehicle-side USB interface or also into a vehicle-side diagnostic socket. In this way, the mobile sensor device can be coupled to the vehicle quite easily in order to obtain a wide variety of data regarding the vehicle movements.In addition, it is also possible for the detection device to be coupled wirelessly, preferably via a WLAN interface provided on the vehicle side, to a main unit on the vehicle side, that is to say a data processing device, which provides selected data relating to the vehicle movements.In a further advantageous embodiment of the invention, it is provided that the interface is designed to transmit the data relating to the vehicle movements wirelessly and / or by cable to the visual output device that can be worn on the head. For example, the mobile sensor device can transmit the data relating to the vehicle movements via a Bluetooth connection. Furthermore, it is also possible that both the mobile sensor device and the visual output device can be connected to a WLAN provided on the vehicle side. In this case, said data relating to the vehicle movements can be transmitted via the WLAN connection. Alternatively or additionally, it is also possible that the mobile sensor device can be connected simply by means of a cable to the visual output device in order to transmit the data relating to the vehicle movements to the visual output device. In any case, it is ensured that the data relating to the vehicle movements can be reliably transmitted to the visual output device.According to a further advantageous embodiment of the invention, it is provided that the mobile sensor device has the form of a beverage container, in particular a beverage can, which can be accommodated in a beverage holder of the vehicle. As a result, the mobile sensor device can be accommodated on the vehicle side in a particularly secure manner, in particular also in a crash-proof manner. In addition, it can thereby be ensured that the sensor device can be fixed firmly in any vehicles in a particularly simple manner. This is advantageous for vehicle movements measured by means of the sensor device itself. Due to the shape of a beverage container, in particular in the case of a standardized can or bottle shape, the sensor device can be reliably fixed in a vehicle-side beverage holder, namely without relative movements occurring between the beverage holder and the sensor device. The sensor device can thereby provide particularly good measurement data with respect to the vehicle movements.A further advantageous embodiment of the invention provides that the mobile sensor device has a battery and / or a plug which can be connected to the vehicle for supplying energy. The energy supply of the sensor device can thus be reliably ensured.It is also provided according to the invention that the mobile sensor device has a further interface for digital image and sound transmission, so that digital image and sound data can be received by means of the mobile sensor device and transmitted to the visual output device that can be worn on the head. The further interface can be, for example, an HDMI interface. Thus, for example, a streaming media stick, by means of which films can be streamed wirelessly, can be inserted into the HDMI interface. For example, movie data can be received via the mobile sensor device and transmitted to the visual output device that can be worn on the head. Or, for example, a game console can also be connected via the HDMI interface, so that the head-portable visual output device can be used quite easily as output means for the game console in the vehicle.The display system according to the invention comprises the mobile sensor device according to the invention or an advantageous embodiment of the mobile sensor device and at least one visual output device which is portable on the head and is configured to display a structure corresponding to the detected vehicle movements in a partial region of its display surface in order to reduce a contradiction between visual sensations and sensory impressions relating to the spatial position and / or movement of the vehicle occupant in the case of a vehicle occupant wearing the visual output device. The head-worn visual output device is preferably virtual reality glasses, augmented reality glasses or augmented reality lenses.In the method according to the invention for operating the display system according to the invention or an advantageous embodiment of the display system according to the invention, vehicle movements of the vehicle are detected by means of the sensor device and data relating to the vehicle movements are transmitted to the visual output device which can be worn on the head and displays a structure corresponding to the detected vehicle movements in a partial region of its display surface in order to reduce a contradiction between visual sensation impressions and sensory impressions relating to the spatial position and / or movement of the vehicle occupant in the case of a vehicle occupant wearing the visual output device. In addition, digital image and sound data are received by means of the mobile sensor device and transmitted by means of the further interface of the mobile sensor device to the visual output device that can be worn on the head. The detection device of the sensor device has at least one sensor for detecting the vehicle movements. Advantageous embodiments of the method according to the invention are to be regarded as advantageous embodiments of the mobile sensor device or of the display system, wherein the mobile sensor device or the display system in particular has means for carrying out the method steps.Further advantages, features and details of the invention will become apparent from the following description of a preferred exemplary embodiment and with reference to the drawing. The features and combinations of features mentioned above in the description and the features and combinations of features shown below in the description of the figures and / or in the figures alone can be used not only in the stated combination, but also alone or in other combinations, without departing from the scope of the invention.The drawing shows in: FIG. 1 shows a schematic representation of a display system having a mobile sensor device and electronic smart glasses, wherein the mobile sensor device is designed to detect vehicle movements of a vehicle and to provide data relating to the electronic smart glasses; and FIG. 2 shows a schematic representation of a display area of the electronic smart glasses, wherein structures are displayed in a lateral peripheral region of the display area in accordance with the detected vehicle movements in order to prevent nausea from occurring in a vehicle occupant wearing the electronic smart glasses in the vehicle.A display system 1 with a mobile sensor device 2 is shown in a schematic illustration in FIG. 1. The mobile sensor device 2 comprises a detection device 3 for detecting vehicle movements of a vehicle and an interface 4 for transmitting data relating to the vehicle movements to electronic smart glasses 5 of the display system 1. Instead of the electronic smart glasses 5, however, other visual output devices that can be worn on the head can also be used, for example also one or more augmented reality lenses.Vehicle occupants, in particular if they are passengers, can put on the electronic smart glasses 5 in order to allow a wide variety of contents to be displayed during the journey, for example media contents such as movies and the like, console games or else websites. During the travel with the vehicle, it may occur that a wearer of such electronic smart glasses 5 becomes bad, in particular the greater the discrepancy between the visual sensations due to the overlay of the contents by means of the electronic smart glasses 5 and the sensory impressions which relate to the spatial position and movement of the wearer of the electronic smart glasses 5.The mobile sensor device 2 is a stand-alone hardware box which can be used in any vehicles. A wide variety of variables relating to the vehicle movements of the vehicle can be detected by means of the detection device 3 and corresponding data can be transmitted to the electronic smart glasses 5 via the interface 4. The detection device 3 can detect, for example, a direction of movement of the vehicle. The detection device 3 can likewise also detect accelerations of the vehicle. Furthermore, the detection device 3 can also detect a position of the vehicle. The detection device 3 can have, for example, a data interface for detecting the vehicle movements, which can be coupled to the relevant vehicle. Thus, the detection device 3 can be plugged, for example, into an onboard interface of the vehicle or else simply into a USB interface in order to detect the various vehicle movements. Alternatively or additionally, it is also possible for the detection device 3 to have one or more sensors for detecting the vehicle movements. In particular, it is also possible for the mobile sensor device 2 to be able to detect respective vehicle movements completely independently of vehicles. In this case, the mobile sensor device 2 is configured with a corresponding sensor system, by means of which movements and accelerations and possibly also position information can be independently recorded.The interface 4 can be either a wireless or a wired interface. For example, the data relating to the vehicle movement can be transmitted to the electronic smart glasses 5 via a Bluetooth connection, a WLAN connection or also via a mobile radio connection. Alternatively or additionally, it is also possible for a cable connection to be established simply between the mobile sensor device 2 and the electronic smart glasses 5, for example by simply plugging a USB cable into the electronic smart glasses 5.The mobile sensor device 2 can have the form of a beverage can, for example, so that the mobile sensor device 2 can be reliably and securely accommodated and held in a beverage holder of the relevant vehicle. Even in the case of a more rapid driving mode and abrupt driving maneuvers, it can be ensured that the mobile sensor device 2 is held securely in the vehicle. For supplying energy to the mobile sensor device 2, the latter preferably comprises a battery. In addition, the mobile sensor device 2 can be connected to the relevant vehicle, for example, via a plug, so that the mobile sensor device 2 can also be supplied with energy, wherein the battery of the mobile sensor device 2 can also be charged in this way.FIG. 2 schematically shows a display surface 6 of the electronic smart glasses 5. On the one hand, a central display area 7 can be seen, and on the other hand, peripheral lateral display areas 8 are also shown on the left and right thereof. Depending on the data provided by means of the mobile sensor device 2 which relate to the movements of the vehicle, structures corresponding to the detected vehicle movements are displayed in the laterally peripheral display regions 8. As a result, in the case of a vehicle occupant wearing the electronic smart glasses 5, contradictions between visual sensations and sensations relating to the spatial position and / or movement of the vehicle occupant can be reduced or completely resolved.Thus, when electronic smart glasses 5 are placed on, a vehicle occupant can view a movie in the central display area 7, for example, or can also view the contents of a video game. Structures such as arrows or other symbols are displayed in the lateral peripheral display regions 8, which move in accordance with the detected vehicle movement. If the vehicle in which the vehicle occupant sits with the electronic smart glasses 5 placed thereon is, for example, just accelerated strongly, the displayed structures in the peripheral regions 8 are likewise accelerated strongly. If, on the other hand, the vehicle is abruptly braked, the movement of the displayed structures in the peripheral display regions 8 is likewise greatly braked. The visual representation of the current vehicle movements is of course not limited only to the display in such lateral peripheral display regions 8. The shape of the structures mentioned is essentially also arbitrary. It is only important that the user of the electronic smart glasses 5 receives visual feedback about how the vehicle in question, and thus also the user himself, is moving. As a result, the occurrence of the so-called simulator sickness, which is also referred to as travel malasis, motion malasis or kinetosis, can be reduced to a considerable extent or prevented completely.Of course, other applications are also possible on the basis of the data relating to the vehicle movement, which convert the own movement of the vehicle into the contents shown by means of the electronic smart glasses 5. The mobile sensor device 2 can function in particular completely independently of the vehicle in which the mobile sensor device 2 is used. A user therefore only needs to take the electronic smart glasses 5 and the mobile sensor device 2 into the vehicle in question. Then, the user can display a wide variety of contents by means of the electronic smart glasses 5 during the journey with the relevant vehicle, wherein the mobile sensor device 2 detects vehicle movements in the described manner and provides related data to the electronic smart glasses 5, so that the occurrence of nausea on the wearer of the electronic smart glasses 5 can be significantly reduced or completely prevented.
Claims
Mobile sensor device (2) for a head-portable visual output device (5) usable in a vehicle, comprising - a detection device (3) for detecting vehicle movements of the vehicle; - an interface (4) for transmitting data relating to the vehicle movements to the head-portable visual output device (5); - wherein the mobile sensor device (2) has a further interface for digital image and sound transmission, such that digital image and sound data can be received by means of the mobile sensor device (2) and transmitted to the head-portable visual output device (5) - wherein the detection device (3) has at least one sensor for detecting the vehicle movements.Mobile sensor device (2) according to Claim 1, characterized in that the detection device (3) is designed to detect a direction of movement of the vehicle.Mobile sensor device (2) according to Claim 1 or 2, characterized in that the detection device (3) is designed to detect accelerations of the vehicle.Mobile sensor device (2) according to claim 1 or 2, characterized in that the detection device (3) is configured to detect a position of the vehicle.Mobile sensor device (2) according to one of the preceding claims, characterized in that the detection device (3) has a data interface which can be coupled to the vehicle for detecting the vehicle movements.Mobile sensor device (2) according to one of the preceding claims, characterized in that the interface (4) is designed to transmit the data relating to the vehicle movements wirelessly and / or by cable to the visual output device (5) which can be worn on the head.Mobile sensor device (2) according to one of the preceding claims, characterized in that the mobile sensor device (2) has the form of a beverage container, in particular a beverage can, which can be accommodated in a beverage holder of the vehicle.Mobile sensor device (2) according to one of the preceding claims, characterized in that the mobile sensor device (2) has a battery and / or a plug which can be connected to the vehicle for supplying energy.Display system (1) having a mobile sensor device (2) according to one of the preceding claims and at least one head-portable visual output device (5) which is configured to display a structure corresponding to the detected vehicle movements in a partial region (8) of its display surface (6) in order to reduce a contradiction between visual sensations and sensory impressions relating to a spatial position and / or movement of the vehicle occupant in the case of a vehicle occupant wearing the visual output device (5).Display system (1) according to Claim 9, characterized in that the head-worn visual output device (5) is virtual reality spectacles, augmented reality spectacles or augmented reality lenses.Method for operating a display system (1) according to one of Claims 9 or 10, in which vehicle movements of the vehicle are detected by means of the sensor device (2) and data relating to the vehicle movements are transmitted to the head-portable visual output device (5), which displays a structure corresponding to the detected vehicle movements in a partial region (8) of its display surface (6) in order to reduce a contradiction between visual sensations and a spatial position and / or movement of the vehicle occupant-relating sensations in the case of a vehicle occupant wearing the visual output device (5), wherein digital image and sound data are received by means of the mobile sensor device (2) and are transmitted to the head-portable visual output device (5) by means of the further interface of the mobile sensor device (2), wherein the detection device (3) of the sensor device (2) detects the vehicle movements by means of at least one sensor.
Citation Information
Patent Citations
Motion-Coupled Visual Environment for Prevention or Reduction of Motion Sickness and Simulator / Virtual Environment Sickness
US20070034212A1
Audio device having integrated satellite receiver and FM transmitter functionalities
US20070042709A1