Control device and method for operating a head-mounted display device in a motor vehicle

Abstract

The invention relates to a method for operating a head-mounted display device in a motor vehicle (1), wherein at least the following condition is checked: whether there are no other vehicle occupants (9) in the motor vehicle (1) other than the driver (2) when the motor vehicle (1) is not operating in an automated driving mode, and if this condition is met, the display device is restricted in terms of content display as follows: if the display device is a virtual reality pair of glasses (3), display of any content is prohibited; if the display device is an augmented reality pair of glasses, only traffic-related content is allowed to be displayed on the display device. The invention also relates to a control device (4) for operating a head-mounted display device in a motor vehicle (1).

Description

Technical Field

[0001] The invention relates to a control device and a method for operating a head-mounted display device in a motor vehicle. The invention also relates to a motor vehicle having such a control device. Background Art

[0002] In the foreseeable future, people will be able to wear virtual reality or augmented reality glasses in a motor vehicle for entertainment purposes and use them to view different content. While driving, especially before automated driving becomes available, such entertainment will be available to fellow passengers rather than the driver himself.

[0003] DE 10 2013 221 858 A1 discloses a method for operating data glasses in a motor vehicle. If it is determined that the seat in which the data glasses are used is the driver's seat of the vehicle, the transmission of usage data, in particular graphic or video data, to the data glasses is prohibited. This is particularly the case if it cannot be reliably determined whether the driver is not using the data glasses in an operating mode suitable for the driving task. This reduces the risk of being distracted by the data glasses.

[0004] DE 10 2014 206 623 A3 discloses a method for operating data glasses in a vehicle. The display of the data glasses is controlled depending on the seat of the user of the data glasses.

[0005] DE 10 2016 213 916 A1 shows an infotainment system for a motor vehicle having data glasses for displaying virtual reality, which data glasses can be assigned to specifically designated seats. Summary of the invention

[0006] The object of the present invention is to provide a solution by means of which it can be ensured in a particularly simple manner that the motor vehicle driver is not distracted from his driving task by a display device worn on the head.

[0007] In the method according to the invention for operating a head-mounted display device, at least the following condition is checked: whether there are no other vehicle occupants in the motor vehicle besides the driver when the motor vehicle is not operated in the automatic driving mode. This is to be understood in the sense of the invention as: the driver drives the car completely by himself. This can also be understood as: certain assistance systems help in operating the vehicle, such as an adaptive cruise control system. This can also be understood as: a certain degree of semi-automation is present when performing the driving task. Functions such as automatic parking, lane keeping, general steering guidance, acceleration, braking, etc. can also be taken over by assistance systems (e.g. traffic jam assistants).

[0008] The situation in which a motor vehicle is not operated in an automatic driving mode may refer, for example, to the automatic driving levels 0, 1 and 2 according to the SAE J3016 standard. Therefore, an automatic driving mode in the sense of the present invention is to be understood as, for example, the automation of operation. The driver does not have to constantly monitor the system, for example the motor vehicle. The motor vehicle independently performs functions such as triggering turn indicators, changing lanes and keeping lanes. The driver can focus on other things, but will take over the system within the system's advance warning time when necessary. In the sense of the present invention, high automation can also include the following situation: the motor vehicle is operated in an automatic driving mode. The driving of the motor vehicle is permanently taken care of by an appropriate system. If the system is no longer able to handle the driving task, the driver can be asked to take over the driving. The automatic driving mode can also be understood as complete automation without the need for a driver at all. Apart from setting targets and starting the system, no manual intervention is required.

[0009] In principle, the motor vehicle can be a motor vehicle that can or cannot drive itself automatically. If the motor vehicle is not operating in the automatic driving mode - whether because the motor vehicle is not capable of automatic driving at all or because the corresponding driving mode has just been selected - and the condition that there are no other vehicle occupants in the motor vehicle besides the driver is met, the display device that can be worn on the head is restricted in terms of display content in one of the following ways: if the display device is a virtual reality pair of glasses, the display of any content is prohibited; if the display device is an augmented reality pair of glasses, only traffic-related content is allowed to be displayed on the display device.

[0010] In order to reduce the risk that the driver accidentally or intentionally uses virtual reality glasses or augmented reality glasses while driving alone and is thus exposed to avoidable dangers, if the display device is a virtual reality glasses, it is prohibited to display any content; if the display device is an augmented reality glasses, only traffic-related content is allowed to be displayed on the display device. In the case of augmented reality glasses, the augmented reality glasses are operated in such a way that they can only be used in an operating mode that is suitable for the driving task. In this case, the augmented reality glasses can display, for example, navigation instructions, speed instructions, etc., in which case the display of graphics and / or videos purely for entertainment purposes is prohibited. In the case of virtual reality glasses, if the above conditions are met, it is prohibited to display any content. Because virtual reality glasses visually completely isolate the wearer from his surroundings.

[0011] The invention is based on the knowledge that if a passenger or a front passenger is detected, it can be assumed that the passenger or the front passenger himself uses the head-mounted display device or that the driver is prohibited from using the display device. In the method according to the invention, it is not necessary to use complex sensors to determine exactly where the head-mounted display device is located in the motor vehicle and which vehicle occupant is wearing it. The method according to the invention thus makes it possible to prevent the driver from being distracted from his actual driving task by the head-mounted display device in a particularly simple and reliable manner when the motor vehicle is not operating in an automated driving mode.

[0012] An advantageous embodiment proposes that if there are other vehicle occupants in the motor vehicle, as an additional condition, it is checked whether the vehicle occupant is located behind the corresponding front seat of the motor vehicle, in particular on the rear seat of the motor vehicle. Only if this additional condition is met, any content can be displayed by the display device, and if this additional condition is not met, a restriction is made. The latter means that in the case of virtual reality glasses, any content is prohibited from being displayed, while in the case of augmented reality glasses, only traffic-related content can be displayed. If it is only desired or permitted to use a head-mounted display device on, for example, the rear seat, then in the presence of other vehicle occupants other than the driver, it is checked whether these vehicle occupants are located on, for example, the rear seat. Therefore, if the at least one other vehicle occupant is not located on the rear seat, but is located on, for example, the front passenger seat, the playback or display content of the display device is restricted. If, on the other hand, it is determined that the at least one other vehicle occupant is sitting on the rear seat, any content can be displayed by means of the head-mounted display device. By this measure, it can be ensured in a particularly reliable manner that the driver is not distracted from his driving task by the head-mounted display device. Because in this case, the head-mounted display device can only be used or used to display any content when at least one other vehicle occupant is sitting behind the front seat of the motor vehicle, for example on the rear seat.

[0013] Another advantageous embodiment of the present invention proposes that in the case of virtual reality glasses, the display of any content is prohibited by prohibiting the transmission of data that can display content from the motor vehicle and / or from other data sources to the virtual reality glasses. Image data and / or video data can be transmitted to the virtual reality glasses, for example, from the infotainment system of the vehicle. If the display of any content with the virtual reality glasses is to be prohibited, the corresponding data connection between the infotainment system and the virtual reality glasses can be interrupted as long as the condition that there are no other vehicle occupants in the motor vehicle except the driver is met. In the case of augmented reality glasses, if the above-mentioned restrictions are to be made, it is possible, for example, to allow only traffic-related content to be transmitted to the augmented reality glasses on the one hand or on the other hand. The head-worn display device can also obtain the data to be displayed, for example, from a smartphone or other device that is not permanently installed on the vehicle. In this case, the transmission of data that can display content can also be prohibited in the case of virtual reality glasses, or corresponding filtering can be performed in the case of augmented reality glasses.

[0014] According to a further advantageous embodiment of the invention, provision is made for virtual reality glasses to be used to prevent any content from being displayed using the virtual reality glasses. In this way, it can be ensured particularly reliably that, in the case of the aforementioned restrictions, no content can be displayed at all using the virtual reality glasses. If the driver wears virtual reality glasses when the motor vehicle is not in the automated driving mode, he will most likely take them off or remove them because they have been deactivated.

[0015] In another advantageous embodiment of the invention, it is provided that the seat occupancy detection is used to check whether there are no other vehicle occupants in the motor vehicle besides the driver. For this purpose, corresponding seat occupancy sensors can be used in the motor vehicle. It is also possible to check by means of the seat occupancy detection whether there are possibly other vehicle occupants behind the respective front seats of the motor vehicle. By means of the seat occupancy detection, it is possible to check in a simple manner whether there are vehicle occupants in the motor vehicle and where they are located.

[0016] Another advantageous embodiment of the invention provides for monitoring the opening and closing of the doors of the motor vehicle and, on this basis, for checking whether there are no other vehicle occupants in the motor vehicle besides the driver. In this way, it is also possible to check, for example, whether other vehicle occupants are sitting in the rear seats or in the front passenger seat. By monitoring the opening and closing movements of the doors, it is easy to check where the respective vehicle occupant is most likely to be sitting.

[0017] According to another advantageous embodiment of the invention, it is provided that the opening and closing of the seat belt buckle of the motor vehicle is monitored and on this basis a check is made as to whether there are no other vehicle occupants in the motor vehicle besides the driver. In general, by checking or monitoring the seat belt buckle of the motor vehicle, it can be determined quite reliably whether there are vehicle occupants in the motor vehicle and where they are seated.

[0018] Another advantageous embodiment of the invention provides for a camera-based check to determine whether there are no other vehicle occupants in the motor vehicle besides the driver. It is also possible to check or monitor where any vehicle occupants are sitting in the motor vehicle based on a camera. Sensors, for example in the form of cameras, which are installed in motor vehicles for vehicle occupancy and / or driver status recognition, can generally be used to detect the driver himself or other vehicle occupants and their positions in the motor vehicle.

[0019] The control device according to the invention for operating a head-mounted display device in a motor vehicle is configured to carry out the method according to the invention or an advantageous embodiment of the method according to the invention. Advantageous embodiments of the method according to the invention are also considered to be advantageous embodiments of the control device according to the invention and vice versa, wherein the control device has in particular components for carrying out the method steps. The control device can, for example, have one or more data interfaces via which it can be connected to various sensors or detection devices that can be used to check the above-mentioned conditions.

[0020] The motor vehicle according to the invention comprises a control device according to the invention or an advantageous embodiment of the control device according to the invention. According to a further independent aspect of the invention, it can also be provided that the head-mounted display device itself has a control device.

[0021] Further advantages, features and details of the invention are apparent from the following description of preferred exemplary embodiments and with reference to the drawings. The features and feature combinations mentioned above in the description and the features and feature combinations mentioned below in the description of the drawings and / or shown individually in the drawings can be used not only in the respectively described combination but also in other combinations or alone without departing from the scope of the invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In the attached figure:

[0023] Figure 1 A schematic diagram of a motor vehicle is shown, in which sits a driver wearing virtual reality glasses;

[0024] Figure 2 Another schematic diagram of a motor vehicle is shown, wherein in addition to the driver, another vehicle occupant is seated on the front passenger seat;

[0025] Figure 3A further schematic illustration of a motor vehicle is shown, in which other vehicle occupants are seated on the rear seats of the motor vehicle. DETAILED DESCRIPTION

[0026] In the figures, identical or functionally identical elements are provided with the same reference symbols.

[0027] exist Figure 1 Schematically shown in FIG. A driver 2 wearing virtual reality glasses 3 is sitting in the motor vehicle 1. The virtual reality glasses 3 are connected to a control device 4 by means of signal technology or data technology, which is provided for operating the virtual reality glasses 3. The data connection is preferably wireless. The driver 2 is sitting in the driver's seat 5, and the front passenger seat 6 and the rear seats 7 of the motor vehicle 1 are not occupied.

[0028] The method for operating virtual reality glasses 3 in a motor vehicle 1 is described in more detail below. If the motor vehicle 1 is not operated in the automatic driving mode, the control device 4 checks at least the following condition: whether there are no other vehicle occupants in the motor vehicle 1 besides the driver 2. In order to check this, a detection device 8 is installed or arranged in the motor vehicle 1.

[0029] The detection device 8 can, for example, perform seat occupancy detection by means of corresponding seat occupancy sensors in order to check whether there are no other vehicle occupants in the motor vehicle 1 besides the driver 2. The detection device 8 can also have corresponding sensors which are designed to check or monitor the opening and closing of the doors of the motor vehicle 1, so that the control device 4 can check on this basis whether there are no other vehicle occupants in the motor vehicle 1 besides the driver 2.

[0030] The detection device 8 can also have corresponding sensors, which can monitor the opening and closing of the seat belt buckle of the motor vehicle 1, so that the control device 4 can check on this basis whether there are no other vehicle occupants in the motor vehicle 1 besides the driver 2. In addition, the detection device 8 can also have one or more cameras, so that the detection device 8 or the control device 4 can check on the basis of the camera whether there are no other vehicle occupants in the motor vehicle 1 besides the driver 2. The detection device 8 can usually provide the control device 4 with various sensor data about the occupancy of the vehicle, so that the control device 4 can check on the basis of these sensor data whether there are no other vehicle occupants in the motor vehicle 1 besides the driver 2.

[0031] If this condition is met, the control device 4 imposes the following restrictions on the virtual reality glasses 3: it is prohibited to display any content with the virtual reality glasses 3. If the driver 2 is sitting alone in the motor vehicle 1, the driver must not be allowed to use the virtual reality glasses 3 to display any content as long as the motor vehicle 1 is not operating in the automatic driving mode. The driver 2 will then inevitably take off the virtual reality glasses 3 so that he can perform the actual driving task without distraction.

[0032] The glasses may also be augmented reality glasses instead of virtual reality glasses 3. In this case, only traffic-related content is allowed to be displayed on the display device. With the augmented reality glasses, only content that assists the driver 2 when performing driving tasks, such as navigation tips, speed tips, etc., can be displayed without any entertainment content.

[0033] exist Figure 2 , a motor vehicle 1 is shown in another schematic diagram, wherein a further vehicle occupant 9 is seated on the front passenger seat 6. In this case, provision can be made that the above-mentioned restrictions are not imposed on the virtual reality glasses 3 or augmented reality glasses. It can be assumed that the further vehicle occupant 9 will urge the driver 2 to take off the virtual reality glasses 3. Alternatively, contrary to this illustration, the vehicle occupant 9 sitting on the front passenger seat 6 can also wear the virtual reality glasses 3, so that the operation of the virtual reality glasses 3 does not need to be restricted in the above-mentioned way at all. This also applies to the augmented reality glasses already mentioned above.

[0034] However, if other vehicle occupants 9 are in the motor vehicle 1, a further condition can also be checked: whether the vehicle occupant 9 is located behind the front seats 5, 6 of the motor vehicle 1, i.e., on the rear seat 7, in which case the use of the virtual reality glasses 3 or augmented reality glasses for displaying the content is permitted only if this further condition is met. If this further condition is not met, the above-mentioned restriction is made. It can therefore also be provided that the vehicle occupants sitting in the front seats 5, 6 cannot use the virtual reality glasses 3 or augmented reality glasses at all. This prevents in a particularly reliable manner the driver 2 from being distracted from his driving task, perhaps by wearing the virtual reality glasses 3 or by wearing the augmented reality glasses, when the motor vehicle 1 is not operating in the automated driving mode.

[0035] exist Figure 3 1 shows a motor vehicle 1 in another schematic diagram, in which a vehicle occupant 9 is seated on a rear seat 7. In this case, no restrictions are imposed on the manner of operation of the virtual reality glasses 3 or augmented reality glasses. Contrary to this illustration, it is also possible that the vehicle occupant 9 wears the virtual reality glasses 3 or augmented reality glasses.

[0036] In the case of virtual reality glasses 3, the display of any content can be prevented in the following way: the control device 4 prevents the transmission of data that can display content from the motor vehicle 1 and / or from other data sources (e.g. from a smartphone, tablet) via the Internet to the virtual reality glasses 3. In the case of virtual reality glasses 3, the display of any content can be prevented by shutting down the virtual reality glasses 3 by the control device 4. In the case of augmented reality glasses, it is also possible, for example, to filter the data transmission of the augmented reality glasses so that only traffic-related content is transmitted to the augmented reality glasses. As an alternative to this, it is also possible to simply intervene in the control of the augmented reality glasses so that they can only display traffic-related content - if this restriction applies. The control device 4 can be part of the motor vehicle 1. However, the control device 4 can also alternatively be part of the virtual reality glasses 3 or the augmented reality glasses.

[0037] The method and control device 4 thus make it possible in a particularly simple and reliable manner to prevent the driver 2 from being distracted from his actual driving task by wearing virtual reality glasses 3 or augmented reality glasses when the motor vehicle 1 is not in the automated driving mode.

Claims

1. A method for operating a head-mounted display device in a motor vehicle (1), characterized in that At least the following condition is checked: whether there are no other vehicle occupants (9) other than the driver (2) in the motor vehicle (1) when the motor vehicle (1) is not operating in the automatic driving mode, and if this condition is met, the display device is restricted in terms of content display as follows: If the display device is a virtual reality goggles (3), display of any content is inhibited, wherein the display of any content is inhibited by inhibiting the transmission of data from the motor vehicle (1) and / or from other data sources to the virtual reality goggles (3) that can display the content; If the display device is an augmented reality pair of glasses, only traffic-related content is allowed to be displayed on the display device, wherein the display is allowed by allowing the transmission of traffic-related content on the vehicle side and / or on the pair of glasses side.

2. The method according to claim 1, It is characterized in that If there are other vehicle occupants (9) in the motor vehicle (1), a further condition is checked as to whether the vehicle occupant (9) is located behind the corresponding front seat of the motor vehicle (1). Only if this further condition is met is the display device allowed to display content; if this further condition is not met, restrictions are imposed.

3. The method according to claim 1 or 2, It is characterized in that In the case of the virtual reality glasses (3), display of any content is prohibited by deactivating the virtual reality glasses (3).

4. The method according to claim 1 or 2, It is characterized in that Seat occupancy detection is used to check whether no other vehicle occupants (9) are present in the motor vehicle (1) besides the driver (2).

5. The method according to claim 1 or 2, It is characterized in that The opening and closing of a door of a motor vehicle (1) is monitored and based on this it is checked whether no other vehicle occupants (9) are present in the motor vehicle (1) besides the driver (2).

6. The method according to claim 1 or 2, It is characterized in that The opening and closing of a seat belt buckle of a motor vehicle (1) is monitored and based on this, a check is performed to determine whether no other vehicle occupants (9) are present in the motor vehicle (1) besides the driver (2).

7. The method according to claim 1 or 2, It is characterized in that A camera is used to check whether no other vehicle occupants (9) are present in the motor vehicle (1) besides the driver (2).

8. A control device (4) for operating a head-mounted display device in a motor vehicle (1), the control device being configured to carry out a method according to one of claims 1 to 7.

9. A motor vehicle (1) having a control device (4) according to claim 8.

Images