Vehicle arrangement and procedures for operating the vehicle arrangement

Abstract

The invention relates to a vehicle arrangement 1 for a vehicle 2, with AR glasses 5 for a driver 3 of the vehicle 1, wherein the AR glasses 5 define a field of vision 6, wherein the AR glasses 5 are configured to project vehicle-mounted content into the field of vision 6, with a display device 7 for displaying image content, wherein the display device 7 is arranged in a vehicle-mounted manner, wherein the AR glasses 5 are configured to project an overlay 10 of the display device 7 into the field of vision 6 to prevent distraction of the driver.

Description

[0001] The invention relates to a vehicle arrangement with AR glasses to prevent a driver of a vehicle from being distracted, and to a corresponding method.

[0002] Virtual driver assistance systems are projected into the driver's field of vision via head-up displays or computer glasses to provide information such as navigation or speed updates. This gives the driver useful information that improves visibility and safety while driving.

[0003] The publication EP 2762950 A1 discloses a vehicle head-up display arrangement comprising: a vehicle windshield and a projection unit arranged to selectively project light onto the vehicle windshield, and a unit for estimating the driver's eye position, and a detection unit arranged to detect traffic signs in an environment outside the vehicle in which the arrangement (1) is located and their position relative to the vehicle, and a processing unit arranged to determine the content of the traffic signs detected by the detection unit, characterized in that the processing unit is further arranged to determine the relevance of the content of the traffic signs detected by the detection unit, and in that the projection unit is arrangedthat they project light onto one or more areas of the windscreen in accordance with the estimated eye position of the driver and traffic signs whose content has been determined to be irrelevant, so that these traffic signs are at least partially obscured by the estimated eye position of the driver.

[0004] The invention is based on the objective of proposing a vehicle arrangement that contributes to increasing safety during a journey.

[0005] This problem is solved by a vehicle arrangement having the features of claim 1 and by a method having the features of claim 9. Preferred or advantageous embodiments of the invention will become apparent from the dependent claims, the following description and / or the accompanying figures.

[0006] According to the invention, a vehicle arrangement for a vehicle is proposed. Optionally, the vehicle together with the vehicle arrangement forms part of the invention.

[0007] The vehicle configuration includes AR glasses for the driver. The AR glasses are intended to be worn by the driver, who is seated in the vehicle's driver's seat. The AR glasses preferably have a headband, such as a pair of glasses, designed to be worn on the driver's head. The AR glasses, in their position within the vehicle, define a field of vision that the driver can utilize. Furthermore, the AR glasses feature displays, preferably transparent ones, which can project virtual content into the driver's field of vision.

[0008] The AR glasses are designed to overlay vehicle-mounted content as virtual content into the driver's field of vision. This vehicle-mounted content is designed to remain stationary relative to the vehicle within the field of vision, even if the AR glasses' field of view changes or the driver's position inside the vehicle changes.

[0009] The vehicle assembly includes a display device, such as a screen, which can display image content. The display device is permanently installed in the vehicle and / or can be installed in a different location.

[0010] It is proposed that the AR glasses be designed to overlay the display unit as a fixed element within the driver's field of vision, thus preventing distraction. During operation of the vehicle system, particularly when needed, the AR glasses will overlay the display unit. This overlay ensures that the driver can no longer see the display unit, and especially its image content, or can only see it vaguely.

[0011] One aspect of the invention is that not all screens in a vehicle are used to display driving and / or driver-related information. Rather, some screens are also used for entertainment purposes, and these screens are intended to be used by passengers.

[0012] To prevent driver distraction, mechanical visual barriers can be used between the driver and the screen. Laptops are known to use polarizing films that prevent the driver from viewing the screen from the side. It is also possible to have the screen deactivated as soon as the driver looks at it. However, these known methods have the disadvantage of negatively impacting the user experience for passengers and hindering entertainment purposes.

[0013] In contrast, the invention proposes that, to prevent driver distraction, an overlay of the display device as vehicle-fixed content is projected into the driver's field of vision using AR glasses. This allows the driver to either completely prevent viewing the display device or restrict it to such an extent that the driver is no longer distracted by it. Thus, the AR glasses are used to suppress information unrelated to the driving process and / or the vehicle, with the aim of improving driving safety. The overlay of the display device specifically includes an area in which the image content is displayed. Stationary edge areas of the display device may, but do not necessarily have to, be overlaid.

[0014] The overlay is, in particular, a flat, area-limited display within the AR glasses. The overlay can be a flat area of ​​virtual content. In the simplest case, the virtual content is a colored area, a darkened area, a grayed-out area, hatching, etc. A stationary image, such as a clock, can also be displayed as an overlay.

[0015] In a preferred embodiment of the invention, the display device is assigned to a passenger. Particularly when viewed laterally, the display device can be arranged in an area extending from the center console to the lateral boundary of the vehicle interior on the passenger side. Due to its position, the display device and the image content it displays are already oriented towards the passenger, thus reducing driver distraction. In particular, the overlay is controlled based on the position of the display device within the vehicle.

[0016] Alternatively or additionally, the AR glasses are designed to display the overlay depending on the content shown on the display device. For example, it can be configured that the content is known and that the overlay is activated when it contains content unrelated to driving and / or the vehicle, particularly media content. Conversely, the overlay is deactivated when it contains driving and / or vehicle-related content that also concerns the driver. In particular, the overlay is controlled based on the content.

[0017] Alternatively or additionally, the AR glasses are designed to display the overlay depending on the vehicle's speed. For example, the overlay can be deactivated when the vehicle is stationary, as distracting media content and the like are "allowed" while stationary. The overlay can be activated when the vehicle is moving.

[0018] Alternatively or additionally, the AR glasses are designed to display the overlay depending on the vehicle's state. For example, the overlay can be deactivated when the vehicle is stopped or parked, with, for instance, the engine deactivated, as distracting media content and the like are "allowed" when the engine is deactivated. The overlay can be activated when the vehicle enters a driving state, such as when the engine is engaged.

[0019] In one possible implementation, the overlay is designed as a blur effect and / or a darkening effect. The blur effect ensures that the display device, and in particular its image content, appears blurred. In this way, the driver is not distracted by the specific image content of the display device; rather, the driver only perceives that the display device is active, but is informationally decoupled from the image content itself.

[0020] In another possible implementation, the overlay is designed as an opaque overlay. Specifically, the overlay can be a bar, or more precisely, a black bar. In this implementation, the driver cannot even tell whether the display is active. Therefore, the driver is not distracted by the display.

[0021] In a preferred embodiment of the invention, the AR glasses are configured to adjust the superposition state depending on the position of the display device within the driver's field of vision. The superposition is intensified when the display device moves into the driver's primary field of vision and / or the center of the driver's field of vision, and attenuated when the display device moves to a peripheral area of ​​the driver's field of vision. In the intensified state, the superposition can be opaque, while in the attenuated state, the superposition can be blurred and / or darkened. This embodiment is based on the consideration that the further the display device moves into the driver's primary field of vision, the greater the attenuation of the image content on the display device due to the superposition should be to prevent driver distraction.

[0022] Optionally, the vehicle setup includes an interior camera designed to detect the AR glasses and determine an interior pose of the AR glasses within a vehicle-fixed coordinate system. The interior pose includes, in particular, the position and orientation of the AR glasses. Specifically, the interior pose is designed as a 6DoF (six degrees of freedom). The driver's field of vision approximately corresponds to the field of vision of the AR glasses, which is defined by the interior pose. Based on the interior pose, the AR glasses are designed to correctly position the overlay within the driver's field of vision.

[0023] The AR glasses and / or the display device and / or the indoor camera can each have an evaluation unit for implementing the described functions. In particular, the evaluation unit is designed as a digital data processing device, such as a computer, a microcontroller, etc. Alternatively or additionally, the AR glasses and / or the display device and / or the indoor camera can have a shared evaluation unit and / or a connection to a cloud to implement the described functions.

[0024] Preferably, the AR glasses are not limited to the function of overlaying the display device. Rather, it is preferred that the AR glasses are designed to display driving and / or vehicle-related information. Such information can relate to a vehicle status, such as speed or fuel level. Alternatively, the information can include navigation information. Thus, the AR glasses, which are inherently designed to display driving and / or vehicle-related information, can also be used to overlay the display device.

[0025] A further aspect of the invention is a method for operating the vehicle arrangement as previously described. The vehicle arrangement is provided. To prevent driver distraction, the AR glasses superimpose an overlay of the display device into the driver's and / or the AR glasses' field of vision.

[0026] In particular, the overlay is adjusted depending on the position of the display device in the vehicle, the position of the display device in the field of vision and / or the display content of the display device.

[0027] In particular, the goal is to prevent the driver from being distracted by (moving) content on a passenger-side display. While existing techniques can be used for this purpose, they often impair the passenger's experience: frequent video pausing, poor display visibility, and significant viewing angle dependency. When the driver actively wears AR glasses, a fixed overlay is projected into the driver's field of vision when the passenger-side display is in use, preventing them from perceiving the screen content. The projection is controlled based on the driver's gaze direction and intensifies the overlay when the passenger-side display enters the driver's primary field of vision. This prevents the moving content on the passenger-side display from pausing.The process can be implemented as follows: 1) Vehicle with interior camera and passenger display. 2) Video plays on the passenger display while driving. 3) Driver wears AR glasses and receives driving-related information. The AR glasses are actively tracked (e.g., by the interior camera), and it is possible to produce content fixed to the vehicle. 4) If the driver now looks towards the passenger display, a bar is displayed across the screen. 5) If the moving image is at the edge of the display, it is blurred.

[0028] Further features, advantages, and effects of the invention will become apparent from the following description of preferred embodiments of the invention. These include: Fig. 1 a schematic block diagram of a vehicle arrangement as an embodiment of the invention with a first field of view orientation; Fig. 1 b a schematic representation of the field of view in the first field of view orientation according to Fig. 1 a; Fig. 2 a schematic block diagram of a vehicle arrangement as an embodiment of the invention with a second field of view orientation; Fig. 2 b a schematic representation of the field of view in the second field of view orientation according to Fig. 2 a; Fig. 3 a a schematic block diagram of a vehicle arrangement as an embodiment of the invention with a third field of view orientation; Fig. 3 b a schematic representation of the field of view in the third field of view orientation according to Fig. 3 a.

[0029] Corresponding or identical parts are each provided with the same reference symbols in the figures.

[0030] The Fig. Figure 1a shows a schematic block representation of a vehicle arrangement 1 as an embodiment of the invention, which is also used to illustrate an embodiment of the method.

[0031] Vehicle arrangement 1 is located in or formed by vehicle 2. Vehicle 2 can be, for example, a passenger car, truck, bus, etc.

[0032] Vehicle 2 can accommodate a driver 3 and a passenger 4. Driver 3 and driver 4 are seated in the first row and / or in the driver's seat and / or passenger's seat, respectively, of vehicle 2.

[0033] The vehicle arrangement 1 includes AR glasses 5, which are worn by the driver 3 of the vehicle 2 during the procedure. The AR glasses 5 are placed on the driver 3's head and have at least one display, which is transparent so that virtual content can be superimposed on the real environment. The virtual content is displayed by the AR glasses 5.

[0034] The AR glasses 5 and thus the driver 3 have a field of vision 6, which, in the first field of vision orientation of the driver 3 or the AR glasses 5 shown, is directed in the direction of travel of the vehicle 2.

[0035] The vehicle assembly 1 includes a display device 7, which in this embodiment is designed as a passenger-side screen located on the passenger's side 4 with respect to a transverse direction of the vehicle 2. The display device 7 can display image content, such as media content, in particular films, music videos, etc. It is also possible for the image content to include internet content, such as browser pages, etc. The display device 7 is fixed to the vehicle. Its orientation can be adjusted if necessary.

[0036] The vehicle arrangement 1 can include an interior camera 8, wherein the interior camera 8 is configured to detect an interior pose of the AR glasses 5. The interior pose of the vehicle describes the interior position and orientation of the AR glasses 5 and thus of the field of view 6. The interior pose of the vehicle is defined with respect to a vehicle-fixed coordinate system.

[0037] The vehicle arrangement 1 can include an evaluation unit 9, which controls and / or organizes the functions of the AR glasses 5, the display unit 7 and / or the interior camera 8. For example, it is possible that information about the image content of the display unit 7 and / or the vehicle interior pose of the AR glasses 5 converges in the evaluation unit 9 and / or that the AR glasses 5 use the evaluation unit 9 to generate content for the driver's field of vision 6.

[0038] Knowing the vehicle interior position of the AR glasses 5, it is possible for the AR glasses 5 to project content into the driver's field of vision 6 in a vehicle-fixed manner. The projected content therefore does not change its position relative to the vehicle's fixed coordinate system, as perceived by the driver 3, when the vehicle interior position of the AR glasses 5 is changed.

[0039] The Fig. Figure 1b schematically shows the vehicle gutter of vehicle 2 from the driver's perspective 3, with the field of vision 6 schematically depicted according to the first field of vision orientation. The illustration shows that the display device 7 is located outside the field of vision 6. For orientation, the Fig. 1 b additionally shows a steering wheel 11.

[0040] In the Fig. 2 a is the vehicle arrangement 1 of the Fig. 1 a shown, with the difference that the orientation of the AR glasses 5 as part of the vehicle interior pose has changed towards the display device 7, so that the AR glasses 5 assume a second field of view orientation.

[0041] As can be seen from the Fig. Figure 2b, which shows the vehicle arrangement 1 with the second field of vision orientation and / or the modified vehicle interior pose, shows that the display device 7 is located in the field of vision 6 of the AR glasses 5 and thus of the driver 3. Therefore, the display device 7 can distract the driver while driving.

[0042] The AR glasses 5 are designed to overlay 10 of the display device 7, in particular a screen of the display device 7, into the driver's field of vision 6 as virtual content in order to prevent distraction of the driver 3. The overlay 10 is adjusted, in particular, depending on the position of the display device 7 in the field of vision 6. Fig. 1 a the display device 7 is located outside the field of vision 6. Thus, no overlay 10 of the display device 7 is shown.

[0043] However, in the second field-of-view orientation, the display device 7 is located at the edge of the field of view 6 and / or partially or sectionally outside of the field of view 6. Therefore, the display device 7 has only a low potential to distract the driver 3. In this second field-of-view orientation, an overlay state is set, with the overlay 10 being designed as a blur effect. For example, the display device 7 may be displayed as blurred. Due to this overlay state, the driver 3 cannot even perceive the image content of the display device 7 peripherally, thus preventing any distraction of the driver 3 by the display device 7.

[0044] In the Fig. 3 a is the vehicle arrangement 1 of the Fig. 1 a shown, with the difference that the orientation of the AR glasses 5 as part of the vehicle interior pose has changed further in the direction of the display device 7, so that the AR glasses 5 assume a third field of view orientation.

[0045] As can be seen from the Fig. Figure 3b, which shows the vehicle arrangement 1 with the third field of vision orientation and / or the modified vehicle interior pose, shows that the display device 7 is located centrally in the field of vision 6 of the AR glasses 5 and thus of the driver 3. Therefore, the display device 7 can distract the driver while driving.

[0046] The AR glasses 5 are designed to overlay the display device 7, in particular a screen of the display device 7, as virtual content into the driver's field of vision 6 in order to prevent distraction of the driver 3. The overlay 10 is adjusted, in particular, depending on the position of the display device 7 in the field of vision 6.

[0047] In the Fig.In the third field of view orientation, the display device 7 is located centrally or in a primary area of ​​the field of view 6. This means that the display device 7 has a high potential to distract the driver 3. In this third field of view orientation, an overlay state is set, with the overlay 10 being designed as a black bar, so that the display device 7 is completely obscured. This overlay state prevents the driver 3 from perceiving the image content of the display device 7, even from a central top view, thus preventing the driver 3 from being distracted by the display device 7. The overlay state is therefore set position-dependently of the position of the display device 7 within the field of view 6. Reference symbol list 1 Vehicle arrangement 2 vehicles 3 drivers 4 passengers 5 AR glasses 6 field of vision 7 Display device 8 Interior camera 9 Evaluation unit 10 Overlay QUOTES INCLUDED IN THE DESCRIPTION

[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature

[0000] EP 2762950 A1

[0003]

Claims

[1] Vehicle arrangement (1) for a vehicle (2), with AR glasses (5) for a driver (3) of the vehicle (1), wherein the AR glasses (5) define a field of view (6), wherein the AR glasses (5) are designed to display vehicle-mounted content in the field of vision (6), with a display device (7) for displaying image content, wherein the display device (7) is fixedly arranged in the vehicle, wherein the AR glasses (5) are designed to overlay (10) the display device (7) into the field of vision (6) in order to prevent distraction of the driver. [2] Vehicle arrangement (1) according to claim 1, characterized by , that the display device (7) is assigned to a passenger. [3] Vehicle arrangement (1) according to one of the preceding claims, characterized by , that the AR glasses (5) are designed to display the overlay (10) depending on the display content of the display device (7). [4] Vehicle arrangement (1) according to one of the preceding claims, characterized by , that the overlay (10) is formed as a blur effect and / or as a darkening. [5] Vehicle arrangement (1) according to any one of the preceding claims, characterized by , that the overlay (10) is designed as an opaque overlay (10). [6] Vehicle arrangement (1) according to any one of the preceding claims, characterized by , that the AR glasses (5) are designed to set a superposition state of the superposition (10) depending on the position of the display device (7) in the field of view (6). [7] Vehicle arrangement (1) according to any one of the preceding claims, characterized byan interior camera (8), wherein the interior camera (8) is configured to detect the AR glasses (5) and to determine an interior vehicle pose of the AR glasses (5) in the vehicle (1), wherein the AR glasses (5) are configured to arrange the overlay (10) correctly in the field of view (6) based on the interior vehicle pose. [8] Vehicle arrangement (1) according to any one of the preceding claims, characterized by , that the AR glasses (5) are designed to display driving and / or vehicle-related information. [9] Method for operating the vehicle arrangement (1) according to one of the preceding claims, wherein the vehicle arrangement (1) is provided, wherein the AR glasses (5) to prevent distraction of the driver (3) superimposes (10) the display device (7) into the field of vision (6). [10] Method according to claim 9, characterized by, that the overlay (10) is to be adjusted depending on the position of the display device (7) in the vehicle (1), the display content of the display device (7) and / or the position of the display device (7) in the field of vision (6).

Images