Direction-of-gaze dimming for AR glasses in vehicles

The system intelligently controls AR glasses dimming based on vehicle surface areas and user gaze to maintain visibility of critical elements, addressing the issue of obscured real-world objects and enhancing interaction and visibility in vehicles.

DE102024003803B3Active Publication Date: 2026-04-02MERCEDES BENZ GROUP AG
View PDF 13 Cites 0 Cited by

Patent Information

Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Filing Date
2024-11-12
Publication Date
2026-04-02

AI Technical Summary

Technical Problem

Modern AR glasses in vehicles often obscure real-world objects, making them invisible, especially when global dimming is activated, which is problematic for interacting with vehicle screens and other important elements.

Method used

A system that determines the position and orientation of AR glasses relative to the vehicle, identifies predefined surface areas within the vehicle, and adjusts dimming based on the user's viewing direction and context to ensure visibility of these areas, allowing intelligent control of global or selective dimming.

Benefits of technology

Enhances visibility and readability of vehicle screens and other important elements by dynamically adjusting dimming, ensuring seamless interaction and improved visual experience, especially in critical situations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

The invention relates to a system for automatically controlling the dimming of augmented reality glasses (1) with a dimming function worn by an occupant of a vehicle, comprising: an orientation determination unit configured and designed to determine the position and orientation of the augmented reality glasses (1) relative to the vehicle and, based on the position and orientation, to determine the occupant's viewing direction relative to the vehicle; an interface configured and designed to provide predefined surface areas (3) of the vehicle;and a control device (5) designed and configured to adjust the dimming of the augmented reality glasses (1) depending on the predefined surface areas (3) and the direction of gaze, wherein at least one of the surface areas (3) is a surface of an electronic display unit in the interior of the vehicle, and wherein the control device (5) is designed and configured to adjust the brightness and / or contrast of content displayed in the augmented reality glasses (1) depending on content displayed on the display unit.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The invention relates to a system for automatically controlling the dimming of augmented reality glasses with a dimming function worn by an occupant of a vehicle, a vehicle with such a system, and a method for automatically controlling the dimming of augmented reality glasses with a dimming function worn by an occupant of a vehicle.

[0002] Augmented reality (AR) glasses are increasingly being used as in-car entertainment for passengers and to assist drivers. Users wearing these glasses are presented with spatially referenced virtual objects superimposed on their natural surroundings. This spatial referencing allows for a consistent experience across the senses, particularly ensuring that the inertial perception of the inner ear and the visual images are aligned. To achieve this, the glasses need to continuously determine their position and orientation relative to a coordinate system fixed to the environment, such as the Earth, in order to adjust the display of virtual objects accordingly.

[0003] In this context, DE 10 2017 219 790 A1 relates to a system for determining the pose of augmented reality glasses in a motor vehicle, comprising: at least one light source arranged in the motor vehicle for illuminating at least one windshield of the motor vehicle with light of a wavelength imperceptible to humans; an optical detection device arranged in the augmented reality glasses that can detect light of a wavelength imperceptible to humans; and a pose determination device for determining the pose of the augmented reality glasses based on the information detected by the optical detection device.

[0004] CN 208334627 U also relates to an electronic system for localizing sound sources, wherein the electronic system comprises a sound source localization module, the sound source localization module comprises a plurality of sound source collection units, the plurality of sound source collection units forming an array and collecting sound source data to localize the position where the sound source is located and to assign the sound-emitting object, and the position where the sound source is located is obtained based on the geometric positional relationship of the plurality of sound source collection units.

[0005] In this context, DE 10 2017 222 534 B3 further relates to a method for calibrating augmented reality glasses in a vehicle, comprising the steps of: sequentially illuminating a set of points in the interior of the vehicle; capturing at least a subset of the illuminated points by a camera arranged in the augmented reality glasses; and determining a transformation rule for the augmented reality glasses by comparing the subset of illuminated points captured by the camera with a known geometry of the set of points.

[0006] Furthermore, DE 10 2016 008 231 A1 relates to a method for generating a virtual view from a vehicle, in which images provided by several image acquisition units are evaluated in an image processing unit and superimposed directly in the field of vision at the head of a vehicle occupant, wherein the image processing unit creates a virtual image from the images provided by the image acquisition units designed as external cameras, which is displayed in augmented reality glasses or virtual reality glasses.

[0007] DE 10 2013 005 342 A1 relates to a motor vehicle control device comprising a head unit and at least one augmented reality glasses with a display, which is operationally connected to the head unit and a gaze direction sensor designed to detect head movements, wherein the gaze direction sensor is a position sensor arranged on the augmented reality glasses.

[0008] US Patent 2018 / 0056861 A1 concerns a vehicle-mounted augmented reality system. The system consists of a glasses device and a body-mounted device. The glasses device comprises a receiver module and a projection display module. The receiver module is configured to receive information from the vehicle's body-mounted device, and the projection display module is configured to perform a projection or display based on the received information.The vehicle body device comprises: a motion tracking module, an information acquisition module, a processing module, and a communication module, wherein the motion tracking module is configured to determine a position and / or orientation of the spectacle device; wherein the information acquisition module is configured to acquire vehicle-related information; wherein the processing module is configured to make the acquired information available to the spectacle device according to its position and / or orientation; and the communication module is configured to transmit the acquired information to the spectacle device.

[0009] It is also known from the prior art to provide a screen with variable transmission in the vehicle, and furthermore to provide light source detectors for methods for selectively dimming a display unit in the interior of the vehicle: US 2020 / 0026076 A1 relates to an assistance device for supporting the operation of a motor vehicle, comprising: a variable transmission screen positioned between a road scene in front of the motor vehicle and a driver of the motor vehicle, wherein the assistance device includes a plurality of sensors capable of reconstructing data representative of an environment in which the motor vehicle is located, wherein the assistance device is configured to drive at least one transmission coefficient of the variable transmission screen, and wherein the assistance device is configured to take into account the data recovered by the plurality of sensors and calculate the at least one transmission coefficient by combining the data.

[0010] US 2024 / 0319496 A1 relates to a method for selectively dimming an appropriate subset of a plurality of tiles (DTPTs) that are part of a continuous dimmable transparent panel (DTP), wherein the method comprises: using a processor and in a continuous feedback loop in real time: detecting, with a light source detector with an outward-facing sensor, the position of a light source within a volume adjacent to an outer surface of the DTP; determining, with a head / eye detector with an inward-facing sensor, the viewing direction of an observer within a volume adjacent to an inner surface of the DTP; determining an intersection point for a light beam extending from the position of the light source along the viewing direction of the observer; and selectively dimming the appropriate subset of DTPTs near the control panel intersection point.

[0011] DE 10 2016 225 082 A1 relates to a method for operating smart glasses, comprising the following steps: - Providing virtual objects for display on one or more display surfaces in the smart glasses; - Determining a pose of the smart glasses; - Providing positions of one or more handling objects; - Defining assigned masking areas for those handling objects that are in the field of view of the smart glasses, depending on the pose of the smart glasses; - Suppressing or modifying the display of one or more of the virtual objects in the assigned masking areas.

[0012] DE 10 2016 225 262 A1 relates to a method for operating smart glasses, comprising the following steps: - Providing virtual objects for display on one or more display surfaces in the smart glasses; - Detecting the position and / or movement of one or more operating body parts; - Upon detection that a wearer of the smart glasses intends to interact with a specific handling object, determining a masking area depending on the respective position of the one or more operating body parts; - Preventing the display of one or more of the virtual objects in the masking area.

[0013] DE 10 2022 123 223 A1 relates to a method for displaying visual content to a vehicle user, comprising the steps of: - visual display of the content either by a vehicle-mounted display device or by smart glasses worn by the user at least temporarily in the vehicle; - detection of a trigger event that is intended to initiate a transfer of the visual display of the content from a vehicle-mounted display by the vehicle-mounted display device to a smart glasses display, or vice versa;and- thereby triggered transmission of the display content with content coordination and temporal and / or spatial synchronization of its vehicle-bound and glasses-bound display via wireless communication between the data glasses on the one hand and the vehicle and / or the vehicle-bound display device on the other.;

[0014] DE 10 2022 106 648 A1 relates to a method for operating a display system with smart glasses in a motor vehicle, comprising the following steps: - Capturing a rear area of ​​the vehicle with a camera device to obtain a video stream; - Determining a pose of the smart glasses in a vehicle coordinate system; - Processing the video stream to obtain a mirrored video stream; - Displaying the mirrored video stream in the smart glasses using contact analog technology.

[0015] DE 10 2017 209 798 A1 relates to a method for operating a display system in a motor vehicle with smart glasses, comprising the following steps: - providing selected display information for display on at least one permanently installed display unit; - if the selected display information is perceptible to a wearer of the smart glasses, suppressing the display of a substitute display information that corresponds to or represents the selected display information.

[0016] Modern AR glasses can not only represent the color "black" through transparency, but also darken the glasses themselves through dimming to display black as true black. This dimming, or darkening, can be performed either globally or selectively. Global dimming reduces the view of the real world, so black is perceived as true black. Selective dimming allows individual regions or pixels on the display surface to be darkened. Dimming can help increase contrast and improve the readability of information on the AR glasses, especially in bright ambient light, by darkening distracting background elements. Examples of use cases for dimming include media playback, video conferencing, gaming, and navigation.

[0017] One problem here is that real-world objects may become invisible, even when this is crucial depending on the situation or context. For example, a touchscreen inside a vehicle might be obscured behind darkened glasses, making it unreadable and preventing any interaction. Therefore, the global dimming function of the AR glasses must be deactivated to ensure that the vehicle's screen remains visible and usable. The same applies to interactive elements, communication partners, other occupants, or important external elements that must remain visible.

[0018] The object of the invention is to improve the use of augmented reality glasses in the vehicle interior with one or more screens.

[0019] The invention is defined by the features of the independent claims. Advantageous further developments and embodiments are the subject of the dependent claims.

[0020] A first aspect of the invention relates to a system for automatically controlling the dimming of augmented reality glasses with a dimming function worn by an occupant of a vehicle, comprising: - an alignment determination unit designed and configured to determine the position and orientation of the augmented reality glasses relative to the vehicle and, based on the position and orientation, to determine the occupant's viewing direction relative to the vehicle; - an interface designed and configured to provide predefined surface areas of the vehicle; and - a control device designed and configured to adjust the dimming of the augmented reality glasses depending on the predefined surface areas and the viewing direction, wherein at least one of the surface areas is a surface of an electronic display unit in the interior of the vehicle, and wherein the control device is designed and configured to adjust the brightness and / or contrast of content displayed in the augmented reality glasses depending on content displayed on the display unit.

[0021] It is understood that the orientation determination unit for determining the position and orientation of the glasses can have a sensor system comprising several sensors, such as one or more cameras, an IMU, a brightness sensor, etc., whose acquired signals can be combined with other signal sources, such as GNSS. The glasses themselves can also have such a sensor system.

[0022] In this context, dimming and darkening refer both to the ability of augmented reality glasses (AR glasses) to change their transparency or opacity. Global dimming describes a method in which the entire display area of ​​the AR glasses is uniformly darkened to reduce the view of the real world and display black as true black. Selective dimming, on the other hand, uses a method in which only specific areas or pixels of the AR glasses' display are darkened to selectively alter certain parts of the field of view.

[0023] In order for virtual content to be positioned correctly within a vehicle, the pose (which describes the current position and rotation) of the augmented reality glasses relative to the vehicle must be determined continuously, as accurately as possible, and with minimal latency. The position of the glasses provides a reference point for the viewing direction, and the orientation determines the viewing direction itself. Therefore, the viewing direction, starting from the reference point, is suitable for determining the intersection of the viewing direction with a zone, particularly a surface area within the vehicle's interior.A large number of these surface areas in the interior of the vehicle are provided by the interface, whereby certain attributes can be assigned to the surface areas, in particular the attribute with the information that dimming of the glasses should be at least partially or completely canceled, or left unchanged, or even increased.

[0024] In particular, if a screen inside the vehicle is configured with the attribute that dimming should be disabled for this purpose, the dimming of the glasses can be interrupted when the gaze falls on the screen, thus enabling a clear view of the screen even while wearing the AR glasses inside the vehicle, even if the AR glasses were previously used in dimmed mode before the gaze fell on the screen.

[0025] This allows for the advantageous intelligent control of a global or selective dimming function, i.e., a darkening function, of AR glasses in the vehicle. The aim is, in particular, to control the dimming of the AR glasses depending on the situation and / or context, in order to ensure optimal vision and interaction with both the real world and the virtual world. In principle, this enables an ad-hoc switch between views in augmented reality and virtual reality.

[0026] Furthermore, this offers the advantage of improved visibility and readability, particularly of content displayed on a screen. In addition to a screen, other surface areas of the vehicle can also be specified for reducing the dimming effect of the augmented reality glasses, such as a rearview mirror inside the vehicle or an exterior mirror. These defined surface areas can thus be viewed without restriction, even while wearing the augmented reality glasses with previously activated high dimming, without having to remove the glasses. This is because the glasses automatically reduce the dimming when the user looks at these predefined surface areas, allowing them to be viewed without obstruction.Seamless interaction with the vehicle interface, such as the touchscreen, is therefore possible without having to remove the glasses. This approach can be flexibly applied to various use cases such as media playback, video conferencing, gaming, or navigation.

[0027] Furthermore, the contrast between virtual content and the real background can be enhanced, and the readability of text displayed on the augmented reality glasses can be improved, especially in bright ambient light. This advantageously ensures a clear view of important objects and displays in the vehicle, such as a touchscreen, by adjusting the dimming according to the situation.

[0028] Furthermore, in critical traffic situations, such as an impending hard braking maneuver, the dimming can be automatically lifted to give the user of the augmented reality glasses an unobstructed view of the outside world. Potential hazards can be recognized and avoided more quickly when the dimming is lifted or significantly reduced as needed. The context-dependent adjustment of the dimming based on current situations and / or the wearer's gaze direction further contributes to a more intuitive and user-friendly experience.

[0029] The implementation of so-called "diminished reality" makes it possible to remove distracting elements from the user's field of vision, further improving the visual experience. By selectively darkening distracting background elements, distractions are minimized.

[0030] According to an advantageous embodiment, the system further comprises a situation determination unit configured and designed to determine and evaluate the current traffic situation in the vehicle's vicinity according to a predefined rating scale, wherein the rating scale distinguishes at least between non-critical and critical traffic situations, and wherein the control device is configured and designed to adjust the dimming of the augmented reality glasses depending on the evaluation of the current traffic situation. The control device can be integrated into the vehicle or into the glasses.

[0031] According to a further advantageous embodiment, the control device is designed and configured to prevent the display of objects on the augmented reality glasses in the event of a current traffic situation assessed as critical.

[0032] According to another advantageous embodiment, at least one of the surface areas is a rearview mirror of the vehicle.

[0033] In a further advantageous embodiment, the control device is configured and designed to check an angle from the occupant's line of sight on the vehicle's display unit. This angle can be defined as a surface area, and an attribute containing information for dimming the augmented reality glasses can be assigned to the display unit. This attribute describes a predefined threshold for the perpendicular component of the angle defined as the surface area. If the perpendicular component of the angle defined as the surface area reaches or exceeds the predefined threshold, the dimming of the augmented reality glasses is at least partially deactivated. If the perpendicular component of the angle defined as the surface area falls below the predefined threshold, the augmented reality glasses are at least partially deactivated.

[0034] This makes it advantageous to achieve intelligent (situation-dependent and / or context-dependent) control of a global or selective dimming function of AR glasses in the vehicle.

[0035] Another aspect of the invention relates to a vehicle with a system as described above and below.

[0036] Advantages and preferred further developments of the proposed vehicle result from an analogous and substantive transfer of the above statements made in connection with the proposed system.

[0037] Another aspect of the invention relates to a method for automatically controlling the dimming of augmented reality glasses with a dimming function worn by an occupant of a vehicle, comprising: - Determining the position and orientation of the augmented reality glasses relative to the vehicle using an alignment unit, and based on the position and orientation: determining the driver's gaze direction relative to the vehicle using the alignment unit; - Providing one or more predefined surface areas of the vehicle through an interface; and - Adjusting the dimming of the augmented reality glasses via a control device depending on the predefined surface areas and the direction of view.

[0038] According to the invention, at least one of the surface areas is a surface of an electronic display unit in the interior of the vehicle, and the brightness and / or contrast of content displayed in the augmented reality glasses is adjusted depending on content displayed on the electronic display unit.

[0039] According to another advantageous embodiment, the method further comprises the following steps: - Determining and evaluating a current traffic situation in the vehicle's current environment according to a predefined rating scale, whereby the rating scale distinguishes at least between non-critical and critical traffic situations, and - Controlling the brightness and / or contrast of content displayed in the augmented reality glasses depending on the assessment of the current traffic situation.

[0040] Advantages and preferred further developments of the proposed procedure result from an analogous and substantive transfer of the above statements made in connection with the proposed system.

[0041] Further advantages, features and details will become apparent from the following description, in which - possibly with reference to the drawing - at least one embodiment is described in detail.

[0042] They show: Fig. 1: An interior of a vehicle with a system according to an embodiment of the invention. Fig. 2: An interior of a vehicle with a system according to a further embodiment of the invention. Fig. 3: A method for the automatic control of dimming according to an embodiment of the invention.

[0043] The representations in the figures are schematic and not to scale.

[0044] Fig. Figure 1 shows a section of a vehicle's interior and a system for automatically controlling the dimming of augmented reality glasses 1 with a dimming function worn by a vehicle occupant. An orientation determination unit serves to determine the position and orientation of the augmented reality glasses 1 relative to the vehicle. This is achieved, for example, by means of optical position and orientation detection using a camera. Alternatives are also possible, such as the arrangement of electronic or electromagnetic and / or acoustic transmitters or reflectors on the glasses 1. It is understood that the orientation determination unit for determining the position and orientation of the glasses 1 can include a sensor system comprising several sensors, such as one or more cameras, an IMU, a brightness sensor, etc., whose acquired signals can be combined with other signal sources, such as GNSS.The glasses (model 1) can also have such a sensor system.

[0045] Within the vehicle, the exact position and orientation of the glasses are known, allowing the occupant's gaze vectors to be precisely determined. These gaze vectors relative to the vehicle make it possible to define "regions of interest" (ROIs), i.e., specific areas in the user's field of vision relevant to a given situation or task. When a gaze vector encounters a "region of interest," this event can trigger a brightening or darkening of the glasses.

[0046] The ROIs comprise predefined surface areas 3 of the vehicle, such as screens in the vehicle interior and / or a rearview mirror and / or a side mirror, and are provided via an interface in which they are either pre-stored or determined in real time. It is understood that the list of predefined surface areas is not exhaustive, but may include, for example, further display elements, controls, vehicle geometries, etc. A control device 5 of the vehicle or a control device of the glasses 1 (not shown), in particular comprising GPU, CPU, memory unit, RAM, adjusts the dimming of the augmented reality glasses 1 based on this information. Since this can be coupled with an understanding of the respective use cases, very precise automatic control of the global and selective dimming can be achieved.If the augmented reality glasses 1 include the control unit not shown, this unit can be communicatively connected to the aforementioned sensor unit of the glasses 1. The aforementioned control device 5 of the vehicle can also be communicatively connected to the aforementioned alignment unit, which includes the sensor system.

[0047] A use case is a specific scenario or application in which the AR glasses are used, e.g., media playback, navigation, or communication. To correctly determine the "regions of interest" in a context-dependent manner, the vehicle geometry must be mapped while simultaneously taking into account any special equipment. Additional contextual information about the status of the use cases and the occupants is also considered.

[0048] In the example of the Fig. In the vehicle, the driver wears augmented reality glasses 1 with a dimming function. This is permissible because the vehicle is a highly automated vehicle that does not require driver intervention, at least during certain sections of the journey. The control device 5 checks the angle from the driver's line of sight to a screen in the vehicle, which is defined as a predefined surface area 3 of the interface. The screen is assigned the attribute that, under certain circumstances, the dimming of the augmented reality glasses 1 should be lifted when the driver's line of sight falls on the screen. If the perpendicular angle is less than a predefined threshold, the glasses 1 are set to transparent; otherwise, they are set to dark mode. The dark mode does not have to be the maximum dimming level; it can be predefined.This ensures that the touchscreen becomes visible when it is partially or fully visible in the lower area of ​​the glasses. Gradual dimming adjustments based on the angle could also be made if enough dimming levels are available.

[0049] Fig. Figure 2 shows another application example of the system. Here, the vehicle occupant wearing augmented reality glasses 1 is sitting in the passenger seat. The passenger is watching a video with global dimming set to 100% darkness. For example, the occupant wants to pause the video briefly and lowers their gaze towards the passenger display, which is defined as a predefined surface area 3 by the interface, to press the pause button. The system detects the lowered gaze towards the passenger display, e.g., a touchscreen, relative to the vehicle and brightens the global dimming so that the surroundings can be seen more clearly and the touchscreen can be interacted with more easily. As soon as the video restarts and the occupant looks up, the glasses 1 darken again. The following three further scenarios are based on the situation shown in Figure 2. Fig. 2 shown possible:

[0050] First: The occupant is sitting in the passenger seat wearing augmented reality glasses 1 while watching a video with global dimming set to 100% darkness. A situational awareness unit in the vehicle detects a complex traffic situation in which heavy braking is imminent. Glasses 1 brighten and the video pauses to give the occupant a clear view of the outside world so they can prepare for the situation.

[0051] Second: The occupant is wearing augmented reality glasses 1 and watching a video with global dimming set to 100% darkness. The occupant is sitting in the passenger seat and turns to face the driver to speak with him. The control device 5 sets the transparency level of the glasses 1 to 100% to allow for an undisturbed conversation.

[0052] Third: The occupant is sitting in the passenger seat wearing AR glasses with selective dimming while watching a video with global dimming set to 100% darkness. The system detects that the vehicle is passing through a construction zone, which is visually distracting. Using Diminished Reality, the glasses mask the construction zone and replace it with a more comfortable visual representation while the video continues to play. This provides an uninterrupted and more pleasant viewing experience. Diminished Reality allows specific elements from the real world to be virtually removed or hidden to enhance the occupant's visual experience.

[0053] It goes without saying that, unlike the Fig. 1 and Fig. 2. An occupant in a rear seat can also wear augmented reality glasses 1. This is particularly conceivable if the driver's seat and / or the front passenger seat has a screen on the side facing the occupant in the rear seat, and if at least 3DoF, preferably 6DoF, tracking of the augmented reality glasses 1 relative to the vehicle and the outside world is provided for all seats using the proposed system. 3DoF refers to 3 Degrees of Freedom Tracking, which relates to tracking the orientation of an object in three dimensions: roll (rotation around the Z-axis), pitch (rotation around the X-axis), and yaw (rotation around the Y-axis). This type of tracking is used to monitor the head movements of an occupant (or object in general) and adjust the view accordingly.

[0054] 6DoF: 6 Degrees of Freedom Tracking describes the complete freedom of movement of an object in a three-dimensional space. It encompasses both the three rotational axes and the three translational axes: Translational movements: Forward / Backward (X-axis) Left / Right (Y-axis) Up / Down (Z-axis) Rotational movements: Roll (rotation around the X-axis) Pitch (rotation around the Y-axis) Yaw (rotation around the Z-axis)

[0055] 6DoF tracking is used to precisely track and display the position and orientation of an occupant (or object in general). It enables more realistic and immersive interaction because it captures both movements and rotations in space.

[0056] Fig.Figure 3 shows a method for automatically controlling the dimming of augmented reality glasses 1 with dimming function worn by an occupant of a vehicle, comprising: - Determining S1 a position and orientation of the augmented reality glasses 1 relative to the vehicle by means of an orientation determination unit, and based on the position and orientation: determining a direction of view of the driver relative to the vehicle by means of the orientation determination unit; - Providing S2 from one or more predefined surface areas 3 of the vehicle through an interface; and - Setting S3 of a dimming of the augmented reality glasses 1 by a control device 5 depending on the predefined surface areas 3 and the direction of view.

[0057] Although the invention has been further illustrated and explained in detail by means of preferred embodiments, the invention is not limited by the disclosed examples, and other variations can be derived from them by a person skilled in the art without departing from the scope of protection of the invention. It is therefore clear that a multitude of possible variations exist. It is also clear that the embodiments mentioned as examples are truly only examples and are not to be understood in any way as limiting, for example, the scope of protection, the possible applications, or the configuration of the invention.Rather, the preceding description and the description of the figures enable the person skilled in the art to implement the exemplary embodiments in concrete terms, whereby the person skilled in the art, with knowledge of the disclosed inventive concept, can make various changes, for example with regard to the function or the arrangement of individual elements mentioned in an exemplary embodiment, without leaving the scope of protection defined by the claims and their legal equivalents, such as further explanations in the description. Reference symbol list 1 Augmented Reality Glasses 3 Predefined surface areas 5 Control device S1 Determine S2 Provision S3 Settings

Claims

[1] System for automatic control of dimming of augmented reality glasses (1) with dimming function worn by an occupant of a vehicle, comprising: - an orientation determination unit which is set up and designed to determine a position and orientation of the augmented reality glasses (1) relative to the vehicle and, based on the position and orientation, to determine a viewing direction of the occupant relative to the vehicle; - an interface designed and configured to provide predefined surface areas (3) of the vehicle; and - a control device (5) designed and configured to adjust the dimming of the augmented reality glasses (1) depending on the predefined surface areas (3) and the viewing direction, wherein at least one of the surface areas (3) is a surface of an electronic display unit in the interior of the vehicle, and wherein the control device (5) is designed and configured to adjust the brightness and / or contrast of content displayed in the augmented reality glasses (1) depending on content displayed on the display unit. [2] System according to claim 1, further comprising a situation determination unit which is configured and designed to determine and evaluate a current traffic situation in an environment of the vehicle according to a predetermined rating scale, wherein the rating scale distinguishes at least non-critical and critical traffic situations, wherein the control device (5) is configured and designed to adjust the dimming of the augmented reality glasses (1) depending on the evaluation of the current traffic situation. [3] System according to claim 2, wherein the control device (5) is configured and designed to prevent the display of objects on the augmented reality glasses (1) in the event of a current traffic situation assessed as critical. [4] System according to one of the preceding claims, wherein at least one of the surface areas (3) is a rearview mirror of the vehicle. [5] Vehicle with a system according to any of the preceding claims. [6] Method for automatically controlling the dimming of augmented reality glasses (1) with a dimming function worn by an occupant of a vehicle, comprising: - Determining (S1) a position and orientation of the augmented reality glasses (1) relative to the vehicle by means of an orientation determination unit, and based on the position and orientation: determining a direction of view of the driver relative to the vehicle by means of the orientation determination unit; - Provision (S2) of one or more predefined surface areas (3) of the vehicle through an interface; and - Adjusting (S3) the dimming of the augmented reality glasses (1) by means of a control device (5) depending on the predefined surface areas (3) and the direction of view, wherein at least one of the surface areas (3) is a surface of an electronic display unit in the interior of the vehicle and the adjustment of the brightness and / or contrast of content displayed in the augmented reality glasses (1) is dependent on content displayed on the electronic display unit. [7] Method according to claim 6, further showing the steps: - Determining and evaluating a current traffic situation in the vehicle's current environment according to a predefined rating scale, whereby the rating scale distinguishes at least between non-critical and critical traffic situations, and - Controlling the brightness and / or contrast of content displayed in the augmented reality glasses (1) depending on the assessment of the current traffic situation.

Citation Information

Patent Citations

  • A electronic system for sound localization

    CN208334627U

  • Motor vehicle control device has viewing direction sensor such as position sensor that is arranged at augmented reality glasses, to detect movements of head

    DE102013005342A1

  • Method and device for generating a virtual view from a vehicle

    DE102016008231A1

  • System and method for determining the pose of augmented reality glasses, system and method for measuring augmented reality glasses, method for supporting the determination of the pose of augmented reality glasses and a suitable motor vehicle for the method

    DE102017219790A1

  • Method, computer-readable storage medium with instructions, device and system for calibrating augmented reality glasses in a vehicle, vehicle suitable for the method and augmented reality glasses suitable for the method

    DE102017222534B3