Sun visor as a virtual display for augmented reality (AR) glasses

Abstract

The invention relates to an augmented reality (AR) system for eyeglasses that enhances visibility and interaction by using a vehicle's sun visor as a background for content and as an interaction medium. The AR glasses, equipped with a camera system and a sun visor sensor module, can detect the status of the sun visor (open or closed) either via computer vision or electromechanically. The glasses' display module overlays visual content onto the sun visor, utilizing its light-blocking properties to increase contrast. The system's control unit adjusts the brightness, contrast, or visibility of the content depending on the sun visor's position and allows switching between different display modes. The system offers a more interactive user experience, improved visibility, and efficient integration into existing vehicle systems.

Description

BACKGROUND

[0001] Augmented reality (AR) glasses represent a significant technological advancement with the potential to revolutionize many aspects of our daily lives. They overlay the user's real-world view with digital information, thereby enhancing their perception of reality. AR glasses are finding applications in various fields, including entertainment, education, and industry. However, the technology is relatively new and has not yet reached its full potential. One area where AR glasses could be particularly useful is in vehicles, where they could provide drivers with valuable information without distracting them from the road. However, with the current state of AR glasses technology, there are some limitations that restrict their practicality in such applications.

[0002] One of the main challenges is display brightness. Since AR glasses are typically used in brightly lit environments, the display needs to be sufficiently bright for the digital information to be clearly visible. However, current AR glasses technologies are unable to produce displays bright enough for practical outdoor or in-vehicle use. Another challenge is battery life. AR glasses require a significant amount of power to operate, and current battery technologies cannot provide enough energy to power the glasses for extended periods. This is particularly problematic for in-vehicle use, where the glasses need to be worn for the duration of a journey.

[0003] Another problem with current AR glasses technologies is the visibility of different colors on the display. Depending on the tint of the glasses, some colors are more visible than others. This can make it difficult for the user to recognize certain elements of the digital information that overlay their real-world view. To solve this problem, it has been suggested to use the sun visors in vehicles as a background for the glasses' display. This would create a darker background against which the digital information would be more visible. However, this solution presents a number of challenges, such as coordinating the glasses' display with the position of the sun visor.

[0004] In addition to the challenges mentioned above, AR glasses must also be able to accurately track their position in physical space. This is the only way to ensure that the digital information is correctly superimposed on the user's real-world view. Current AR glasses technologies can track the rotation (3 degrees of freedom) and position (6 degrees of freedom) of the glasses, but this tracking is not always accurate enough for practical use. Furthermore, the glasses need to know the status of the sun visor (whether it is open or closed) to adjust the display accordingly. This could be achieved through electromechanical means built into the sun visor or through computer vision detection on the glasses themselves. However, both solutions have their own limitations and challenges.

[0005] In light of these challenges, there is a need for a more effective solution. SUMMARY

[0006] Exemplary embodiments of the present invention provide an augmented reality (AR) system that improves visibility and interaction possibilities by using the sun visor of a vehicle as a carrier for content.

[0007] In one implementation, a vehicle's sun visor is used as a mount for a display, and mechanical means are implemented to improve the coordination between the AR glasses and the sun visor. The system also proposes enhancing the display's visibility by adjusting brightness and contrast based on the sun visor's position. This could significantly improve the practicality and usability of AR glasses in vehicles.

[0008] Exemplary embodiments of the system offer tangible interaction possibilities for showing and hiding content, thus improving the user experience and the design possibilities. A further objective of the present invention is to provide AR glasses equipped with a camera system running a computer vision algorithm or an electromechanical system that detects the position of the sun visor. This allows the glasses to adjust the display according to the position of the sun visor, thereby improving visibility and contrast.

[0009] A further objective of the present invention is to ensure the system's compatibility with existing vehicle systems and interfaces. The system can potentially be compatible with all current cars if it uses a computer vision approach to detect the sun visor's status.

[0010] According to one aspect of the present invention, the AR glasses comprise a display module configured to overlay visual content onto the environment visible through the lenses. The glasses are integrated with a camera system that captures environmental data in real time. A sun visor sensor module is functionally connected to the AR glasses, the sensor detecting the position of a vehicle's sun visor. A control unit is configured to adjust the brightness, contrast, or visibility of the visual content based on the detected position of the sun visor, switching between different display modes depending on whether the sun visor is deployed. The system also includes a mechanical trigger module configured to automatically adjust the content displayed on the AR glasses based on the intensity of the ambient light and the tint of the lenses.

[0011] According to another aspect of the present invention, the AR glasses further comprise a computer vision algorithm configured to analyze the real-time video data from the camera system to detect ambient lighting conditions. The sun visor sensor module includes an electromechanical switch that detects whether the sun visor is fully or partially extended. The control unit adjusts the color palette of the visual content to ensure optimal visibility of specific colors based on the ambient light conditions and the state of the sun visor. The mechanical trigger module also adjusts the opacity or brightness of the AR glasses lenses depending on the detected sunlight intensity.The AR glasses are configured to trigger a display mode that darkens the background when the sun visor is detected in a lowered position, thus improving the visibility of certain visual elements. The control unit stores historical data on sun visor positions and external conditions to optimize future content settings.

[0012] A computer-implemented method for improving the visibility of augmented reality (AR) displays in a vehicle environment is also provided. The method includes capturing environmental data, including lighting conditions, via a camera system on AR glasses; detecting the position of a vehicle sun visor via a sensor module; adjusting the brightness or contrast of the visual content displayed on the AR glasses based on the detected position of the sun visor and the lighting conditions via a control unit; triggering automatic switching of display modes to improve visibility when the sun visor is deployed via a mechanical trigger module; and adjusting the color or hue of the visual content in response to the lighting conditions and the position of the sun visor via the control unit.

[0013] The preceding sections were given as a general introduction and are not intended to limit the scope of the following claims. The described embodiments and further advantages are best understood by referring to the following detailed description in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS Fig. Figure 1 shows an AR glass system according to an embodiment of the invention; and Fig. Figure 2 shows an electromechanical switch according to an embodiment of the invention. DETAILED DESCRIPTION OF THE INVENTION

[0014] Aspects of the present invention are best understood by reference to the description contained herein. All aspects described herein will be better appreciated and understood when considered in conjunction with the following descriptions. However, it should be understood that the following descriptions, while indicating preferred aspects and numerous specific details thereof, are given for illustrative purposes only and should not be treated as limitations. Changes and modifications may be made within the scope of the present description without departing from the spirit and scope of the description, and the present invention includes all such modifications.

[0015] The invention relates to a system (10) for augmented reality (AR) glasses (22). The AR glasses include a display module (12) that overlays visual content onto the environment visible through the lenses. The display module enables the user to see digital content in their field of vision. This overlay of digital content can include a variety of information, such as navigation instructions, notifications, and other relevant data.

[0016] The AR glasses are also equipped with a camera system. This system captures environmental data in real time, which is then processed and used to adjust the AR glasses' display. The system can include one or more cameras that can be positioned at different locations on the AR glasses. The camera system allows the glasses to understand and react to the user's surroundings.

[0017] The invention further comprises a sun visor sensor module (14). This sensor module is functionally connected to the AR glasses and detects the position of the sun visor of a vehicle (24). The sun visor sensor module (14) can be implemented in various ways, including, but not limited to, an electromechanical switch (as in Fig. 2 shown), a segmented slip ring or other suitable sensor technologies.

[0018] The system also includes a control unit (16). The control unit (16) adjusts the brightness, contrast, or visibility of the visual content depending on the detected position of the sun visor (14). Depending on whether the sun visor is extended, the control unit can switch between different display modes. The control unit (16) can be implemented using a variety of technologies, including, but not limited to, a microcontroller, a microprocessor, or other suitable control devices.

[0019] A mechanical trigger module (18) is also part of the system. This module automatically adjusts the content displayed on the AR glasses depending on the intensity of the ambient light and the tint of the glasses. The mechanical trigger module (18) can be implemented using a variety of technologies, including, but not limited to, a mechanical switch, a light sensor, or other suitable triggering technologies.

[0020] The AR glasses also incorporate a computer vision algorithm. This algorithm analyzes the real-time video images from the camera system to detect ambient lighting conditions. The computer vision algorithm can be implemented using a variety of techniques, including but not limited to machine learning algorithms, image processing techniques, or other suitable computer vision techniques.

[0021] The sun visor sensor module (14) can have an electromechanical switch (as in Fig. (2 shown) contains a sensor that detects whether the sun visor is fully or partially deployed. This electromechanical switch can be implemented using a variety of technologies, including, but not limited to, a mechanical switch, an electrical switch, or other suitable switching technologies.

[0022] The control unit (16) can also adjust the color palette of the visual content to ensure optimal visibility of certain colors depending on the external lighting conditions and the state of the sun visor. This color adjustment can be achieved using a variety of techniques, including, but not limited to, color correction algorithms, image processing techniques, or other suitable color adjustment techniques.

[0023] The mechanical trigger module (18) can also adjust the opacity or brightness of the AR glasses lenses depending on the detected sunlight intensity. This adjustment can be made using a variety of techniques, including, but not limited to, light intensity sensors, image processing techniques, or other suitable techniques for adjusting the light.

[0024] The AR glasses can trigger a display mode that darkens the background when the sun visor is detected in a lowered position, in order to improve the visibility of certain visual elements. This display mode can be implemented using a variety of techniques, including, but not limited to, image processing techniques, display control algorithms, or other suitable display mode techniques.

[0025] The control unit (16) can also store historical data of sun visor positions and external conditions to optimize future settings of the contents. This container can be implemented using a variety of techniques, including, but not limited to, data storage algorithms, database management systems, or other suitable data storage techniques.

[0026] The invention also relates to a computer-implemented method for improving the visibility of augmented reality (AR) displays in a vehicle environment. The method includes acquiring environmental data, detecting the position of a vehicle's sun visor, adjusting the brightness or contrast of the visual content, triggering automatic switching of display modes, and adjusting the color or hue of the visual content. Each of these steps can be performed using a variety of techniques, as described in the preceding sections.

[0027] The procedure may also involve the use of an electromechanical switch or a segmented slip ring to monitor the sight's condition. This monitoring can be performed using a variety of techniques, including, but not limited to, switch technologies, slip ring technologies, or other suitable monitoring technologies.

[0028] The procedure can further include analyzing the real-time video images from the camera system to detect changes in sunlight intensity and adjust the display accordingly. This analysis and adjustment can be performed using a variety of techniques, including, but not limited to, image processing techniques, light intensity detection algorithms, or other suitable analysis and adjustment methods.

[0029] The process may also involve adjusting the visual content by modifying the color palette to improve the visibility of certain colors under different conditions. This color adjustment can be accomplished using a variety of techniques, including, but not limited to, color correction algorithms, image processing techniques, or other suitable color adjustment techniques.

[0030] The method may further include darkening the background of the AR display when the sunshade (24) is in the lowered position to ensure that certain content is more visible. This darkening can be achieved using a variety of techniques, including, but not limited to, image processing techniques, display control algorithms, or other suitable darkening techniques.

[0031] The method can also include the control unit (16) dynamically switching between a high-brightness mode and a low-brightness mode based on the detected external lighting and the position of the sun visor. This dynamic switching can be implemented using a variety of techniques, including, but not limited to, brightness control algorithms, image processing techniques, or other suitable dynamic switching techniques.

[0032] The method can further involve storing data from previous AR display settings under various lighting and sunshade conditions to improve the rendering of future content. This storage can be implemented using a variety of techniques, including, but not limited to, data storage algorithms, database management systems, or other suitable data storage techniques.

[0033] The present invention presents an advanced augmented reality (AR) glasses system designed for enhanced visibility and an interactive user experience. This unique system utilizes a vehicle's sun visor as a background for displaying content and simultaneously serves as a tangible interaction medium for hiding or revealing content. The AR glasses, equipped with a camera system running a computer vision algorithm or alternatively connected to the car via an electromechanical link, detect the state of the sun visor.

[0034] Among the innovative elements of this system is an AR headset with a display module (12) designed to project visual content through the lenses into the visible environment. This display module is configured so that the virtual display visible in the headset overlays the sun visor, utilizing its light-blocking properties to enhance contrast. This improves visibility and provides the user with an interactive experience.

[0035] The AR glasses (22) are also equipped with a camera system that captures environmental data in real time. This camera system could include technologies that allow the glasses to track the position and rotation of the user's head in physical space. This could include technologies that offer three degrees of freedom (in terms of rotation) or six degrees of freedom (in terms of rotation and position), thus enabling a more precise and responsive user experience.

[0036] The system further includes a sun visor sensor module (14) that can detect the position of the sun visor. This sensor module can be an electromechanical switch or a segmented slip ring (as in Fig.(2 shown) or other types of sensor technologies that are affected by the state of the sun visor (either open or closed). Depending on the position of the sun visor, the system's control unit adjusts the brightness, contrast, or visibility of the displayed content and switches between different display modes.

[0037] Furthermore, the system features a mechanical trigger module (18) that automatically adjusts the content displayed on the AR glasses (22) according to the intensity of the ambient light and the tint of the glasses. This innovative function enables a customizable viewing experience by adapting the visual output to fluctuating ambient light conditions and the tint of the glasses to ensure optimal vision.

[0038] The AR glasses (22) can also include a computer vision algorithm that analyzes the real-time video feed from the camera system. This enables the detection of ambient lighting conditions, allowing the glasses to adapt to changes in the outside light. Furthermore, the control unit adjusts the color palette of the visual content to optimize the visibility of certain colors depending on the outside lighting and the position of the sun visor. This ability to dynamically adjust the color palette adds another layer of adaptability and personalization to the system.

[0039] A special display mode can be activated by the AR glasses when the sun visor is in the lowered position. This mode darkens the background, thus improving the visibility of certain visual content. In this way, the system ensures optimal visibility of digital content under different conditions and sun visor positions. The control unit can also store historical data on sun visor positions and external conditions. This data can be used to optimize future content settings, making the system more intuitive and responsive to user needs over time.

[0040] The functionality of this invention not only offers improved vision but also enhances user interaction and experience in various states and environments. The current invention utilizes AR glasses as the display technology, creating a more personalized and immersive user experience.

[0041] Variations of the invention allow the AR glasses to be designed to utilize various types of transparent head-mounted display (HMD) technologies, such as current waveguide or birdbath technology. The glasses can also be equipped with cameras or depth sensors to enhance tracking capabilities. Furthermore, the system can be upgraded to detect the sun visor's status using computer vision, theoretically making it compatible with all current cars. The invention thus introduces advanced features and versatility to the field of augmented reality, offering a unique combination of visibility, interaction, and user experience.

[0042] The advantages of the present invention are numerous. It eliminates the need for physical touchscreens and offers an interactive and immersive experience directly within the user's field of vision. Its ability to adapt to different conditions and blend seamlessly with the vehicle's sun visor ensures improved visibility of the digital content. This not only enhances the user experience but also contributes to user safety, particularly in relation to vehicle operation.

[0043] The invention has a wide range of applications and encompasses various fields. For example, it can be useful for drivers who need real-time information such as navigation instructions, vehicle status updates, or traffic warnings without having to take their attention off the road. It can also be used in professional fields such as construction, engineering, or healthcare, where AR glasses can augment the real-world view of professionals with helpful information. The system is also suitable for immersive entertainment and gaming experiences, providing users with a seamless fusion of the real and digital worlds. With its unique features and broad range of applications, the present invention significantly advances augmented reality technology.

[0044] The embodiments of the present invention shown here are for illustrative purposes only and are not limiting. Other embodiments are possible, and modifications to the embodiments may be made without departing from the spirit and scope of the invention. As such, these embodiments are merely an illustration of the inventive concepts contained herein.

Claims

[1] System for glasses with augmented reality (AR), comprising: AR glasses with a display module configured to overlay visual content onto the environment visible through the lenses; a camera system integrated into the AR glasses that captures environmental data in real time; a sun visor sensor module that is functionally connected to the AR glasses, wherein the sensor detects the position of a sun visor of the vehicle; a control unit configured to adjust the brightness, contrast, or visibility of the visual content based on the detected position of the sun visor, with the control unit switching between different display modes depending on whether the sun visor is deployed; a mechanical trigger module configured to automatically adjust the content displayed on the AR glasses depending on the intensity of the ambient light and the tint of the glasses. [2] System according to claim 1, wherein the AR glasses further comprise a computer vision algorithm configured to analyze the real-time video input from the camera system to detect the ambient lighting conditions. [3] System according to claim 1, wherein the sun visor sensor module comprises an electromechanical switch that detects whether the sun visor is fully or partially deployed. [4] System according to claim 1, wherein the control unit adjusts the color palette of the visual content to ensure optimal visibility of certain colors based on the external lighting conditions and the condition of the sun visor. [5] System according to claim 1, wherein the mechanical trigger module also adjusts the opacity or brightness of the lenses of the AR glasses depending on the detected sunlight intensity. [6] System according to claim 1, wherein the AR glasses are configured to trigger a display mode that darkens the background when the sun visor is detected in a lower position in order to improve the visibility of certain visual elements. [7] System according to claim 1, wherein the control unit stores historical data of the positions of the sun visors and the states of the external lighting in order to optimize future settings of the content. [8] Computer-implemented method for improving the visibility of augmented reality (AR) displays in a vehicle environment, comprising the following: Capturing environmental data, including lighting conditions, using a camera system on AR glasses; Detecting the position of a vehicle's sun visor using a detection module; Adjusting the brightness or contrast of the visual content displayed on the AR glasses by a control unit based on the detected position of the sun visor and the lighting conditions; Automatic switching of display modes is triggered by a mechanical release module to improve visibility when the sun visor is extended; Adjusting the color or hue of the visual content by the control unit depending on the states and position of the sun visor. [9] Method according to claim 8, wherein detecting the position of the sun visor comprises the use of an electromechanical switch or a segmented slip ring to monitor the condition of the sun visor. [10] The method according to claim 8 further comprises the analysis of the real-time video feed from the camera system to detect changes in sunlight intensity and to adjust the display accordingly. [11] Method according to claim 8, wherein adjusting the visual content includes modifying the color palette to improve the visibility of certain colors under different conditions. [12] The method according to claim 8 further comprises darkening the background of the AR display when the sun visor is in the lower position to ensure that certain content is more visible. [13] Method according to claim 8, wherein the control unit dynamically switches between a high brightness mode and a low brightness mode based on the detected external lighting and the position of the sun visor. [14] The method according to claim 8 further comprises storing data of previous AR display settings under different lighting and sun visor conditions to improve the reproduction of future content.

Images