Sun visor as virtual display for optical augmented reality (ar) glasses

Abstract

The invention pertains to a system for augmented reality (AR) glasses 22 to enhance visibility and interaction for efficient and more interactive user experience. The system comprising of AR glasses,

Description

BACKGROUND Augmented Reality ( AR) glasses are a significant technological advancement that have the potential to revolutionize many aspects of our daily lives. They overlay digital information onto the user’s real-world view, enhancing their perception of reality. Augmented Reality (AR) glasses have found applications in various areas, including entertainment, education, and industry. However, the technology is relatively new and has not yet reached its full potential. One area where AR glasses could be particularly useful is in vehicles, where they could provide drivers with valuable information without distracting them from the road. However, the current state of AR glasses technology presents several challenges that limit their practicality in such applications. One of the main challenges is the brightness of the display. Given that AR glasses are typically used in brightly lit environments, the display must be sufficiently bright to ensure that the digital information is clearly visible. However, current AR glasses technologies are not capable of producing displays that are bright enough for practical use in outdoor settings or in vehicles. Another challenge is the battery life of the glasses. AR glasses require a significant amount of power to function, and current battery technologies are not able to provide enough power for the glasses to be used for extended periods of time. This is particularly problematic for use in vehicles, where the glasses would need to be used for the duration of a drive. Another issue with current AR glasses technologies is the visibility of different colors on the display. Depending on the level of tinting on the glasses, some colors may be more visible than others. This can make it difficult for users to view certain elements of the digital information that is overlaid on their real-world view. To address this issue, some have proposed using the sun visor in vehicles as a backing for the glasses' display. This would provide a darker background against which the digital information could be more clearly seen. However, this solution presents its own set of challenges, such as coordinating the display of the glasses with the position of the sun visor. In addition to the above challenges, AR glasses also need to be able to accurately track their position in physical space. This is essential for ensuring that the digital information is correctly overlaid on the user's real-world view. Current AR glasses technologies are capable of tracking the glasses' rotation (3 degrees of freedom) and position (6 degrees of freedom), but this tracking is not always accurate enough for practical use. Furthermore, the glasses need to be aware of the state of the sun visor (whether it is open or closed) in order to adjust the display accordingly. This could be achieved through electromechanical means built into the sunshade, or through computer vision detection on the glasses. However, both of these solutions have their own limitations and challenges. In light of these challenges, there is a need for a more effective solution. SUMMARY Example embodiments of the present invention provide an augmented reality (AR) system that enhances visibility and interaction possibilities by utilizing the sun visor of a vehicle as a backing for content. In an implementation the sun visor of a vehicle is used as a backing for a display, and by implementing mechanical means to improve the coordination between the AR glasses and the sun visor. The system also proposes to enhance the visibility of the display by adjusting the brightness and contrast based on the position of the sun visor. This could significantly improve the practicality and usability of AR glasses in vehicles. Example embodiments of the system offers tangible interaction affordance for hiding and showing content, thus improving user experience and design possibilities. Another objective of the present invention is to provide AR glasses equipped with a camera system running a computer vision algorithm or an electro-mechanical system that is aware of the state of the sun visor. This feature allows the glasses to adjust the display based on the sun visor's position, thereby enhancing visibility and contrast. Yet another objective of the present invention is to ensure compatibility of the system with existing vehicle systems and interfaces. The system can potentially be compatible with all current cars if it uses the computer vision approach to detect the sun visor state. According to one aspect of the present invention, the AR glasses include a display module configured to overlay visual content onto the environment visible through the lenses. The glasses are integrated with a camera system that captures real-time environmental data. A sun visor sensor module is operably connected to the AR glasses, wherein the sensor detects the position of a vehicle sun visor. A control unit is configured to adjust the brightness, contrast, or visibility of the visual content based on the detected position of the sun visor, wherein the control unit switches between different display modes depending on whether the sun visor is deployed. The system also includes a mechanical trigger module configured to automatically adjust the content displayed on the AR glasses based on the level of external light and the tint of the glasses. According to another aspect of the present invention, the AR glasses further comprise a computer vision algorithm configured to analyze real-time video feed from the camera system to detect environmental lighting conditions. The sun visor sensor module includes an electro-mechanical switch that detects whether the sun visor is fully or partially deployed. The control unit adjusts the color palette of the visual content to ensure optimal visibility of specific colors based on the external lighting conditions and sun visor state. The mechanical trigger module further adjusts the opacity or brightness of the AR glasses' lenses in response to detected sunlight intensity. The AR glasses are configured to trigger a display mode that darkens the background when the sun visor is detected in a down position to improve visibility of specific visual elements. The control unit stores historical data of sun visor positions and external lighting conditions to optimize future content adjustments. A computer-implemented method for enhancing augmented reality (AR) display visibility in a vehicle environment is also provided. The method involves capturing environmental data including lighting conditions by a camera system on AR glasses, detecting the position of a vehicle sun visor by a sensor module, adjusting the brightness or contrast of visual content displayed on the AR glasses based on the detected position of the sun visor and the lighting conditions by a control unit, triggering automatic switching of display modes to improve visibility when the sun visor is deployed by a mechanical trigger module, and adapting the color or tint of the visual content in response to the lighting conditions and the sun visor position by the control unit. The foregoing paragraphs have been provided by way of general introduction and are not intended to limit the scope of the following claims. The described embodiments, together with further advantages, will be best understood by reference to the following detailed description taken in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF DRAWINGS Fig. 1 relates to an AR glass system, according to an implementation of the invention; and Fig. 2 relates to an electro-mechanical switch, according to an implementation of the invention. DETAILED DESCRIPTION OF THE INVENTION Aspects of the present invention are best understood by reference to the description set forth herein. All the aspects described herein will be better appreciated and understood when considered in conjunction with the following descriptions. It should be understood, however, that the following descriptions, while indicating preferred aspects and numerous specific details thereof, are given by way of illustration only and should not be treated as limitations. Changes and modifications may be made within the scope herein without departing from the spirit and scope thereof, and the present invention herein includes all such modifications. The invention pertains to a system (10) for augmented reality (AR) glasses (22). The AR glasses include a display module (12) that overlays visual content onto the environment visible through the lenses. The display module enables the user to view digital content in their field of vision. This overlay of digital content can include a variety of information, such as navigation instructions, notifications, and other relevant data. The AR glasses are also equipped with a camera system. This camera system captures real-time environmental data, which is then processed and used to adjust the display of the AR glasses. The camera system might include one or more cameras, and these cameras can be positioned in various locations on the AR glasses. The camera system enables the glasses to understand and respond to the user's environment. The invention further includes a sun visor sensor module (14). This sensor module is operably connected to the AR glasses and detects the position of a vehicle's sun visor (24). The sun visor sensor module (14) can be implemented in a variety of ways, including but not limited to, an electro-mechanical switch (as shown in Fig 2), a segmented slip ring, or other suitable sensor technologies. The system also comprises a control unit (16). The control unit (16) adjusts the brightness, contrast, or visibility of the visual content based on the detected position of the sun visor (14). The control unit can switch between different display modes depending on whether the sun visor is deployed. The control unit (16) can be implemented using a variety of technologies, including but not limited to, a microcontroller, a microprocessor, or other suitable control technologies. A mechanical trigger module (18) is also included in the system. This module automatically adjusts the content displayed on the AR glasses based on the level of external light and the tint of the glasses. The mechanical trigger module (18) can be implemented using a variety of technologies, including but not limited to, a mechanical switch, a light sensor, or other suitable trigger technologies. The AR glasses further include a computer vision algorithm. This algorithm analyzes real-time video feed from the camera system to detect environmental lighting conditions. The computer vision algorithm can be implemented using a variety of techniques, including but not limited to, machine learning algorithms, image processing techniques, or other suitable computer vision techniques. The sun visor sensor module (14) can include an electro-mechanical switch (as shown in Fig. 2) that detects whether the sun visor is fully or partially deployed. This electromechanical switch can be implemented using a variety of technologies, including but not limited to, a mechanical switch, an electrical switch, or other suitable switch technologies. The control unit (16) can also adjust the color palette of the visual content to ensure optimal visibility of specific colors based on the external lighting conditions and sun visor state. This color adjustment can be implemented using a variety of techniques, including but not limited to, color correction algorithms, image processing techniques, or other suitable color adjustment techniques. The mechanical trigger module (18) can further adjust the opacity or brightness of the AR glasses' lenses in response to detected sunlight intensity. This adjustment can be implemented using a variety of techniques, including but not limited to, light intensity sensors, image processing techniques, or other suitable light adjustment techniques. The AR glasses can trigger a display mode that darkens the background when the sun visor is detected in a down position to improve visibility of specific visual elements. This display mode can be implemented using a variety of techniques, including but not limited to, image processing techniques, display control algorithms, or other suitable display mode techniques. The control unit (16) can also store historical data of sun visor positions and external lighting conditions to optimize future content adjustments. This data storage can be implemented using a variety of techniques, including but not limited to, data storage algorithms, database management systems, or other suitable data storage techniques. The invention also pertains to a computer-implemented method for enhancing augmented reality (AR) display visibility in a vehicle environment. The method involves capturing environmental data, detecting the position of a vehicle sun visor, adjusting the brightness or contrast of visual content, triggering automatic switching of display modes, and adapting the color or tint of the visual content. Each of these steps can be implemented using a variety of techniques, as described in the preceding paragraphs. The method can also involve using an electro-mechanical switch or segmented slip ring to monitor the visor’s state. This monitoring can be implemented using a variety of techniques, including but not limited to, switch technologies, slip ring technologies, or other suitable monitoring technologies. The method can further involve analyzing the real-time video feed from the camera system to detect changes in sunlight intensity and adjusting the display accordingly. This analysis and adjustment can be implemented using a variety of techniques, including but not limited to, image processing techniques, light intensity detection algorithms, or other suitable analysis and adjustment techniques. The method can also involve adjusting the visual content by modifying the color palette to improve the visibility of specific colors under different lighting conditions. This color adjustment can be implemented using a variety of techniques, including but not limited to, color collection algorithms, image processing techniques, or other suitable color adjustment techniques. The method can further involve darkening the background of the AR display when the sun visor (24) is in the down position to ensure certain content is more visible. This darkening can be implemented using a variety of techniques, including but not limited to, image processing techniques, display control algorithms, or other suitable darkening techniques. The method can also involve the control unit (16) dynamically switching between a high-brightness and low-brightness mode based on the detected external lighting and sun visor position. This dynamic switching can be implemented using a variety of techniques, including but not limited to, brightness control algorithms, image processing techniques, or other suitable dynamic switching techniques. The method can further involve storing data from previous adjustments to the AR display in various lighting and sun visor conditions to improve future content rendering. This data storage can be implemented using a variety of techniques, including but not limited to, data storage algorithms, database management systems, or other suitable data storage techniques. The present invention introduces an advanced system for augmented reality (AR) glasses, designed to enhance visibility and create an interactive user experience. Uniquely, this system leverages the sun visor of a vehicle, using it as a backdrop for displaying content while also serving as a tangible interaction medium for hiding or showing content. The AR glasses, equipped with a camera system running a computer vision algorithm, or alternatively connected to the car through electro-mechanics, are made aware of the state of the sun visor. The innovative elements of this system include AR glasses with a display module (12), designed to overlay visual content onto the visible environment through the lenses. This display module is configured to ensure that the virtual display viewable inside the glasses is superimposed upon the sun visor, taking advantage of its light-blocking properties to enhance contrast. This assists in improving visibility and providing an interactive experience for the user. The AR glasses (22) are also equipped with a camera system that captures real-time environmental data. This camera system might incorporate technologies that enable the glasses to have the ability to track the position and rotation of the user's head in the physical space. This could include technologies that offer three degrees of freedom (rotationally), or six degrees of freedom (rotationally and positionally), creating a more precise and responsive user experience. The system further includes a sun visor sensor module (14) which can detect the position of the sun visor. This sensor module may incorporate an electro-mechanical switch or a segmented slip ring (as shown in Fig. 2), or other types of sensor technologies influenced by the sun visor's state (either OPEN or CLOSED). Depending on the sun visor's position, the system's control unit adjusts the brightness, contrast, or visibility of the overlayed visual content, and switches between different display modes. Furthermore, the system introduces a mechanical trigger module (18), which automatically adjusts the displayed content on the AR glasses (22) guided by the level of external light and the tint of the glasses. This innovative feature allows for an adaptive viewing experience, tailoring the visual output to the fluctuating external lighting conditions and the tint of the glasses for the best possible visibility. The AR glasses (22) can also include a computer vision algorithm that serves to analyze the real-time video feed from the camera system. This facilitates the detection of environmental lighting conditions, enabling the glasses to adaptively respond to changes in external light, hi addition, the control unit adjusts the color palette of the visual content to optimize the visibility of specific colors based on the external lighting and the sun visor state. This capability to adjust the color palette dynamically adds a further layer of adaptability and customization to the system. A distinctive display mode can be triggered by the AR glasses when the sun visor is in a down position. This mode darkens the background, thereby improving the visibility of specific visual content elements. In this way, the system ensures optimum visibility of digital content across varying lighting conditions and sun visor positions. The control unit also holds the capacity to store historical data regarding sun visor positions and external lighting conditions. This data can be utilized to optimize future content adjustments, making the system more intuitive and user-responsive over time. The functionality of this invention not only provides better visibility, but also enhances interaction and user experience in various lighting conditions and environments. The current invention utilizes AR glasses as the display technology, creating a more personalized and immersive user experience. As variations of the invention, the AR glasses could be designed to use different types of transparent Head Mounted Display (HMD) technologies, such as current wave guide or birdbath technology. The glasses can also be equipped with cameras or depth sensors to enhance tracking abilities. The system may also be updated to detect the sun visor state through computer vision, making the system hypothetically compatible with all current cars. The invention, therefore, introduces advanced features and versatility to the domain of augmented reality, offering a unique combination of visibility, interaction, and user experience. The advantages of the present invention are numerous. It eliminates the need for physical touch screen displays, providing an interactive and immersive experience that is directly in the user's line of view. Its ability to adapt to varying lighting conditions and blend with the vehicle's sun visor provides an enhanced visibility of digital content. This not only augments the user experience but also contributes to user safety, particularly in the context of vehicle operation. Potential applications of the invention range widely across various sectors. For example, it can be useful for drivers who need real-time information such as navigation instructions, vehicle status updates or traffic alerts, without having to shift their focus away from the road. It can also be used in professional fields such as construction, engineering, or healthcare, where AR glasses can augment professionals' real-world view with helpful information. The system is further applicable in immersive entertainment and gaming experiences, providing users with a seamless blend of the real and digital worlds right before their eyes. With its distinctive features and wide-ranging applications, the present invention significantly advances the realm of augmented reality technology. The embodiments of the present invention disclosed herein are intended to be illustrative and not limiting. Other embodiments are possible and modifications may be made to the embodiments without departing from the spirit and scope of the invention. As such, these embodiments are only illustrative of the inventive concepts contained herein.

Claims

1. A system for augmented reality (AR) glasses, comprising:AR glasses including a display module configured to overlay visual content onto the environment visible through the lenses;a camera system integrated into the AR glasses, the camera system capturing real-time environmental data;a sun visor sensor module operably connected to the AR glasses, wherein the sensor detects the position of a vehicle sun visor;a control unit configured to adjust the brightness, contrast, or visibility of the visual content based on the detected position of the sun visor, wherein the control unit switches between different display modes depending on whether the sun visor is deployed;a mechanical trigger module configured to automatically adjust the content displayed on the AR glasses based on the level of external light and the tint of the glasses.

2. The system of claim 1, wherein the AR glasses further comprise a computer vision algorithm configured to analyze real-time video feed from the camera system to detect environmental lighting conditions.

3. The system of claim 1, wherein the sun visor sensor module includes an electromechanical switch that detects whether the sun visor is fully or partially deployed.

4. The system of claim 1, wherein the control unit adjusts the color palette of the visual content to ensure optimal visibility of specific colors based on the external lighting conditions and sun visor state.

5. The system of claim 1, wherein the mechanical trigger module further adjusts the opacity or brightness of the AR glasses' lenses in response to detected sunlight intensity.

6. The system of claim 1, wherein the AR glasses are configured to trigger a display mode that darkens the background when the sun visor is detected in a down position to improve visibility of specific visual elements.

7. The system of claim 1, wherein the control unit stores historical data of sun visor positions and external lighting conditions to optimize future content adjustments.

8. A computer-implemented method for enhancing augmented reality (AR) display visibility in a vehicle environment, comprising:capturing, by a camera system on AR glasses, environmental data including lighting conditions;detecting, by a sensor module, the position of a vehicle sun visor;adjusting, by a control unit, the brightness or contrast of visual content displayed on the AR glasses based on the detected position of the sun visor and the lighting conditions;triggering, by a mechanical trigger module, automatic switching of display modes to improve visibility when the sun visor is deployed;adapting, by the control unit, the color or tint of the visual content in response to the lighting conditions and the sun visor position.

9. The method of claim 8, wherein detecting the position of the sun visor includes using an electro-mechanical switch or segmented slip ring to monitor the visor’s state.

10. The method of claim 8, further comprising analyzing the real-time video feed from the camera system to detect changes in sunlight intensity and adjusting the display accordingly.

11. The method of claim 8, wherein adjusting the visual content includes modifying the color palette to improve the visibility of specific colors under different lighting conditions.

12. The method of claim 8, further comprising darkening the background of the AR display when the sun visor is in the down position to ensure certain content is more visible.

13. The method of claim 8, wherein the control unit dynamically switches between a high-brightness and low-brightness mode based on the detected external lighting and sun visor position.

14. The method of claim 8, further comprising storing data from previous adjustments to the AR display in various lighting and sun visor conditions to improve future content rendering.

Images