AR Smartglasses Mirror Display With 3D Rear Depth Perception
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing display systems for augmented reality smartglasses in vehicles fail to provide an effective perception of spatial depth and distance to surrounding objects in the rear vehicle environment, which can lead to delayed or missed hazard recognition.
Innovation Solution
A method and system that utilize an environment capture device with cameras and 3D capture technology to generate a spatial image representation of the rear vehicle environment, which is then communicated to smartglasses for stereoscopic presentation, enabling improved spatial perception of environment objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a virtual vehicle mirror is used to present the rear view to the driver, then the driver does not need to turn their head and convenience is improved, but the driver's ability to perceive spatial depth and distance to environment objects deteriorates
Solution Approach 1:
The patent transitions from 2D flat mirror images to 3D spatial representations by using depth cameras to capture depth information and generating three-dimensional environment objects with point clouds. This dimensional enhancement allows the driver to perceive both the convenience of a forward-facing display and accurate spatial depth and distance to objects.
Solution Approach 2:
The patent changes the parameter of image representation from standard 2D video to 3D spatial data by integrating depth information from depth cameras. The system generates depth maps, creates three-dimensional point clouds, and applies depth-of-field effects to restore natural depth perception, thereby improving measurement precision while maintaining ease of operation.
2Device complexity
If a flat 2D image is displayed to show the rear environment, then device complexity is reduced, but the ability to perceive spatial depth and distance deteriorates
Solution Approach 1:
The system adds a depth dimension to the display by using depth cameras to capture Z-axis information and generating three-dimensional point clouds. This allows spatial depth perception to be achieved without significantly increasing device complexity, as the depth information is integrated into the existing display pipeline.
Solution Approach 2:
The patent introduces intermediate processing steps including depth map generation, point cloud creation, and depth-of-field effect application. These intermediary elements bridge the gap between simple 2D display and complex 3D rendering, enabling spatial depth perception while managing device complexity through staged processing.
3Measurement precision
If traditional vehicle mirrors are used, then spatial depth perception is maintained, but the driver must turn their head which reduces convenience
Solution Approach 1:
The system creates a virtual copy of the rear environment that can be displayed in the driver's forward field of view. By using depth cameras and generating three-dimensional point clouds, this virtual copy preserves the spatial depth perception characteristics of traditional mirrors while eliminating the need for head turning, thereby improving driver convenience.
Solution Approach 2:
The patent enhances the traditional mirror function by adding depth information through depth cameras and creating three-dimensional representations. This dimensional enhancement allows the virtual mirror to maintain accurate spatial depth perception while being displayable in the driver's forward view, resolving the contradiction between convenience and depth perception.
4Measurement precision
If 3D spatial image representation is generated and presented in smartglasses, then spatial depth and distance perception is improved, but device complexity increases
Solution Approach 1:
The system implements 3D spatial image representation by integrating depth cameras with standard cameras to capture both 2D image and 3D depth information. The depth information is processed to create point clouds and depth maps that are rendered in the smartglasses, providing improved spatial perception while managing complexity through efficient depth processing algorithms.
Solution Approach 2:
The patent introduces intermediary processing components including depth map generation, point cloud creation, and depth-of-field effect application. These intermediary elements manage the complexity of 3D processing by breaking it down into manageable stages, allowing spatial depth perception to be achieved without overwhelming device complexity.
Data Source
AI summary
A method for operating a display system for smartglasses in a motor vehicle includes ascertaining a spatial image representation of a rear vehicle environment with the aid of an environment capture device includes a camera system for providing a camera image representation and a 3D capture device for providing a distance profile; communicating at least one portion of the spatial image representation of the rear vehicle environment as object information to the smartglasses; and performing contact-analog presentation of display images on a display surface of the smartglasses in a presentation region at a vehicle-fixed position, which region corresponds to a vehicle mirror position, wherein the display images are created stereoscopically depending on the spatial image representation of the rear vehicle environment with the aid of a graphics engine implemented in the smartglasses in order to enable a spatial presentation of environment objects of the rear vehicle environment.