AR Device Windshield Display for Driving Safety

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Drivers face challenges in maintaining awareness of their surroundings while driving, especially at high speeds, due to limited human vision and external factors like fatigue, which can compromise driving safety.

Innovation Solution

An augmented reality (AR) device is integrated into a car's center console to process images of the environment, detect parameters, calculate a cropping ratio coefficient, crop images, extract contour feature points, and display augmented reality images on the windshield, providing the driver with a comprehensive view of the surroundings.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the driver relies solely on human eyesight to observe the environment, then the driver can maintain natural driving operation, but the driver cannot clearly perceive dynamic environmental status due to limited vision and external factors

Engineering Contradiction:
Improveperception accuracy of environmental statusVSAvoidcomplexity of observation system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent merges the camera-based image capture system with the windshield display system to create an integrated observation enhancement system. The camera captures real-time images of the environment, processes them to extract contour features, and overlays these features onto the windshield, combining multiple functions into a unified system that enhances perception without requiring separate devices

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent creates a visual copy of the environmental contours and overlays it onto the windshield. By capturing the environment through a camera, processing the image to extract contour information, and displaying this copied visual information on the windshield, the system provides an enhanced representation of the environment that compensates for human vision limitations

Inventive Principle:
Principle #26Copying

2Loss of information

If the driver focuses attention on specific targets to improve perception, then the driver can obtain detailed information about those targets, but the driver cannot maintain comprehensive awareness of the entire environment

Engineering Contradiction:
Improvecomprehensive environmental informationVSAvoidtime to process environmental information
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent performs preliminary processing of environmental information by continuously capturing images with a camera and pre-processing them to extract contour features. This preparation work is done in advance so that when the driver needs to perceive environmental status, the processed contour information is already available for immediate display on the windshield, reducing the time required for the driver to comprehend environmental details

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent segments the environmental information processing into distinct components: image capture by camera, image processing to extract contours, and display on windshield. By dividing the comprehensive environmental information into detectable contour segments, the system enables the driver to perceive both individual target details and overall environmental status simultaneously through the overlaid contour features

Inventive Principle:
Principle #1Segmentation

3Reliability

If the AR device processes and displays augmented reality images, then the driver's situational awareness is improved, but the device complexity and processing requirements increase

Engineering Contradiction:
Improvedriving safetyVSAvoidcomplexity of AR processing system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent extracts only the essential contour feature information from the captured images and displays only these extracted features on the windshield. By taking out and displaying only the critical contour information rather than processing and displaying complete enhanced images, the system improves driving safety through essential visual cues while minimizing the processing burden and device complexity

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS10712556B2Image information processing method and augmented reality AR device
Publication Date: 2020.07.14 HUAWEI TECH CO LTD
  • US10712556B2 patent drawing
  • US10712556B2 patent drawing
  • US10712556B2 patent drawing

AI summary

An image information processing method includes obtaining, by an AR device, a first image including an image of a target object. The method includes detecting an environmental parameter of the AR device based on the first image. The method includes determining a cropping ratio coefficient of the first image based on the environmental parameter. The method includes cropping the first image based on the cropping ratio coefficient, to obtain a second image. The method includes extracting M contour feature points in a remaining image of the target object from the second image, to generate an AR image of the target object. The method includes displaying the AR image on a front windshield of a car.