AR Driving Assistance Cloud Image Merging

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Autonomous vehicles face limitations in data detection due to clustered neighboring vehicles or adverse weather conditions, which restricts accurate image and position data capture, impacting safe driving.

Innovation Solution

An apparatus and method that utilize a cloud server to provide panoramic images, combining them with limited data from image and position sensors to generate augmented-reality images, enabling accurate data detection and safe driving even in challenging conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If autonomous vehicles use sensors to collect data about surroundings, then driving route determination is enabled, but data detection is limited due to neighboring vehicles

Engineering Contradiction:

Improvedata detection accuracyVSAvoiddata limitation caused by neighboring vehicles

Core Design Contradiction:

ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent introduces a cloud server as an intermediary that receives images from multiple vehicles and generates panoramic images. This mediator allows vehicles to overcome physical blocking by neighboring vehicles, as the panoramic image provides comprehensive surrounding information that isn't blocked by adjacent vehicles

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent combines images from multiple vehicles and multiple time points to create a panoramic image. By merging data from different sources (multiple vehicles' cameras capturing different angles), the system achieves complete surrounding coverage that individual sensors cannot provide alone

Inventive Principle:

Principle #5Merging (Combining)

2Measurement precision

If sensors capture images for autonomous driving, then position data is obtained, but information is lost due to night or bad weather

Engineering Contradiction:

Improveposition data accuracyVSAvoidimage information loss in adverse conditions

Core Design Contradiction:

Measurement precisionVSLoss of information

Solution Approach 1:

The system performs preliminary actions by storing images captured during good weather conditions in the cloud server. When adverse weather occurs, these pre-stored images from normal conditions are retrieved and combined with current limited data, providing comprehensive information that compensates for the information loss during bad weather

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent uses panoramic images as copies of the surrounding environment that can be obtained from the cloud server. These panoramic images serve as reference copies that contain complete environmental information, allowing the system to compensate for information loss when direct sensing fails due to adverse conditions

Inventive Principle:

Principle #26Copying

Data Source

PatentUS11557201B2Apparatus for assisting driving of a host vehicle based on augmented reality and method thereof

Publication Date: 2023.01.17 HL KLEMOVE CORP

AI summary

An apparatus for assisting driving of a host vehicle based on augmented reality and a method thereof are provided. The apparatus for assisting driving of a host vehicle based on augmented reality includes an image sensor configured to capture an image of surroundings of the host vehicle, and a controller communicatively connected to the image sensor. The controller is configured to transmit the captured image to a cloud server through a wireless communicator, determine whether information about the captured image is lost due to the other vehicle neighboring the host vehicle, receive a panoramic image of a corresponding location from the cloud server through the wireless communicator if the information of the captured image is lost, process the received panoramic image in combination with the image, the information of which is lost, so as to generate an augmented-reality image, and perform autonomous driving according to the augmented-reality image or display the augmented-reality image on a display.