Reverse Assist Imaging With Spliced Top Views for Blind Spot Coverage

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current vehicle reverse assist technologies face challenges in providing comprehensive blind area coverage during reversing without increasing hardware costs and memory resource consumption, particularly in determining the position of static obstacles and relative vehicle position in posterior lateral views.

Innovation Solution

A reverse assist method that transforms images from a monocular camera into top plan views, splices intermediate images based on vehicle motion information to generate comprehensive reversing path images, reducing hardware costs and memory usage by updating images according to predetermined conditions such as displacement or time intervals.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If four wide-angle cameras are installed on the front, back, left and right sides of the car to solve blind area coverage, then the comprehensive view of reversing path is improved, but the hardware cost and memory resource consumption increase

Engineering Contradiction:
Improvecomprehensive view of reversing pathVSAvoidhardware cost and memory resource consumption
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent divides the reversing path view into multiple segments: current top plan view and historical top plan views. By segmenting the temporal and spatial information, the system can selectively process and store only necessary historical frames rather than continuous video data, reducing memory requirements while maintaining comprehensive path coverage.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary transformation of camera images into top plan views in advance during the reversing process. By pre-processing and storing only key historical top plan views rather than raw camera images, the system prepares information ahead of time for efficient retrieval and splicing, reducing real-time processing burden and memory requirements.

Inventive Principle:
Principle #10Preliminary action

2Loss of information

If continuous top plan views are generated and stored for the entire reversing path, then the comprehensive path image is improved, but the memory resource consumption increases

Engineering Contradiction:
Improvepath image coverageVSAvoidmemory resource consumption
Core Design Contradiction:
Loss of informationVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential historical top plan views that are necessary for constructing the comprehensive path image, rather than storing all intermediate frames. By selecting and storing only key historical moments during reversing, the system achieves complete path coverage with minimal memory consumption.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent discards redundant historical top plan views that are no longer needed for path reconstruction, and recovers only the essential ones when generating the final comprehensive path image. This selective retention and recovery strategy minimizes memory usage while maintaining complete path information.

Inventive Principle:
Principle #34Discarding and recovering

3Loss of information

If historical top plan views are spliced with current top plan view to show the complete reversing path, then the visibility of static obstacles is improved, but the image processing complexity increases

Engineering Contradiction:
Improvestatic obstacle position detectionVSAvoidimage processing complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent creates simplified copies of historical top plan views and current top plan views in a standardized format suitable for splicing. By using consistent coordinate systems and image formats across different time points, the system enables straightforward concatenation without complex alignment algorithms, reducing processing complexity while maintaining accurate static obstacle position information.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11780435B2Reverse assist method and system, image processor and corresponding drive assist system
Publication Date: 2023.10.10 BLACK SESAME TECH INC
  • US11780435B2 patent drawing
  • US11780435B2 patent drawing
  • US11780435B2 patent drawing

AI summary

The present disclosure provides a reverse assist method for a vehicle, comprising: transforming an i-th image in a reversing direction acquired by a camera unit at time Ti into an i-th top plan view, wherein i≥1; generating an i-th result image based on the i-th top plan view, wherein when i is greater than 1, the i-th top plan view and an intermediate image are spliced to generate an i-th result image; outputting the i-th result image; and wherein the intermediate image is a view transformed from an image of an outside environment in the reversing direction acquired at a time earlier than Ti, and the intermediate image is updated according to a predetermined condition during reversing.