Vehicle Camera Visibility Extension via Cumulative Virtual Image

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing visual reversing aid systems using cameras on vehicles face challenges in reconstructing obstacles at low speeds due to short stereoscopic base, requiring high precision sensors and costly calculation power, and can only reconstruct objects within the camera's field of view during two successive image acquisitions.

Innovation Solution

A method that generates a basic virtual image correlated with real images, characterizes points of interest, and builds a cumulative virtual image by superimposing new images on previous ones, with transparency adjustments based on color differences, allowing for extended visibility area without the need for high precision sensors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single image acquisition apparatus is used for visual reversing aid, then the system complexity is reduced, but the measurement precision of obstacle distance deteriorates

Engineering Contradiction:
Improvesystem complexityVSAvoidobstacle distance measurement precision
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent divides the obstacle detection task into two independent stages: (1) generating a basic virtual image from a single real image through pixel correlation with a planar surface model, and (2) extending visibility by superimposing multiple basic virtual images to form a cumulative virtual image. This segmentation allows each stage to be optimized independently, achieving extended visibility without requiring complex multi-camera systems.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transforms the 3D obstacle detection problem into a 2D virtual image generation problem by correlating pixels with a planar surface model. This dimensionality change simplifies the measurement process while maintaining accuracy, as the planar surface assumption provides sufficient constraints for distance calculation from a single image.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Speed

If the vehicle moves at low speed during maneuver, then the stereoscopic base becomes very short, but the three-dimensional image reconstruction becomes difficult

Engineering Contradiction:
Improvevehicle speedVSAvoidthree-dimensional image reconstruction precision
Core Design Contradiction:
SpeedVSManufacturing precision

Solution Approach 1:

The patent pre-establishes a planar surface model of the ground before image acquisition. This preliminary action provides a reference framework that allows accurate virtual image generation even when vehicle displacement between images is minimal, eliminating the need for large stereoscopic base that would otherwise be required.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates a basic virtual image that is a correlated copy of the real image, transformed according to the planar surface model. This copying process generates a top-down view that preserves distance information without requiring physical camera displacement, enabling accurate reconstruction at low speeds.

Inventive Principle:
Principle #26Copying

3Measurement precision

If successive image acquisitions are used for stereoscopic view, then obstacle distance can be determined, but the visibility area is limited to the camera field of view

Engineering Contradiction:
Improveobstacle distance determinationVSAvoidvisibility area
Core Design Contradiction:
Measurement precisionVSArea of stationary object

Solution Approach 1:

The patent merges multiple basic virtual images into a single cumulative virtual image through superimposition. This combining process extends the visibility area beyond the original camera field of view, as each new basic virtual image adds previously unseen areas while overlapping regions provide redundant distance measurements.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent continuously accumulates virtual images as the vehicle moves, maintaining an ever-expanding cumulative virtual image. This continuous accumulation ensures that the visibility area grows with vehicle displacement, providing extended coverage without requiring the camera to pan or tilt.

Inventive Principle:
Principle #20Continuity of useful action

4Measurement precision

If high precision sensors are used for obstacle detection, then the reconstruction accuracy is improved, but the device complexity and cost increase

Engineering Contradiction:
Improveobstacle detection accuracyVSAvoidsensor precision requirements
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces expensive high-precision sensors with a standard camera and computational algorithms. By using a single image acquisition apparatus with a planar surface model, the system achieves accurate obstacle detection without requiring costly specialized sensors, making the solution more economically viable.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Solution Approach 2:

The patent substitutes mechanical sensor precision requirements with computational image processing. Instead of relying on high-precision hardware sensors, the system uses pixel correlation algorithms and planar surface modeling to extract accurate distance measurements from standard camera images.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS8860810B2Method and device for extending a visibility area
Publication Date: 2014.10.14 PEUGEOT CITROEN AUTOMOBILES SA
  • US8860810B2 patent drawing
  • US8860810B2 patent drawing
  • US8860810B2 patent drawing

AI summary

In order to extend a visibility area of a camera mounted on a vehicle, the method of the invention comprises a step of generating a basic virtual image (I2v) in which a set of pixels of the basic virtual image is correlated with a set of pixels of a real image (I1R) captured by the camera while taking into account that the set of pixels of the real image reproduces a planar surface of the real world, and a step of building a virtual cumulative image (I3v) in which at least a portion of the basic virtual image (I2v) is superimposed on at least a portion of the cumulative virtual image (I3v) while coinciding the points of interest of the basic virtual image (I2v) with the points of interest of the cumulative virtual image (I3v).