Vehicle Surround-View Imaging for Glass and Reflective Object Positioning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image generation techniques for vehicle-periphery images struggle to accurately display light-transmissive objects like glass surfaces and reflective objects, leading to incorrect positioning and reduced visibility, which hampers safe driving by not providing a clear representation of these objects to the driver.

Innovation Solution

An image generating apparatus that acquires camera images from multiple cameras, calculates distances, detects the position of light-transmissive and reflective objects using polarized and infrared images, and generates images from a different viewpoint, ensuring these objects are displayed at their correct positions, using methods like stereo vision and light polarization characteristics to improve visibility.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional image generation techniques are used to map camera images in a predetermined space model, then the overall vehicle-periphery image can be generated, but light-transmissive objects like glass surfaces and reflective objects cannot be accurately positioned and displayed

Engineering Contradiction:
Improvepositioning accuracy of light-transmissive and reflective objectsVSAvoidvisibility and recognizability of light-transmissive and reflective objects
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent segments the image processing by separating light-transmissive and reflective objects from ordinary objects. It uses specialized processing paths: ordinary objects are mapped using conventional space model mapping, while light-transmissive and reflective objects are detected through polarization characteristics and infrared radiation, then positioned using stereo vision techniques. This segmentation allows each object type to be handled with appropriate methods, resolving the positioning accuracy problem.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the detection parameters for different object types. For light-transmissive objects, it uses polarization degree parameters to distinguish them from ordinary objects. For reflective objects, it uses infrared radiation characteristics. These parameter changes enable accurate detection and positioning that conventional methods miss, directly improving measurement precision for these specific object types.

Inventive Principle:
Principle #35Parameter changes

2Loss of information

If multiple cameras are used to capture images for three-dimensional position calculation, then the coverage and information quality improve, but the calculation complexity and cost increase

Engineering Contradiction:
Improveinformation quality of vehicle peripheryVSAvoidcalculation complexity and system cost
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent applies partial action by not processing all captured images through the full three-dimensional mapping pipeline. Instead, it uses a hybrid approach: conventional space model mapping for most areas, and selective stereo vision processing only for regions containing light-transmissive or reflective objects. This reduces calculation complexity while maintaining information quality where it matters most.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent introduces an intermediary detection step using polarization cameras and infrared sensors to identify objects requiring three-dimensional processing. This intermediary layer filters which regions need complex calculation, allowing the system to maintain high information quality for critical objects while avoiding unnecessary calculations for ordinary scenes, thus balancing complexity and information quality.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution effectively enhances the visibility and accurate positioning of light-transmissive and reflective objects in vehicle-periphery images, improving driver awareness and safety by providing clear and accurate representations of these objects, even in complex lighting conditions.

Implementation Method 1

detects a position of a light-transmissive object or a reflective object in the camera images

Methodology Applied
Scientific EffectLight polarization: Polarisation

Implementation Method 2

calculates a distance between one of the cameras and a target included in the camera images in a three-dimensional space by using the plurality of camera images

Methodology Applied
Scientific EffectStereo vision: Parallax

Implementation Method 3

generates an image from a point of view that is different from points of view of the plurality of camera images

Methodology Applied
Scientific EffectPoint of view transformation:

Data Source

PatentUS11948462B2Image generating apparatus, image generating method, and recording medium
Publication Date: 2024.04.02 PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
  • US11948462B2 patent drawing
  • US11948462B2 patent drawing
  • US11948462B2 patent drawing

AI summary

An image generating apparatus generates an image to be displayed on a display and includes at least one memory and a control circuit. The control circuit acquires a plurality of camera images captured by a plurality of cameras installed in a vehicle, calculates a distance between one of the cameras and a target to be projected in in the camera images, detects a position of a light-transmissive object or a reflective object in the camera images, and generates an image from a point of view that is different from points of view of the plurality of camera images by using the plurality of camera images and the distance, the generated image including a predetermined image that is displayed at the position of the light-transmissive object or the reflective object.