Vehicle Rear View Image Overlay for Virtual Bumper Distance Cues

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Rear view cameras and CMS cameras have different capturing field of views, making it challenging to provide a high-quality rear view image without including the vehicle's bumper in the CMS camera's field of view, which is essential for distance perception.

Innovation Solution

An image processing apparatus that generates a first image from a camera attached to a vehicle and superimposes an image representing the vehicle's body, such as a virtual bumper, onto the first image, adjusting the position based on vehicle speed to enhance distance perception.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single camera is used for both CMS and rear view functions, then device complexity and cost are reduced, but the capturing field of view cannot include both the subsequent vehicle and the vehicle bumper simultaneously

Engineering Contradiction:
Improvecamera system complexityVSAvoidcapturing field of view coverage
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent synthesizes images from two different camera angles (CMS camera and rear view camera) to create a composite rear view image. This dimensional approach allows the system to capture both the subsequent vehicle and the vehicle bumper in a single processed image, effectively resolving the field of view limitation without requiring additional physical cameras.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent introduces an image processing apparatus as an intermediary that receives images from the CMS camera and synthesizes them with virtual images of the vehicle bumper. This intermediary processing step enables the system to achieve both CMS monitoring and rear view display functions using a single camera system.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If the CMS camera captures a wider field of view to monitor subsequent vehicles, then monitoring capability is improved, but the vehicle bumper is excluded from the capturing field of view

Engineering Contradiction:
Improvemonitoring capabilityVSAvoidbumper image information
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The patent creates virtual images that copy the appearance and position of the vehicle bumper based on data from the rear view camera. These virtual bumper images are then superimposed onto the CMS camera output, allowing the bumper information to be restored in the final composite image without requiring the bumper to be physically visible in the CMS camera's field of view.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent merges the CMS camera image (providing wide-angle subsequent vehicle monitoring) with the rear view camera image (providing bumper information) into a single composite rear view image. This merging process combines the advantages of both camera systems, achieving both monitoring capability and bumper visibility.

Inventive Principle:
Principle #5Merging (Combining)

3Adaptability or versatility

If separate cameras are used for rear view and CMS functions, then capturing field of view requirements are met, but device complexity and cost increase

Engineering Contradiction:
Improvecapturing field of view coverageVSAvoidcamera system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent enables the CMS camera system to perform dual functions: both subsequent vehicle monitoring and rear view display. By using image processing to synthesize virtual bumper images and combine them with the CMS camera output, the system achieves multi-functionality with a single camera system, eliminating the need for separate dedicated rear view and CMS cameras.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11830104B2Image processing apparatus, camera system, and image processing method for superimposing an image representing a part of a vehicle body
Publication Date: 2023.11.28 SONY SEMICON SOLUTIONS CORP
  • US11830104B2 patent drawing
  • US11830104B2 patent drawing
  • US11830104B2 patent drawing

AI summary

An image processing apparatus includes a first signal processing unit for generating a first image of a first angle of view from an image captured by a camera attached to a vehicle body, and an image superimposing unit for superimposing an image representing a part of the vehicle body on the first image.