Rearview Display Image Overlay for Motion Parallax Distance Cues

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing in-vehicle electronic mirrors struggle to provide a sense of distance through motion parallax, which is essential for driver perception.

Innovation Solution

An image processing apparatus that superimposes an image of a vehicle onto a captured rear image, allowing for the generation of motion parallax by adjusting the positional relationship based on the driver's viewpoint motion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a 3D model of individual subjects is generated from multi-viewpoint video images captured by multiple cameras to provide motion parallax, then a sense of distance can be provided, but the amount of calculation required becomes enormous

Engineering Contradiction:
Improvesense of distanceVSAvoidamount of calculation
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts only the essential element needed for motion parallax - the vehicle body image - and separates it from the captured rear scene. By displaying the captured image alone or with simple overlays rather than generating full 3D models of all subjects, the calculation burden is dramatically reduced while still providing the necessary sense of distance through the vehicle body reference

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent uses a captured image as a simplified copy or representation of the rear scene rather than creating detailed 3D models. This captured image copy provides sufficient spatial reference for motion parallax effects without requiring the computational resources needed for complete 3D reconstruction of all objects

Inventive Principle:
Principle #26Copying

2Device complexity

If the display image is made only from the captured image, then the system is simple, but it cannot provide a sense of distance by motion parallax

Engineering Contradiction:
Improvesystem simplicityVSAvoidsense of distance
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent merges the captured rear image with a computer-generated vehicle body image to create a composite display. This combination maintains system simplicity while adding the vehicle body reference needed for motion parallax, allowing the driver to perceive distance relationships between the vehicle and rear objects

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The vehicle body image serves as an intermediary element between the driver and the captured rear scene. By positioning this intermediate reference in the display, the system enables motion parallax perception without requiring complex processing of the entire rear scene

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS12296749B2Image processing apparatus, image processing method, and image processing system
Publication Date: 2025.05.13 SONY GROUP CORP
  • US12296749B2 patent drawing
  • US12296749B2 patent drawing
  • US12296749B2 patent drawing

AI summary

A display image is obtained by superimposing an image showing a vehicle on a captured image obtained by capturing an image on a rear side from the vehicle. For example, the image showing the vehicle is a computer graphics image. For example, a change is made in a superimposed positional relationship between the captured image and the image showing the vehicle in accordance with motion of a viewpoint of a driver. Since the display image is not only made from the captured image obtained by capturing an image on a rear side from the vehicle, but the display image is obtained by superimposing the image showing the vehicle on the captured image, it is possible to easily provide a sense of distance by motion parallax.