Rear Camera Mirror Imaging for Motion Parallax and Visual Field Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional in-vehicle electronic mirrors fail to effectively provide a sense of distance through motion parallax, which is crucial for driving, as they do not adequately account for individual preferences and varying driving situations.

Innovation Solution

An image processing apparatus that superimposes a vehicle interior image onto a rear camera image, allowing for adjustable reference visual fields, including display position, size, and compression settings, to generate a display image that enhances motion parallax and accommodates different driving scenarios and driver preferences.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a captured image from a rear camera is displayed on a display unit, then rear visibility is provided, but a sense of distance through motion parallax is not effectively provided

Engineering Contradiction:
Improvesense of distanceVSAvoiddriver perception
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent creates a virtual copy of the camera image in three-dimensional space, allowing the driver to perceive depth and distance through motion parallax. The processing unit generates a virtual camera image that replicates the optical properties of a physical mirror, enabling natural depth perception without requiring actual physical depth.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent transitions from a two-dimensional flat display to a three-dimensional virtual space representation. By arranging the camera image in three-dimensional space and applying perspective transformation based on viewpoint position, the system creates depth perception and motion parallax effects that are impossible with traditional 2D displays.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Ease of operation

If the display image is adjusted to provide motion parallax, then driver perception is improved, but the visual field may be impaired or restricted

Engineering Contradiction:
Improvedriver perceptionVSAvoidvisual field
Core Design Contradiction:
Ease of operationVSArea of stationary object

Solution Approach 1:

The patent implements dynamic adjustment of the visual field based on the driver's viewpoint position. The processing unit continuously updates the perspective transformation parameters according to the detected viewpoint, allowing the visual field to adapt dynamically while maintaining motion parallax effects. This ensures both depth perception and comprehensive rear visibility.

Inventive Principle:
Principle #15Dynamics

3Adaptability or versatility

If multiple camera images are used to widen the capturing range, then the degree of freedom in visual field setting is increased, but device complexity increases

Engineering Contradiction:
Improvevisual field settingVSAvoidimage processing
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent combines multiple camera images into a unified virtual space representation. The processing unit integrates images from multiple cameras and applies consistent perspective transformation based on a single viewpoint position, creating a cohesive three-dimensional virtual environment that maintains simplicity while expanding visual field options.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS20240430379A1Image processing apparatus, image processing method, and image processing system
Publication Date: 2024.12.26 SONY GROUP CORP
  • US20240430379A1 patent drawing
  • US20240430379A1 patent drawing
  • US20240430379A1 patent drawing

AI summary

Provision of a sense of distance by motion parallax and provision of various visual fields are satisfactorily realized.A display image is generated by superimposing a vehicle interior image on a captured image obtained by capturing an image on a rear side from a vehicle. The display image is generated on the basis of reference visual field setting information set by a setting unit. For example, the reference visual field setting includes a display position setting, a display size setting, a compression setting in all or part of a horizontal direction, a compression setting in all or part of a vertical direction, and the like. For example, the image showing the vehicle is a computer graphics image. For example, a change is made in a superimposed positional relationship between the captured image and the image showing the vehicle in accordance with motion of a viewpoint of a driver.