Electronic Mirror Imaging With Motion Parallax and Adjustable Visual Field

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional in-vehicle electronic mirrors fail to effectively provide a sense of distance through motion parallax and do not adapt to varying visual fields based on driving situations or individual preferences.

Innovation Solution

An image processing apparatus that superimposes a vehicle interior image onto a rear-facing captured image, generating a display image based on setting information for a reference visual field, which includes settings for display position, size, and compression, allowing for adjustable visual fields and motion parallax to enhance the driver's perception of distance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a conventional electronic mirror displays only the captured rear image, then the device complexity is low, but the sense of distance through motion parallax is insufficient

Engineering Contradiction:
Improvesense of distance perceptionVSAvoidimage processing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent combines the captured rear image with a generated vehicle interior image into a composite display image. The processing unit overlays these two images, merging real captured data with synthesized graphical data to create a composite view that provides both realistic appearance and motion parallax effects for improved distance perception.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces a processing unit as an intermediary that generates a virtual vehicle interior image based on camera image data, then combines it with the actual captured image. This intermediary processing layer adds motion parallax information without requiring complex hardware modifications to the mirror itself.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If the electronic mirror provides a fixed visual field, then the device complexity is low, but the adaptability to different driving situations and individual preferences is poor

Engineering Contradiction:
Improvevisual field adaptabilityVSAvoidsetting system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a dynamic visual field system where the processing unit can adjust the display parameters including compression ratios in horizontal and vertical directions, display position, and visual field range. These parameters can be dynamically changed based on driving situations and individual driver preferences through the setting unit.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent allows modification of multiple display parameters including compression ratios (horizontal and vertical), display position, and visual field range. The setting unit enables drivers to adjust these parameters to suit different driving conditions and personal preferences, making the system adaptable without requiring complex hardware changes.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If the electronic mirror uses only captured images, then the manufacturing precision requirements are low, but the visual perception realism is insufficient

Engineering Contradiction:
Improvevisual perception realismVSAvoidimage superimposition precision
Core Design Contradiction:
ReliabilityVSManufacturing precision

Solution Approach 1:

The patent creates a virtual copy of the vehicle interior based on camera image data. The processing unit generates a graphical representation of the vehicle interior that mirrors the actual captured scene, providing a synthesized copy that enhances realism through motion parallax while maintaining alignment with the real captured image.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS12088952B2Image processing apparatus, image processing method, and image processing system
Publication Date: 2024.09.10 SONY GROUP CORP
  • US12088952B2 patent drawing
  • US12088952B2 patent drawing
  • US12088952B2 patent drawing

AI summary

Provision of a sense of distance by motion parallax and provision of various visual fields are satisfactorily realized.A display image is generated by superimposing a vehicle interior image on a captured image obtained by capturing an image on a rear side from a vehicle. The display image is generated on the basis of reference visual field setting information set by a setting unit. For example, the reference visual field setting includes a display position setting, a display size setting, a compression setting in all or part of a horizontal direction, a compression setting in all or part of a vertical direction, and the like. For example, the image showing the vehicle is a computer graphics image. For example, a change is made in a superimposed positional relationship between the captured image and the image showing the vehicle in accordance with motion of a viewpoint of a driver.