Dynamic Virtual Perspective Synthesis for Vehicle Surroundings

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies for displaying vehicle surroundings from a virtual perspective are limited, making it difficult for users to view images from desired angles, which can increase concern when monitoring suspicious activities.

Innovation Solution

An image display device and system that acquires images from multiple cameras, synthesizes them into a virtual perspective, and allows users to change the perspective dynamically based on their operations, enabling viewing from desired angles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a fixed virtual perspective is used for displaying vehicle surroundings, then the system structure is simple, but the user cannot view images from desired angles

Engineering Contradiction:
Improveviewing angle flexibilityVSAvoidperspective control mechanism
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a dynamic virtual perspective system where the viewpoint can be freely changed in three-dimensional space based on user input. The virtual camera position and orientation are dynamically adjusted to allow viewing from any desired angle, transforming the fixed perspective into a flexible, user-controllable viewing experience.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent introduces a virtual camera as an intermediary between the captured images and the user's view. This virtual camera synthesizes the surrounding image from multiple camera inputs and allows the user to control its position and orientation, effectively mediating between the fixed physical cameras and the flexible viewing requirements.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Area of stationary object

If multiple cameras are used to capture surroundings, then the coverage area is improved, but the image synthesis complexity increases

Engineering Contradiction:
Improvesurroundings coverageVSAvoidimage synthesis process
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The patent merges images from multiple physical cameras into a single synthesized surrounding image viewed from a virtual perspective. By combining the image data and processing them through coordinate transformations and perspective adjustments, the system achieves comprehensive coverage while presenting a unified view to the user.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent creates a virtual copy of the physical camera system in the digital domain. The virtual camera replicates the function of capturing images but operates in software, allowing flexible positioning and orientation without additional physical hardware. This virtual copying enables comprehensive coverage with controlled synthesis complexity.

Inventive Principle:
Principle #26Copying

3Ease of operation

If the virtual perspective position is changed frequently, then the user can find desired viewing angles, but the processing time increases

Engineering Contradiction:
Improveperspective adjustmentVSAvoidimage regeneration time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent performs preliminary actions by pre-processing the images from multiple cameras into a standardized format suitable for virtual perspective synthesis. By preparing the image data in advance with proper coordinate system alignment and calibration, the system reduces the computational burden during real-time perspective changes, enabling faster regeneration when the user adjusts the viewing angle.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11643047B2Image display device, image display system, image display method and program
Publication Date: 2023.05.09 FUJITSU TEN LTD
  • US11643047B2 patent drawing
  • US11643047B2 patent drawing
  • US11643047B2 patent drawing

AI summary

A plurality of images of an imaging subject are captured by using a plurality of cameras. The plurality of images are synthesized to generate a synthesized image viewing the imaging subject from a virtual perspective. The synthesized image is displayed on a screen. When a user operation for changing the position of the virtual perspective is detected, the position of the virtual perspective in the synthesized image is changed.