Synthesizing Virtual Objects Behind Real-World Imagery

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing image processing technologies fail to effectively engage users by merely using real-world images as backgrounds, lacking the ability to attract and maintain user interest in virtual reality environments.

Innovation Solution

An image processing program that synthesizes real-world images with virtual objects, allowing the virtual objects to appear behind or in front of the real-world image, enhancing depth perception and user engagement by prioritizing the real-world image and applying image processing techniques to create an immersive experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If real world images are used as backgrounds in virtual reality displays, then the sense of reality is maintained, but user interest and engagement are not attracted

Engineering Contradiction:

Improvesense of realityVSAvoiduser interest

Core Design Contradiction:

ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent combines real world images with virtual objects in a synthesized image, merging the authenticity of real imagery with the engagement potential of virtual elements. This allows the system to maintain the sense of reality from actual captured images while incorporating interesting virtual objects that attract user interest, resolving the contradiction between reliability and adaptability.

Inventive Principle:

Principle #5Merging (Combining)

2Adaptability or versatility

If virtual objects are displayed in front of real world images, then user interest is enhanced, but the sense of depth and realism is reduced

Engineering Contradiction:

Improveuser interestVSAvoidsense of depth

Core Design Contradiction:

Adaptability or versatilityVSReliability

Solution Approach 1:

The patent applies different display priorities to different virtual objects based on their position and importance. Some virtual objects are displayed in front of the real world image while others are displayed behind it, creating local variations in depth presentation. This allows certain areas to enhance user interest while other areas maintain the sense of depth and realism.

Inventive Principle:

Principle #3Local quality

3Adaptability or versatility

If multiple virtual objects are synthesized with real world images, then user engagement is improved, but image processing complexity increases

Engineering Contradiction:

Improveuser engagementVSAvoidimage processing complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent divides the virtual space into multiple regions and processes virtual objects differently based on their location and importance. By segmenting the synthesis process according to virtual object priorities and positions, the system can efficiently handle multiple virtual objects without uniformly processing all elements at maximum complexity, thus improving user engagement while managing processing complexity.

Inventive Principle:

Principle #1Segmentation

Data Source

PatentEP2442280B1Blending a real world with a virtual world

Publication Date: 2019.01.16 HAL LABORATORY

Figure 1
Figure 2
Figure 3A~3D

AI summary

A real world image captured by a real camera such as an outside right imaging unit 23b is acquired, a synthesized image is generated by synthesizing the acquired real world image and a virtual image depicting a first virtual object such as an enemy object EO, in such a manner that the first virtual object such as an enemy object EO appears to be present behind the real world image, and the synthesized image thus generated is displayed on a display device.