Image Processing Apparatus for Real-World Texture Integration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image processing systems that combine real and virtual worlds lack diversity and engagement, as they primarily display virtual objects without incorporating dynamic textures and interactions from real-world images.

Innovation Solution

An image processing program that captures real-world images, generates virtual world images using textures from specific areas of the captured images, and combines them to create new, interactive and immersive displays, allowing objects to appear as if they are sliding out of the real-world image and responding to facial expressions or physical body recognition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If virtual objects are displayed without real-world texture integration, then device complexity is reduced, but image interest and user engagement deteriorate

Engineering Contradiction:
Improvesystem complexityVSAvoidimage interest
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent merges real-world captured images with virtual world images by integrating textures from real objects into virtual object representations. This combination allows the system to maintain relatively simple processing while generating highly engaging and interesting images that bridge the real and virtual worlds, directly resolving the contradiction between system simplicity and image interest.

Inventive Principle:
Principle #5Merging (Combining)

2Speed

If static virtual objects are displayed, then processing speed is improved, but image dynamism and user engagement deteriorate

Engineering Contradiction:
Improveprocessing speedVSAvoidimage dynamism
Core Design Contradiction:
SpeedVSDuration of action of moving object

Solution Approach 1:

The patent implements dynamics by enabling virtual objects to respond to detected facial expressions and physical movements in real-time. The system processes captured images to identify facial features and body movements, then dynamically adjusts virtual object states accordingly, creating lively and engaging images that maintain high processing speed through efficient real-time detection algorithms.

Inventive Principle:
Principle #15Dynamics

3Adaptability or versatility

If general virtual objects are used, then adaptability is improved, but image specificity and engagement deteriorate

Engineering Contradiction:
Improvevirtual object varietyVSAvoidimage specificity
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent applies local quality by extracting specific texture information from particular regions of captured real-world images and applying these textures to corresponding virtual objects. This approach preserves the unique characteristics and specificity of real-world objects while maintaining the adaptability of virtual object representations, ensuring that each virtual object reflects its real-world counterpart's distinctive features.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9495800B2Storage medium having stored thereon image processing program, image processing apparatus, image processing system, and image processing method
Publication Date: 2016.11.15 NINTENDO CO LTD
  • US9495800B2 patent drawing
  • US9495800B2 patent drawing
  • US9495800B2 patent drawing

AI summary

Using as a texture of an image to be placed in a virtual world an image included in a predetermined area in a captured image captured by a real camera, a virtual world image is generated, in which the object placed in the virtual world is viewed from a virtual camera. Then, the captured image captured by the real camera is combined with the virtual world image, and the combined image is displayed on a display device.