Color-Based Virtual Object Generation in AR Displays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional display systems that overlap real and virtual world images lack engagement, as they do not effectively integrate the two, resulting in monotonous and uninteresting visuals for users.

Innovation Solution

A display control program and system that uses a real camera to capture images, detects specific color information, and generates virtual objects to be displayed in a virtual world, allowing for dynamic combination with real-world images, enabling interactive and engaging visuals by adjusting object size, position, and motion based on detected color and area information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If a real world image is displayed as background without color-based object generation, then the display system is simple and easy to implement, but the displayed image becomes monotonous and uninteresting

Engineering Contradiction:
Improveease of implementationVSAvoidvisual interest
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The system changes the parameter of color information extraction from the captured image to generate virtual objects. By analyzing color parameters (hue, saturation, brightness) of specific regions in the captured image, the system dynamically generates virtual objects that correspond to detected color patterns, transforming the static background display into an interactive system where visual interest is generated through color-based object generation while maintaining the simplicity of the overall architecture

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If virtual objects are generated based on color detection from captured images, then user engagement and visual interest are improved, but the system complexity increases

Engineering Contradiction:
Improvevisual interestVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system segments the captured image into multiple regions and detects color information specifically in predetermined regions. By dividing the image processing task into regional analysis, the system reduces the computational complexity of processing the entire image while still achieving effective color-based virtual object generation. This segmentation approach allows the system to maintain visual interest through targeted color detection without the burden of processing every pixel across the entire image

Inventive Principle:
Principle #1Segmentation

3Productivity

If the background image is updated at regular time intervals, then the display is simple and efficient, but the system cannot respond dynamically to color changes in the captured image

Engineering Contradiction:
Improvedisplay efficiencyVSAvoiddynamic response
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The system implements a feedback mechanism where color information detected from the captured image directly influences the generation of virtual objects. Instead of updating the background at fixed intervals, the system continuously monitors color changes in the captured image and dynamically generates virtual objects in response to detected color patterns. This feedback loop enables the system to adapt dynamically to real-time color changes while maintaining display efficiency through event-driven updates rather than continuous processing

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS8884987B2Storage medium having stored thereon display control program, display control apparatus, display control system, and display control method for setting and controlling display of a virtual object using a real world image
Publication Date: 2014.11.11 NINTENDO CO LTD
  • US8884987B2 patent drawing
  • US8884987B2 patent drawing
  • US8884987B2 patent drawing

AI summary

Captured image acquisition means acquires a captured image captured by a real camera. Color detection means, in the captured image acquired by the captured image acquisition means, detects at least one pixel having specific range color information in color information including at least one selected from the group including RGB values, a hue, a saturation, and a brightness. Image generation means, on the basis of the specific range color information of the at least one pixel detected by the color detection means, generates an image of an object to be placed in a virtual world. Image display control means displays the image generated by the image generation means on a display device.