Information Processing System for Intuitive Color Masking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing systems are difficult for non-graphics software skilled users to operate, particularly when updating color information of images, as they require complex masking and positioning operations.

Innovation Solution

A computer-based information processing program that acquires images of a real-space subject, displays corresponding images, and updates color information, with features to fix the display position and shape of one image relative to another, allowing intuitive updating of color information without continuous precise positioning.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If complex masking and positioning operations are used to update color information, then manufacturing precision is improved, but ease of operation deteriorates

Engineering Contradiction:
Improveprecision of color information updateVSAvoidease of image processing operation
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The patent introduces a camera as an intermediary device to capture the actual subject and generate a mask image automatically. This mediator bridges the gap between the user's simple operation (pointing the camera) and the complex processing (color update with precise masking), eliminating the need for users to manually perform complex masking and positioning operations while maintaining high precision through the captured image data

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs self-service by automatically generating the mask image from camera captures and automatically positioning it according to the subject's location. The system updates color information without requiring manual intervention for masking or positioning, making the process accessible to non-expert users while maintaining precision through automated image processing algorithms

Inventive Principle:
Principle #25Self-service

2Manufacturing precision

If manual masking operations are required, then manufacturing precision is improved, but device complexity increases

Engineering Contradiction:
Improveprecision of mask applicationVSAvoidcomplexity of image processing system
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent replaces manual mechanical operations (hand-drawn masking, manual positioning) with an automated optical system. The camera captures the subject automatically, and software algorithms generate and position the mask image without manual intervention. This substitution reduces device complexity from the user perspective while maintaining or improving precision through consistent automated execution

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Manufacturing precision

If continuous positioning is required during color update, then manufacturing precision is improved, but loss of time increases

Engineering Contradiction:
Improveprecision of color update positioningVSAvoidtime for color information update
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs preliminary action by capturing the subject image and generating the mask image before the color update operation begins. The mask image is pre-positioned and prepared in advance, so when the color update is executed, no continuous positioning is needed - the pre-prepared mask is simply applied. This eliminates time loss during the actual color update while maintaining precision through the pre-captured image data

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3578236B1Information processing program, information processing system and information processing method
Publication Date: 2022.07.27 NINTENDO CO LTD
  • EP3578236B1 patent drawingFigure 1
  • EP3578236B1 patent drawingFigure 2
  • EP3578236B1 patent drawingFigure 3A~3B

AI summary

A game system that is an example of an information processing system includes a game apparatus, and an input device and a television are connected to the game apparatus. If graphics software is executed and coloring processing is started, a virtual object is displayed, and when a mask mode is set, a real space is imaged by an infrared imaging unit provided on the input device. A candidate image based on an imaging result is generated, and according to a fixing instruction by a user, the candidate image is fixedly displayed, as a mask image, in the front of an image including the virtual object. When a coloring instruction is input, an area of the virtual object image not overlapping with the mask image is colored and color information of the virtual object image is updated, whereas, an area overlapping with the mask image is not colored and the update of the color information is restricted.