Game Program Continuous Image Capture for Facial Expression Display

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional game programs only capture and display a user's facial expression at a predetermined timing during gameplay, limiting the ability to showcase dynamic and amusing expressions throughout the game experience.

Innovation Solution

A game program that uses an image pick-up device to capture and store user images based on predetermined conditions, allowing for the display of facial expressions during gameplay, after gameplay, or at passing conditions, using detection instructions to identify the user's area and skin tone, and overlaying objects for enhanced representation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If image data is captured only at predetermined timing, then the game program structure is simple, but the user's facial expressions throughout gameplay cannot be displayed

Engineering Contradiction:
Improvegame program structureVSAvoiduser's facial expressions
Core Design Contradiction:
Device complexityVSLoss of information

Solution Approach 1:

The system performs preliminary action by continuously capturing image data during gameplay and storing it in advance. This allows the game program to later retrieve and display relevant facial expressions without needing to capture them only at predetermined moments, thus preserving more user expressions while maintaining program simplicity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies dynamics by transitioning from static predetermined timing capture to dynamic continuous capture during gameplay. The image pickup device operates continuously to capture facial expressions at various game stages, and the system dynamically selects and displays appropriate expressions based on game events, resolving the contradiction between program simplicity and expression diversity.

Inventive Principle:
Principle #15Dynamics

2Loss of information

If image data is captured continuously during gameplay, then more facial expressions can be displayed, but the processing load and complexity increase

Engineering Contradiction:
Improveuser's facial expressionsVSAvoidimage processing complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system extracts only the necessary image data for display by identifying specific game events (such as passing conditions or significant gameplay moments) and selecting image data corresponding to those events. This extraction approach allows continuous capture to preserve all expressions while reducing processing complexity by focusing only on relevant expressions for display.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

By continuously capturing and storing image data in advance during gameplay, the system performs preliminary action that eliminates the need for complex real-time processing during critical moments. The pre-captured data can be retrieved and displayed with minimal processing, reducing overall system complexity while maintaining comprehensive expression coverage.

Inventive Principle:
Principle #10Preliminary action

3Ease of operation

If facial expressions are displayed during gameplay, then user engagement is enhanced, but the game performance may be affected

Engineering Contradiction:
Improveuser engagementVSAvoidgame performance
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The system performs preliminary action by capturing and storing image data during gameplay in advance, so that displaying facial expressions later does not require real-time processing that would affect game performance. This allows enhanced user engagement through expression display without compromising game productivity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses copying by storing image data as digital copies during gameplay and displaying these copies afterward. This allows the original game performance to proceed without interruption while enabling expression display functionality, thus enhancing user engagement without affecting game productivity.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS9220976B2Storage medium storing game program, and game device
Publication Date: 2015.12.29 NINTENDO CO LTD
  • US9220976B2 patent drawing
  • US9220976B2 patent drawing
  • US9220976B2 patent drawing

AI summary

A processor repeatedly executes, at a predetermined cycle, obtaining image data by an inner camera and body recognition processing based on the obtained image data. The processor proceeds with a game based on a recognition result (user's image) obtained (updated) periodically. The processor captures image data at the timing of the recognition result (user's image) satisfying each of conditions 1, 2, . . . during the game proceeding. After the game is over, image data 1, 2, . . . captured during game play is displayed (replayed).