Virtual Object Control via Multi-Sensor Movement Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional information processing systems fail to effectively encourage whole-body exercises by separately using outputs from apparatuses held and stepped on by users, limiting the variety and engagement of game processes.

Innovation Solution

An information processing system that includes sensors and transmitters for detecting movements of both lower and upper body apparatuses, allowing a virtual object to perform actions based on combined outputs, promoting whole-body operations and increasing playability by requiring coordinated movements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If outputs from apparatuses held and stepped on by users are separately used for game control, then the control structure is simple, but the variety of actions and user engagement are limited

Engineering Contradiction:
Improvevariety of actionsVSAvoidcontrol structure
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent combines outputs from multiple apparatuses (held apparatus and stepped-on apparatus) to control a single virtual object. The information processing apparatus integrates data from both apparatuses to determine combined actions, merging separate control inputs into unified virtual object behavior that increases action variety without requiring separate virtual objects for each apparatus.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The control system is designed to handle multiple types of apparatuses and multiple types of actions through a universal processing framework. The information processing apparatus can process outputs from various sensor types and translate them into different virtual object actions (movement, attack, defense, etc.), making the system adaptable to different apparatus configurations and action types.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Productivity

If outputs from multiple sensors are combined to control virtual object actions, then user engagement and exercise promotion are improved, but the processing complexity and computational requirements increase

Engineering Contradiction:
Improveexercise promotion effectivenessVSAvoidprocessing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system performs preliminary classification of sensor outputs into distinct action types (movement actions, attack actions, defense actions). By pre-categorizing sensor data before combining it with other inputs, the system reduces processing complexity during real-time operation. Each apparatus output is evaluated against predetermined conditions and classified into action categories before being integrated with other sensor data.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The control process is segmented into distinct evaluation stages: first evaluating outputs from the held apparatus, then evaluating outputs from the stepped-on apparatus, and finally combining them. This segmentation allows the system to process complex multi-sensor data in manageable steps, reducing overall processing complexity while maintaining comprehensive analysis of all inputs.

Inventive Principle:
Principle #1Segmentation

3Adaptability or versatility

If the virtual object performs diverse actions based on combined sensor outputs, then playability increases, but the difficulty of coordinating real-world movements increases

Engineering Contradiction:
ImproveplayabilityVSAvoidmovement coordination
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system provides feedback by mapping real-world apparatus movements to intuitive virtual object actions. When sensors detect specific movement patterns (e.g., swinging the held apparatus, stepping with the stepped-on apparatus), the virtual object performs corresponding actions (attack, move, defend). This feedback loop helps users learn and coordinate movements more easily by providing clear cause-effect relationships between physical actions and virtual responses.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system uses parameter changes in sensor outputs to determine action types. By monitoring changes in movement intensity, direction, and pattern from the apparatuses, the system translates subtle variations in user movement into distinct virtual object actions. This allows diverse playability options while maintaining ease of operation, as users naturally produce different movement parameters during gameplay without needing to consciously coordinate complex sequences.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS12109483B2Information processing system, storage medium storing information processing program, information processing apparatus, and information processing method
Publication Date: 2024.10.08 NINTENDO CO LTD
  • US12109483B2 patent drawing
  • US12109483B2 patent drawing
  • US12109483B2 patent drawing

AI summary

A first sensor detects a movement of a first apparatus attached to a lower body of a user, and a second sensor detects a movement of a second apparatus attached to an upper body of the user or held by a hand of the user. Then, a virtual object is caused to continue a first action in a virtual space while received outputs from the first sensor and the second sensor both satisfy a condition.