Controller Sensor Fusion for Dance Simulation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing dancing simulation systems are complex and expensive due to the need for multiple sensors, and they do not allow performers to easily enjoy dancing simulations, as they require intricate movement instructions that are difficult to follow.

Innovation Solution

An input instruction device and method that uses a controller with a physical quantity sensor to generate instruction images guiding the movement of the controller, allowing the detection and determination of the controller's movement in real space, enabling performers to easily follow and accurately perform dancing simulations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple infrared sensors are used to detect movement in five directions at five positions, then measurement precision is improved, but device complexity increases and cost increases

Engineering Contradiction:
Improvemovement detection precisionVSAvoidsystem configuration complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts the movement detection function from multiple infrared sensors and concentrates it into a single controller with acceleration and inclination sensors. This extraction reduces system complexity while maintaining the ability to detect movement in multiple directions through sensor fusion algorithms that process data from the consolidated sensors.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The controller is designed as a multi-functional device that performs both inclination detection and acceleration detection, replacing the need for separate infrared sensors at multiple positions. This universal device can detect movement in all five directions through integrated sensor data processing, reducing overall system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Ease of operation

If a controller with physical quantity sensor is used for dancing simulation, then ease of operation is improved, but measurement precision deteriorates due to difficulty in accurately detecting intricate movements

Engineering Contradiction:
Improveease of performing simulationVSAvoidmovement detection accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system provides real-time feedback by displaying instruction images that show the correct controller movements and comparing them with actual sensor data. This feedback mechanism helps users adjust their movements to achieve more accurate detection results while maintaining ease of operation through visual guidance.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent changes the detection parameters by using both acceleration and inclination sensors simultaneously, and by processing their combined data through algorithms that account for the controller's orientation and movement dynamics. This parameter transformation enables accurate detection of intricate dance movements while keeping the operation simple for users.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system allows performers to easily and accurately perform dancing simulations by visually instructing the movement of the controller, improving the enjoyment and effectiveness of the simulation experience through precise movement detection and feedback.

Implementation Method 1

a controller (input section) including a physical quantity sensor (e.g., acceleration sensor)

Methodology Applied
Scientific EffectAcceleration sensor detection: Accelerometer

Data Source

PatentEP2039402B1Input instruction device, input instruction method, and dancing simultation system using the input instruction device and method
Publication Date: 2020.02.19 BANDAI NAMCO ENTERTAINMENT INC
  • EP2039402B1 patent drawingFigure 1
  • EP2039402B1 patent drawingFigure 2
  • EP2039402B1 patent drawingFigure 3

AI summary

An input instruction device for a simulation system performs a process that generates and displays an instruction image that instructs a given movement of a controller including an acceleration sensor, and a process that acquires a signal from the acceleration sensor included in the controller to detect the movement of the controller, and determines the degree of conformity of the detected movement of the controller with the instructed movement instructed by the instruction image.