Camera-Based Dance Game Input System with Motion Normalization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing dance video games face challenges in providing an intuitive and immersive experience for users unfamiliar with traditional game controllers, as they require complex button-based inputs or cumbersome dance mats, and existing camera-based systems lack the ability to effectively grade dance performances and teach users new moves.

Innovation Solution

A system that utilizes a camera-based input method, such as the KINECT, to track users' three-dimensional movements and provide feedback, while normalizing positional data to account for differences in user height and body type, allowing for the creation of a target performance model and comparison with user input to score dance moves and provide interactive feedback.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional game controllers with buttons and joysticks are used, then input precision is improved, but ease of operation deteriorates for users unfamiliar with video games

Engineering Contradiction:
Improveinput precisionVSAvoidease of operation
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent replaces mechanical controllers (buttons, joysticks, dance mats) with a camera-based optical system. The camera captures user movements and the system processes video data to detect body position and motion, substituting physical controller interaction with natural body movement detection. This eliminates the learning curve associated with mechanical controllers while maintaining input precision through sophisticated movement analysis algorithms.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If dance mats are used to provide foot-based input, then ease of operation is improved, but device complexity and space requirements worsen

Engineering Contradiction:
Improveease of operationVSAvoiddevice complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent extracts the input detection function from physical dance mats and relocates it to a camera-based system. Instead of requiring specialized flooring with pressure sensors, the system uses visual detection to capture foot movements and body position. This eliminates the need for bulky, single-use dance mats while maintaining the ability to detect dance-related movements through optical means.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The camera system serves multiple functions: it detects body position, tracks movement, identifies dance moves, and provides feedback. This single device replaces the specialized dance mat, traditional controller, and feedback mechanisms, creating a multi-functional system that reduces overall device complexity and space requirements.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If camera-based input is used to improve ease of operation, then ease of operation is improved, but measurement precision of dance performance deteriorates

Engineering Contradiction:
Improveease of operationVSAvoidmeasurement precision
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent implements a feedback loop where the camera captures user performance, the system analyzes the movements against target dance moves, and provides real-time feedback on accuracy. This feedback mechanism enables the system to maintain measurement precision by continuously monitoring and evaluating performance metrics such as body position, movement timing, and dance move execution, allowing users to improve their performance based on quantitative assessment.

Inventive Principle:
Principle #23Feedback

4Ease of operation

If existing camera systems are used to detect user movements, then ease of operation is improved, but the ability to grade performance and teach moves deteriorates

Engineering Contradiction:
Improveease of operationVSAvoidperformance feedback capability
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent introduces an intermediary processing system between the camera and the user. This system includes software that analyzes video data, compares user performance against target moves, and generates graded feedback. The intermediary translates raw camera data into meaningful performance metrics and instructional information, enabling both grading and teaching functions that were absent in simple camera-based systems.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS9358456B1Dance competition game
Publication Date: 2016.06.07 HARMONIX MUSIC SYSTEMS
  • US9358456B1 patent drawing
  • US9358456B1 patent drawing
  • US9358456B1 patent drawing

AI summary

Techniques for use with a game console and a camera system, the techniques include providing a first prompt to a first player to create and perform a dance move, receiving at the game console information from the camera system reflecting a position of the first player in response to the first prompt, generating, using the game console, a target frame using the received information relating to the first player, providing, using the audiovisual system connected to the game console, a second prompt to a second player to perform the dance move created by the first player, receiving at the game console information from the camera system reflecting a position of the second player in response to the second prompt, generating, using the game console, an input frame using the information relating to the second player, and comparing the input frame to the target frame to determine a comparison value.