Motion Tracking Sensor for Interactive Music Game Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing music video games can be intimidating for casual gamers due to the complexity of game controllers and the limited versatility of music-instrument-shaped peripherals, which are often single-use and not compatible with multiple games.
Innovation Solution
A system that uses a camera-based motion-tracking sensor to allow players to interact with music videos and games using hand movements, eliminating the need for traditional controllers, and enabling customizable and immersive gameplay experiences through the use of Orbs and special effects in a virtual three-dimensional space.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional game controllers with numerous buttons or music-instrument-shaped peripherals are used, then musical performance simulation is improved, but device complexity and ease of operation deteriorate
Solution Approach 1:
The patent replaces complex mechanical controllers (guitar-shaped peripherals with fret buttons, dance mats with multiple switches) with a camera-based motion tracking system that captures hand movements and translates them into game inputs. This substitution eliminates the need for physical instruments while maintaining musical performance simulation through visual gesture recognition.
Solution Approach 2:
The motion tracking system serves multiple functions: it tracks hand positions, recognizes gestures, determines timing of movements, and works across different game modes without requiring specialized controllers. This universal system replaces multiple single-purpose peripherals (guitar controllers for rhythm games, dance mats for dance games, etc.).
2Reliability
If music-instrument-shaped peripherals are used, then musical interaction is improved, but adaptability deteriorates
Solution Approach 1:
The camera-based motion tracking system is designed to work across multiple game genres and platforms, not just rhythm games. It can track hand movements for guitar simulations, dance movements for rhythm games, and various other gestures, making it adaptable to different game types without requiring specialized controllers for each genre.
Solution Approach 2:
Instead of requiring physical copies of musical instruments (guitar peripherals, drum controllers), the system creates a virtual copy of the instrument interaction through motion tracking. Players perform gestures in the air that are captured by the camera and translated into controller inputs, eliminating the need for physical instrument replicas.
Data Source
AI summary
Disclosed herein are methods, systems, computer program products, and devices associated with a music action game, wherein a user can interact, by means of an input device, with the graphics and music associated with a music video playing on a gaming platform. The player's interactions can alter the song or music video during gameplay, which can be recorded and stored in a memory of the gaming platform.