Hand-Specific Musical Instrument Control via Image Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing techniques for controlling electronic musical instruments struggle to accurately distinguish between right-hand and left-hand operations, especially when the hands are close or overlapping, leading to difficulties in setting split points and executing different processing tasks effectively.
Innovation Solution
An information processing method and system that analyzes performance images to generate operation data representing finger operations, allowing for distinct processing based on whether the instrument is operated with the left hand or right hand, using a computer system with a performance analysis unit and operation control unit to execute different processing tasks accordingly.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If tones are reproduced to have characteristics which are different between when a user plays with right hand and when the user plays with left hand, then diverse performance can be achieved, but it is difficult to set a split point between right hand range and left hand range with high accuracy when hands are close or overlapping
Solution Approach 1:
The patent replaces the mechanical/manual method of setting split points with image recognition technology. The system captures images of the user's hands and automatically identifies which hand is operating which keys, eliminating the need for manual split point configuration and maintaining accuracy even when hands are close or overlapping.
Solution Approach 2:
The patent introduces an image recognition system as an intermediary between the user's hand operations and the instrument's response. This intermediary analyzes visual data to determine hand identity and key operations, enabling accurate differentiation of right-hand and left-hand operations without requiring the user to manually define boundaries.
2Ease of operation
If manual split point setting is used to differentiate right hand and left hand operations, then processing can be differentiated, but accuracy deteriorates when right hand and left hand are close to each other or overlap
Solution Approach 1:
The patent replaces the manual mechanical approach of setting split points with an automated image recognition system. The system captures visual information of the hands and keys, processes this data to identify which hand is pressing which keys, and automatically executes the appropriate processing without requiring manual boundary definition.
Solution Approach 2:
The patent transitions from a one-dimensional approach (manual split point on a keyboard spectrum) to a two-dimensional approach by incorporating visual spatial information. The image recognition system analyzes the spatial relationship between hands and keys in the visual field, adding a spatial dimension to hand identification that resolves ambiguities when hands are close or overlapping.
Data Source
AI summary
An information processing method is implemented by a computer system. The information processing method includes: generating operation data representing one or more fingers, of a plurality of fingers of a left hand and a right hand of a user, that operate a musical instrument, by analyzing a performance image indicating the plurality of fingers of the user who plays the musical instrument; and executing first processing in a case where the operation data represents the musical instrument being operated with a finger of the left hand, and executing second processing different from the first processing in a case where the operation data represents the musical instrument being operated with a finger of the right hand.