Virtual Instrument Positioning via Distance Calculation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional musical instruments that generate sound based on a performer's actions struggle with accurately identifying the virtual musical instrument being targeted, leading to unintended sound generation due to complex adjustments and lack of visual feedback.
Innovation Solution
A musical instrument system comprising a stick unit with sensors, a camera unit for image capture, and a center unit that calculates distances to virtual instruments, allowing for precise sound generation based on the performer's actions and virtual instrument identification.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If sound is generated based on musical instrument area in virtual image, then sound generation is automated, but adjustment of musical instrument area becomes complicated
Solution Approach 1:
The system captures images of the performer and the virtual musical instruments, detects the position of the musical performance member in the captured image, and provides visual feedback by displaying the captured image with the virtual musical instrument positions. This feedback mechanism allows the performer to intuitively understand the relationship between their actions and the virtual instrument positions, eliminating the need for complex manual adjustments of musical instrument areas.
2Measurement precision
If virtual musical instrument positions are adjusted manually, then sound generation accuracy improves, but adjustment work becomes complicated
Solution Approach 1:
The system automatically detects the position of the musical performance member in the captured image and automatically determines which virtual musical instrument is being targeted based on the detected position. This self-service mechanism eliminates the need for manual adjustment of virtual instrument positions, achieving both high position accuracy and operational simplicity.
3Illumination intensity
If captured image is displayed without virtual musical instrument overlay, then image clarity is maintained, but performer cannot visually recognize virtual instruments
Solution Approach 1:
The system merges the captured image of the performer with an overlay displaying the positions of the virtual musical instruments. This combination allows the performer to simultaneously see both the captured image maintaining its clarity and the virtual instrument positions, enabling intuitive understanding of the relationship between their actions and the virtual instruments without sacrificing image quality.
Data Source
AI summary
A CPU (31) of a musical instrument (1) calculates distances between central positions of a plurality of virtual pads (81) and a position of a marker unit (15), by making adjustment such that a distance is shorter as a size associated with the virtual pad (81) is larger. The CPU 31 identifies a virtual pad (81) corresponding to the shortest distance among the distances calculated, as a virtual pad (81) for outputting sound. The CPU (31) identifies a tone corresponding to the virtual pad (81) for outputting sound by referring to set layout information.