Score Display via Audio Embedded Control Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems for displaying musical scores related to a music piece played on electronic musical instruments face challenges such as the need for manual score page turning before performance, inaccurate beat and pitch detection, especially in varying tempos or noisy environments, and difficulties in updating the score display synchronously with the music reproduction.
Innovation Solution
A system comprising a music reproduction apparatus that generates and transmits control information, including music piece identification and reproduced position information, via an audio signal to an independent information processing apparatus, which demodulates and uses this information to display the corresponding musical score data accurately and synchronously, even before the music starts, and can acquire additional content from a server as needed.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual score page turning is required before performance, then the user can prepare the display, but it increases user burden and operation complexity
Solution Approach 1:
The system performs preliminary action by automatically determining and displaying the appropriate score page before the performance starts. The control information embedded in the music data includes page turning instructions that are executed in advance, eliminating the need for manual intervention during performance preparation.
Solution Approach 2:
The system implements self-service by enabling the score display apparatus to automatically manage page turning based on embedded control information. The apparatus independently determines which pages to display without requiring user operations, making the system serve itself in managing score presentation.
2Extent of automation
If beat and pitch detection is used to identify performed position, then automatic score updating is achieved, but accuracy deteriorates in varying tempos or noisy environments
Solution Approach 1:
The invention extracts the control information (including performed position data) directly from the music data itself, separating it from the audio signal analysis process. By taking out the position information from the need to detect it through beat and pitch analysis, the system achieves accurate position identification without relying on noisy environmental audio detection.
Solution Approach 2:
The control information embedded in the music data serves as an intermediary that carries performed position information from the music reproduction apparatus to the score display apparatus. This intermediary transmission method is more reliable than direct audio detection, as it bypasses the noisy environment and varying tempo issues.
3Reliability
If score display is updated in accordance with performed position detection, then synchronization is achieved, but reliability decreases when detection fails
Solution Approach 1:
The system implements feedback by using the control information embedded in the music data to continuously update the score display according to the actual performed position. The feedback loop is established through the embedded control information that provides accurate position data, ensuring reliable synchronization without depending on error-prone audio detection.
4Reliability
If content is pre-stored in the information processing apparatus, then display capability is ensured, but device complexity and storage requirements increase
Solution Approach 1:
The music reproduction apparatus serves multiple functions: it not only reproduces music but also embeds and transmits control information for score display. This multi-functionality eliminates the need for the information processing apparatus to independently store all score content, as the control information can be generated and transmitted during music reproduction.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution enables automatic and accurate display of musical scores corresponding to the current reproduced position, reducing user burden and ensuring synchronization, even in challenging environments, and allows for secure content protection by eliminating the need for pre-stored content.
Implementation Method 1
a modulation section configured to output, on the basis of the control information generated by the generation section, an audio signal of a predetermined frequency band for carrying the control information
Implementation Method 2
an extraction section configured to demodulate the control information from the audio signal received by the reception section and extract the music piece information and the reproduced position information included in the demodulated control information
Data Source
AI summary
A music reproduction apparatus includes: a reproduction section for reproducing user-selected music piece data; a generation section for generating control information including music piece information identifying a music piece reproduced by the reproduction section and reproduced position information indicative of a currently-reproduced position; a modulation section for outputting, on the basis of the generated control information, an audio signal of a predetermined frequency band for carrying the control information; and an output section for transmitting to outside the audio signal generated by the modulation section. An information processing apparatus stores a plurality of sets of displaying content, receives the audio signal, demodulates the control information from the received audio signal to extract the music piece information and reproduced position information, identifies displaying content from the extracted music piece information, and displays a part of the identified displaying content in accordance with the extracted reproduced position information.