Electronic Musical Instrument Voice Synchronization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional electronic musical instruments fail to synchronize the progression of singing voices with accompaniment data, leading to lyrics either running ahead or lagging behind, regardless of the number of pitches specified by the user, resulting in an unnatural timing alignment.
Innovation Solution
An electronic musical instrument with a processor that digitally synthesizes and outputs singing voices based on user-specified pitches and stored musical piece data, ensuring synchronization by using a voice synthesis LSI employing statistical parametric speech synthesis based on deep learning, which adjusts the timing and pitch of the singing voice to match the intended musical notes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If lyrics are progressively output each time a key is specified by the user, then the user can specify pitches freely, but the lyrics will run ahead or lag behind the accompaniment data
Solution Approach 1:
The system continuously monitors the timing relationship between lyric output and accompaniment data progression, and dynamically adjusts the lyric output timing based on this feedback to maintain synchronization. The processor compares the current lyric position with the accompaniment timing and modifies subsequent lyric output accordingly.
Solution Approach 2:
The system changes the timing parameter of lyric output dynamically based on the detected synchronization state. When lyrics run ahead, the system delays subsequent lyric output; when lyrics lag behind, the system accelerates lyric output timing, thereby maintaining proper synchronization throughout performance.
2Adaptability or versatility
If multiple pitches are specified within a single measure, then the user can express complex melodies, but the lyrics will run ahead of the accompaniment data
Solution Approach 1:
The system monitors the number of pitches specified per measure and the resulting lyric progression speed, then adjusts timing parameters based on this feedback to prevent lyrics from running ahead of accompaniment data even when multiple pitches are specified.
3Ease of operation
If fewer pitches are specified within a single measure, then the user can simplify performance, but the lyrics will lag behind the accompaniment data
Solution Approach 1:
When fewer pitches are specified per measure, the system adjusts the timing parameter to accelerate lyric output progression, ensuring that lyrics remain synchronized with accompaniment data even when the user specifies fewer pitches for simplified performance.
Data Source
AI summary
An electronic musical instrument in one aspect of the disclosure includes; a plurality of operation elements to be performed by a user for respectively specifying different pitches; a memory that stores musical piece data that includes data of a vocal part, the vocal part including at least a first note with a first pitch and an associated first lyric part that are to be played at a first timing; and at least one processor, wherein if the user does not operate any of the plurality of operation elements in accordance with the first timing, the at least one processor digitally synthesizes a default first singing voice that includes the first lyric part and that has the first pitch in accordance with data of the first note stored in the memory, and causes the digitally synthesized default first singing voice to be audibly output at the first timing.