Singing Assist System Pitch Correction and Lyric Continuation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing singing devices cannot assist users when they sing off-pitch or forget lyrics, as they lack effective pitch adjustment and continuing singing features.
Innovation Solution
A singing assisting system and method that uses acoustic and pitch models with autoencoder structures to detect and adjust singing pitch and provide continuing vocals, maintaining the original singer's pitch and the user's timbre.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional singing devices play the original singing track to help users singing, then users can practice singing, but the devices cannot assist users when they sing off-pitch or forget lyrics during performance
Solution Approach 1:
The system dynamically switches between different assistance modes (pitch correction mode and lyric continuation mode) based on real-time detection of user singing state. The pitch correction module actively adjusts off-pitch vocals in real-time, while the lyric continuation module activates when users forget lyrics, providing dynamic and adaptive performance support throughout the singing process
Solution Approach 2:
The system introduces an intermediary processing layer between the user's voice and the output sound. The pitch correction module acts as an intermediary to adjust pitch deviations, and the lyric continuation module serves as an intermediary to generate supplementary vocal content when users forget lyrics, thereby enhancing performance support without requiring direct user control
2Manufacturing precision
If pitch correction is applied to adjust off-pitch singing, then singing accuracy is improved, but the user's original timbre may be altered
Solution Approach 1:
The pitch correction module applies pitch adjustment selectively to specific frequency components that are off-pitch, while preserving the formant structures and spectral characteristics that define the user's timbre. This localized processing ensures pitch accuracy is improved without altering the overall timbral quality of the user's voice
3Productivity
If the system generates continuing singing when users forget lyrics, then performance continuity is maintained, but the complexity of the system increases
Solution Approach 1:
The system segments the lyric continuation function into distinct components: a lyric database storing segmented lyric phrases, a detection module that identifies when users forget lyrics, and a synthesis module that retrieves and plays appropriate lyric continuations. This segmentation allows the complex function to be implemented through modular, manageable components
Solution Approach 2:
The lyric continuation module copies and plays pre-recorded lyric phrases from the database that match the current song context. Instead of generating new vocal content from scratch, the system copies existing lyric segments and plays them through the user's voice model, thereby maintaining performance continuity without requiring complex real-time speech synthesis
Data Source
AI summary
A singing assisting system, a singing assisting method, and a non-transitory computer-readable medium including instructions for executing the method are provided. When the performed singing track does not appear in an ought-to-be-performed period, a singing-continuing procedure is executed. When the performed singing track is off pitch, a pitch adjustment procedure is executed.