Trained Model for Singing Sound to Instrument Audio Correlation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing techniques require specialized music knowledge to output musical instrument sounds that correlate with singing sounds, limiting their accessibility to users without such expertise.
Innovation Solution
A computer-implemented sound processing method using a trained model learned through machine learning to correlate singing sounds with musical instrument sounds, allowing users to generate appropriate musical instrument sounds without needing music knowledge, by inputting singing sound data into the model.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a trained model learned through machine learning is used to correlate singing sounds with musical instrument sounds, then the accessibility for users without music knowledge is improved, but the device complexity increases
Solution Approach 1:
A trained model learned through machine learning serves as an intermediary between singing sound input and musical instrument sound output. The model automatically learns the complex mapping relationship between singing sounds and appropriate musical instrument sounds, eliminating the need for users to have specialized music knowledge while handling the computational complexity internally.
2Ease of operation
If machine learning is used to automatically generate musical instrument sounds correlated with singing sounds, then the specialized knowledge requirement is reduced, but the processing time and computational resources increase
Solution Approach 1:
The system performs preliminary action by pre-training the machine learning model offline using large amounts of training data containing singing sounds and corresponding musical instrument sounds. This pre-training phase captures complex musical relationships in advance, allowing the trained model to quickly generate correlated sounds during actual use without requiring extensive processing time for each query.
Data Source
AI summary
A computer-implemented sound processing method includes: outputting singing sound data based on a sound signal representing singing sound; and outputting sound data representing musical instrument sound that correlates with musical elements of the singing sound, by inputting input data that includes the singing sound data to a trained model that has learned, by machine learning, a relationship between singing sound for training and musical instrument sound for training.