Pitch Shift Module for Voice Data Quality
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for shifting the pitch of voice data using vocoders face challenges such as voice data deterioration and difficulty in achieving exact pitch shifts, especially when using simple pitch shift modules and acoustic models with high maintenance costs.
Innovation Solution
An electronic device is configured with processing circuitry to identify a target pitch shift value, divide it into integer and decimal components, and use these values to update the pitch features of voice data through a pitch shift embedding model and table, resulting in precise pitch shifting without data deterioration.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional vocoders with acoustic models are used for pitch shifting, then pitch shifting capability is achieved, but voice data deterioration occurs and maintenance costs increase
Solution Approach 1:
The patent extracts the pitch shifting function from the complex acoustic model and separates it into an independent pitch shift module. This module receives voice data and pitch shift values as input, processes only the pitch component, and outputs modified voice data without requiring the full acoustic model infrastructure, thereby reducing complexity while maintaining functionality
Solution Approach 2:
The patent creates a simplified copy of the pitch shifting functionality that operates independently from the original complex acoustic model. The pitch shift module replicates the essential pitch modification capability using a lighter-weight architecture with embedding tables and simple neural network components, avoiding the need for maintenance of the full acoustic model
2Measurement precision
If simple pitch shift modules are used, then device complexity is reduced, but pitch shifting precision deteriorates
Solution Approach 1:
The patent changes the parameter representation by dividing the pitch shift value into integer and decimal components, and by using embedding tables to map pitch shift values to learned representations. This parameter transformation enables the simple module to achieve high precision pitch shifting by leveraging learned embeddings rather than complex signal processing
Solution Approach 2:
The patent introduces embedding tables as intermediary structures that map pitch shift values to learned vector representations. These embeddings act as mediators between the simple pitch shift module and the desired output, enabling precise pitch control without requiring complex acoustic models. The embeddings capture nuanced pitch relationships that would otherwise require sophisticated processing
Data Source
AI summary
Disclosed is an electronic device and a control method therefor. The electronic device according to an embodiment includes: memory storing at least one instruction and at least one processor, comprising processing circuitry, individually and/or collectively, configured to execute the at least one instruction, and to: identify a target pitch shift value for shifting a pitch of voice data, divide the identified target pitch shift value into a first pitch shift value and a second pitch shift value, identify a pitch shift embedding value based on the first pitch shift value, obtain second voice data by updating a feature of a pitch of first voice data based on the second pitch shift value, identify a pitch embedding value based on a pitch of the obtained second voice data, and obtain third voice data to which the pitch of the first voice data is shifted based on the pitch shift embedding value and the pitch embedding value.