Generated Speech Classification Using Convolution, Quantization, and BERT
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing speech generation technologies, such as TTS and VC, are susceptible to misuse due to their ability to produce highly natural synthesized speech, leading to issues like voice phishing, and there is a need for accurate methods to classify and determine the authenticity of generated speech.
Innovation Solution
A method and apparatus that utilize a one-dimensional convolution operation, residual vector quantization, and a BERT language model to embed and classify generated speech, considering overall contextual structure, by converting feature vectors into positive integer values for accurate classification.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If speech generation technologies (TTS, VC) are advanced to produce highly natural synthesized speech, then speech quality and naturalness are improved, but the risk of misuse (voice phishing) increases
Solution Approach 1:
The patent implements a feedback mechanism by training a classifier model on a dataset containing both real and generated speech samples. The classifier provides feedback signals that enable the system to distinguish between authentic and synthesized speech, thereby mitigating the harmful effects of advanced speech generation technologies while preserving their beneficial naturalness characteristics.
2Measurement precision
If a classifier model with natural language processing is applied to determine speech authenticity, then classification accuracy is improved, but computational complexity increases
Solution Approach 1:
The patent segments the speech classification task into distinct functional components: a feature extractor that processes raw speech data through one-dimensional convolution operations, a quantizer that converts feature vectors into discrete representations, and a classifier model that performs the final authentication. This segmentation allows each component to be optimized independently, managing overall system complexity while maintaining high classification accuracy.
3Loss of information
If residual vector quantization is applied to process feature vectors, then information representation efficiency is improved, but processing complexity increases
Solution Approach 1:
The patent applies residual vector quantization by transforming continuous feature vectors into discrete quantized representations through a learned codebook. This parameter transformation efficiently compresses the feature space while preserving essential speech characteristics, reducing information loss. The residual nature of the quantization allows iterative refinement, improving representation efficiency despite the increased processing complexity of the quantization operation.
Data Source
AI summary
A method and apparatus for classifying generated speech are disclosed. The method for classifying generated speech includes: applying a one-dimensional convolution operation to raw speech data to embed the raw speech data into a feature space and extract a feature vector; quantizing the feature vector by applying it to a residual vector quantizer; and applying the quantized result to a classifier model including a natural language processing model to output a classification label.


