Generated Speech Classification Using Convolution, Quantization, and BERT

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing speech generation technologies, such as TTS and VC, are susceptible to misuse due to their ability to produce highly natural synthesized speech, leading to issues like voice phishing, and there is a need for accurate methods to classify and determine the authenticity of generated speech.

Innovation Solution

A method and apparatus that utilize a one-dimensional convolution operation, residual vector quantization, and a BERT language model to embed and classify generated speech, considering overall contextual structure, by converting feature vectors into positive integer values for accurate classification.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If speech generation technologies (TTS, VC) are advanced to produce highly natural synthesized speech, then speech quality and naturalness are improved, but the risk of misuse (voice phishing) increases

Engineering Contradiction:
Improvespeech naturalnessVSAvoidmisuse risk
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent implements a feedback mechanism by training a classifier model on a dataset containing both real and generated speech samples. The classifier provides feedback signals that enable the system to distinguish between authentic and synthesized speech, thereby mitigating the harmful effects of advanced speech generation technologies while preserving their beneficial naturalness characteristics.

Inventive Principle:
Principle #23Feedback

2Measurement precision

If a classifier model with natural language processing is applied to determine speech authenticity, then classification accuracy is improved, but computational complexity increases

Engineering Contradiction:
Improveclassification accuracyVSAvoidmodel complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the speech classification task into distinct functional components: a feature extractor that processes raw speech data through one-dimensional convolution operations, a quantizer that converts feature vectors into discrete representations, and a classifier model that performs the final authentication. This segmentation allows each component to be optimized independently, managing overall system complexity while maintaining high classification accuracy.

Inventive Principle:
Principle #1Segmentation

3Loss of information

If residual vector quantization is applied to process feature vectors, then information representation efficiency is improved, but processing complexity increases

Engineering Contradiction:
Improvefeature representation efficiencyVSAvoidquantization complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent applies residual vector quantization by transforming continuous feature vectors into discrete quantized representations through a learned codebook. This parameter transformation efficiently compresses the feature space while preserving essential speech characteristics, reducing information loss. The residual nature of the quantization allows iterative refinement, improving representation efficiency despite the increased processing complexity of the quantization operation.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20250246185A1Method and apparatus for classifying generated speech
Publication Date: 2025.07.31 FOUND OF SOONGSIL UNIV IND COOP
  • US20250246185A1 patent drawing
  • US20250246185A1 patent drawing
  • US20250246185A1 patent drawing

AI summary

A method and apparatus for classifying generated speech are disclosed. The method for classifying generated speech includes: applying a one-dimensional convolution operation to raw speech data to embed the raw speech data into a feature space and extract a feature vector; quantizing the feature vector by applying it to a residual vector quantizer; and applying the quantized result to a classifier model including a natural language processing model to output a classification label.