AI Voice Communication via STT-TTS for Low-Bandwidth Networks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing voice communication systems consume significant bandwidth, especially in limited network conditions, and there is a need for a method that minimizes bandwidth usage while maintaining speaker's voice fidelity and personal nuances.
Innovation Solution
A system utilizing Al-based Speech-to-Text (STT) and Text-to-Speech (TTS) models to convert voice signals to text and back, preserving speaker characteristics through metadata transmission, reducing bandwidth requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If audio data is transmitted using traditional voice communication systems, then real-time communication is achieved, but bandwidth consumption increases significantly
Solution Approach 1:
The patent extracts only the essential information from audio signals by converting speech to text, transmitting only the text data, and then reconstructing speech on the receiving end. This extraction of core information (text representation) eliminates the need to transmit the full audio data, significantly reducing bandwidth consumption while maintaining communication functionality.
Solution Approach 2:
The patent introduces text as an intermediary medium between the sender's speech and the receiver's reconstructed speech. Instead of directly transmitting audio signals, the system uses text transcription as a mediator that can be efficiently transmitted over networks with limited bandwidth, then converted back to speech form at the destination.
2Quantity of substance
If audio compression codecs are used to reduce data size, then bandwidth usage decreases, but voice fidelity and personal nuances are still compromised compared to text-based transmission
Solution Approach 1:
The patent creates a text copy of the spoken information that can be transmitted efficiently, then generates a synthesized speech copy at the receiving end. This copying approach allows the original audio to be replaced with a text representation that consumes less bandwidth, while the synthesized copy restores the voice experience for the receiver.
Solution Approach 2:
The patent changes the parameter of data representation from audio waveforms to text characters. This parameter change fundamentally alters how voice information is encoded and transmitted, transitioning from continuous analog/digital audio signals to discrete text representations, which are more bandwidth-efficient while preserving the essential information content.
3Quantity of substance
If text transcription is transmitted instead of audio, then bandwidth utilization is optimized, but speaker's voice characteristics may be lost
Solution Approach 1:
The patent uses text transcription as an intermediary that carries the essential information from sender to receiver. The text serves as a compact representation that can be efficiently transmitted, and then synthesized speech acts as another intermediary to restore the voice characteristics at the receiving end, allowing bandwidth optimization without permanent loss of voice information.
Solution Approach 2:
The patent replaces the mechanical transmission of audio signals with an information-based system using text and synthesis. Instead of transmitting the actual voice waves, the system transmits text information and uses computational synthesis to recreate the voice characteristics, substituting physical audio transmission with information processing and regeneration.
Data Source
Figure 1A
Figure 1B
Figure 2
AI summary
A system for providing voice communication with efficient bandwidth utilization, comprising a sender's terminal device for receiving speech signals as an input from a sender; an Al-based Speech-To-Text (STT) conversion model, on the sender's terminal device, for generating a text transcription of the input speech signals, the sender's terminal device is adapted to transmit the text transcription to a receiver's terminal device, over a data communication network; a receiver's terminal device being adapted to receive the transmitted text transcription and generate synthesized speech reconstruction of the speech signals using an Al-based Text-To-Speech (TTS) conversion model, running on the receiver's terminal device.