Real-Time Voice Transformation Selection via Machine Learning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Customer support agents face challenges in managing their speaking manner to achieve desired conversation outcomes, as maintaining vocal changes across multiple calls with diverse issues and callers is difficult due to the high volume and variability of calls in a call center environment.

Innovation Solution

A system that uses machine learning techniques to select and apply voice transformations in real-time, based on confidence scores and trained models, to align voice characteristics with desired conversation outcomes by analyzing caller and agent attributes, as well as conversation types and products, to enhance the effectiveness of customer interactions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If customer support agents intentionally change vocal characteristics for each call, then the desired conversation outcome is improved, but the agent's workload and difficulty are significantly increased

Engineering Contradiction:
Improvedesired conversation outcomeVSAvoidagent's effort to maintain vocal changes
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system enables self-service by having the machine learning model automatically select and apply appropriate voice transformations without requiring the agent to manually adjust their vocal characteristics. The ML model analyzes call attributes and autonomously determines the optimal voice modulation, eliminating the burden of conscious effort from the agent while maintaining reliable conversation outcomes.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system applies parameter changes by dynamically adjusting voice characteristics (pitch, tone, cadence, volume) based on ML model predictions. The voice transformation system modifies acoustic parameters in real-time to match the desired vocal profile for each specific call scenario, thereby improving conversation outcomes without requiring the agent to physically change their speaking manner.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If customer support agents select new vocal characteristics for each separate call, then the effectiveness of customer interactions is improved, but the time and cognitive load required are unsustainable in high-volume environments

Engineering Contradiction:
Improveeffectiveness of customer interactionsVSAvoidtime to select and maintain vocal characteristics
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system implements preliminary action by pre-training the machine learning model on extensive datasets of call attributes and effective voice characteristics. The model learns optimal voice transformations in advance during the training phase, so that during actual calls, the system can rapidly retrieve and apply pre-determined voice profiles without requiring real-time analysis or agent decision-making, thereby saving time in high-volume environments.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system replaces the mechanical system of manual voice adjustment with an automated electronic system. Instead of the agent physically controlling their vocal cords to change pitch, tone, and cadence, the ML model generates transformation parameters that are applied through software-based voice modulation, dramatically reducing the time and cognitive effort required while maintaining or improving interaction effectiveness.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If the system applies complex machine learning models and real-time analysis, then the accuracy of voice transformation selection is improved, but the computational complexity and processing requirements are increased

Engineering Contradiction:
Improveaccuracy of voice transformation selectionVSAvoidsystem complexity for real-time analysis
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system applies segmentation by dividing the complex task of voice transformation selection into distinct modular components: (1) call attribute extraction module that identifies relevant features from the call context, (2) ML model inference module that selects the appropriate voice transformation, and (3) voice synthesis module that applies the transformation. This modular architecture reduces overall system complexity while maintaining high accuracy in voice transformation selection.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11120812B1Application of machine learning techniques to select voice transformations
Publication Date: 2021.09.14 CRESTA INTELLIGENCE INC
  • US11120812B1 patent drawing
  • US11120812B1 patent drawing
  • US11120812B1 patent drawing

AI summary

Techniques for monitoring a conversation in real-time to detect attributes of a conversation, identifying a desired outcome of the conversation, and identifying voice modulations that may be applied to the agent's voice to help accomplish the desired outcome are disclosed. The system may identify voice modulations by comparing a current conversation to one or more prior conversations having desired outcomes similar to that of the current conversation. A trained machine learning model may select and apply voice modulations associated with accomplishing a desired outcome.