Speaker Role Determination and Identifying Information Scrubbing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems fail to accurately determine speaker roles in conversations and effectively scrub identifying information from audio and text data, leading to privacy and data security risks, as well as errors in conversation metrics analysis.

Innovation Solution

The system employs machine learning algorithms and automatic speech recognition to identify speaker roles by classifying data into portions based on characteristics and scrubbing identifying information using contextual analysis and key phrases, replacing sensitive data with placeholders to maintain privacy and data security while preserving conversation context.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Weight of moving object

If speaker diarization is used to separate audio data into segments corresponding to different participants, then the audio data can be divided into portions related to different speaking parties, but the participants' roles in the conversation remain unknown

Engineering Contradiction:
Improvedata segmentation capabilityVSAvoidspeaker role information
Core Design Contradiction:
Weight of moving objectVSLoss of information

Solution Approach 1:

The system segments audio data into portions corresponding to different speaking parties using speaker diarization, then further segments these portions by identifying and separating identifying information segments from non-identifying information segments, enabling role-specific processing while maintaining data structure

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces an intermediary classification process that analyzes characteristics of speaking parties (such as speech patterns, vocabulary, and contextual cues) to determine their roles, acting as a mediator between raw audio segments and meaningful role identification

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If identifying information for users and customers is recorded during interactions, then complete conversation data is captured, but privacy and data security risks increase

Engineering Contradiction:
Improveconversation data completenessVSAvoidprivacy and data security risks
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The system extracts identifying information segments from the audio data through pattern recognition and keyword detection, then separates these segments from the main conversation data, removing the harmful identifying elements while preserving the useful conversational content for analysis

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system applies different quality treatments to different portions of the audio data: identifying information segments are removed or redacted to protect privacy, while non-identifying information segments are preserved in full detail to maintain conversation context and analytical value

Inventive Principle:
Principle #3Local quality

3Productivity

If all conversation data is retained for metrics analysis, then comprehensive performance evaluation is possible, but data processing complexity and computational resources increase

Engineering Contradiction:
Improvemetrics analysis comprehensivenessVSAvoiddata processing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system segments conversation data into role-specific data sets by identifying speaking party roles and separating their contributions, then processes each segment independently for metrics analysis, reducing overall computational complexity while maintaining comprehensive evaluation capability

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system processes only the necessary portions of conversation data relevant to each speaking party's role performance rather than analyzing every segment uniformly, applying partial processing actions that are sufficient for metrics evaluation without unnecessary computational overhead

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11062706B2System and method for speaker role determination and scrubbing identifying information
Publication Date: 2021.07.13 MICROSOFT TECHNOLOGY LICENSING LLC
  • US11062706B2 patent drawing
  • US11062706B2 patent drawing
  • US11062706B2 patent drawing

AI summary

Methods for speaker role determination and scrubbing identifying information are performed by systems and devices. In speaker role determination, data from an audio or text file is divided into respective portions related to speaking parties. Characteristics classifying the portions of the data for speaking party roles are identified in the portions to generate data sets from the portions corresponding to the speaking party roles and to assign speaking party roles for the data sets. For scrubbing identifying information in data, audio data for speaking parties is processed using speech recognition to generate a text-based representation. Text associated with identifying information is determined based on a set of key words/phrases, and a portion of the text-based representation that includes a part of the text is identified. A segment of audio data that corresponds to the identified portion is replaced with different audio data, and the portion is replaced with different text.