Empathy Confidence Score for Customer Service Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Customer service representatives face challenges in determining and improving their empathetic behavior during communications, as existing technologies lack reliable and accurate methods for real-time analysis and feedback.

Innovation Solution

A system utilizing artificial intelligence-based speech recognition and facial recognition techniques to analyze voice characteristics, keywords, and facial expressions, generating an empathy confidence score and providing real-time feedback to enhance empathetic behavior.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple analysis modules (voice, text, facial expression) are integrated to comprehensively assess empathy, then measurement precision of empathy level is improved, but device complexity increases

Engineering Contradiction:
Improveempathy assessment accuracyVSAvoidsystem structure complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The empathy assessment system is divided into three independent analysis modules: voice analysis module (analyzing tone, pitch, volume), text analysis module (analyzing speech content and keywords), and facial expression analysis module (analyzing physical expressions via camera). Each module independently processes its specific data type and generates separate scores, which are then aggregated to form the overall empathy confidence score. This segmentation allows comprehensive assessment while maintaining manageable module complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent combines multiple analysis modules (voice, text, facial expression) into a unified empathy assessment system. The individual scores from each module are merged through a classification model to generate a comprehensive empathy confidence score. This merging approach enables holistic empathy measurement that leverages the strengths of each individual module while presenting a unified interface to the user.

Inventive Principle:
Principle #5Merging (Combining)

2Loss of time

If real-time analysis of voice, text, and facial expressions is performed, then empathy feedback timeliness is improved, but computing power consumption increases

Engineering Contradiction:
Improvefeedback delayVSAvoidcomputing resource consumption
Core Design Contradiction:
Loss of timeVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary analysis by converting speech to text and extracting keywords before full empathy assessment. The voice analysis module pre-processes audio signals to identify vocal cues, and the facial expression module pre-identifies key facial features. These preliminary actions reduce the computational burden of the final empathy scoring while maintaining real-time responsiveness.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system selectively analyzes specific features rather than processing all data equally. The text analysis module focuses on extracting empathy-related keywords rather than analyzing every word. The facial expression module identifies specific emotional indicators rather than tracking all facial movements. This partial action approach reduces computing power consumption while maintaining accurate real-time empathy assessment.

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If automated empathy analysis and software execution are implemented, then productivity of empathy training is improved, but ease of operation decreases

Engineering Contradiction:
Improveempathy skill development speedVSAvoidsystem operation simplicity
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The system automatically generates empathy confidence scores and provides real-time feedback to the communication participant. The classification model compares analyzed behavior against empathy standards and delivers actionable recommendations through a user interface. This automated feedback loop enables rapid empathy skill development without requiring manual evaluation, significantly improving productivity while the standardized interface maintains ease of operation.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system enables self-service empathy training by automatically analyzing the participant's own communication patterns and providing personalized feedback. The participant receives real-time guidance on their voice tone, text content, and facial expressions without requiring external trainers or complex manual assessment procedures. This self-service approach accelerates productivity while keeping the system easy to operate.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10755712B2Automated execution of computer software based upon determined empathy of a communication participant
Publication Date: 2020.08.25 FMR CORP
  • US10755712B2 patent drawing
  • US10755712B2 patent drawing
  • US10755712B2 patent drawing

AI summary

Methods and apparatuses are described for automated execution of computer software based upon determined empathy of a communication participant. A server captures a digitized voice segment from a remote computing device. The server analyzes vocal cues of the digitized voice segment to generate a voice empathy score. The server converts speech in the digitized voice segment into text and determines empathy keywords in the text to generate a keyword empathy score. The server captures digitized images of the participant's face and analyzes physical expressions of the face to identify emotions and generate a facial empathy score. The server generates an overall empathy confidence score for the communication participant based upon the voice empathy score, the keyword empathy score, and the facial empathy score. The server generates recommended changes for the user based upon the overall empathy confidence score and executes a software application that displays the recommended changes.