Emotion-Based Voice Assistance System for Personalized Interaction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional digital convergence systems lack the ability to provide emotionally intelligent interactions, resulting in robotic responses that fail to mimic human-like conversations, limiting their effectiveness in providing personalized assistance.

Innovation Solution

A personalized voice assistance system that utilizes a network of sensors and machine learning to detect activities and emotional states of individuals, generating a voice output similar to a designated individual based on their emotional reaction, providing real-time assistance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a typical two-party command-response interaction is used between devices, then the interaction is simple and direct, but the response sounds robotic and fails to mimic intelligent human-like responses with emotional reaction

Engineering Contradiction:
Improveinteraction simplicityVSAvoidemotional intelligence
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The system copies the voice characteristics and emotional patterns of absent individuals to generate responses. By analyzing voice footprints and emotional reactions from recorded interactions, the system creates synthetic responses that mimic the absent person's communication style, thereby providing emotionally intelligent assistance while maintaining interaction simplicity

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system introduces an intermediary layer between the command and response that processes emotional context and voice characteristics. This intermediary analyzes the emotional state of both the present and absent individuals, then generates responses that incorporate appropriate emotional reactions, bridging the gap between simple command-response and human-like emotional interaction

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If emotion-based voice generation is implemented, then human-like emotional responses are achieved, but system complexity increases due to multiple sensors and machine learning components

Engineering Contradiction:
Improveemotional intelligenceVSAvoidsystem architecture
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system employs a multi-functional architecture where a single processor performs multiple tasks: detecting activities through sensor data, analyzing emotional states from voice and other inputs, generating emotional reactions, and synthesizing voice outputs. This universal processor approach consolidates what could be separate complex subsystems into one integrated unit, reducing overall system complexity while maintaining emotional intelligence capabilities

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system performs preliminary actions by pre-collecting and storing voice footprints and emotional reaction patterns from absent individuals during normal interactions. This pre-processing of emotional and vocal data creates a ready-to-use repository that speeds up real-time response generation, reducing the computational complexity required during actual assistance scenarios

Inventive Principle:
Principle #10Preliminary action

3Productivity

If real-time activity detection and emotion computation are performed, then personalized assistance is provided, but processing time and computational resources increase

Engineering Contradiction:
Improvepersonalization speedVSAvoidprocessing delay
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system performs preliminary analysis by continuously monitoring and pre-processing sensor data, voice patterns, and emotional indicators even when no assistance is immediately required. This ongoing background processing ensures that when an assistance scenario arises, the system already has processed emotional states and activity contexts ready, enabling rapid personalized response generation without significant processing delays

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses self-service mechanisms by leveraging existing sensor networks and device data that are already collecting information about user activities and environmental context. By repurposing this existing data infrastructure for emotional analysis and assistance determination, the system avoids the time and resource costs of building separate detection systems, achieving fast personalization with minimal additional processing overhead

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10497360B2Personalized assistance system based on emotion
Publication Date: 2019.12.03 SATURN LICENSING LLC
  • US10497360B2 patent drawing
  • US10497360B2 patent drawing
  • US10497360B2 patent drawing

AI summary

A personalized voice assistance system and method to provide a personalized emotion-based assistance to a first individual from a group of individuals are disclosed. The personalized voice assistance system detects an activity of the first individual in a first time period in a defined area. A requirement of an assistance for the first individual may be determined based on the detected activity in the defined area. The personalized voice assistance system may further compute, based on the detected activity, an emotional reaction of a second individual from the group of individuals. The emotional reaction of the second individual may be computed for the determined requirement of the assistance for the first individual. The personalized voice assistance system may further generate an output voice similar to the second individual based on at least the computed emotional reaction to assist the first individual.