Emotion Data Fusion for Privacy-Preserving Communication

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing communication technologies fail to effectively balance the recognition of emotions between communication partners, leading to potential miscommunication due to over-recognition of emotions, especially in private settings, and the need for controlled emotion data provision.

Innovation Solution

An information processing device and communication support system that utilize both public and private emotion sensing to generate shared emotion data by combining external and internal emotion data using a decided combination ratio, allowing controlled disclosure to communication partners.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If emotion recognition is enhanced to improve communication understanding, then communication quality improves, but user privacy is compromised

Engineering Contradiction:
Improveemotion recognition accuracyVSAvoiduser privacy
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent segments emotion data into two distinct categories: public emotion data (from behavior used for communication) and private emotion data (from movement/response not used for communication). This segmentation allows the system to handle different types of emotion information separately, enabling privacy preservation while maintaining communication effectiveness.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by treating different emotion data sources with different levels of disclosure. Public emotion data is disclosed to communication partners to improve communication, while private emotion data is protected. The combination ratio is adjusted locally based on communication atmosphere and partner relationships, allowing selective privacy protection in different contexts.

Inventive Principle:
Principle #3Local quality

2Loss of information

If all emotion data is disclosed to communication partners, then communication understanding improves, but control over personal information is lost

Engineering Contradiction:
Improveemotion information sharingVSAvoiduser control over data
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent implements dynamic control by allowing users to adjust the combination ratio between public and private emotion data based on communication context. The system adapts the disclosure level in real-time according to communication atmosphere and partner relationships, providing flexible control rather than fixed privacy settings.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the parameter of emotion data combination ratio to control information disclosure. By adjusting this ratio parameter, users can control how much private emotion data is mixed with public emotion data for disclosure, enabling fine-grained control over personal information sharing while maintaining communication effectiveness.

Inventive Principle:
Principle #35Parameter changes

3Loss of information

If only public emotion data is used, then privacy is protected, but true emotions may not be accurately reflected

Engineering Contradiction:
Improveprivacy protectionVSAvoidtrue emotion accuracy
Core Design Contradiction:
Loss of informationVSMeasurement precision

Solution Approach 1:

The patent creates composite emotion data by combining public emotion data and private emotion data in a specific ratio. This composite approach allows the system to maintain privacy protection while incorporating private emotion information that reflects true emotions more accurately, achieving both privacy and accuracy goals simultaneously.

Inventive Principle:
Principle #40Composite materials

Data Source

PatentUS20240412560A1Information processing device, communication support device, and communication support system
Publication Date: 2024.12.12 SONY GROUP CORP
  • US20240412560A1 patent drawing
  • US20240412560A1 patent drawing
  • US20240412560A1 patent drawing

AI summary

An information processing device according to the present disclosure includes: a first emotion estimation section configured to generate first emotion data by estimating emotion of a user on the basis of a result of detection made by a first sensing section configured to detect behavior of the user, the behavior being used for communication; a second emotion estimation section configured to generate second emotion data by estimating emotion of the user on the basis of a result of detection made by a second sensing section configured to detect movement or response of the user, the movement or response not being used for communication; an emotion data generation section configured to decide a combination ratio between the first emotion data and the second emotion data, and to generate third emotion data by combining the first emotion data and the second emotion data with use of the decided combination ratio; and a communication section configured to transmit the third emotion data.