Remote Live Reaction Synchronization for Presented Video and Voice

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing technologies fail to present videos and voices with less uncomfortable feeling due to delays in communication paths causing deviations in spectator reactions, impairing the sense of unity and participation in remote live events.

Innovation Solution

An information processing device and method that receives reaction information from multiple terminals, generates a presented video or voice based on this information and environment data, and synchronizes the reactions to minimize delays and deviations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If reaction information is transmitted through communication paths, then spectator reactions can be shared across terminals, but delays and deviations occur causing uncomfortable feelings

Engineering Contradiction:

Improvesense of unityVSAvoidcommunication delay

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by predicting future reaction information based on past reaction patterns before the actual reactions occur. This allows the presented video/voice to be synchronized in advance with anticipated reactions, eliminating the uncomfortable delay effect when reactions are displayed.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

Instead of directly transmitting raw reaction data which causes delays, the system creates copied and processed versions of reaction information through prediction algorithms. The predicted reaction data serves as a substitute that maintains temporal coherence without suffering from communication path delays.

Inventive Principle:

Principle #26Copying

2Adaptability or versatility

If reactions from multiple terminals are aggregated, then participation feeling increases, but deviations in timing cause uncomfortable feelings

Engineering Contradiction:

Improveparticipation feelingVSAvoidtiming synchronization

Core Design Contradiction:

Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The system changes the temporal parameters of reaction information by predicting future reaction timings based on historical patterns. This parameter transformation allows reactions from multiple terminals to be synchronized to a common predicted timeline, eliminating timing deviations while preserving the diversity of participant reactions.

Inventive Principle:

Principle #35Parameter changes

Solution Approach 2:

The system uses past reaction data as feedback to predict future reactions. By continuously analyzing the timing patterns of reactions from multiple terminals and using this feedback for prediction, the system achieves precise timing synchronization across all aggregated reactions, creating a coherent multi-participant experience.

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS12549816B2Information processing device and information processing method

Publication Date: 2026.02.10 SONY GROUP CORP

AI summary

Provided is an information processing device that includes a reception unit that receives reaction information indicating a reaction of another user, generated by each of a plurality of other terminals different from an own terminal and a generation unit that generates a presented video or a presented voice corresponding to a plurality of the reactions of the other users, on a basis of a plurality of pieces of the reaction information and environment information indicating an environment of the own terminal. The present technology is applicable to a remote live system.