Spectator Reaction Visualization in Remote Live Video Streams

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for presenting spectator reactions in remote live events, such as text messages or button selections, inadequately convey excitement, enthusiasm, or support to performers, limiting their motivation and ability to communicate with distant spectators.

Innovation Solution

An information processing device and method that receives spectator reaction information and generates an effect video, which changes based on the reactions, allowing for the visualization of these reactions and enabling communication between performers and spectators through dynamic visual elements like moving fountains, fireworks, or face videos.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If text messages or button selections are used to present spectator reactions, then the implementation is simple, but the excitement and enthusiasm of spectators cannot be sufficiently conveyed to performers

Engineering Contradiction:
Improveimplementation simplicityVSAvoidspectator reaction expression
Core Design Contradiction:
Ease of manufactureVSLoss of information

Solution Approach 1:

The patent applies color changes to visual effects in the video stream to represent different spectator reactions. Different colors indicate different levels of excitement or reaction types, allowing performers to visually perceive spectator enthusiasm without complex text or button interfaces. This resolves the contradiction by maintaining implementation simplicity while significantly improving reaction expression capability.

Inventive Principle:
Principle #32Color changes

Solution Approach 2:

The patent transitions from one-dimensional text or button selections to multi-dimensional visual effects including color, size, position, and animation. These visual dimensions provide richer information about spectator reactions while still being implemented through standard video processing techniques, thus conveying more information without proportionally increasing implementation complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If visual effects are used to present spectator reactions, then the reaction expression is enhanced, but the system complexity increases

Engineering Contradiction:
Improvespectator reaction expressionVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent implements a reaction presentation system that serves multiple functions: it detects spectator reactions, processes the reaction data, generates appropriate visual effects, and integrates these effects into the live video stream. By making the system multi-functional, it achieves enhanced reaction expression without requiring separate complex subsystems for each function, thus controlling overall system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces an intermediary processing layer that receives spectator reaction data and transforms it into visual effects parameters. This intermediary layer acts as a mediator between the simple reaction detection input and the complex visual effect output, managing system complexity by centralizing the transformation logic in a single processing module rather than distributing complexity across multiple components.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS20240378781A1Information processing device and method, and program
Publication Date: 2024.11.14 SONY GROUP CORP
  • US20240378781A1 patent drawing
  • US20240378781A1 patent drawing
  • US20240378781A1 patent drawing

AI summary

The present technology relates to an information processing device, a method, and a program that more effectively display a reaction of a spectator. The information processing device includes a communication unit that receives reaction information indicating the reaction of the spectator outside a venue of a predetermined event and a control unit that generates an effect video that changes according to the reaction of the spectator on the basis of the reaction information. The present technology is applicable to a remote live system.