Remote Conference Atmosphere Visualization via Participant State Metadata

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

As the number of participants in a remote conference increases, it becomes more difficult to grasp the atmosphere of the meeting based solely on voice, image, or video images, as existing technologies do not effectively convey the emotional states and interactions among participants.

Innovation Solution

A system where metadata is transmitted and received among terminal apparatuses, allowing at least one terminal to present the states of participants using pre-determined rules, deduced from their responses, through colors, symbols, or sound effects, and optionally adjusting these based on the number of occurrences or changes in participant states.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If multiple participants join a remote conference, then the conference capacity and productivity increase, but the difficulty to grasp the atmosphere and emotional states of participants increases

Engineering Contradiction:
Improveconference capacityVSAvoiddifficulty to grasp atmosphere
Core Design Contradiction:
ProductivityVSDifficulty of detecting and measuring

Solution Approach 1:

The system segments the complex emotional state of each participant into discrete, standardized state categories (e.g., happy, sad, angry, neutral). This segmentation allows the system to manage and process emotional information from multiple participants without being overwhelmed by the complexity of individual emotional expressions, thereby maintaining the ability to grasp overall atmosphere even as participant numbers increase.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system uses color changes to visually represent different emotional states of participants. By assigning specific colors to specific emotions (e.g., red for anger, green for happiness), the system creates an intuitive visual atmosphere indicator that can be quickly perceived by conference organizers, enabling them to grasp the overall emotional climate without analyzing individual facial expressions or body language in detail.

Inventive Principle:
Principle #32Color changes

2Loss of information

If the system displays detailed image and voice information of each participant, then the information completeness increases, but the ease of operation and atmosphere perception decreases

Engineering Contradiction:
Improveinformation completenessVSAvoidease of atmosphere perception
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system extracts only the most relevant emotional state information from the complete video and audio data of each participant. Instead of displaying all detailed visual and auditory information, it selectively extracts and presents only the emotional state metadata, which is sufficient for grasping the atmosphere while significantly reducing the complexity of operation for conference organizers.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system introduces an intermediary layer of emotional state metadata that mediates between the raw detailed information (video/audio) and the user's need to perceive atmosphere. This intermediary abstraction layer translates complex sensory data into interpretable emotional categories, making atmosphere perception easier without losing essential information about participant states.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS20240064184A1Non-transitory computer readable medium, information processing system, and information processing method
Publication Date: 2024.02.22 FUJIFILM BUSINESS INNOVATION CORP
  • US20240064184A1 patent drawing
  • US20240064184A1 patent drawing
  • US20240064184A1 patent drawing

AI summary

A non-transitory computer readable medium stores a program causing a computer to execute a process for information processing for a room in which metadata is transmitted and received by multiple terminal apparatuses, and the process includes causing at least one of the multiple terminal apparatuses to present states of multiple participants in the room in accordance with a shared rule determined in advance, the states being deduced from responses of the multiple participants.