Video Chat Character Object State Display Controller

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video chat systems face challenges in accurately representing user states, leading to miscommunication between participants, as they fail to effectively display the status of users engaged in other activities or distracted by background noise, which can hinder seamless interaction.

Innovation Solution

An information processing system that includes a receiver, an executing portion, a specifying portion, and a controller to receive and analyze user terminal information, specifying user states based on movement and sound data, and adjusting the display mode of character objects accordingly, such as indicating if a user is not looking at the screen, not speaking, or distracted by background noise.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If the system displays character objects without additional indicators, then the display is simple and clear, but the user state information is insufficient leading to miscommunication

Engineering Contradiction:
Improveuser state informationVSAvoiddisplay complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The display is segmented into multiple layers: the base character object and optional overlay indicators. Indicators are only displayed when specific conditions are met (e.g., user not looking at screen, background noise detected), allowing information to be divided into essential always-visible elements and conditional supplementary elements.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different visual indicators are applied to different character objects based on their specific states. Each user's character object receives customized indicators reflecting their individual situation (e.g., headphones icon for music listening, noise indicator for background sound), making the information presentation locally optimized for each participant.

Inventive Principle:
Principle #3Local quality

2Reliability

If the system monitors and displays multiple user states, then communication clarity is improved, but the processing complexity and computational load increase

Engineering Contradiction:
Improvecommunication reliabilityVSAvoidsystem processing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system pre-defines specific user states and their corresponding indicators before runtime (e.g., not looking at screen, music listening, background noise). During video chat, the system only needs to check which pre-defined state applies rather than analyzing all possible states from scratch, reducing real-time processing complexity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system monitors changes in key parameters (movement data, audio levels, application state) and triggers indicator display only when parameters cross specific thresholds or change state. This event-driven approach reduces continuous processing load while maintaining reliable detection of meaningful state changes.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If the system continuously monitors user movement and audio data, then user state detection accuracy is improved, but the energy consumption and processing load increase

Engineering Contradiction:
Improveuser state detection accuracyVSAvoidenergy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

Instead of continuous monitoring, the system performs periodic checks at intervals or triggers analysis only when state changes are detected. For example, movement data is analyzed periodically rather than continuously, and audio monitoring is activated only when speech or significant background noise is detected, reducing energy consumption while maintaining detection accuracy.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system utilizes data already being collected by the user's device (camera, microphone, accelerometer) for video chat purposes. This existing sensor data is repurposed for state detection without requiring additional dedicated sensors or continuous high-power monitoring, allowing the device to serve multiple functions with minimal additional energy expenditure.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS20230412766A1Information processing system, information processing method, and computer program
Publication Date: 2023.12.21 GREE HOLDINGS INC
  • US20230412766A1 patent drawing
  • US20230412766A1 patent drawing
  • US20230412766A1 patent drawing

AI summary

An information processing system includes one or more processors programmed to receive information for generating a video, including information related to movement of a user, information related to sound, and information related to a character object, that is sent from a user terminal of the user; execute a video chat between a plurality of users using character objects, based on the received information for generating the video; specify a state of the user terminal; and change a display mode of the character object corresponding to the user terminal according to the specified state of the user terminal.