Performer Avatar Motion Control for Natural Virtual Audience Interaction

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing virtual live performance systems lack natural interaction between performers and audiences due to spatial and positional discrepancies between avatars, leading to unnatural movements and interactions.

Innovation Solution

An information processing device and method that presents audience avatars in a display region recognizable by a performer avatar, and controls the performer avatar's motion based on the performer's motion relative to the audience avatars, adjusting for spatial and positional relationships to create natural interactions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the performer avatar performs motions in a virtual space without considering the positional relationship with audience avatars, then the performance can be delivered to multiple venues simultaneously, but the interaction between performer and audience becomes unnatural

Engineering Contradiction:

Improveability to perform live in multiple venues simultaneouslyVSAvoidnaturalness of interaction between performer and audience

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

The system acquires line-of-sight information of the performer and uses it to determine which audience avatar is being looked at. This feedback loop allows the performer avatar's motions to be adjusted based on the actual positional relationship with audience avatars, making interactions natural while maintaining multi-venue performance capability

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The system dynamically adjusts the performer avatar's line-of-sight and motions based on the real-time positional relationship between the performer and audience avatars in different virtual spaces. This dynamic adaptation enables natural interactions while preserving the ability to perform simultaneously in multiple venues

Inventive Principle:

Principle #15Dynamics

2Device complexity

If the performer avatar's line-of-sight is not adjusted according to the positional relationship with audience avatars, then the system complexity is reduced, but the interaction realism deteriorates

Engineering Contradiction:

Improvesimplicity of motion control systemVSAvoidrealism of performer-audience interaction

Core Design Contradiction:

Device complexityVSReliability

Solution Approach 1:

The system introduces line-of-sight information as an intermediary element that mediates between the performer's actual position and the performer avatar's motions. This intermediary allows the system to maintain relatively simple motion control while achieving realistic interactions by using line-of-sight data to determine which audience avatar should be targeted

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS12579754B2Information processing device and information processing method

Publication Date: 2026.03.17 SONY GROUP CORP

AI summary

A natural interaction between a performer and an audience is realized through a virtual space. An information processing device according to the present disclosure includes: a presentation unit configured to present an image representing an audience avatar group disposed in at least one virtual space in a display region visually recognizable by a performer corresponding to a performer avatar disposed in the virtual space; and a control unit configured to control the performer avatar in the at least one virtual space on the basis of a motion of the performer with respect to the audience avatar group represented by the image presented in the display region.