VR Viewing System One-to-One Interaction via Character Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current VR live performance systems struggle to provide realistic interactions between viewing users and performer characters, as existing technologies can only facilitate one-to-many interactions, leading to delayed responses from performers, which diminishes the immersive experience.
Innovation Solution
A viewing system that captures physical motions of multiple performers and allows real-time control of performer characters, enabling one-to-one interactions by using motion capture systems, behavior control units, and decision units to render and present binocular stereopsis content, allowing viewing users to influence the behaviors of performer characters based on their inputs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If one-to-many interaction mode is used to enable feedback from viewing users to performer characters, then the system can collect operational inputs and control mob character behaviors, but the response timing is delayed and realistic sensations wane
Solution Approach 1:
The system segments the performer characters into multiple independent character instances, each capable of receiving and responding to operational inputs from viewing users. This segmentation enables one-to-one interaction between each performer character and viewing users, eliminating the response delays inherent in aggregated one-to-many interaction modes while maintaining system versatility.
2Adaptability or versatility
If multiple performer characters are arranged in three-dimensional space to enable individual interactions, then one-to-one interactions become possible, but the device complexity increases
Solution Approach 1:
The system creates virtual copies of performer characters in the three-dimensional space, where each copy can independently interact with viewing users. These copied character instances inherit the base performer's properties and behaviors, enabling multiple simultaneous one-to-one interactions without proportionally increasing the complexity of the underlying system architecture.
3Reliability
If real-time motion capture and behavior control is implemented for multiple performer characters, then realistic sensations are enhanced, but the processing requirements and system resources increase
Solution Approach 1:
The system performs preliminary preparation by pre-configuring multiple performer character instances with their behavior patterns and interaction protocols before the viewing session begins. Motion capture data and operational inputs are pre-processed and buffered, allowing real-time behavior control of multiple characters without overwhelming processing resources during the actual interaction.
Data Source
AI summary
A viewing system provides a viewing user with an experience of viewing a content that presents a character whose behaviors are controlled based on physical motions of a performer, the content being a binocular stereopsis content that presents staging in a 3D space in which a first character associated with a first performer and a second character associated with a second performer are arranged. The first character is arranged in a first region in the space, a viewpoint associated with the viewing user and the second character are arranged in a second region in the space. The system controls behaviors of the first character based on first motion information of the first performer, and controls behaviors of the second character based on at least one of second motion information of the second performer and information of an operational input performed by the viewing user.