VR User Address Signaling for Multiuser Video Communication
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In multiuser communication scenarios combining VR and video, remote users often cannot determine if they are being addressed by the local user, as the same video feed is provided to all, obscuring cues like gaze and orientation.
Innovation Solution
Detect communication intent from the local user and generate communication data differently for target and non-target remote users, using graphical indicators or adjusted video feeds to signal address status.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the same video feed is provided to all remote users, then system complexity is reduced and ease of operation is improved, but remote users cannot determine if they are being addressed and communication clarity deteriorates
Solution Approach 1:
The video feed is segmented into different versions based on communication intent. When the local user addresses a specific remote user, a first version of the video feed is provided to that user showing the local user's face and orientation cues. Other remote users receive a second version that may show a different view or indicate they are not addressed, enabling them to determine their address status without complicating the overall system operation
Solution Approach 2:
Different quality attributes are applied to different portions of the communication stream. The video feed received by the target user includes enhanced facial expressions, eye gaze direction, and body orientation cues that are optimized for that specific user. Other users receive a version with reduced or modified these cues, allowing each user to receive appropriately tailored information without requiring complete system redesign
2Loss of information
If graphical indicators or adjusted video feeds are used to signal address status, then communication clarity is improved, but device complexity increases
Solution Approach 1:
An intermediary processing layer is introduced between the local user's video feed and the remote users' displays. This intermediary automatically detects communication intent through voice analysis, avatar orientation, or explicit user input, and dynamically generates appropriate visual indicators or adjusted video feeds for each remote user. This approach maintains communication clarity while minimizing the complexity burden on individual devices by centralizing the processing logic
Solution Approach 2:
Instead of requiring complex real-time processing at each device, the system creates simplified copies or representations of the communication state. Visual indicators such as highlighted avatars, colored borders, or symbolic markers are generated as copies that convey address status without requiring the full complexity of analyzing and processing the original communication context at each endpoint
3Measurement precision
If different communication data is generated for target and non-target users, then information accuracy is improved, but processing time and productivity are reduced
Solution Approach 1:
The system performs preliminary detection of communication intent before generating the actual communication data. By analyzing voice patterns, avatar orientation, or user selections in advance, the system pre-determines which remote users are being addressed and prepares the appropriate video feed versions or visual indicators beforehand. This preliminary action ensures high information accuracy while reducing processing time during the actual communication moment
Solution Approach 2:
The system applies partial processing only to the extent necessary for each user type. Target users receive fully processed communication data with all relevant cues, while non-target users receive a simplified version with only the essential information needed to understand they are not addressed. This selective processing level maintains information accuracy for those who need it while significantly reducing overall processing time and computational resources
Data Source
Figure 1A~1B
Figure 2
Figure 3
AI summary
A system and method are provided for facilitating multiuser communication in a Virtual Reality [VR] environment (10). The multiuser communication may invovle a VR device configured to render the VR environment (10) to a local user (5), a plurality of remote communication devices which enable respective remote users to participate in the multiuser communication, and a camera (120) configured to record video of the local user (5) and to transmit the video as part of communication data to the plurality of remote communication devices for remote rendering of the video. The system and method may detect communication (15), or an intent of communication, from the local user (5) to at least one of the remote users so as to identify a target user and thereby a target communication device of the target user, and differently generate the communication data for a) the target communication device, and b) other remote communication devices of other remote users, to signal whether a particular remote communication device is addressed by the communication, e.g., using a graphical indicator (50).