3D Virtual Interaction Resource Allocation Using Predictive Behaviors
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies for broadcasting 6DoF videos struggle to provide a high-quality bidirectional virtual space experience due to inefficient allocation of processing resources, leading to delays and impaired realism in interactions.
Innovation Solution
An information processing apparatus and method that includes predictive behavior determination units to identify starting and ending interactions, allowing for optimized allocation of processing resources based on user interactions, such as eye contact and gestures, to enhance realism and reduce latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If processing resources are allocated to all user objects uniformly, then processing completeness is maintained, but processing efficiency deteriorates due to wasted resources on non-interacting users
Solution Approach 1:
The patent applies local quality by differentiating processing resource allocation based on interaction state. User objects are classified into different processing levels: interaction target objects receive high-priority processing with high-quality video encoding, while non-interacting user objects receive low-priority processing with low-quality video encoding. This selective quality differentiation resolves the contradiction by concentrating resources on interacting users while reducing resources for non-interacting users.
Solution Approach 2:
The patent uses preliminary action by predicting interaction start behavior before actual interaction occurs. The behavior prediction unit analyzes user behavior patterns to predict when a user is likely to start interacting with another user object. Based on this prediction, processing resources are pre-allocated to the predicted interaction target, ensuring high-quality processing is ready before the interaction actually begins, thus maintaining processing completeness while improving efficiency.
2Manufacturing precision
If high processing resources are allocated continuously, then video quality is improved, but resource waste occurs during non-interaction periods
Solution Approach 1:
The patent implements periodic action by dynamically switching processing resource allocation based on interaction state changes. When interaction start behavior is detected or predicted, the system transitions to high-resource allocation mode for video encoding. When interaction end behavior is detected, the system transitions to low-resource allocation mode. This periodic switching between high and low resource states ensures high video quality during interactions while minimizing resource waste during non-interaction periods.
Solution Approach 2:
The patent applies dynamics by making processing resource allocation flexible and adaptive rather than static. The degree of freedom unit allows user objects to move freely in 3D space, and the behavior prediction unit continuously monitors behavior changes. Based on these dynamic changes, the system adjusts video encoding quality and processing priority in real-time, matching resource allocation to actual interaction needs rather than maintaining constant high-resource allocation.
3Productivity
If processing resources are reduced for non-interacting users, then resource efficiency is improved, but interaction response time may deteriorate if resources are not allocated timely
Solution Approach 1:
The patent uses preliminary action to prevent response time deterioration. The behavior prediction unit continuously analyzes user behavior to predict when an interaction is about to start. When prediction indicates imminent interaction, the system proactively allocates high processing resources to the predicted interaction target before the interaction actually begins. This advance resource allocation ensures that when the interaction starts, high-quality video encoding and low-latency processing are already in place, maintaining fast response time while allowing resource reduction during non-interaction periods.
Solution Approach 2:
The patent implements feedback through continuous monitoring of user behavior and interaction state. The behavior prediction unit feeds back information about predicted interaction targets to the degree of freedom unit and video encoding unit. This feedback loop allows the system to adjust resource allocation dynamically based on actual behavior patterns, ensuring resources are allocated timely to maintain response speed while optimizing overall resource efficiency through accurate prediction and adaptation.
Data Source
AI summary
A present information processing apparatus includes a starting predictive behavior determination unit, an ending predictive behavior determination unit, and a resource setting unit. The starting predictive behavior determination unit determines, with respect to another user object that is a virtual object corresponding to another user within a three-dimensional space, presence or absence of a starting predictive behavior that becomes a sign to start an interaction with a user. The ending predictive behavior determination unit determines, with respect to an interaction target object that is the another user object that has been determined as having taken the starting predictive behavior, presence or absence of an ending predictive behavior that becomes a sign to end the interaction. The resource setting unit sets, with respect to the interaction target object, processing resources that are used in processing for improving reality to be relatively high until it is determined that the ending predictive behavior has been taken.