Multi-Terminal Virtual Object Viewpoint Synchronization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual reality and augmented reality systems struggle with users having difficulty operating virtual objects shared across multiple terminals, leading to discomfort and inefficiencies in coordinating viewpoints and controls.
Innovation Solution
A system that manages virtual objects by correlating them with real-world features, allowing for seamless switching between different user viewpoints and controlling virtual objects across terminals using management and provision means, including anchor information and viewpoint synchronization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If an image including a virtual object referred to by a certain terminal is shared by another terminal, then the virtual object can be viewed from another terminal's viewpoint, but the user of the other terminal has difficulty operating the virtual object in the image
Solution Approach 1:
The system separates the viewing function from the operation function by introducing a controller terminal. The first terminal (wearable terminal) focuses on displaying the virtual object from its viewpoint, while the second terminal (controller terminal) specializes in receiving operation inputs and transmitting control signals, thereby resolving the operational difficulty faced by users of the first terminal
Solution Approach 2:
The management server acts as an intermediary between terminals. It receives operation information from the controller terminal, manages the virtual object state, and relays control signals back to the appropriate terminal, enabling seamless operation of shared virtual objects across multiple terminals without direct peer-to-peer complexity
2Reliability
If a virtual object is projected onto the real world using a camera to ascertain feature quantities, then the virtual object can be correlated with the real world, but the background image on the wearable terminal side is included in the shared image causing user discomfort
Solution Approach 1:
The system extracts only the necessary operational information from the wearable terminal's viewpoint and transmits it to the controller terminal, excluding unnecessary background image data. This allows the controller terminal to operate the virtual object based on essential viewpoint information without being distracted by the wearable terminal's background image
Solution Approach 2:
The management server preliminarily processes the operation information by extracting key viewpoint parameters before transmitting them to the controller terminal. This preliminary extraction of essential data enables the controller terminal to accurately operate the virtual object without receiving redundant background image information that would cause user discomfort
Data Source
AI summary
A system that manages a virtual object includes: a management means configured to manage viewpoint information of a user of a first terminal for a virtual object which is provided using the first terminal and which is projected in the first terminal for the user of the first terminal; and a provision means configured to provide information of the virtual object to be projected in a second terminal in response to a feature quantity in the real world for displaying the virtual object in correlation with the real world which is detected by the second terminal. Control for switching between projection of the virtual object corresponding to a viewpoint of the user of the first terminal and projection of the virtual object corresponding to a viewpoint other than the viewpoint using the managed viewpoint information on the basis of an instruction for projection of the virtual object is performed in the second terminal.