Virtual Object Rendering for Multi-User AR View Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In mixed reality and augmented reality systems, users at different locations experience optical deviations and discomfort due to differing real-space environments, making it difficult for multiple users to synchronize their views of virtual objects accurately.
Innovation Solution
An information processing apparatus that includes a receiver to acquire virtual object information and surrounding environment data, generating and controlling the display of a virtual object image based on both, ensuring synchronization across multiple users.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a virtual object is displayed in a real space using MR or AR techniques, then the user can view the virtual object superimposed on the real space, but optical deviation is generated between the views of the real space and the virtual object when users are at different locations
Solution Approach 1:
The patent applies local quality by capturing the specific surrounding environment of each user location and using that local environmental data to adjust the virtual object rendering. Each user receives a customized virtual object image that matches their specific real-space environment, rather than using a universal rendering approach. This resolves the optical deviation issue by making the virtual content adapt to local environmental conditions at each user's location.
Solution Approach 2:
The patent implements preliminary action by capturing and storing the surrounding environment information of different user locations in advance. Before users view the virtual objects, the system pre-acquires environmental data (such as background images, lighting conditions, and spatial characteristics) for each location. This pre-captured environmental data is then used to adjust and render the virtual objects appropriately for each user's specific environment, preventing optical deviation before it occurs.
2Device complexity
If the same virtual object is rendered for all users, then the system complexity is reduced, but users at different locations experience different optical conditions and discomfort
Solution Approach 1:
The patent introduces an intermediary mechanism - the surrounding environment information - that mediates between the virtual object and each user's real-space environment. Instead of directly rendering different virtual objects for each user (which would increase complexity), the system uses environmental data as an intermediary to adjust and adapt the virtual object presentation. This intermediary approach maintains system simplicity while ensuring each user experiences optically consistent and comfortable viewing in their specific environment.
3Measurement precision
If environment information is captured and processed for each user location, then optical deviation is reduced, but the information processing load increases
Solution Approach 1:
The patent reduces processing energy consumption by performing preliminary action - capturing and storing surrounding environment information in advance at each user location. Instead of processing environmental data in real-time when users need to view virtual objects, the system pre-acquires and stores environmental data (such as background images and spatial characteristics). This pre-processing approach shifts the computational load to an earlier stage, reducing the energy required during actual virtual object rendering and user interaction.
Data Source
AI summary
An information processing apparatus according to the present invention is a client apparatus connected to a network, and includes: a receiver configured to receive first information, which is information on a virtual object, via the network; and a controller configured to acquire second information, which is information on environment of surrounding of the client apparatus, generate an image of the virtual object on a basis of the first information and the second information, and control so that the generated image of the virtual object is displayed on a display.