Virtual Object Data Selection for Visibility-Aware XR Transmission
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing XR technologies inefficiently transmit and receive virtual object data, leading to unnecessary data transmission and poor user experience due to invisible objects being included in the data transfer.
Innovation Solution
A virtual object data selection apparatus that selects and transmits only visible or potentially visible virtual object data based on user location, real object shapes, and virtual object arrangements, using a selector and transmission controller to optimize data transfer.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If all virtual object data for virtual objects in an area is transmitted to the XR device, then the user can access all virtual objects in the area, but unnecessary data transmission occurs when visibility is poor, reducing transmission efficiency
Solution Approach 1:
The patent extracts only the necessary virtual object data that will be visually recognized by the user based on their location and viewing direction. The selection apparatus determines which virtual objects are visible from the user's perspective and transmits only that data, eliminating unnecessary data transmission for invisible objects.
Solution Approach 2:
The patent applies local quality by differentiating the treatment of different virtual objects based on their visibility from the user's location. Instead of uniformly transmitting all virtual object data in an area, the system selectively transmits data only for objects that are locally relevant to the user's current viewing context.
2Reliability
If virtual object data is transmitted based on area location, then users can access virtual objects, but large virtual objects are not transmitted until the user enters the area, causing delays
Solution Approach 1:
The patent implements preliminary action by transmitting virtual object data in advance based on predicted user movement and viewing direction. The selection apparatus predicts which objects the user will likely view and transmits that data before the user actually needs it, ensuring objects are ready for immediate display.
Solution Approach 2:
The patent applies dynamics by continuously updating the selection of virtual object data based on real-time changes in user location and viewing direction. The system dynamically adjusts which objects are transmitted based on the user's current and predicted viewing interests, rather than using static area-based transmission.
3Loss of information
If all virtual objects in an area are transmitted regardless of visibility, then complete object information is provided, but data volume increases unnecessarily
Solution Approach 1:
The patent extracts only the essential information for virtual objects that are actually visible from the user's location. By determining visibility based on user position and viewing direction, the system extracts and transmits only the necessary object data, reducing overall data volume while maintaining information completeness for relevant objects.
Solution Approach 2:
The patent applies partial action by transmitting data for only a subset of virtual objects rather than all objects in an area. This partial transmission approach provides sufficient information for visible objects while avoiding the excessive data transmission that would occur if all objects were transmitted regardless of visibility.
Data Source
AI summary
A selector selects at least one piece of virtual object data from plural pieces of virtual object data based on first location information, first shape information, plural pieces of second shape information, and plural pieces of second location information. The first location information indicates a location of a user in a real space. The first shape information indicates a shape of a real object located in the real space. Each piece of second shape information indicates a shape of a corresponding one of the virtual objects. Each piece of second location information indicates a location in which a corresponding one of the virtual objects is arranged in the real space. A transmission controller transmits virtual object data to a display device. The selector estimates at least one visible object visually recognizable from the location of the user and selects virtual object data corresponding to the at least one visible object as the at least one piece of virtual object data.