XR Occluded Data Visualization Using Gesture-Based Front Data Removal
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In extended reality (XR) environments, it is challenging for users to understand and interact with occluded data structures due to overwhelming amounts of continuous data, making it difficult to visualize hidden data elements or phenomena.
Innovation Solution
A computer-implemented method allowing users to control the visualization of occluded data through intuitive hand gestures, enabling the XR device to change the view by removing or manipulating the representation of front data to reveal occluded data, using gestures to specify direction, depth, width, and angle of removal.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If continuous data structures are visualized in XR, then comprehensive data representation is achieved, but data occlusion and understanding difficulty increase
Solution Approach 1:
The patent segments the continuous data structure into discrete volumetric elements (voxels) that can be individually manipulated. Users can select and remove specific voxel groups to reveal occluded data behind them, transforming the overwhelming continuous data into manageable segments while preserving the complete data representation.
Solution Approach 2:
The patent enables extraction of specific data elements (voxels) from the continuous data structure. By removing selected voxel groups, the system extracts foreground data that blocks the view, allowing users to access and understand previously occluded data without losing the extracted elements permanently.
2Shape
If data structures are displayed in XR, then spatial visualization is improved, but occluded data becomes invisible
Solution Approach 1:
The patent introduces dynamic interaction where data structures can be temporarily removed and restored. The front data voxels can be dynamically removed to reveal occluded data, then restored to return to their original positions, providing flexible control over visibility while maintaining spatial visualization integrity.
Solution Approach 2:
The patent implements temporary discarding of front data voxels to access occluded data, with the capability to recover these voxels by restoring them to their original positions. This allows users to discard blocking data temporarily for inspection, then recover it to maintain the complete spatial representation.
3Loss of information
If user interacts with data by changing point of view, then occluded data can be seen, but interaction complexity increases
Solution Approach 1:
Instead of requiring users to change their viewpoint to see occluded data, the patent extracts (removes) the blocking front data voxels directly from the scene. This allows users to view occluded data from their original position without changing their point of view, simplifying the interaction.
Solution Approach 2:
The patent uses gesture recognition as an intermediary mechanism to control data removal. Users perform simple hand gestures that are translated into commands to remove specific voxel groups, providing an intuitive interface that avoids complex interaction requirements while achieving the goal of viewing occluded data.
Data Source
AI summary
A computer-implemented method for visualizing, in an extended reality (XR), occluded data, the XR visualizing front data, behind which the occluded data is hidden, the method comprising: displaying a view on the XR to a user on an XR device, the view comprising 3D representations of the visualized front data; receiving commands from the user regarding a change of the view on the XR; and changing the view on the extended reality based on the commands, wherein receiving the commands comprises performing a gesture recognition procedure to detect execution of pre-defined gestures by the user, wherein each of the pre-defined gestures is interpreted as a corresponding command for the XR device.