Perceptual Property Vector for XR Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing devices that present environments, such as smartphones, are ineffective in allowing users to interact with the environment effectively.
Innovation Solution
Generating a perceptual property vector (PPV) for graphical objects in extended reality (XR) environments, which includes synthesizing XR representations of physical elements and bounding surfaces based on semantic labels, and compositing affordances to enable interaction with these representations according to their perceptual characteristic values.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional environment presentation devices are used, then basic display functionality is provided, but user interaction effectiveness is poor
Solution Approach 1:
The patent transforms environmental data into perceptual property vectors that encode multiple sensory dimensions (visual, auditory, haptic, olfactory, gustatory parameters). This parameter transformation enables more effective user interaction by presenting environmental characteristics in a format that human perception can naturally process and respond to.
Solution Approach 2:
The perceptual property vector acts as an intermediary between raw environmental sensor data and user interaction. It translates complex sensor inputs into standardized perceptual characteristics that can be consistently processed by XR systems, improving both interaction effectiveness and reliability.
2Reliability
If XR environments are created without perceptual property vectors, then development is simpler, but realism and similarity to physical world are reduced
Solution Approach 1:
The system pre-computes perceptual property vectors from environmental sensor data before XR rendering. This preliminary processing organizes complex sensor information into structured perceptual characteristics, reducing runtime complexity while maintaining high realism in the XR experience.
Solution Approach 2:
The patent transforms raw sensor parameters into standardized perceptual property vectors that encompass multiple sensory modalities. This parameter transformation creates a comprehensive representation of physical environment properties, enhancing XR realism without requiring complex individual processing of each sensor type during runtime.
3Measurement precision
If multiple sensor types are integrated, then environmental perception accuracy is improved, but device complexity increases
Solution Approach 1:
The patent merges data from multiple sensor types (cameras, microphones, haptic sensors, olfactory sensors, gustatory sensors) into unified perceptual property vectors. This consolidation maintains high environmental perception accuracy by integrating diverse sensor inputs while reducing system complexity through a standardized output format that encompasses all sensory modalities.
Data Source
AI summary
In some implementations, a method includes obtaining a semantic construction of a physical environment. In some implementations, the semantic construction of the physical environment includes a representation of a physical element and a semantic label for the physical element. In some implementations, the method includes obtaining a graphical representation of the physical element. In some implementations, the method includes synthesizing a perceptual property vector (PPV) for the graphical representation of the physical element based on the semantic label for the physical element. In some implementations, the PPV includes one or more perceptual characteristic values characterizing the graphical representation of the physical element. In some implementations, the method includes compositing an affordance in association with the graphical representation of the physical element. In some implementations, the affordance allows interaction with the graphical representation of the physical element in accordance with the perceptual characteristic values included in the PPV.