Mixed Reality Headset Social Rule Inference
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mixed reality environments face challenges in managing and controlling the overwhelming amount of virtual information presented to users, particularly in automatically displaying relevant virtual objects based on social interactions and relationships, leading to user fatigue and complexity in privacy settings management.
Innovation Solution
A see-through head-mounted display device identifies real objects and detects interactions, using social rules to infer relationships and automatically display virtual objects, allowing for dynamic management of virtual information and sharing between devices based on inferred relationships, with privacy settings determined by proximity and interaction context.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If virtual information is automatically displayed based on social interactions and relationships, then user overload is reduced and relevant information is provided, but the complexity of privacy settings management and system complexity increases
Solution Approach 1:
The system automatically infers social relationships and determines privacy settings without requiring manual user configuration. The mobile device autonomously analyzes sensor data, interaction patterns, and contextual information to dynamically adjust which virtual information is displayed, eliminating the need for users to manually manage complex privacy settings while still providing relevant information filtering
Solution Approach 2:
Social rules act as an intermediary layer between raw sensor data and virtual information display decisions. The system uses predefined social rules that encode relationship inference logic and privacy determination criteria, mediating between complex data inputs and simplified user experience by automatically translating interactions into appropriate information filtering without exposing users to the underlying complexity
2Loss of information
If social rules are used to infer relationships and automatically display virtual objects, then information relevance is improved, but the complexity of detecting and measuring interactions increases
Solution Approach 1:
The mobile device utilizes its existing multi-functional sensor suite (camera, microphone, accelerometer, GPS) for purposes beyond their traditional functions. These sensors simultaneously capture data for navigation, photography, and social interaction analysis, enabling relationship inference without requiring dedicated detection hardware and reducing the complexity of interaction measurement
3Adaptability or versatility
If virtual information is dynamically managed based on context and proximity, then user experience is enhanced with personalized content, but the processing requirements and energy consumption increase
Solution Approach 1:
Social rules and relationship inference criteria are pre-computed and stored in the system before runtime. The mobile device loads predefined social rules that encode relationship types, privacy settings, and information filtering criteria, allowing rapid contextual matching during operation without performing complex computations in real-time, thereby reducing energy consumption while maintaining personalized content delivery
Data Source
AI summary
A system for automatically displaying virtual objects within a mixed reality environment is described. In some embodiments, a see-through head-mounted display device (HMD) identifies a real object (e.g., a person or book) within a field of view of the HMD, detects one or more interactions associated with real object, and automatically displays virtual objects associated with the real object if the one or more interactions involve touching or satisfy one or more social rules stored in a social rules database. The one or more social rules may be used to infer a particular social relationship by considering the distance to another person, the type of environment (e.g., at home or work), and particular physical interactions (e.g., handshakes or hugs). The virtual objects displayed on the HMD may depend on the particular social relationship inferred (e.g., a friend or acquaintance).