AR User Representation With Semantic Context Sharing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
There is a need for improved communication of semantic information between augmented reality (AR) communication devices, particularly in rendering user representations that are adapted to the environment of the second user, ensuring the second user is aware of how the first user is displayed and their environment.
Innovation Solution
An AR module extracts semantic information from sensory data using a semantic classification process, which includes obtaining sensory data from a first AR communication device, classifying it, and providing this information to a second AR communication device for rendering a representation of the first user, including environmental and activity-related information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If semantic information is communicated between AR communication devices, then the representation of users is semantically adapted to the environment, but the complexity of the communication system increases
Solution Approach 1:
The system segments semantic information into distinct categories (environmental context, user activity, device state) that can be independently processed and transmitted. This allows the complex communication task to be divided into manageable components, reducing overall system complexity while maintaining adaptability.
Solution Approach 2:
The patent introduces an intermediary component that mediates between the first and second AR communication devices, handling the semantic information extraction, classification, and transmission. This intermediary layer simplifies the direct communication complexity by providing a structured interface for semantic data exchange.
2Loss of information
If semantic classification process is applied to sensory data, then semantic information is extracted for communication, but the processing time and computational resources increase
Solution Approach 1:
The system performs preliminary classification of sensory data into predefined semantic categories before transmission. By pre-defining classification schemas and categories, the system avoids complex real-time analysis, reducing processing time while ensuring comprehensive semantic information extraction.
Solution Approach 2:
The patent applies partial classification by focusing on the most relevant semantic categories for the current communication context rather than analyzing all possible sensory data aspects. This selective approach reduces computational overhead while maintaining sufficient semantic information for effective communication.
Data Source
AI summary
Arrangements for extracting semantic information from sensory data. An AR module is in communication with a first AR communication device to be worn by a first user and a second AR communication device to be worn by a second user. The first AR communication device includes a first user interface for displaying a representation of the second user and the second AR communication device includes a second user interface for displaying a representation of the first user. Sensory data of the first user as captured by the first AR communication device is obtained. Semantic information of the first user is extracted from the sensory data by subjecting the sensory data to a semantic classification process. The semantic information is provided towards the second user interface for rendering a representation of the semantic information together with a displayed representation of the first user on the second user interface.