Context-Dependent AR Using Social Network Object Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional augmented reality (AR) systems rely on structured patterns or user input to display virtual elements, limiting their ability to provide context-dependent augmentations based on the user's surroundings and social network data.
Innovation Solution
An AR/VR system that integrates a social network server application to identify objects and persons in sensor data, retrieve relevant social network data, and display context-dependent augmentations on the AR/VR device display, incorporating user profiles and social network information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional AR systems use structured patterns or user input to display virtual elements, then the system operation is simple, but the context-dependency and relevance of augmentations are limited
Solution Approach 1:
The patent introduces a server as an intermediary component that receives sensor data from the AR device, identifies objects and persons, retrieves relevant social network data, and sends augmentation data back to the AR device. This mediator approach enables complex context-dependent functionality while keeping the AR device itself relatively simple.
Solution Approach 2:
The system is divided into distinct functional modules: sensor data acquisition on the AR device, object/person identification on the server, social network data retrieval on the server, and augmentation display on the AR device. This segmentation allows each component to specialize in specific tasks, improving overall context-dependency while managing complexity through distribution.
2Loss of information
If AR systems display virtual elements based solely on structured patterns, then the device complexity is low, but the quantity and relevance of information provided is limited
Solution Approach 1:
The system performs preliminary actions by having the server proactively identify objects and persons in sensor data, retrieve relevant social network data in advance, and prepare augmentation data before the user even views the AR display. This ensures information completeness is achieved without adding complexity to the user-facing AR device.
Solution Approach 2:
The server automatically performs object identification, data retrieval, and augmentation generation without requiring explicit user commands. The system serves itself by autonomously processing sensor data and providing relevant social network information, reducing information loss while maintaining simple user interaction.
3Extent of automation
If AR systems rely on user input to select virtual elements, then the device structure is simple, but the automation and user experience are reduced
Solution Approach 1:
The server acts as an automated intermediary that receives sensor data, performs object/person identification, retrieves social network data, and generates augmentations without requiring user input. This mediator enables high automation while keeping the AR device architecture relatively simple by offloading complex processing to the server.
Solution Approach 2:
The system achieves automation through self-service mechanisms where the server autonomously processes sensor data, identifies relevant objects and persons, retrieves appropriate social network data, and generates augmentations automatically. This eliminates the need for manual user selection while maintaining simple device structure through centralized server processing.
Data Source
AI summary
An augmented reality system includes an augmented reality (AR) device and a server computing device. The AR device transmits sensor data to the server computing device. The server computing device identifies a person and/or object in the sensor data. The server computing device executes a search over social network data to identify a portion of the social network data that relates to the identified person and/or object. The server computing device outputs augmentation data to the AR device that includes the identified portion of the social network data, and is configured to cause the AR device to display an augmentation that includes the portion of the social network data.