AR Guidance Interface Using AI Activity Recognition and Policy Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality devices struggle to provide real-time guidance based on user activities in mixed reality environments, failing to effectively utilize real-life experience and value information to enhance user interaction with both real and virtual objects.
Innovation Solution
An augmented reality device that obtains policies from a server, processes user activities through an AI model, and outputs a graphic user interface (GUI) to guide user actions based on policy performance levels, integrating location, time, and object interactions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If augmented reality devices overlay virtual images on real world objects, then user interaction with mixed reality environment is enabled, but real-time monitoring and guidance of user activities becomes complex
Solution Approach 1:
The patent introduces a policy provider server as an intermediary that handles the complex activity monitoring and evaluation logic externally. The AR device communicates with this server to obtain policies and report activities, transferring the computational burden of activity analysis from the AR device to the server, thus reducing device complexity while maintaining versatile user interaction capabilities
Solution Approach 2:
The system segments the activity monitoring function into separate components: the AR device captures user activities via camera, the policy provider server receives and analyzes these activities against predefined policies, and the processor evaluates policy performance levels. This segmentation allows each component to specialize in specific tasks, reducing overall system complexity while enabling sophisticated monitoring
2Productivity
If the device processes user activities in real-time to provide guidance, then user engagement is improved, but processing time and computational resources increase
Solution Approach 1:
The system pre-defines policies and their corresponding activity criteria before user execution. The policy provider server stores structured policies that specify expected activities, locations, times, and objects. When users perform activities, the system only needs to match observed actions against these pre-defined criteria rather than analyzing from scratch, significantly reducing real-time processing time while maintaining high guidance efficiency
Solution Approach 2:
The system implements a feedback loop where the processor continuously monitors user activities, compares them against policies, determines policy performance levels, and provides real-time guidance feedback through the AR display. This closed-loop feedback enables efficient real-time guidance by using accumulated policy information to quickly assess current activity status and provide targeted feedback without requiring complete re-analysis
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method, performed by an augmented reality device, for providing a guide for user activity, includes: obtaining, from a server of a policy provider, a policy comprising at least one activity about at least one of a location, a time, a space, or an object; inputting an image obtained through a camera to an artificial intelligence model, and recognizing, from the image, at least one activity of a user interacting with at least one of the location, the time, the space, or the object by using the artificial intelligence model; determining a policy performance level of the user by comparing the recognized at least one activity of the user with the at least one activity in the policy; and based on the policy performance level, outputting a graphic user interface (UI) for providing the guide for the user's activity on the policy.