Mobile AR Prototyping for Proxemic IoT Interactions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies for designing and implementing interactions between augmented reality (AR) and real-world (RW) environments require specialized hardware and programming skills, limiting their accessibility and applicability, especially for prototyping in-situ full-body pro-ges interactions.
Innovation Solution
A framework that utilizes a mobile device to track camera pose, estimate full-body human poses, and infer 3D scene geometry, allowing for the design and specification of AR scenes relative to a RW environment without the need for programming skills or extra hardware.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If specialized hardware and programming skills are required for designing AR-RW interactions, then the precision and reliability of interaction design can be improved, but the ease of operation and accessibility deteriorate
Solution Approach 1:
The patent uses mobile device cameras to capture and process visual content of the real-world environment, creating a digital copy that can be analyzed and integrated with AR content. This eliminates the need for specialized tracking hardware while maintaining accurate spatial mapping capabilities.
Solution Approach 2:
The system introduces an intermediary processing layer that automatically analyzes visual content, detects events, and maps AR interactions without requiring users to write programming code. This intermediary handles the complexity of interaction design internally while providing a simplified interface to users.
2Measurement precision
If specialized hardware is used for AR prototyping, then the measurement precision and detection accuracy can be improved, but the device complexity and cost increase
Solution Approach 1:
The patent replaces specialized tracking hardware with mobile device cameras that capture visual content of the environment. The system creates a digital representation of the real-world space and uses image processing to achieve accurate spatial mapping and event detection without additional hardware sensors.
Solution Approach 2:
The patent substitutes mechanical and optical tracking hardware with software-based visual content analysis. Instead of using specialized sensors and processing systems, the solution uses standard mobile device cameras combined with AI-powered event detection algorithms to achieve the same functional outcomes.
3Manufacturing precision
If programming skills are required for AR interaction design, then the manufacturing precision and control can be improved, but the ease of manufacture and development speed deteriorate
Solution Approach 1:
The patent introduces an intermediary system that automatically translates visual content and user intentions into structured AR interaction specifications. The event detection component analyzes the environment and generates precise interaction definitions without requiring users to manually program each interaction, thereby maintaining precision while simplifying the creation process.
Solution Approach 2:
The system performs self-service by automatically detecting events in the real-world environment and generating the corresponding AR interaction logic. The event detection component autonomously analyzes visual content, identifies relevant actions, and configures the interaction framework without human intervention, eliminating the need for programming while maintaining precise interaction control.
Data Source
AI summary
One or more devices, systems, methods and/or non-transitory, machine-readable mediums are described herein for specifying one or more events in an augmented reality (AR) environment relative to a real-world (RW) environment. A system can comprise a memory that stores executable components, and a processor, coupled to the memory, that executes or facilitates execution of the executable components. The executable components can comprise a visual component that analyzes captured visual content of a RW environment, an interface component that integrates the visual content of the RW environment with AR content of an AR environment overlaying the RW environment, and a design component that facilitates in-situ placement of the AR content in the AR environment based on the visual content being overlayed, wherein the AR content comprises a specification of an event to be executed in the RW environment that triggers a virtual asset in the AR environment.