Augmented Reality Prop Interactions with Surface-Linked Object Pairing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality (AR) systems lack the ability to seamlessly integrate interactions between virtual and physical objects, limiting the creativity and immersion of user experiences.
Innovation Solution
The system captures images of a scene, identifies an object receiving surface and coordinates, connects an AR primary object with a physical or virtual prop object, and generates overlays responsive to user input, allowing for interactive and immersive AR experiences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If AR systems use traditional virtual object display methods, then the system complexity is low, but the user interaction creativity and immersion are limited
Solution Approach 1:
The patent combines virtual AR objects with physical prop objects to create hybrid interactions. The system merges the digital virtual bear with physical objects like drums, books, and musical instruments that users can hold and manipulate in the real world, enabling creative storytelling experiences that bridge virtual and physical domains
Solution Approach 2:
The patent introduces physical prop objects as intermediaries between the user and virtual AR objects. These physical props serve as mediators that users can tangibly interact with while triggering and controlling virtual object behaviors, enhancing immersion without requiring complex direct virtual interaction interfaces
2Reliability
If AR systems enable interactions between virtual and physical objects, then user immersion is enhanced, but the difficulty of detecting and measuring object interactions increases
Solution Approach 1:
The patent enables physical prop objects to serve themselves by automatically being detected and registered by the AR system. Once a physical object is placed in the scene, the system autonomously identifies it, associates it with appropriate virtual AR objects, and establishes interaction rules without requiring manual configuration or complex detection algorithms
Solution Approach 2:
The patent creates a universal prop object system where any physical object can serve as an interactive prop. The system is designed to work with diverse objects (drums, books, instruments, toys) through common detection and association mechanisms, allowing the same technical framework to handle multiple types of objects and interactions
3Adaptability or versatility
If AR systems allow free interaction between AR objects and props, then storytelling creativity is enhanced, but the control and management of interactions becomes complex
Solution Approach 1:
The patent pre-establishes interaction rules and associations between prop objects and virtual AR objects before user interaction. The system预先 defines how physical objects like drums trigger musical notes, how books trigger storytelling modes, and how instruments control virtual bear actions, simplifying real-time interaction control while maintaining creative freedom
Data Source
AI summary
Augmented reality (AR) systems, devices, media, and methods are described for generating AR experiences including interactions with virtual or physical prop objects. The AR experiences are generated by capturing images of a scene with a camera system, identifying an object receiving surface and corresponding surface coordinates within the scene, identifying an AR primary object and a prop object (physical or virtual), establishing a logical connection between the AR primary object and the prop object, generating AR overlays including actions associated with the AR primary object responsive to commands received via a user input system that position the AR primary object adjacent the object receiving surface responsive to the primary object coordinates and the surface coordinates within the scene and that position the AR primary object and the prop object with respect to one another in accordance with the logical connection, and presenting the generated AR overlays with a display system.