Physical Object Rigging with Indicator-Tracked AR Graphics
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems for creating interactive augmented reality (AR) experiences with physical objects are domain-specific, lack flexible customization interfaces, and rely on pre-programmed behaviors, making it challenging for novice users to create expressive graphical effects with everyday objects.
Innovation Solution
A user interface that allows users to rig physical objects, draw virtual graphics, configure relationships between the physical and virtual elements, and render interactive graphics based on object properties, using a computing system to track and animate these interactions in real-time.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If pre-programmed behaviors are used in existing AR systems, then system reliability is improved, but adaptability and ease of operation deteriorate
Solution Approach 1:
The system enables novice users to create custom interactive behaviors through an intuitive interface that requires no programming knowledge. Users can define custom joints, constraints, and graphical effects by simply selecting objects and configuring parameters through graphical controls, allowing the system to serve itself with user-defined behaviors rather than relying on pre-programmed options
Solution Approach 2:
The system transitions from static pre-programmed behaviors to dynamic user-configurable behaviors. Users can modify joint types, constraint parameters, and graphical effect properties in real-time, allowing the system to adapt its behavior dynamically based on user preferences and specific application requirements
2Ease of operation
If domain-specific pre-programmed systems are used, then ease of operation is improved for experts, but adaptability deteriorates for novice users
Solution Approach 1:
The system breaks down complex AR configuration tasks into discrete, manageable components such as individual joints, constraints, and graphical effects. Each component can be configured independently through specialized interface panels, allowing novice users to build complex interactions step-by-step without being overwhelmed by system complexity
Solution Approach 2:
The system introduces an intermediary configuration interface that mediates between the user and the underlying complex AR system. This interface provides high-level controls and visual feedback that simplify interaction, allowing novice users to achieve expert-level customization without needing to understand the underlying technical complexity
3Adaptability or versatility
If comprehensive customization interfaces are provided, then adaptability is improved, but device complexity increases
Solution Approach 1:
The interface dynamically adapts its complexity based on the user's needs and progress. Basic configurations are presented first with simple controls, while advanced options become available as users progress or select specific object types, allowing comprehensive customization capability while maintaining interface simplicity for common tasks
Solution Approach 2:
Different parts of the interface provide different levels of detail and control based on local requirements. Specific object types or configuration scenarios reveal specialized controls and options relevant to that context, while other areas maintain simplified interfaces, allowing comprehensive customization without overwhelming the user with unnecessary complexity throughout the entire interface
Data Source
AI summary
A computing system captures a first image, comprising an object in a first position, using a camera. The object has indicators indicating points of interest on the object. The computing system receives first user input linking at least a subset of the indicators and establishing relationships between the points of interest on the object and second user input comprising a graphic element and a mapping between the graphic element and the object. The computing system captures second images, comprising the object in one or more modified positions using, the camera. The computing system tracks the modified positions of the object across the second images using the indicators and the relationships between the points of interest. The computing system generates a virtual graphic based on the one or more modified positions, the graphic element, and the mappings between the graphic element and the object.