Mobile AR Multiple 3D Model Interaction Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional augmented reality (AR) software applications do not allow users to effectively interact with multiple virtual objects simultaneously within a physical environment, leading to user confusion and a negative experience due to occlusions and collisions, which can result in users abandoning the AR feature or the software.

Innovation Solution

The implementation of techniques that enable users to interact with multiple virtual objects in an AR simulation by providing visual and haptic feedback when collisions or occlusions occur, such as rendering bounding boxes for collided objects and modifying the appearance of occluded objects, to enhance user experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If multiple virtual objects are placed in an AR environment, then the quantity of virtual objects increases, but user confusion increases due to occlusions and collisions

Engineering Contradiction:
Improvenumber of virtual objectsVSAvoiduser interaction clarity
Core Design Contradiction:
Quantity of substanceVSEase of operation

Solution Approach 1:

The system provides visual feedback by displaying bounding boxes around virtual objects that are colliding or occluding each other. This feedback mechanism helps users understand spatial relationships and interactions between multiple virtual objects, reducing user confusion while allowing increased quantity of objects in the AR environment.

Inventive Principle:
Principle #23Feedback

2Ease of operation

If visual feedback is provided for collisions and occlusions, then user experience is enhanced, but device complexity increases

Engineering Contradiction:
Improveuser experienceVSAvoidsoftware complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system applies visual feedback selectively rather than universally. Bounding boxes are displayed only for virtual objects that are colliding or occluding each other, not for all objects in the scene. This localized approach enhances user experience for problematic interactions while minimizing the overall visual complexity and processing requirements.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11983835B2Placing and manipulating multiple three-dimensional (3D) models using mobile augmented reality
Publication Date: 2024.05.14 AMAZON TECH INC
  • US11983835B2 patent drawing
  • US11983835B2 patent drawing
  • US11983835B2 patent drawing

AI summary

Techniques for placing and manipulating multiple three-dimensional (3D) models using mobile augmented reality (AR) are described. One technique includes receiving a first request to initialize an AR simulation of a first product for sale within a physical environment. In response to the first request, a first 3D model of the first product for sale is rendered onto the screen. After rendering the first 3D model, a second request to visualize a second product for sale within the physical environment is received during the AR simulation of the first product for sale. In response to the second request, a second 3D model of the second product for sale is rendered onto the screen with the first 3D model.