Augmented Reality User Interfaces With Haptic Input Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality systems lack haptic feedback, leading to inaccurate user interactions with virtual objects and challenges in creating graphics that match the user's intended results, especially when using virtual surfaces for drawing, painting, or writing.

Innovation Solution

The system detects real-world surfaces and graphics input tools to provide haptic feedback and accurately track their motion, allowing users to create augmented reality graphics that correspond to their intended actions, while synchronizing and aligning graphics across multiple users in an environment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If haptic feedback is added to AR systems, then user interaction accuracy improves, but device complexity increases

Engineering Contradiction:
Improveuser interaction accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces haptic feedback as an intermediary element between the user and virtual objects. The haptic feedback device acts as a mediator that translates virtual interactions into tangible sensations, allowing users to perceive virtual object properties (texture, weight, resistance) through physical feedback without adding complex mechanical interfaces to the AR headset itself.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system implements closed-loop feedback by continuously monitoring user interactions with virtual objects and providing real-time haptic responses. The haptic feedback device receives control signals based on detected interactions and adjusts the tactile sensations dynamically, creating a feedback cycle that enhances interaction accuracy while keeping the system architecture modular and manageable.

Inventive Principle:
Principle #23Feedback

2Ease of operation

If virtual surfaces are used for drawing, then ease of operation improves, but manufacturing precision of graphics deteriorates

Engineering Contradiction:
Improveease of drawingVSAvoidgraphic creation accuracy
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The system provides haptic feedback that simulates the resistance and texture of physical drawing surfaces. When users interact with virtual surfaces using graphics input tools, the haptic feedback device delivers tactile sensations that mimic paper friction, canvas texture, or other surface properties, enabling users to draw with precision while maintaining the convenience of virtual surfaces.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent replaces physical drawing surfaces and tools with their virtual counterparts, augmented by haptic feedback. Instead of requiring actual paper, pencils, or paintbrushes, users interact with virtual representations that generate appropriate tactile sensations, substituting mechanical drawing systems with an optical-digital-haptic integration that preserves drawing precision.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If multiple users create graphics simultaneously, then adaptability improves, but synchronization difficulty increases

Engineering Contradiction:
Improvemulti-user collaborationVSAvoidsynchronization complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system introduces a coordination server as an intermediary that manages multi-user graphics creation sessions. The server acts as a central mediator that receives input from multiple users, processes their contributions, and distributes synchronized updates to all participants' devices, enabling collaborative graphic creation without requiring direct peer-to-peer synchronization between users.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system implements real-time feedback mechanisms that notify users of other users' actions in the shared graphics space. When one user creates or modifies a graphic element, the system provides feedback to other users (through visual updates and haptic notifications) to maintain awareness of the collaborative environment and coordinate their interactions appropriately.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20250308176A1Generating user interfaces displaying augmented reality graphics
Publication Date: 2025.10.02 SNAP INC
  • US20250308176A1 patent drawing
  • US20250308176A1 patent drawing
  • US20250308176A1 patent drawing

AI summary

An Augmented Reality (AR) graphics system is provided. The AR graphics system may coordinate the display of augmented reality graphics created by multiple users located in an environment. The AR graphics system may determine an alignment object located in the environment that is designated as a common origin of a real-world coordinate system that is used to determine where to display AR graphics within the environment. Additionally, a prioritization scheme is implemented to resolve conflicts between overlapping input provided by different users in order to generate a single version of AR graphics.