AR Graphics Input Tracking with Haptic Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality systems lack haptic feedback, making user interactions with virtual objects awkward and inaccurate, particularly in tasks like drawing or writing, as users cannot gauge how virtual objects react to their interactions without physical sensation.

Innovation Solution

An augmented reality graphics system that detects a real-world surface and a graphics input tool, tracking its motion to generate AR graphics, providing haptic feedback as the tool interacts with the surface, thereby enhancing the accuracy and precision of user interactions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If augmented reality systems display virtual objects overlaid on the surrounding environment, then users can see virtual objects as part of the real environment, but users cannot gauge how virtual objects react to their interactions due to lack of haptic feedback

Engineering Contradiction:
ImproveAR interaction capabilityVSAvoidInteraction accuracy
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent implements haptic feedback mechanisms that provide tactile sensations to users when they interact with virtual objects in the augmented reality environment. This feedback loop allows users to perceive the reaction of virtual objects to their interactions, thereby improving interaction accuracy while maintaining the versatility of AR display capabilities.

Inventive Principle:
Principle #23Feedback

2Loss of information

If the head-worn device provides visual information through transparent display, then users can view both the surrounding environment and virtual objects, but users lack tactile sensation to accurately perform tasks like drawing or writing

Engineering Contradiction:
ImproveVisual information completenessVSAvoidInteraction precision
Core Design Contradiction:
Loss of informationVSMeasurement precision

Solution Approach 1:

The patent merges visual display technology with haptic feedback mechanisms in a unified head-worn device. The transparent display provides complete visual information while integrated haptic actuators provide tactile feedback, combining both modalities to enable accurate interaction tasks such as drawing or writing in the augmented reality environment.

Inventive Principle:
Principle #5Merging (Combining)

3Productivity

If the system tracks motion of a graphics input tool to generate AR graphics, then users can create drawings or writings in the AR environment, but users cannot gauge how the virtual surface reacts to their interactions

Engineering Contradiction:
ImproveAR content creation capabilityVSAvoidInteraction naturalness
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The patent implements haptic feedback specifically for graphics input tool interactions with virtual surfaces. As users draw or write in the AR environment, the system provides tactile feedback that simulates the resistance and reaction of the virtual surface, making the content creation process more natural and intuitive while maintaining full AR graphics generation capability.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20250218143A1Generating user interfaces displaying augmented reality graphics
Publication Date: 2025.07.03 SNAP INC
  • US20250218143A1 patent drawing
  • US20250218143A1 patent drawing
  • US20250218143A1 patent drawing

AI summary

An Augmented Reality (AR) graphics system is provided. The AR graphics system may detect an object in a real-world scene that corresponds to an AR graphics display surface. The AR graphics system may generate AR graphics that are displayed as overlays of the AR graphics display surface. The AR graphics system may track the motion of a graphics input tool with respect to the AR graphics display surface to generate AR graphics based on the motion of the graphics input tool. The AR graphics may be comprised of a number of markings generated based on the motion of the graphics input tool.