Air Writing Gesture Personalization for AR Displays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality (AR) systems do not effectively personalize air-writing content for users based on their individual preferences and capabilities, limiting accessibility and content consumption.

Innovation Solution

A method and system that translate air-writing gestures into personalized displays on AR devices by analyzing three-dimensional movements to determine emphasis and applying user-specific gesture display styles based on individual user profiles, allowing for customized visualization of air-written content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If air-writing content is displayed on AR devices using existing systems, then content can be viewed, but the content cannot be personalized to individual user preferences and capabilities

Engineering Contradiction:
Improvepersonalization capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by capturing user profile information and gesture preferences before air-writing content is displayed. User profiles including accessibility preferences, gesture mapping preferences, and display preferences are stored in advance, allowing the system to automatically personalize content without adding complexity during the actual air-writing interaction.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary processing layer between the air-writing input and the AR display output. This intermediary system analyzes gestures, maps them according to user profiles, and translates them into personalized display formats. This mediator handles the complexity of personalization logic centrally, keeping the individual AR devices and air-writing interfaces relatively simple.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If gesture analysis is performed to determine emphasis, then content accessibility is improved, but processing time increases

Engineering Contradiction:
Improvecontent accessibilityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system applies partial action by selectively analyzing only those gestures that convey emphasis or accessibility-relevant information, rather than processing every movement detail. The gesture analysis focuses on extracting essential meaning (emphasis, user intent) rather than complete motion reconstruction, reducing processing time while maintaining accessibility.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system performs self-service by using pre-stored user profiles and gesture mappings to automatically interpret and personalize air-writing content without requiring real-time manual analysis. The pre-configured gesture types and user preferences enable the system to self-adapt to individual users, reducing the computational burden during actual content interaction.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11373373B2Method and system for translating air writing to an augmented reality device
Publication Date: 2022.06.28 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11373373B2 patent drawing
  • US11373373B2 patent drawing
  • US11373373B2 patent drawing

AI summary

Techniques for translating air writing to augmented reality (AR) devices are described. In one embodiment, a method includes receiving indications of gestures from an originator. The indications identify movement in three dimensions that correspond to an emphasis conferred on one or more words that are air-written by the originator and are configured to be displayed by a plurality of AR devices. The method includes analyzing the identified movement to determine a gesture type associated with the emphasis, where the gesture type includes a first emphasis to be conferred on the air-written words. The method includes providing a display of the air-written words on a first AR device of the plurality of AR devices. The first emphasis is conferred on the words on the display of the first AR device using a first gesture display style based on a profile of a first user utilizing the first AR device.