Pen-Like External Interface for Head-Worn Writing Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Wearable computing systems face challenges in providing effective user interfaces that align and track writing patterns on a writing surface while maintaining a see-through view of the environment, requiring intuitive control mechanisms that adapt to contextual conditions.

Innovation Solution

A hand-held external user interface, resembling a pen, equipped with a camera, IMU, pressure sensors, and communication modules, allows for alignment and tracking of writing patterns, and adapts its operation based on contextual information and user gestures to control head-worn computing systems.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a hand-held external user interface is used to align and track writing patterns on a writing surface, then writing pattern recognition precision is improved, but the complexity of the system increases due to additional sensors and processing requirements

Engineering Contradiction:
Improvewriting pattern recognition precisionVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

A hand-held external user interface device serves as an intermediary between the user and the head-worn computer system. This device includes a camera to capture writing patterns on a writing surface, an IMU to track the device's orientation and movement, and a processor to align and recognize the writing patterns. The external device handles the complex tasks of pattern recognition and alignment, thereby improving measurement precision while isolating the head-worn system from excessive complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces traditional mechanical writing pattern recognition with optical and computational methods. Instead of relying on physical contact or mechanical means to detect writing, the system uses a camera to capture images of writing patterns on a surface and an IMU to track device orientation. The processor then computationally aligns and recognizes the patterns, substituting mechanical detection with optical sensing and digital processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If the head worn computer provides displayed content for alignment guidance, then ease of operation is improved, but the visual clarity of the see-through view may be compromised

Engineering Contradiction:
Improvealignment guidance easeVSAvoidvisual clarity of see-through view
Core Design Contradiction:
Ease of operationVSIllumination intensity

Solution Approach 1:

The displayed content in the head-worn computer is localized to specific regions or layers that provide alignment guidance without obscuring the entire see-through view. The display presents graphical overlays, markers, or alignment indicators in targeted areas where they are most useful for guiding the user's writing or interaction, while maintaining the transparency and clarity of the surrounding environmental view.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The displayed content dynamically adjusts its properties such as brightness, opacity, size, and position based on the user's actions and environmental conditions. When alignment guidance is needed, the displayed content becomes more prominent; when the user needs an clear view of the environment, the displayed content diminishes or relocates. This dynamic adjustment balances ease of operation with visual clarity of the see-through view.

Inventive Principle:
Principle #15Dynamics

3Adaptability or versatility

If multiple sensors (camera, IMU, pressure sensors) are integrated into the hand-held interface, then adaptability to contextual conditions is improved, but the weight of the device increases

Engineering Contradiction:
Improveadaptability to contextual conditionsVSAvoidhand-held interface weight
Core Design Contradiction:
Adaptability or versatilityVSWeight of moving object

Solution Approach 1:

The hand-held external user interface is designed as a multi-functional device that integrates multiple sensors including a camera for capturing visual information, an IMU for tracking orientation and movement, and pressure sensors for detecting contact force. These sensors enable the device to adapt to various contextual conditions such as different writing surfaces, writing pressures, and user gestures. The processor analyzes data from all sensors to provide comprehensive contextual awareness and adaptive control.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system segments the sensing functions between the hand-held external device and the head-worn computer. The hand-held device contains the sensors (camera, IMU, pressure sensors) and performs local processing of sensor data. The head-worn computer receives processed information and performs higher-level processing. This segmentation allows the hand-held device to be optimized for sensing without requiring all processing capabilities, potentially reducing its weight while maintaining adaptability.

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables intuitive and adaptive control of head-worn computing systems, allowing for precise writing and gesture recognition while maintaining a see-through view, enhancing user interaction and functionality.

Implementation Method 1

a camera, IMU, pressure sensors, and communication modules, allows for alignment and tracking of writing patterns

Methodology Applied
Scientific EffectCamera imaging: Photography

Implementation Method 2

a camera, IMU, pressure sensors, and communication modules, allows for alignment and tracking of writing patterns

Methodology Applied
Scientific EffectInertial measurement: Accelerometer

Implementation Method 3

a camera, IMU, pressure sensors, and communication modules, allows for alignment and tracking of writing patterns

Methodology Applied
Scientific EffectPressure sensing: Piezoresistive Effect

Data Source

PatentUS12443294B2External user interface for head worn computing
Publication Date: 2025.10.14 OSTERHOUT GROUP INC
  • US12443294B2 patent drawing
  • US12443294B2 patent drawing
  • US12443294B2 patent drawing

AI summary

Aspects of the present invention relate to external user interfaces used in connection with head worn computers (HWC).