Optical Pen Input for Electronic Displays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing electronic devices face challenges in providing cost-effective and reliable handwritten user input on conventional graphical displays, as they often require specialized sensors that are susceptible to unintended contact and limited to writing on paper, lacking the ability to alter or augment the written image in real-time.

Innovation Solution

A pen-like device with an optical pattern tracking component that captures images of a surface beneath its tip, allowing it to track movement over any electronic graphical display configured with a grid of dots or symbols, enabling efficient and accurate handwritten input by communicating movements to the device, which can disable touch screen inputs to prevent false contacts.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If touch sensors or contact location sensors are incorporated into the display screen to detect stylus motion, then handwritten input capability is enabled, but the device becomes susceptible to detecting unintended contact such as palm resting on the screen

Engineering Contradiction:
Improvehandwritten input capabilityVSAvoiddetection accuracy
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system segments the detection function by separating it from the display screen itself. Instead of using sensors embedded in the screen that detect all contact, the solution uses an optical sensor in the stylus tip that only detects the specific grid pattern printed on the screen, thereby segmenting intended input (stylus following grid) from unintended contact (palm resting).

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The grid pattern serves as an intermediary between the stylus and the detection system. The optical sensor in the stylus detects this intermediate grid pattern to determine motion, rather than directly detecting contact with the screen. This intermediary allows the system to distinguish between intentional stylus movement following the grid and unintentional palm contact that does not follow the grid pattern.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If specialized sensors are used in the display screen for handwriting detection, then handwritten input is enabled, but the device complexity and cost increase

Engineering Contradiction:
Improvehandwritten input capabilityVSAvoidsensor integration
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The stylus device performs self-detection of its own motion by using an optical sensor in its tip to capture images of the grid pattern and process this data to determine its movement. This eliminates the need for the display screen to have specialized sensors, as the stylus itself provides the detection capability.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces mechanical/contact-based sensing systems (touch sensors embedded in the screen) with an optical sensing system. The optical sensor in the stylus tip uses optical fields to detect the grid pattern and determine motion, substituting mechanical contact detection with optical field detection.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If pen-like devices with optical sensors are used with pre-printed dot paper, then optical tracking is enabled, but the system is limited to writing on paper and cannot support conventional electronic graphical displays

Engineering Contradiction:
Improveoptical tracking accuracyVSAvoiddisplay compatibility
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system achieves universality by making the grid pattern displayable on any conventional electronic graphical display while maintaining compatibility with the optical sensor in the stylus. The same basic mechanism works with both paper-based and electronic displays, allowing the system to function across multiple platforms and display types.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Measurement precision

If gyroscopic tracking is used to determine pen movement, then motion detection is enabled, but the device complexity increases with additional tracking components

Engineering Contradiction:
Improvemotion detection capabilityVSAvoidtracking mechanism
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces gyroscopic mechanical tracking systems with an optical sensing system. Instead of using gyroscopes to detect motion, the solution uses an optical sensor to capture images of a grid pattern and determine motion through image processing, eliminating complex mechanical tracking components.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables cost-effective and reliable handwritten input on any electronic graphical display, improving usability by allowing free-form entry of drawings or text without mode changes, reducing input errors, and enhancing user convenience with precise graphical information entry.

Implementation Method 1

uses an optical sensor in its tip to capture images of a grid pattern on a display screen and determines motion of the stylus by analyzing changes in the captured images

Methodology Applied
Scientific EffectOptical detection: Photography

Data Source

PatentUS8884930B2Graphical display with optical pen input
Publication Date: 2014.11.11 MALIKIE INNOVATIONS LTD
  • US8884930B2 patent drawing
  • US8884930B2 patent drawing
  • US8884930B2 patent drawing

AI summary

Methods and apparatuses of obtaining user input. A display of an optical tracking grid is initiated on an electronic graphical display. Changes are determined among images of at least a portion of the optical tracking grid that are captured by a tracking pen device. Based on the determined changes in the images, a movement of a portion of the tracking pen device is determined. A data set characterizing movement is produced in response to determining the movement.