Magnetic Stylus Tracking for Interactive Displays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Electronic interactive displays experience significant latency and high power consumption due to capacitive sensing and TFT screen refresh, which affects the user's perception of writing or drawing on the screen.

Innovation Solution

The use of a magnetically actuatable material in the interactive display layer, combined with a plurality of magnetometers to track the position and orientation of a user-borne device with magnets, reduces latency and power consumption by allowing direct magnetic addressing and tracking of user input.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If capacitive sensing and TFT screen refresh are used for detecting user input, then the display can track writing or drawing actions, but significant latency is introduced affecting user perception

Engineering Contradiction:
Improvedetection accuracyVSAvoidlatency
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces the capacitive sensing system (which requires complex interface electronics and processor register addressing) with a magnetic field-based detection system using magnetometers. The magnetometers directly sense the magnetic field from the stylus magnet, eliminating the need for capacitive coupling and reducing the detection chain to purely magnetic field measurements, thereby significantly reducing latency while maintaining detection accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent extracts the timing-critical detection function from the capacitive sensing pathway and implements it separately using magnetometers. By separating the detection mechanism from the display refresh mechanism, the system can track stylus position in real-time through magnetic field changes without being constrained by the TFT screen refresh rate, thus reducing perceived latency.

Inventive Principle:
Principle #2Taking out (Extraction)

2Measurement precision

If capacitive sensing interface electronics and processor register addressing are used, then user input can be detected, but high power consumption occurs

Engineering Contradiction:
Improveinput detectionVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent substitutes the power-hungry capacitive sensing electronics with passive magnetic field sensing. Magnetometers require significantly less power to operate compared to capacitive sensing circuits and processor register addressing systems. The magnetic field detection occurs passively without requiring active driving signals, thereby reducing power consumption while maintaining input detection capability.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent implements continuous magnetic field monitoring without requiring continuous screen refresh. The magnetometers can track stylus position asynchronously and only trigger display updates when necessary, rather than refreshing the entire screen at fixed intervals. This periodic or event-driven approach significantly reduces power consumption compared to continuous capacitive sensing combined with full-screen refresh.

Inventive Principle:
Principle #19Periodic action

3Ease of operation

If TFT screen refresh is used to display writing or drawing, then visual feedback is provided, but power consumption increases and latency is introduced

Engineering Contradiction:
Improvevisual feedbackVSAvoidpower consumption
Core Design Contradiction:
Ease of operationVSUse of energy by moving object

Solution Approach 1:

The patent separates the tracking function (performed continuously by magnetometers) from the display refresh function. The magnetometers continuously monitor magnetic field changes to track stylus position with high temporal resolution, while the display refresh is triggered only when position changes exceed a threshold or at lower refresh rates. This extraction of the timing-critical tracking function from the display refresh cycle reduces power consumption while maintaining smooth visual feedback.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent implements dynamic display refresh rates based on stylus motion characteristics. When the stylus is stationary or moving slowly, the display refresh rate is reduced or suspended to save power. When rapid motion is detected via magnetic field changes, the refresh rate increases to provide smooth visual feedback. This dynamic adjustment optimizes the balance between visual feedback quality and power consumption.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution significantly reduces latency and power consumption, enabling low-latency rendering and efficient capture of handwriting or drawing motion without the need for high-power screen refresh, while allowing the display to function without electronic components when powered off.

Implementation Method 1

a magnet comprised in the user borne device can switch a portion of the interactive display layer between a first visual state and a second visual state based on exposure to a magnetic field provided by the magnet comprised in the user borne device

Methodology Applied
Scientific EffectMagnetic actuation: Magnetism

Implementation Method 2

The plurality of magnetometers is configured to perform magnetic field measurements of a user borne device comprising at least one magnet within a sensing volume proximate to the interactive display layer

Methodology Applied
Scientific EffectMagnetic field detection: Magnetometer

Data Source

PatentEP4455845A1User borne device type identification
Publication Date: 2024.10.30 ADVANCED MAGNETIC INTERACTION (AMI)
  • EP4455845A1 patent drawingFigure 1A~1C
  • EP4455845A1 patent drawingFigure 2
  • EP4455845A1 patent drawingFigure 3

AI summary

An electronic interactive display (10) comprising a substrate, a power source , an interactive display layer comprised on the substrate, a plurality of magnetometers (M) defining a reference coordinate system of the electronic interactive display (10), wherein each magnetometer of the plurality of magnetometers (M) has a rigid spatial relationship to the other magnetometers (M), processing circuitry (16) communicably coupled to at least the interactive display layer (20B) and the plurality of magnetometers (M). The interactive display layer (20B) comprises a magnetically actuatable material (19A, 19B). The interactive display layer (20B) faces a user (U) of the electronic interactive display (10), in use, and wherein a portion of the interactive display layer (20B) is configurable from least a first visual state into a second visual state based on a magnetic stimulus. The plurality of magnetometers (M) is configured to perform magnetic field measurements of the user borne device (50) within a sensing volume (S) proximate to the interactive display layer (20B), and to provide magnetic field measurement data based on the magnetic field measurements to the processing circuitry (16). The processing circuitry (16) is configured to receive the magnetic field measurement data, and to determine the position and/or orientation, relative to the interactive display layer (20B), of the user borne device (50) comprising at least one magnet when the at least one user borne device (50) is present in the sensing volume (S).