Smart Marker Digitizing Handwriting via UWB and Inertial Sensors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional whiteboards and chalkboards lack the ability to digitize written content, causing it to be lost once erased unless manually copied or typed into a computer.

Innovation Solution

A hand-holdable marker with a substance-dispensing end equipped with motion sensors, such as gyroscopes and accelerometers, and a location system like UWB transceivers, that captures and converts handwriting into a digital format using machine learning algorithms for recognition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If conventional whiteboards and chalkboards are used, then writing can be done easily and erased conveniently, but the written content is lost permanently unless manually copied or typed into a computer

Engineering Contradiction:
Improvewritten contentVSAvoidmanual copying or typing time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent replaces the manual mechanical process of copying or typing written content with an automated digital system. Motion sensors (accelerometers, gyroscopes) detect the marker's movements on the whiteboard surface, and processors convert these physical motions into digital signals that are transmitted to a computing device, automatically capturing the written content without manual intervention.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces motion sensors and processing systems as intermediaries between the physical act of writing and the digital capture of content. The sensors act as mediators that translate the mechanical motion of the marker into digital data, eliminating the need for manual copying while preserving the natural writing experience on the whiteboard.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Extent of automation

If motion sensors and location systems are added to the marker, then handwriting can be automatically digitized, but the device complexity increases

Engineering Contradiction:
Improvehandwriting digitizationVSAvoidmarker structure
Core Design Contradiction:
Extent of automationVSDevice complexity

Solution Approach 1:

The patent integrates multiple functions into a single marker device: the marker retains its traditional writing function while simultaneously incorporating motion sensors, location systems, and processing capabilities for automatic content capture. This multi-functionality allows the marker to serve both as a writing tool and a digital recording device without requiring separate systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent combines the writing function with digital capture functionality by integrating motion sensors, processors, and communication modules directly into the marker. This merging of functions into a single unified device eliminates the need for separate recording equipment and simplifies the overall system architecture.

Inventive Principle:
Principle #5Merging (Combining)

3Measurement precision

If sensors and processing systems are integrated into the marker, then content capture accuracy improves, but the weight of the marker increases

Engineering Contradiction:
Improvehandwriting capture accuracyVSAvoidmarker weight
Core Design Contradiction:
Measurement precisionVSWeight of moving object

Solution Approach 1:

The patent utilizes changes in motion parameters (acceleration, orientation, position) detected by sensors to accurately capture handwriting. By monitoring these physical parameters and converting them into digital representations, the system achieves high capture accuracy while keeping the sensor package relatively small and lightweight.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the digitization of handwriting directly onto a substrate, allowing for the preservation and refinement of written content without manual reentry, enhancing data capture and storage efficiency.

Implementation Method 1

the motion sensor includes at least one gyroscope on the marker and/or at least one accelerometer

Methodology Applied
Scientific EffectAccelerometer: Accelerometer

Implementation Method 2

The location system may at least first RF transmitter, for example an ultra wideband (UWB) transceiver

Methodology Applied
Scientific EffectUltra wideband (UWB) transceiver: Electromagnetic Induction

Data Source

PatentUS10239345B2Smart marker
Publication Date: 2019.03.26 SONY GROUP CORP
  • US10239345B2 patent drawing
  • US10239345B2 patent drawing
  • US10239345B2 patent drawing

AI summary

Conventional whiteboards or chalkboards on which writing is effected using Dry-Erase or chalk markers are enabled for digital conversion of the writing into the digital domain. An indoor positioning subsystem determines the absolute position of a marker with a dry-erase or another conventional writing tip within a local coordinate system to track the location of the marker on the board. Ultra wide band (UWB) is an example technology that may be used for this purpose. An inertial sensor in the marker captures sensor data generated by handwriting by sensing the movement of the marker, essentially tracking the relative positioning and motion of the handwriting. The absolute position and relative positions are then processed to generate digital handwriting which may be refined using deep learning subsystem(s) for handwriting recognition and classification for the data captured by the inertial sensor to determine the most appropriate character or shape of the writing.