Analog-to-Digital Ink Stroke Conversion via Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Transferring analog written content, such as sketches and notes from physical whiteboards or paper, into a digital format for manipulation and editing within content creation applications is challenging due to the inability to separate and convert analog strokes into digital ink strokes effectively.

Innovation Solution

An analog-to-digital ink stroke feature and service that utilize a camera to capture static images of written content, employing artificial intelligence and a stroke analyzer to extract analog strokes and convert them into digital ink strokes, allowing for manipulation within content creation applications as if originally drawn digitally.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a camera is used to capture static images of written content, then the analog content is transformed to digital format, but the strokes cannot be separated from the whole entity captured

Engineering Contradiction:
Improvedigital manipulation capabilityVSAvoidstroke separation complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the captured image into individual strokes by detecting stroke boundaries and separating connected components. This allows each stroke to be independently identified and converted to digital ink format, enabling manipulation while maintaining the complexity management through automated image processing algorithms.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts stroke information from the captured image by analyzing pixel patterns, detecting stroke edges, and isolating individual stroke elements. This extraction process separates the essential stroke data from the background and other elements, enabling digital representation without requiring complex manual separation procedures.

Inventive Principle:
Principle #2Taking out (Extraction)

2Ease of operation

If analog strokes are converted to digital ink strokes, then manipulation capability is improved, but the conversion process becomes more complex

Engineering Contradiction:
Improvecontent manipulation easeVSAvoidconversion process complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces manual mechanical stroke separation and digitization processes with automated computer vision algorithms and machine learning models. These systems automatically detect, segment, and convert analog strokes to digital ink format, significantly improving ease of operation while managing conversion complexity through software-based processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates digital copies of analog strokes by capturing images and generating corresponding digital ink representations. This copying process preserves the original stroke characteristics while enabling digital manipulation, simplifying the conversion process through automated image-to-ink transformation algorithms.

Inventive Principle:
Principle #26Copying

3Ease of manufacture

If static images are converted to pixels only, then the transformation to digital format is simple, but the strokes cannot be manipulated individually

Engineering Contradiction:
Improvedigital transformation simplicityVSAvoidstroke manipulation capability
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The patent segments the pixel data into individual stroke components by detecting stroke boundaries, analyzing connectivity, and separating distinct writing elements. This segmentation maintains the simplicity of digital pixel processing while enabling individual stroke manipulation through structured data organization and automated stroke identification algorithms.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10339372B2Analog strokes to digital ink strokes
Publication Date: 2019.07.02 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10339372B2 patent drawing
  • US10339372B2 patent drawing
  • US10339372B2 patent drawing

AI summary

Analog written content of handwritten drawings or written characters can be transformed into digital ink via an analog-to-ink service. The analog-to-ink service can receive a static image of the analog written content, extract analog strokes from other information, such as background, in the static image, and then convert the analog strokes to digital ink strokes, for example, by populating an ink container with at least two parameters for defining the digital ink strokes. The at least two parameters can include a pressure, at tilt, a direction, a beginning point, an end point, a direction, a color, an order, an overlap, a language, and a time. The analog-to-ink service can provide the ink container to a content creation application that supports inking so that a user can manipulate the content in an inking environment.