Digital Ink Semantic Layout Enhancement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Computer users often create disorganized and difficult-to-follow digital notes using electronic pens, which can be challenging to display effectively on various devices, leading to inefficient use of computer resources and reduced user satisfaction.

Innovation Solution

A system that analyzes digital ink in electronic documents to determine a semantic structure and visually enhances it by adjusting layout, styling, and display characteristics, allowing for improved alignment, spacing, and formatting without converting the ink to text, and adapts to different device displays.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If digital ink is displayed as handwritten input without enhancement, then the original input format is preserved, but the display is disorganized and difficult to follow

Engineering Contradiction:
Improveease of reading digital inkVSAvoidoriginal handwritten format
Core Design Contradiction:
Ease of operationVSStability of the object's composition

Solution Approach 1:

The system performs preliminary analysis of the digital ink to determine semantic structure before display, organizing the content in advance based on detected patterns such as lists, paragraphs, and hierarchical relationships, thereby improving readability without requiring post-input reorganization

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system changes display parameters of the digital ink including spacing, alignment, font styling, and layout based on the determined semantic structure, transforming the visual presentation while preserving the original handwritten strokes and their meaning

Inventive Principle:
Principle #35Parameter changes

2Ease of operation

If digital ink is visually enhanced with layout adjustments and styling, then readability and organization are improved, but computer resources are consumed

Engineering Contradiction:
Improvereadability of digital inkVSAvoidcomputer resource consumption
Core Design Contradiction:
Ease of operationVSUse of energy by moving object

Solution Approach 1:

The system applies visual enhancement selectively rather than uniformly to all digital ink, focusing processing on portions that benefit most from enhancement based on semantic structure analysis, thereby reducing overall resource consumption while maintaining readability improvements

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

Different enhancement strategies are applied to different portions of the digital ink based on their semantic characteristics, such as applying list formatting to bullet points, paragraph spacing to text blocks, and hierarchical styling to headings, optimizing resource use by matching enhancement intensity to content type

Inventive Principle:
Principle #3Local quality

3Adaptability or versatility

If digital ink is displayed without semantic structure analysis, then processing is faster and simpler, but the display cannot be optimized for different devices

Engineering Contradiction:
Improveadaptability to different devicesVSAvoidprocessing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system segments the digital ink into distinct semantic units such as lists, paragraphs, and hierarchical elements through structure analysis, enabling each segment to be independently optimized for different device displays while managing complexity through modular processing

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11023661B2Visually enhanced digital ink
Publication Date: 2021.06.01 MICROSOFT TECHNOLOGY LICENSING LLC
  • US11023661B2 patent drawing
  • US11023661B2 patent drawing
  • US11023661B2 patent drawing

AI summary

Described herein is a system and method for visually enhancing digital ink of an electronic document. A trigger to visually enhance digital ink of portion(s) of the electronic document is received. In response to the received trigger, the digital ink of portion(s) of the electronic document to determine a semantic structure of the digital ink in response to the received trigger. The digital ink of the portion(s) of the electronic document are visually enhanced in accordance with the determined semantic structure. Visual enhancement can include horizontal line adjustment, aligning line(s), aligning word in a particular line using a baseline, adjusting vertical spacing of lines, paragraphs, and/or lists, adjusting spacing between words and/or list items in a particular line, modifying ink styling (e.g., ink size, ink thickness, ink color), adjusting sizing of characters in a same group, unifying ink color, and/or unifying ink thickness.