Hand Markup Command Extraction for Document Formatting

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Authors of writing board content cannot control the formatting or document settings of generated electronic documents, and must manually modify them to include additional content, despite the desire for automated conversion of writing board images into electronic documents.

Innovation Solution

A system and method for image processing that identifies graphics elements corresponding to commands within an image, executing these commands to generate an electronic document, excluding the command elements themselves, and incorporating revised versions of non-command elements, along with additional content and settings, to produce a formatted electronic document.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If automated image processing is used to generate electronic documents from writing board images, then document generation efficiency is improved, but the author loses control over formatting and document settings

Engineering Contradiction:
Improvedocument generation efficiencyVSAvoidcontrol over formatting
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The patent embeds formatting commands and document settings directly into the writing board image itself before processing. Special graphics elements containing formatting information (font, size, color, layout) are included in the source image, so the automated processing system can execute these pre-defined instructions to generate the electronic document with the desired formatting without requiring manual adjustment afterward.

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If manual modification is used to control document formatting and add content, then document quality is improved, but time consumption increases

Engineering Contradiction:
Improvedocument qualityVSAvoidtime consumption
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent enables the writing board image to serve itself by embedding self-descriptive graphics elements that contain both content information and formatting instructions. The image processing system automatically extracts and executes these embedded commands, allowing the document to generate itself with proper formatting and additional content without requiring external manual intervention for quality control.

Inventive Principle:
Principle #25Self-service

3Ease of operation

If command graphics elements are included in the electronic document, then formatting control is improved, but document cleanliness deteriorates

Engineering Contradiction:
Improveformatting controlVSAvoiddocument cleanliness
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent separates the formatting control function from the final document output. Command graphics elements embedded in the source image are executed by the processing system to apply formatting and settings, then these command elements are extracted or discarded from the final electronic document. Only the results of command execution (properly formatted content) remain in the output, maintaining document cleanliness while achieving formatting control.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS9946698B2Inserting text and graphics using hand markup
Publication Date: 2018.04.17 KONICA MINOLTA SYSTEMS LABORATORY INC
  • US9946698B2 patent drawing
  • US9946698B2 patent drawing
  • US9946698B2 patent drawing

AI summary

A method may include obtaining an image that includes a first graphics element and a second graphics element, determining that the first graphics element corresponds to a command and that the second graphics element is a non-command, and generating an electronic document by executing the command. The electronic document may include a revised version of the second graphics element, but not the first graphics element. The electronic document may be generated in response to the first graphics element corresponding to the command.