Handwritten Text Layer Editing in Document Data Structures

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image forming apparatuses face challenges in efficiently editing and managing document data, particularly when handling handwritten text, as they struggle to seamlessly integrate text recognition and image manipulation within a unified document data structure.

Innovation Solution

The apparatus performs text recognition using OCR or ICR, allowing users to edit text layers while simultaneously applying corresponding changes to image layers, enabling operations like deletion, insertion, and replacement, and stores this information in a document data structure that maps text and image layers for efficient editing and saving.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If text recognition (OCR/ICR) is performed on scanned documents to enable text editing, then text readability and editability are improved, but processing time and system complexity increase

Engineering Contradiction:
Improvetext editabilityVSAvoidprocessing time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system performs text recognition (OCR/ICR) on scanned documents in advance during the scanning process, creating a text layer that is ready for immediate editing. This preliminary action eliminates the need for time-consuming text recognition when users want to edit text later, as the text layer is already extracted and synchronized with the image layer.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The document data is divided into separate layers: an image layer containing the scanned document image and a text layer containing the recognized text. This segmentation allows independent processing of text recognition without affecting the entire document handling process, enabling efficient text editing while maintaining the original image integrity.

Inventive Principle:
Principle #1Segmentation

2Ease of operation

If text and image layers are integrated in a unified document data structure, then editing coordination between text and image is improved, but device complexity increases

Engineering Contradiction:
Improveediting coordinationVSAvoiddata structure complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The document data structure is segmented into distinct image layer and text layer components, each with specific functions. The image layer stores the visual representation while the text layer stores the recognized text content. This segmentation simplifies the complexity by providing clear separation of concerns while maintaining coordination through layer association.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The unified document data structure serves multiple functions: it stores both image and text data, enables synchronized editing of both layers, supports various document operations (copy, move, delete), and maintains the relationship between text and its corresponding image region. This multi-functionality reduces the need for separate systems for image handling and text editing.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Loss of information

If OCR/ICR text recognition is performed on handwritten text, then text conversion to computer readable format is improved, but recognition accuracy and processing time are affected

Engineering Contradiction:
Improvetext conversion accuracyVSAvoidrecognition processing time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system introduces an intermediary text layer that acts as a bridge between the handwritten text in the image layer and the computer-readable text format. This text layer contains the recognized text from OCR/ICR processing, allowing accurate text conversion without requiring repeated processing of the original handwritten image, thus reducing processing time while maintaining accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS20240330572A1Edit of text layer and image layer in document including handwritten text
Publication Date: 2024.10.03 HEWLETT PACKARD DEVELOPMENT COMPANY LP
  • US20240330572A1 patent drawing
  • US20240330572A1 patent drawing
  • US20240330572A1 patent drawing

AI summary

An example electronic apparatus includes a processor and a memory to store instructions executable by the processor. The processor, by executing the instructions, is to obtain, for a document including handwritten text, a text layer including text and an image layer including a handwritten image corresponding to the text, detect text related to an edit request of a user, retrieve, in the text layer, at least one character constituting the detected text, retrieve, in the image layer, at least one character image mapped to the retrieved at least one character, and apply a first handwritten image including the retrieved at least one character image to the image layer.