ML Metadata Prediction for Document Workflow Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Document management systems face errors due to incorrect metadata association, leading to incorrect workflow execution, delays, and increased costs due to manual errors in document metadata management.

Innovation Solution

A document management system utilizes machine learning models to predict metadata attributes by extracting tokens or sequences from documents, training on annotated datasets, and incorporating user feedback to improve prediction accuracy and automate metadata determination during document workflows.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual document metadata management is used, then system complexity is low, but metadata accuracy deteriorates leading to workflow errors

Engineering Contradiction:
Improvemetadata accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces manual mechanical processes of metadata assignment with machine learning-based automated prediction systems. The system uses trained models to analyze document content and automatically generate metadata, eliminating human error while maintaining manageable system complexity through modular architecture.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The document management system performs self-service by automatically generating and assigning metadata without human intervention. The machine learning models autonomously analyze document content, extract relevant features, and populate metadata fields, enabling the system to serve itself in the metadata management task.

Inventive Principle:
Principle #25Self-service

2Productivity

If manual document metadata management is used, then automation extent is low, but productivity is maintained through simple processes

Engineering Contradiction:
Improvedocument processing speedVSAvoidautomation level
Core Design Contradiction:
ProductivityVSExtent of automation

Solution Approach 1:

The system performs preliminary action by pre-training machine learning models on extensive document datasets before actual metadata generation. This advance preparation enables rapid, accurate metadata prediction during document processing, significantly improving productivity while the automation handles the entire metadata generation workflow.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Manual metadata management processes are replaced with automated machine learning-based prediction systems. The automated models process documents rapidly, extracting and generating metadata without human intervention, thereby increasing document processing speed while implementing high-level automation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If machine learning models are implemented for metadata prediction, then metadata accuracy improves, but loss of time increases due to model training and execution

Engineering Contradiction:
Improvemetadata prediction accuracyVSAvoidmodel training and execution time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary training of machine learning models on extensive document datasets before deployment. This advance training prepares the models to rapidly predict metadata during actual document processing, reducing execution time while maintaining high accuracy through pre-learned patterns and features.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically adjusts the trade-off between training time and execution speed by implementing incremental learning and model updates. Frequently used models are pre-trained extensively, while less critical metadata predictions may use lighter models, optimizing the balance between accuracy and time consumption based on specific document processing needs.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS20240242108A1Training of machine learning models for predicting document metadata
Publication Date: 2024.07.18 DOCUSIGN INC
  • US20240242108A1 patent drawing
  • US20240242108A1 patent drawing
  • US20240242108A1 patent drawing

AI summary

A system predicts metadata attributes associated with documents using machine learning models. The document may represent an interaction between entities. The system trains machine learning models to predict scores indicating whether a token or a sequence of token of a document represents a metadata attribute. The metadata prediction is used to annotate the document and display to users. The system receives user feedback via the user interface and uses the user feedback to evaluate or retrain the model. The system generates training data by receiving a set of annotated documents and comparing the annotated documents against other documents to identify matching documents. The system determines when to execute the machine learning based metadata prediction based on steps of document workflow executed by the system.