Context-Aware Ambiguous Term Resolution in Handwritten and Audio Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The challenge lies in efficiently converting unstructured handwritten and audio notes into structured data, as existing methods face difficulties with ambiguity in recognition, such as 'dock' and 'clock' being indistinguishable in handwriting and 'seventy' and 'seventeen' in voice notes, leading to productivity inefficiencies in data entry for systems like CRM and project management.

Innovation Solution

A computer-implemented method that analyzes structured data templates to build lexical and phonetic spaces, maps multi-variant answers from handwriting and voice recognition, and uses contextual information to select the correct terms, employing structural attachment tokens and hints to resolve ambiguities through cross-validation and user input.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If automatic recognition (conversion to text, transcription) of handwritten and voice data is performed, then data conversion speed is improved, but recognition accuracy deteriorates due to ambiguous terms

Engineering Contradiction:
Improvedata conversion speedVSAvoidrecognition accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent segments the data conversion process into multiple stages: initial automatic recognition to generate candidate terms, contextual analysis to filter and select from candidates, and validation mechanisms. This segmentation allows the system to maintain high conversion speed while improving accuracy through multi-stage processing that addresses ambiguous terms systematically.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces contextual information as an intermediary element between the raw recognized text and the final structured data. This intermediary layer analyzes the context surrounding ambiguous terms, compares them against templates, and mediates the selection process, thereby resolving ambiguities without sacrificing conversion speed.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If manual conversion of unstructured information into structured data is performed, then data accuracy is improved, but time consumption increases

Engineering Contradiction:
Improvedata accuracyVSAvoidtime consumption
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary automatic recognition and template matching to pre-process unstructured data before manual intervention. This preliminary action handles the bulk of the conversion work, generating structured data outputs that require minimal manual verification, thus maintaining high accuracy while significantly reducing time consumption compared to fully manual conversion.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system enables self-service by automatically performing the majority of the conversion task from unstructured to structured data. The automated recognition, contextual analysis, and template matching processes handle the conversion independently, with only minor manual corrections needed, thereby reducing the time investment required from users.

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If multi-variant answers from handwriting and voice recognition are generated, then coverage of possible interpretations is improved, but complexity of data processing increases

Engineering Contradiction:
Improvecoverage of interpretationsVSAvoiddata processing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies local quality by analyzing and processing only the specific contextual regions surrounding ambiguous terms rather than the entire dataset. The contextual analysis focuses locally on the immediate surroundings of problematic terms, comparing them against relevant templates and selecting the most appropriate interpretation, thereby managing complexity while maintaining comprehensive coverage.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system generates multiple candidate terms (excessive action) to ensure comprehensive coverage of possible interpretations, then applies selective filtering based on contextual analysis. This partial action approach ensures that all plausible interpretations are initially considered, while the subsequent selection process manages complexity by not processing all possibilities equally, but rather focusing on the most likely candidates.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11550995B2Extracting structured data from handwritten and audio notes
Publication Date: 2023.01.10 BENDING SPOONS SPA
  • US11550995B2 patent drawing
  • US11550995B2 patent drawing
  • US11550995B2 patent drawing

AI summary

This application is directed to recognizing unstructured information based on hints provided by structured information. A computer system obtains unstructured information collected from a handwritten or audio source, and identifies one or more terms from the unstructured information. The one or more terms includes a first term that is ambiguous. The computer system performs a recognition operation on the first term to derive a first plurality of candidate terms for the first term, and obtains first contextual information from an information template associated with the unstructured information. In accordance with the first contextual information, the computer system selects a first answer term from the first plurality of candidate terms, such that the first term is recognized as the first answer term.