Tabular Data Narration via Hierarchical Structure Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Natural language processing engines often ignore or fail to correctly interpret tabular data in documents due to the lack of understanding of the hierarchical structure and relationships within the data, leading to incomplete interpretation of cell values and their significance.

Innovation Solution

A method and system that analyze the structure of tabular data, draw inferences based on cell positions, and cross-reference data with other document content to transform tabular data into a narrative form without relying on external sources or templates, enabling NLP engines to interpret tabular data accurately.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If NLP engines process tabular data without analyzing hierarchical structure, then processing speed is maintained, but interpretation accuracy deteriorates

Engineering Contradiction:
Improveinterpretation accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the tabular data into hierarchical structures by identifying categories, sub-categories, and cell relationships. This segmentation allows the NLP engine to process and interpret data systematically through structured analysis rather than treating the table as a flat structure, thereby improving interpretation accuracy without overwhelming complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary analysis of the tabular structure by identifying categories and their hierarchical relationships before generating narrative descriptions. This preliminary structuring enables more accurate interpretation of cell values and their relationships, as the data is pre-organized into meaningful categories that guide subsequent processing.

Inventive Principle:
Principle #10Preliminary action

2Loss of information

If NLP engines ignore tabular data, then processing simplicity is maintained, but information completeness deteriorates

Engineering Contradiction:
Improveinformation completenessVSAvoidprocessing complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent merges the narrative generation process with tabular data processing by transforming table structures directly into narrative form. This integration ensures that tabular information is not ignored or separated from the document content, but rather combined and processed together, maintaining information completeness while avoiding the complexity of separate processing pipelines.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent uses an intermediary transformation process that converts tabular data into narrative form as an intermediate representation. This intermediary step bridges the gap between structured tabular data and natural language processing, enabling complete information preservation while simplifying the final processing by presenting data in a more accessible narrative format.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If NLP engines use templates for narrative generation, then generation speed is improved, but adaptability deteriorates

Engineering Contradiction:
Improvenarrative adaptabilityVSAvoidgeneration speed
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent employs dynamic narrative generation that adapts to the specific structure and content of each tabular dataset rather than relying on fixed templates. The system dynamically identifies categories, relationships, and hierarchical structures, then generates narratives that naturally fit the data's unique characteristics, achieving high adaptability while maintaining efficient processing through automated pattern recognition.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10909303B2Adapting tabular data for narration
Publication Date: 2021.02.02 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US10909303B2 patent drawing
  • US10909303B2 patent drawing
  • US10909303B2 patent drawing

AI summary

A method, system, and computer program product for adapting tabular data for narration are provided in the illustrative embodiments. A set of categories used to organize data is identified in a first tabular portion of a document. A structure of the categories is analyzed. An inference is drawn about data in a first cell in the first tabular portion based on a position of the first cell in the structure. The first tabular portion of the document is transformed into a first narrative form using the inference.