Semi-Structured JSON Decomposition Using Metadata-Guided Parsing

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing methods for decomposing semi-structured JSON data, such as Pandas read_json and json_normalize, are not flexible enough to handle multiple JSON records and do not collect metadata, making it difficult to process nested and array-based JSON data efficiently.

Innovation Solution

A method for automatically parsing semi-structured data with customizable settings to generate a structured format, which includes metadata collection and decomposition of multiple JSON records, allowing for efficient decomposition of semi-structured data into a structured format.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If existing methods like Pandas read_json and json_normalize are used to decompose semi-structured JSON data, then the decomposition process is simple, but the methods are not flexible enough to handle multiple JSON records and do not collect metadata

Engineering Contradiction:

Improveflexibility to handle multiple JSON recordsVSAvoidcomplexity of decomposition process

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the decomposition process into distinct phases: metadata collection phase and decomposition phase. The system first collects metadata from multiple JSON records to understand their structure, then uses this metadata to guide the decomposition process. This segmentation allows the system to handle multiple records flexibly while maintaining a manageable process complexity through modular design.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent applies preliminary action by collecting metadata from multiple JSON records before performing the actual decomposition. This preliminary metadata collection step enables the system to adapt to different record structures and configurations, providing the flexibility needed to handle various JSON formats without increasing the complexity of the subsequent decomposition operations.

Inventive Principle:

Principle #10Preliminary action

2Adaptability or versatility

If metadata collection is implemented to improve decomposition flexibility, then the ability to handle nested and array-based JSON data improves, but the processing time and complexity increase

Engineering Contradiction:

Improveability to handle nested and array-based JSON dataVSAvoidprocessing time

Core Design Contradiction:

Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent performs metadata collection as a preliminary action before the main decomposition process. By gathering structural information about nested and array-based JSON data in advance, the system can efficiently process these complex structures during decomposition without incurring excessive processing time penalties. The metadata serves as a guide that accelerates the actual decomposition of nested and array elements.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent creates a metadata representation that copies and stores the structural information of JSON records. This metadata copy contains information about nested structures and arrays, allowing the system to handle these complex elements efficiently during decomposition without repeatedly analyzing the original complex JSON structures, thereby reducing processing time.

Inventive Principle:

Principle #26Copying

3Productivity

If a structured format is generated based on metadata from multiple records, then the decomposition efficiency improves, but the initial setup and metadata collection process becomes more complex

Engineering Contradiction:

Improvedecomposition efficiencyVSAvoidcomplexity of metadata collection process

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the overall process into metadata collection and decomposition phases. The metadata collection phase, while more complex, is performed once to generate a structured format that guides subsequent decompositions. This segmentation allows the system to invest complexity upfront in metadata collection, thereby achieving improved decomposition efficiency for multiple records without repeatedly incurring that complexity.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent creates a universal metadata structure that can serve multiple decomposition operations. The structured format generated from metadata collection is designed to be reusable across multiple JSON records with similar structures, allowing the system to amortize the initial complexity investment over many decomposition operations, thereby improving overall productivity.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS12517952B2Semi-structured data decomposition

Publication Date: 2026.01.06 INTERNATIONAL BUSINESS MACHINE CORPORATION

AI summary

A computer-implemented technique for decomposing semi-structured data is provided. In this technique, metadata for a predetermined number of records can be collected from semi-structured data that includes several records. A structured format is generated based on the metadata and the plurality of records is decomposed with the structured format.