Structured Image Parsing via Inference-Rule Search

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing software editing applications face challenges in accurately parsing and manipulating structured images due to inefficiencies in signal processing algorithms, which fail to accurately identify objects and modify images effectively.

Innovation Solution

A method is introduced that generates structured data files by detecting expressions describing image structures, using an inference-rule based search strategy to identify hierarchical bounding boxes, and creating tuples of data files that include content values and style characteristics, enabling efficient parsing and rendering of structured images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If signal processing algorithms are used to identify objects in images, then object detection is enabled, but parsing accuracy deteriorates for structured images

Engineering Contradiction:
Improveobject detection capabilityVSAvoidparsing accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent segments the image parsing problem into distinct structured components (bounding boxes, hierarchical arrangements, content values, style characteristics) rather than treating it as a general object detection task. This segmentation allows the system to accurately parse structured images by identifying specific elements like bounding boxes and their hierarchical relationships, while maintaining the ability to handle various structured image types.

Inventive Principle:
Principle #1Segmentation

2Ease of manufacture

If traditional signal processing algorithms are used, then image processing is enabled, but efficiency deteriorates in parsing structured images

Engineering Contradiction:
Improveimage processing capabilityVSAvoidparsing efficiency
Core Design Contradiction:
Ease of manufactureVSProductivity

Solution Approach 1:

The patent introduces an intermediary parsing system that acts as a bridge between the input structured image and the output data representation. This intermediary system uses bounding box detection, hierarchical arrangement identification, and separate content/style value extraction to efficiently transform structured images into editable data formats, significantly improving parsing efficiency compared to traditional signal processing algorithms.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If signal processing algorithms are applied, then image modification is enabled, but accuracy deteriorates in manipulating structured images

Engineering Contradiction:
Improveimage modification capabilityVSAvoidmanipulation accuracy
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The patent extracts the essential structural and semantic components from structured images into separate editable data elements. By taking out bounding boxes, hierarchical arrangements, content values, and style characteristics as distinct data structures, the system enables accurate manipulation of individual elements without affecting the overall image structure, thereby improving manipulation accuracy while maintaining ease of operation.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS9031894B2Parsing and rendering structured images
Publication Date: 2015.05.12 MICROSOFT TECHNOLOGY LICENSING LLC
  • US9031894B2 patent drawing
  • US9031894B2 patent drawing
  • US9031894B2 patent drawing

AI summary

Systems and methods for generating a tuple of structured data files are described herein. In one example, a method includes detecting an expression that describes a structure of a structured image using a constructor. The method can also include using an inference-rule based search strategy to identify a hierarchical arrangement of bounding boxes in the structured image that match the expression. Furthermore, the method can include generating a first tuple of structured data files based on the identified hierarchical arrangement of bounding boxes in the structured image.