Molecular Pathway Diagram Information Extraction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current cognitive computing systems are unable to effectively interpret, categorize, and classify the complex graphical information contained in molecular pathway diagrams, which are crucial for fields like personalized medicine and drug discovery, as they neglect the valuable information present in graphical representations.

Innovation Solution

A method and system that detect basic graphical structural elements, their semantic, and syntax in molecular pathway diagrams, assigning metadata to extract entities and relationships, utilizing a cognitive computing model with machine learning algorithms to enhance interpretability and categorization without human intervention.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If manual curation by experts is used to build databases, then data accuracy and reliability are improved, but time consumption and productivity are worsened

Engineering Contradiction:
Improvedata accuracyVSAvoiddata processing speed
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent introduces an intermediary system (image processing pipeline with CNNs and NLP models) that bridges the gap between raw pathway diagrams and structured database entries. This intermediary automatically extracts entities, relationships, and metadata from diagrams, reducing reliance on manual expert curation while maintaining data quality through multiple processing stages including image preprocessing, object detection, semantic analysis, and conflict resolution mechanisms.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Device complexity

If graphical information is neglected in favor of text mining, then processing complexity is reduced, but information completeness and measurement precision are worsened

Engineering Contradiction:
Improveprocessing complexityVSAvoidgraphical information loss
Core Design Contradiction:
Device complexityVSLoss of information

Solution Approach 1:

The patent segments the complex task of diagram analysis into distinct processing stages: image preprocessing, basic object detection (shapes, lines, arrows), text recognition, semantic analysis, and relationship extraction. Each stage handles specific types of graphical information independently, allowing the system to process complex visual data systematically while maintaining information completeness and enabling efficient computation through modular architecture.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10360993B2Extract information from molecular pathway diagram
Publication Date: 2019.07.23 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US10360993B2 patent drawing
  • US10360993B2 patent drawing
  • US10360993B2 patent drawing

AI summary

A method for extracting information from a molecular pathway diagram may be provided. The method includes providing a molecular pathway diagram, detecting basic graphical structural elements in the diagram resulting in a set of basic objects, detecting a graphical semantic of each of the basic graphical structural elements resulting in a set of structural primitives, and detecting a graphical syntax of the basic graphical structural element relative to each other and to the diagram. Furthermore, the method includes assigning metadata to a plurality of the detected basic graphical structural elements, where the metadata includes basic graphical structural element data, graphical semantic data and graphical syntax data resulting in a set of entities and relationships.