Automated RFP Requirement Extraction via NLP and Meta-Model Mapping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Manual processing of Request for Proposal (RFP) documents is slow, tedious, and error-prone due to their complexity and diverse formats, making it difficult to identify and extract client service requirements effectively.

Innovation Solution

A method and system that employs linguistic-based and machine learning techniques to parse and analyze RFP documents, identify relationships, and map requirements to meta-models, enabling automated extraction and classification of client service requirements across different vocabularies, with an interactive tool for continuous learning and improvement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If manual processing methods are used to analyze RFP documents, then processing accuracy can be maintained through human judgment, but processing speed and productivity are significantly reduced due to the slow and tedious nature of manual analysis

Engineering Contradiction:
Improveprocessing speedVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent replaces manual mechanical processing with an automated system combining natural language processing (NLP), machine learning models, and computational algorithms. The system automatically parses RFP documents, extracts requirements, identifies relationships among components, and classifies requirements without human intervention, thereby dramatically improving processing speed while managing complexity through standardized computational approaches

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces intermediate processing layers including NLP preprocessing modules, feature extraction components, and relationship identification algorithms that act as mediators between the raw RFP documents and the final requirement extraction. These intermediaries break down the complex processing task into manageable stages, improving both speed and accuracy while managing system complexity through modular architecture

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If automated processing systems are implemented to improve productivity, then processing speed increases, but error rates may increase due to the complexity of handling diverse formats and complex terms

Engineering Contradiction:
Improveprocessing speedVSAvoidprocessing accuracy
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent implements feedback mechanisms where the system continuously learns from processing results, refining its NLP models and relationship identification algorithms. The system analyzes extracted requirements and relationships, validates them against the meta-model, and uses this feedback to improve future extractions, thereby maintaining high accuracy while processing at automated speeds

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent performs preliminary actions by pre-processing RFP documents through NLP techniques, building feature vectors, and identifying relationships before final requirement extraction. The system also pre-trains models on domain-specific vocabulary and formats, enabling more accurate and reliable processing when handling diverse formats and complex terms

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If comprehensive analysis of all document components is performed to ensure complete requirement extraction, then measurement precision improves, but loss of time increases due to the extensive processing required

Engineering Contradiction:
Improverequirement extraction accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent segments the RFP document into distinct components (requirements, constraints, specifications, etc.) and processes each segment separately using targeted NLP techniques. The system identifies and extracts relationships among parsed components, applying the meta-model selectively to relevant segments, thereby achieving complete requirement extraction without processing every single word, thus reducing processing time while maintaining accuracy

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies partial action by focusing computational resources on identifying and extracting only the critical requirement elements and their relationships, rather than performing exhaustive analysis of all document content. The system uses NLP to prioritize and extract the most important components, achieving high measurement precision for requirement extraction while minimizing processing time through selective analysis

Inventive Principle:
Principle #16Partial or excessive action

4Adaptability or versatility

If the system handles diverse vocabularies and complex terms across multiple formats to improve adaptability, then versatility improves, but device complexity increases due to the need to process tens to hundreds of documents in various formats

Engineering Contradiction:
Improveformat compatibilityVSAvoidsystem architecture complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a universal NLP-based processing framework that can handle multiple document formats (PDF, Word, HTML, etc.) and diverse vocabularies through a single integrated system. The meta-model provides a unified structure for representing requirements regardless of source format, and the NLP components are designed to adapt to different vocabularies and formats, achieving high versatility without proportionally increasing system complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent uses parameter changes by dynamically adjusting NLP processing parameters, feature extraction methods, and relationship identification strategies based on the detected document format and vocabulary. The system adapts its processing approach to match the specific characteristics of each RFP package, enabling handling of diverse formats and terms while managing complexity through parameter-based adaptation rather than separate processing pipelines

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10282468B2Document-based requirement identification and extraction
Publication Date: 2019.05.07 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US10282468B2 patent drawing
  • US10282468B2 patent drawing
  • US10282468B2 patent drawing

AI summary

According to an aspect, document-based requirement identification and extraction includes parsing a set of documents and identifying relationships among parsed components of the documents and applying the parsed components and identified relationships to a meta-model that defines requirements. The requirements include a statement expressing a need and/or responsibility. A further aspect includes identifying candidate requirements and their candidate topics from results of the applying. For each of the identified candidate topics, a feature vector is built from the corresponding candidate requirements. A further aspect includes training the meta-model with the feature vectors, validating the meta-model, and classifying output of the validating to identify a subset of the candidate requirements, and corresponding topics expressed in the set of documents.