AI Dataset Generation from Collaboration Forums

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional dataset generation techniques for feature testing are labor-intensive and resource-consuming, posing temporal and resource-related challenges in creating ground truth test data.

Innovation Solution

Automatically generating datasets by processing collaboration forums using artificial intelligence techniques, including obtaining conversational data, classifying and verifying information using AI methods, and generating datasets for test case-related issues for designated applications.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional dataset generation techniques are used, then ground truth test data can be created, but the process is labor-intensive and resource-consuming

Engineering Contradiction:

Improvequality of ground truth datasetVSAvoiddataset generation efficiency

Core Design Contradiction:

ReliabilityVSProductivity

Solution Approach 1:

The system uses AI models to automatically classify conversational data, extract test case information, and generate datasets without human intervention. The verification process also uses AI to analyze multiple entities' contributions, making the entire dataset generation process self-service and eliminating manual labor while maintaining high quality standards.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical processes (human experts creating and verifying test data) with automated AI-based systems. The AI classification model substitutes human categorization work, and the verification process using multiple entities' data substitutes manual validation, dramatically improving productivity while maintaining reliability.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If manual dataset creation processes are used, then accurate ground truth data can be obtained, but temporal challenges arise due to labor-intensive tasks

Engineering Contradiction:

Improveaccuracy of test dataVSAvoiddataset creation time

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary classification of conversational data into categories using AI before extraction and verification. This preliminary organization of data enables parallel processing in subsequent steps, reducing overall creation time while maintaining accuracy through structured AI-based analysis of the classified data.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent implements a continuous automated pipeline where AI classification feeds into information extraction, which feeds into verification by multiple entities, and finally dataset generation. This continuous automated process eliminates idle time between manual tasks and maintains measurement precision through consistent AI-based analysis throughout the workflow.

Inventive Principle:

Principle #20Continuity of useful action

3Productivity

If automated AI techniques are used for dataset generation, then productivity increases, but system complexity increases

Engineering Contradiction:

Improvedataset generation speedVSAvoidAI processing system complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The patent divides the dataset generation process into distinct modular segments: an AI classification model for categorizing conversational data, an information extraction component for retrieving test case details, and a verification process using multiple entities' data. This segmentation allows each component to be independently optimized and managed, reducing overall system complexity while maintaining high productivity through automated AI processing.

Inventive Principle:

Principle #1Segmentation

Data Source

PatentUS11455236B2Automatically generating datasets by processing collaboration forums using artificial intelligence techniques

Publication Date: 2022.09.27 INTERNATIONAL BUSINESS MACHINE CORPORATION

AI summary

Methods, systems, and computer program products for automatically generating datasets by processing collaboration forums using artificial intelligence techniques are provided herein. A computer-implemented method includes obtaining conversational data from collaboration forum sources; classifying, using a first set of artificial intelligence techniques, at least a portion of the conversational data into categories based on designated applications; extracting information, pertaining to test case-related issues, from at least a portion of the classified data; verifying at least a portion of the extracted information by analyzing, using a second set of artificial intelligence techniques, portions of the conversational data attributed to multiple entities and related to the extracted information; generating, using the verified information, one or more datasets related to at least one of the test case-related issues for at least one of the designated applications; performing at least one automated action based on the one or more generated datasets.