Browser Plugin for Ground Truth Data Collection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for generating ground truth data for cognitive question answering systems are expensive and difficult due to the need for dedicated software and separate training processes, making efficient data collection impractical.
Innovation Solution
A browser-based ground truth collector system that provides an embeddable overlay allowing users to highlight and submit passages from any website with a click, featuring a plugin that suggests questions based on user expertise and automatically populates answer and source fields, facilitating seamless data collection and storage for QA system training.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional ground truth collection methods are used with dedicated software and pre-loaded documents, then ground truth data can be collected, but the process becomes expensive and difficult requiring separate training
Solution Approach 1:
The patent makes the ground truth collection tool universally accessible through a browser plugin that works with any website, eliminating the need for dedicated software. The overlay interface can be activated on any webpage, allowing users to collect ground truth data from diverse sources without requiring specialized applications or separate training processes.
Solution Approach 2:
The browser overlay acts as an intermediary layer between the user and any website, providing ground truth collection functionality without modifying the underlying websites or requiring users to leave their current browsing context. This mediator approach allows seamless data collection from any source while maintaining a consistent user interface.
2Productivity
If dedicated ground truth collection software is used, then data can be collected, but separate training is required imposing additional costs
Solution Approach 1:
The browser plugin provides self-service functionality by automatically detecting when a user is viewing a relevant webpage and prompting them to contribute ground truth data. The system identifies suitable pages through URL analysis and automatically activates the overlay, eliminating the need for users to undergo separate training processes or manually configure the tool.
3Quantity of substance
If ground truth data is collected from fact statements submissions, then training data is obtained, but the process is expensive and difficult at practical level
Solution Approach 1:
The patent segments the ground truth collection process into simple, discrete actions that users can perform directly in their browser. The overlay divides the webpage content into selectable passages, allowing users to contribute data through simple clicks and selections rather than complex submission processes, thereby increasing both the volume and ease of data collection.
Data Source
AI summary
A method, system and a computer program product are provided for collecting ground truth data by activating a ground truth collection browser plugin with a designated toolbar button to receive answer data from a webpage which includes user-selected data passage and source data from the webpage for automatic loading into a ground truth submission window along with user input question data corresponding to the answer data so that the user input question data, source data, and answer data from the ground truth submission window may be stored as ground truth data.