Screen Scraping Parser Correction via User Simulation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current processes for correcting screen scraping parser scripts are time-consuming and resource-intensive, requiring users to notify providers of errors, leading to downtime and unnecessary resource allocation, as users must contact providers to identify and fix script issues, which often do not require formal fixes and hinder productivity.
Innovation Solution
A platform that allows individual users of a data management system to access and correct script errors by providing a simulation of the webpage, enabling them to make corrections which are then transformed into user-originated parser scripts, reviewed and implemented for all users, reducing the need for central provider intervention.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If users contact providers to report and correct script errors, then script errors can be identified and fixed, but the process becomes time-consuming and resource-intensive
Solution Approach 1:
The patent enables users to independently correct script errors through an automated error correction system that provides error information, allows users to input corrections, and automatically applies fixes without requiring provider intervention. This self-service approach eliminates the time-consuming process of contacting providers while maintaining reliable error correction.
Solution Approach 2:
The patent introduces an automated error correction system as an intermediary between users and script errors. This system receives error reports, processes corrections, and applies fixes automatically, serving as a mediator that resolves errors without requiring direct user-provider communication, thereby reducing time loss while ensuring reliable correction.
2Reliability
If users contact providers to identify and fix script issues, then script functionality can be restored, but provider resources are unnecessarily allocated
Solution Approach 1:
The automated error correction system enables users to independently restore script functionality by providing error details and accepting corrections without provider involvement. This eliminates unnecessary allocation of provider resources while ensuring reliable script functionality restoration through automated processing.
Solution Approach 2:
The patent extracts the error correction function from the provider's responsibility and transfers it to the user through an automated system. By taking out the correction process from provider workflows, the system restores script functionality reliably while preventing unnecessary consumption of provider resources.
3Reliability
If traditional error reporting processes are used, then script errors can be detected, but productivity is hindered due to delays
Solution Approach 1:
The automated error correction system performs preliminary actions by automatically detecting errors, providing correction information, and applying fixes without waiting for provider intervention. This preliminary automated response maintains reliable error detection while eliminating delays that hinder user productivity.
Solution Approach 2:
Users independently complete the entire error detection and correction process through the automated system, which provides error information and applies fixes without external assistance. This self-service approach ensures reliable error detection while maximizing productivity by eliminating all delays associated with traditional reporting processes.
4Reliability
If formal fixes are applied to all script errors, then script reliability improves, but unnecessary resource allocation occurs for errors that do not require fixes
Solution Approach 1:
The automated error correction system applies corrections selectively based on error analysis rather than uniformly to all errors. It performs partial action by targeting only those errors that require intervention, improving script reliability while avoiding unnecessary resource allocation for errors that resolve themselves or do not impact functionality.
Solution Approach 2:
The system changes the parameter of correction application from universal to conditional, using error characteristics to determine whether formal fixes are necessary. This parameter change enables reliable error handling while optimizing resource allocation by applying fixes only when needed based on error analysis.
Data Source
Figure 1
Figure 2A
Figure 2B~2C
AI summary
Individuals using a data management system are provided the capability to make corrections to default values presented in a simulation of at least part of a webpage including default data indicating the layout of the webpage, and/or one or more identified data fields determined by heuristic analysis and/or from data collected from other individuals/users. These contributing individual corrections are then transformed into contributing individual originated parser scripts associated with the webpage. The contributing individual originated parser scripts are then implemented and/or applied to the webpage for all individuals, including the contributing individual.