Web Script Automation via User Contribution and Self-Service Updates
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current systems for automated web site information retrieval require frequent updates due to site layout changes, leading to increased costs and user frustration, especially when many sites change layout simultaneously, and pose challenges in justifying resource allocation for scripts that serve few users.
Innovation Solution
A system and method that allows information retrieval from web sites by combining elements from different user-provided scripts, using a plug-in or proxy server to assist users in identifying necessary fields, and automatically updating scripts based on success rates, enabling faster and more reliable information retrieval even from less frequently accessed sites.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a single programmer writes and maintains scripts for information retrieval from web sites, then the script can be maintained with dedicated attention, but the cost and time required increase significantly when many web sites need to be monitored and updated
Solution Approach 1:
The patent segments the script maintenance task by distributing script writing and updating responsibilities across multiple users who contribute scripts for different web sites. Each user maintains scripts for sites they are interested in, eliminating the bottleneck of a single programmer while maintaining dedicated attention to each script's reliability.
Solution Approach 2:
The system enables users to automatically update their own retrieval scripts by having them review and approve proposed changes. This self-service approach allows each user to maintain script reliability for their specific needs without requiring centralized programmer intervention for every update.
2Adaptability or versatility
If multiple programmers are employed to update scripts for many web sites, then information can be retrieved from more sites, but the cost increases significantly
Solution Approach 1:
The patent creates a universal platform where any user can contribute and maintain retrieval scripts for any web site. This multi-functional system allows the same infrastructure to serve multiple users and multiple web sites simultaneously, eliminating the need to hire separate programmers for each site while expanding coverage.
Solution Approach 2:
Users automatically update their own scripts by reviewing proposed changes, eliminating the need for paid programmer intervention. This self-service model allows the system to expand coverage to numerous web sites without proportionally increasing resource allocation, as each user maintains their own scripts at no additional cost to the service provider.
3Measurement precision
If programmers manually update scripts when web site layouts change, then information retrieval accuracy is maintained, but delays occur when many sites change simultaneously causing user frustration
Solution Approach 1:
The system performs preliminary actions by automatically detecting layout changes on web sites and generating proposed script updates before users need them. Changes are prepared in advance and queued for user review, so when users check their scripts, the updates are already ready, minimizing delays while maintaining accuracy through user verification.
Solution Approach 2:
The system implements feedback loops where users review proposed script changes and provide approval or corrections. This feedback mechanism ensures retrieval accuracy is maintained while the automated detection and preparation of changes minimizes delays. Users only need to review changes when they occur, rather than continuously monitoring all sites.
4Productivity
If the system only focuses on popular web sites with many users, then resource allocation is justified, but users interested in less popular sites cannot obtain the information they need
Solution Approach 1:
Users interested in niche or less popular web sites can independently contribute and maintain their own retrieval scripts without requiring the service provider to allocate resources to those sites. The self-service model allows the system to cover any number of sites regardless of user interest levels, as each user bears their own maintenance cost through their time investment.
Solution Approach 2:
The universal platform allows any user to contribute scripts for any web site, creating a diverse ecosystem where both popular and niche sites are covered. This multi-functional system serves multiple purposes: it provides cost-effective coverage for popular sites while simultaneously enabling niche site coverage through user contributions, all within the same infrastructure.
Data Source
AI summary
A system and method allows users to provide portions of scripts or scripts for retrieval of information from one or more web sites of one or more businesses by demonstrating operation of the one or more web sites and identifying locations of one or more fields on each web page of the one or more web sites, and the system and method stores the scripts and uses the scripts to retrieve information from such web site or web sites for any number of users. Different portions of different scripts may be used as a single script to retrieve information from a single web site. Scripts or portions of scripts may be repaired using information from previously working scripts or portions, the web site when the script or portion worked, and the web site when the script or portion did not work.