Web-Component Crawler for Real-Time Inventory Data Validation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional systems for maintaining inventory records of items at third-party entities are error-prone and time-consuming due to delays and inaccuracies in receiving updates from third-party providers, which can lead to outdated information in fast-paced e-commerce environments.

Innovation Solution

A system that extracts real-time inventory data from third-party websites by embedding a web-component on the third-party website, which generates an HTML file upon loading, allowing a server to map and update database records automatically, ensuring current and accurate information without relying on periodic updates from the third party.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If periodic updates from third-party providers are used, then the system is simple to operate, but the inventory records become outdated and inaccurate

Engineering Contradiction:

Improveinventory record accuracyVSAvoidsystem complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary component (web-component or crawler system) that mediates between the third-party website and the inventory management system. This intermediary automatically extracts inventory data from third-party websites and transmits it to the server, eliminating the need for direct periodic updates from third parties while maintaining system simplicity for the end user.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The system enables self-service by allowing the inventory management system to automatically retrieve its own data needs. The crawler system autonomously visits third-party websites, extracts inventory information, and updates the database without human intervention, making the system self-sufficient in obtaining accurate inventory data.

Inventive Principle:

Principle #25Self-service

2Reliability

If real-time data extraction from third-party websites is implemented, then inventory record accuracy improves, but the system complexity increases

Engineering Contradiction:

Improveinventory data reliabilityVSAvoiddata extraction system complexity

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The system creates a digital copy of the third-party inventory data by extracting and replicating information from third-party websites into its own database. This copying mechanism ensures the system has an accurate, up-to-date replica of inventory information without needing direct access to or control over the third-party systems.

Inventive Principle:

Principle #26Copying

3Productivity

If periodic updates are used, then the system is easier to maintain, but time delays occur in inventory record updates

Engineering Contradiction:

Improveinventory update speedVSAvoidupdate delay time

Core Design Contradiction:

ProductivityVSLoss of time

Solution Approach 1:

The patent implements continuous data extraction through automated crawlers that continuously monitor and extract inventory data from third-party websites. This continuous action replaces periodic batch updates, ensuring inventory records are constantly synchronized with the latest third-party data without time delays or gaps between updates.

Inventive Principle:

Principle #20Continuity of useful action

Solution Approach 2:

The system performs preliminary actions by proactively extracting and storing inventory data before it is needed. The crawlers continuously gather data in advance, so when inventory information is required for transactions or analysis, it is already available and up-to-date, eliminating waiting time for updates.

Inventive Principle:

Principle #10Preliminary action

4Extent of automation

If third-parties provide inventory records periodically, then the system requires minimal automation, but errors and delays occur

Engineering Contradiction:

Improvedata update automationVSAvoidinventory record accuracy

Core Design Contradiction:

Extent of automationVSReliability

Solution Approach 1:

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The system implements feedback mechanisms where the crawler continuously monitors third-party websites for changes in inventory data. When updates are detected, the system automatically retrieves and processes the new information, creating a closed-loop feedback system that ensures inventory records remain accurate and synchronized with the latest third-party data.

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS12014322B2Updating and validating data stored in a database

Publication Date: 2024.06.18 CAPITAL ONE SERVICES LLC

AI summary

Disclosed herein are system, method, and computer program product embodiments for validating and updating data in a database. In an embodiment, a server may receive an HTML, file including content of a third-party website controlled by a third party from a web-component. The content may include a first set of data associated with an item. The web-component may be configured to extract the content of the third party website and generate the HTML file in response to executing code embedded in the third-party website. The server may retrieve a second set of data associated with the item available at the third-party from the database. The server may identify a difference between the mapped first set of data and the second set of data and execute an action in the database to update to the second set of data.