Virtual Index Server for Multi-Provider Data Aggregation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

The cumbersome and error-prone process of organizing, accessing, and modifying data from multiple cloud and remote data storage services hinders efficient data management, particularly when users need to integrate data from different providers.

Innovation Solution

A virtual index server is constructed to aggregate data from multiple storage providers, creating a unified index that references data stored across different locations, allowing automatic updates and caching, and normalizing metadata for seamless access and analytics.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If data is manually organized and accessed from multiple storage providers, then data can be accessed from different locations, but the process becomes cumbersome and error-prone

Engineering Contradiction:

Improvedata access processVSAvoidtime-intensive process

Core Design Contradiction:

Ease of operationVSLoss of time

Solution Approach 1:

The patent introduces a virtual index server as an intermediary layer between users and multiple storage providers. This server maintains an aggregate index that maps data locations across different storage providers, allowing users to access data through a unified interface without manually navigating multiple providers, thereby simplifying the access process and reducing time consumption

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The virtual index server provides universal access to data from multiple storage providers through a single unified interface. The aggregate index structure allows the system to handle data retrieval, validation, and routing across diverse storage providers through one standardized access point, eliminating the need for separate access procedures for each provider

Inventive Principle:

Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If data from multiple storage providers is integrated, then comprehensive data access is achieved, but the process becomes error-prone

Engineering Contradiction:

Improvedata integration capabilityVSAvoiderror-prone process

Core Design Contradiction:

Adaptability or versatilityVSReliability

Solution Approach 1:

The system implements feedback mechanisms where the virtual index server continuously monitors and validates data locations across storage providers. When data is modified or moved, the system detects these changes and updates the aggregate index accordingly, ensuring data integrity and reducing errors through automated validation and correction

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The virtual index server automatically manages the integration of data from multiple storage providers without requiring manual intervention. The system self-updates the aggregate index by monitoring storage providers, automatically detecting data changes, and maintaining accurate mappings, thereby eliminating human errors in the integration process

Inventive Principle:

Principle #25Self-service

3Manufacturing precision

If manual updates are performed on data indexes, then data accuracy can be maintained, but productivity decreases

Engineering Contradiction:

Improvedata index accuracyVSAvoidupdate efficiency

Core Design Contradiction:

Manufacturing precisionVSProductivity

Solution Approach 1:

The virtual index server implements continuous automated monitoring and updating of the aggregate index. The system continuously tracks data changes across storage providers and automatically updates index entries in real-time, maintaining data accuracy without interruption and eliminating the need for periodic manual updates, thereby significantly improving update efficiency

Inventive Principle:

Principle #20Continuity of useful action

Solution Approach 2:

The patent replaces manual mechanical processes of index updating with automated electronic systems. The virtual index server uses software-based mechanisms to automatically detect, validate, and update data location information in the aggregate index, substituting human operators with automated algorithms that maintain precision while dramatically increasing update speed and productivity

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

4Reliability

If data is duplicated across storage providers, then data availability is improved, but storage efficiency decreases

Engineering Contradiction:

Improvedata availabilityVSAvoidstorage space

Core Design Contradiction:

ReliabilityVSQuantity of substance

Solution Approach 1:

The virtual index server acts as an intermediary that provides unified access to data without requiring physical duplication. The aggregate index maps logical data locations across storage providers, allowing the same data to be accessed from multiple points through the virtual layer without actually copying the data, thereby maintaining availability while preserving storage efficiency

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS11055268B2Automatic updates for a virtual index server

Publication Date: 2021.07.06 MEDIAFIRE LLC

AI summary

Computer systems and methods for constructing and using a virtual index server. The index of the virtual index server may specify locations of respective portions of data at a plurality of remote storage providers. The index may graft multiple files and folders from multiple storage providers together into a single hierarchical index tree. The virtual index server may be automatically updated to reflect changes in data content at the plurality of remote storage providers. The computer system may automatically retrieve log files from a content delivery network (CDN), normalize the log files according to a first analytics provider, and automatically provide the normalized log files to the first analytics provider.