Distributed Data Marketplace Metadata Exchange
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data repository systems require data upload and storage in centralized locations, leading to stale data and loss of control for providers, who must maintain duplicate datasets and incur costs for access and updates.
Innovation Solution
A distributed data marketplace system that allows providers to retain and update data on their own networks while offering it for purchase, enabling clients to access and use data through a royalty or fee-based model, with incentives for data contribution and optimization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If data is uploaded to a centralized repository for purchase and use, then data access and sharing are facilitated, but data becomes stale and providers lose control over their data
Solution Approach 1:
The patent introduces a centralized repository as an intermediary that facilitates data sharing between providers and users while maintaining provider control through metadata-based access. The repository enables data access without requiring physical data movement, thus keeping data fresh at source locations while allowing widespread sharing through the intermediary platform.
Solution Approach 2:
The patent segments data into two components: metadata (stored centrally in the repository for access and discovery) and actual data (retained at source locations for freshness and control). This segmentation allows users to access and share data through metadata references while the actual data remains at its origin, preventing staleness and maintaining provider control.
2Ease of operation
If data is uploaded to a centralized repository, then data sharing is enabled, but providers must maintain duplicate datasets and incur storage costs
Solution Approach 1:
The patent uses metadata copying instead of full data copying. The centralized repository stores only metadata (descriptive information about the data) rather than duplicate copies of the actual data. This allows data sharing through metadata references while the actual data remains stored only at source locations, eliminating duplicate storage requirements.
Solution Approach 2:
The patent extracts only the essential metadata components from the full data sets and stores them in the centralized repository. This extraction approach enables data sharing functionality while removing the need to store complete duplicate data sets, significantly reducing storage requirements while maintaining data accessibility.
3Ease of operation
If data is uploaded to a centralized repository, then data can be purchased and used, but updates require subsequent uploads and provider control is lost
Solution Approach 1:
The patent implements a dynamic system where metadata in the centralized repository can be updated without moving the actual data. Providers maintain control by updating metadata references, timestamps, and access permissions dynamically, while users access data through these dynamic metadata pointers. This allows continuous data updates without full re-uploads and maintains provider control over data location and access.
Solution Approach 2:
The patent establishes preliminary provider control mechanisms through metadata configuration before data access. Providers pre-configure access permissions, pricing, and update protocols in the metadata, which then automatically manage data usage and updates. This preliminary action ensures provider control is maintained throughout the data lifecycle without requiring continuous intervention or loss of control.
Data Source
AI summary
A system for providing a large set of data resources for nearly any client with a centralized collection of historical data, and a server through which changing datasets located on provider networks may be accessed through the system without having to upload them to the system. The system providers a marketplace for buying and selling of data, optionally including blockchain technology to allow for secure and/or anonymous transactions.