Metadata-Based Data Coherence Protocol for Distributed Networks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for maintaining data coherence in non-memory-coupled networks, such as those over the Internet, are inefficient and require significant network traffic and computational resources, as they rely on cache line coherence protocols designed for memory-coupled networks, which are not scalable and need central storage or servers.
Innovation Solution
A platform-independent metadata system is used to generate unique metadata for each data object instance, communicated through a coherence protocol that allows state transitions and operations like read, write, and delete, reducing network load and traffic by only transmitting necessary information between nodes, enabling coherence without central storage or servers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If cache line coherence protocols are used in non-memory-coupled networks, then data coherence can be maintained, but network traffic and computational resources increase significantly
Solution Approach 1:
The patent extracts only the essential coherence information (metadata) from the data objects and transmits this minimal information between nodes. By separating the coherence tracking function from the data itself, the system maintains data coherence while minimizing network traffic, as only metadata needs to be exchanged rather than complete data objects or full cache lines.
Solution Approach 2:
The patent creates virtual copies of data objects as instances that can be independently managed across different nodes. Each node maintains its own instance copy, and the coherence protocol tracks these copies through metadata. This allows multiple nodes to access data simultaneously without requiring continuous synchronization of entire data structures, reducing network overhead.
2Reliability
If cache line coherence protocols are adapted for non-memory-coupled networks, then data coherence can be provided, but device complexity increases
Solution Approach 1:
The patent segments the coherence management function into independent metadata associated with each data object instance. Instead of implementing a centralized coherence controller or complex protocol management, each node independently manages its own data instances through simple metadata operations (read, write, delete). This segmentation distributes complexity and simplifies individual node implementation.
Solution Approach 2:
The patent creates a universal coherence protocol framework that can handle various data object types and network configurations through a single metadata-based approach. The same metadata structure and operation interface work for different data objects, eliminating the need for specialized coherence handling for each data type and reducing overall system complexity.
3Reliability
If monitoring of data traffic is performed in large distributed networks, then data coherence can be maintained, but computational resources and scalability are compromised
Solution Approach 1:
The patent applies partial action by monitoring and synchronizing only the metadata changes rather than tracking all data traffic. Instead of monitoring every data object access and modification in detail, the system tracks only the essential coherence state changes through metadata operations. This partial monitoring approach maintains coherence information while significantly reducing computational overhead and improving scalability.
Solution Approach 2:
The patent implements self-service coherence management where data objects carry their own coherence metadata and nodes autonomously manage coherence based on metadata operations. Each node independently tracks coherence state through metadata without requiring centralized coordination or extensive monitoring infrastructure. This self-service approach eliminates the need for complex global monitoring systems while maintaining data coherence.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The present invention relates to a method and to a program for providing coherence between instances of data objects residing on distributed nodes of a non memory-coupled network. In order to create a method and a program for providing coherence in keeping with the characteristics described above, which allow coherence between basically arbitrary data objects or instances of data objects, in the process are largely freely scalable and also require no central memory or server for the data objects, it is proposed according to the invention that for each instance of a data object to be processed by a node platform-independent unique metadata is generated, and with the help of said metadata and a coherence protocol, which operates based on said metadata, the metadata and consequently the data objects are kept coherent.