Decentralized Data Registry Using DIDs for Automated Asset Discovery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data management systems for open data are centralized, requiring manual maintenance and lacking a unified catalogue and interface structure, which is inefficient and unsustainable for cross-company, cross-government data sharing, and there is a need for a fully decentralized data space.
Innovation Solution
A decentralized data management system utilizing self-sovereign identity (SSI) technology for automatic registration and management of data assets, employing decentralized identifiers (DIDs) and a blockchain-based registry to enable secure, interoperable, and automatable data sharing among data providers and consumers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If a centralized data management system is used, then data exchange facilitation and access management can be achieved, but manual catalogue maintenance and data asset registration are required, reducing automation
Solution Approach 1:
The system enables data providers to automatically register and publish their data assets without manual intervention. The decentralized registry allows data providers to autonomously publish metadata about their data assets, which are then automatically discoverable by data consumers through the unified interface structure, eliminating the need for manual catalogue maintenance.
Solution Approach 2:
The centralized registry is segmented into multiple decentralized registry nodes distributed across different organizations and jurisdictions. Each node maintains a copy of the registry data, allowing the system to scale horizontally while maintaining automatic registration capabilities without a single point of failure or manual intervention requirement.
2Productivity
If manual catalogue maintenance is performed, then data discoverability can be achieved, but time and resources are consumed, reducing productivity
Solution Approach 1:
The unified interface structure enables automated data discovery where data consumers can query the decentralized registry for available data assets using standardized interfaces. The system automatically synchronizes metadata across registry nodes, eliminating manual catalogue maintenance and significantly improving data publication efficiency.
Solution Approach 2:
Data providers publish metadata about their data assets in advance to the decentralized registry, allowing data consumers to discover and access data assets before they are actually needed. This preliminary publication of data descriptors enables efficient data discovery without time-consuming manual maintenance during data access operations.
3Loss of information
If a unified catalogue is implemented, then data discoverability is improved, but system complexity increases due to decentralized architecture
Solution Approach 1:
The decentralized registry nodes use a universal data model and standardized interfaces that allow them to perform multiple functions: storing metadata, enabling data discovery, facilitating data access, and supporting cross-border data sharing. This universality simplifies the overall system architecture despite the decentralized structure, as all nodes operate with the same protocols and data formats.
4Reliability
If centralized identity and access management is used, then access control can be achieved, but trust and security are reduced in cross-company, cross-government environments
Solution Approach 1:
Each organization and jurisdiction maintains local control over their own identity and access management policies within the decentralized registry. Data providers can set granular access controls for their specific data assets, while data consumers can present their credentials locally verified by the registry nodes. This local quality approach enhances trust and security by allowing each entity to enforce their own security policies without requiring a centralized authority.
Data Source
Figure 1~2
Figure 3~4
Figure 5
AI summary
A system for managing data, comprising: one or more computer-implemented data provider clients, one or more computer-implemented data consumer clients, and a registry including one or more registry nodes. Each data provider client is used for a data provider, and is configured to register a decentralized identifier, DID, of the data provider and an DID document of the data provider in the registry, the DID document of each data provider comprises a public key of the data provider and a service endpoint for retrieving metadata of a data asset of the data provider. The registry is configured to store the registered DID of the data provider and/or the registered DID document of the data provider. Each data consumer client comprises a metadata crawler configured to obtain or update a list of DIDs and/or DID documents of all data providers which are registered in the registry.