Asynchronous Communication Schema Registry for Data Discoverability
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing asynchronous communication platforms face challenges in making data easily accessible and scalable, with existing systems often making data difficult to locate and scale.
Innovation Solution
A method and system for registering event schemas in an asynchronous communication platform, involving a schema repository, linting, compatibility checks, and manual validation, to ensure data is standardized, compliant, and easily discoverable.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If synchronous communication channels are used to send data, then data can be delivered immediately, but the recipient receives data at times they do not need it and finds it difficult to locate when needed
Solution Approach 1:
The patent introduces an asynchronous communication platform that acts as an intermediary between data publishers and consumers. This platform includes a schema registry that stores and manages data schemas, allowing data to be published and consumed at different times. The schema registry serves as the mediator that enables data to be located and accessed when needed, resolving the contradiction between immediate delivery and easy retrieval.
2Ease of operation
If existing asynchronous communication platforms are used, then data can be published and accessed as needed, but data becomes difficult to access and discover
Solution Approach 1:
The patent implements a feedback mechanism through the schema registry that automatically validates, versions, and catalogs data schemas. When data is published, the schema is registered and made discoverable through the registry. This feedback loop ensures that data remains accessible while maintaining high discoverability through systematic cataloging and validation, preventing information loss.
3Adaptability or versatility
If existing asynchronous communication platforms are used, then data can be published asynchronously, but the system becomes difficult to scale
Solution Approach 1:
The patent segments the asynchronous communication system into distinct modular components: a schema registry for managing data schemas, a validation service for ensuring schema compliance, and a messaging platform for data exchange. This segmentation allows each component to be independently scaled and maintained, reducing overall system complexity while preserving asynchronous communication capabilities.
Data Source
AI summary
Registering a schema to a schema repository is described. A method of registering includes receiving a pull request from the schema repository, the pull request being associated with a submitted schema; retrieving linting rules from the schema repository; performing a linting process on the submitted schema based on the retrieved linting rules; performing a compatibility check on the submitted schema by comparing the submitted schema with at least one existing schema stored in the schema repository; and causing the submitted schema to be written to the schema repository.