Fine-Grained Telemetry Sharing Through Selective Event Definitions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data sharing methods are cumbersome, slow, and lack control over data access, making it difficult for smaller entities to access valuable data sets, and existing event sharing mechanisms lack flexibility and security controls, hindering seamless workflows.
Innovation Solution
A data exchange platform enables selective sharing of application-generated events through telemetry definitions, allowing providers to control event sharing visibility and duration, and consumers to manage access policies with fine-grained controls.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If data sharing methods are used to transfer data between entities, then data access is enabled, but the process is cumbersome and slow
Solution Approach 1:
The patent introduces a data sharing platform as an intermediary system that enables seamless data exchange between providers and consumers. The platform handles data transfer automation, access control, and protocol management, eliminating the need for direct complex data transfer processes between entities.
Solution Approach 2:
The patent replaces manual data transfer mechanisms with automated system-based data sharing. Instead of physical file transfers or manual queries, the system uses programmatic interfaces, API calls, and automated authentication to enable rapid data access without human intervention.
2Ease of operation
If data sharing is enabled to let other parties perform queries, then data accessibility is improved, but control over data access is lost
Solution Approach 1:
The patent implements fine-grained access control where different users or systems can be granted different levels of access to specific data tables or queries. Instead of uniform access, the system allows providers to customize access rights for different consumers based on their needs, ensuring data security while maintaining accessibility.
Solution Approach 2:
The patent enables dynamic access control where data sharing permissions can be modified in real-time. The system allows providers to update access policies, revoke permissions, or adjust query capabilities dynamically without affecting other users, ensuring ongoing control over data accessibility.
3Loss of information
If all application-generated events are shared with providers, then observability is improved, but data privacy and security are compromised
Solution Approach 1:
The patent segments event sharing into selective categories where consumers can choose which specific events or data types to share with providers. Instead of sharing all events, the system allows filtering by event type, severity level, or other criteria, maintaining necessary observability while protecting sensitive information.
Solution Approach 2:
The patent enables extraction of only the necessary event information for monitoring and troubleshooting purposes. The system allows consumers to extract and share only specific event attributes or summaries rather than complete event data, reducing privacy risks while maintaining functional observability for debugging and performance monitoring.
Data Source
AI summary
Disclosed are techniques for selectively sharing with a provider account of a data exchange, events generated by an application shared by the provider account. A set of telemetry definitions may be defined for a data listing via which an application is shared by a provider account of a data sharing platform. Each of the set of telemetry definitions specifies a type of event generated by the application and a corresponding sharing requirement for the type of event. The set of telemetry definitions are persisted as metadata associated with the data listing. The application may be installed in a consumer account of the data exchange. In response to the application generating a plurality of events, a subset of the plurality of events may be shared with the provider account, wherein the subset of the plurality events that is shared is based in part on the set of telemetry definitions.