Edge Data Log Schema Enforcement for Reliable Pattern Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data processing systems generate non-compliant data logs that lack standardization, hindering effective system monitoring, analytics, and service updates, which impacts the performance and reliability of computer-implemented services.
Innovation Solution
Enforcing a data log schema through data handling rules to convert non-compliant logs into compliant logs, allowing for standardized data collection, interpretation, and storage, and enabling pattern analysis to diagnose issues and generate service updates.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If data logs are generated without standardization, then data collection is flexible and adaptive to different services, but system monitoring and analytics become ineffective
Solution Approach 1:
The patent segments data log handling into two parts: a standardized schema framework that ensures reliability, and flexible service-specific log content that maintains adaptability. The schema defines required fields and formats while allowing service-specific data within those structures.
Solution Approach 2:
The patent changes the parameter of data log structure from unstandardized to standardized by enforcing a schema with specific fields, data types, and formats. This transformation enables reliable monitoring while preserving service flexibility through configurable log levels and optional fields.
2Ease of operation
If non-compliant data logs are used, then device complexity is reduced and ease of operation is improved, but pattern analysis and issue diagnosis become impossible
Solution Approach 1:
The patent applies preliminary action by establishing a data log schema before actual logging occurs. This schema defines the structure, fields, and formats in advance, allowing services to generate compliant logs automatically without complex real-time processing or manual formatting.
3Productivity
If standardized data log schema is enforced, then system analytics and service updates are improved, but data handling complexity increases
Solution Approach 1:
The patent implements self-service by enabling services to generate compliant data logs automatically through the schema framework. The standardized structure allows services to populate their own data without external intervention or complex processing, maintaining productivity while managing complexity.
Data Source
AI summary
Methods and systems for managing operation of a data processing system of a deployment are disclosed. The operation may be managed by enforcing a data log schema for data logs. The data log schema may be enforced by generating compliant data logs from non-compliant data logs of the data processing system. The edge orchestrator may receive the compliant data logs and search for patterns in the operation. From the patterns, an undesired behavior of the data processing system may be found. From the undesired behavior, a root cause may be discovered. Based on the root cause, a service update may be generated and transferred to the data processing system. The service update may be used to improve computer implemented services of the data processing system.