Append-Only Change Data Processing With Embedded Access Requirements
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Complex and heterogeneous software systems face challenges in maintaining data integrity, consistency, and security due to conflicting requirements and increasing complexity, leading to difficulties in adapting to changing requirements and ensuring data security in scenarios like IoT and smart home applications.
Innovation Solution
A computer-implemented method and system utilizing an append-only store and a framework that creates delta objects and RS objects to manage data changes, ensuring data integrity and security by storing and processing data in a tamper-proof archive, with access control and processing requirements integrated into a single data structure.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If measures to increase data security and data integrity are implemented in heterogeneous IT infrastructure, then data security and data integrity are improved, but flexibility and scalability of the IT infrastructure deteriorate
Solution Approach 1:
The system segments data storage into immutable append-only stores that guarantee integrity, while separating computation and access control into flexible framework layers. This allows the data storage layer to maintain security guarantees without constraining the adaptability of processing layers.
Solution Approach 2:
The patent introduces an intermediary framework layer that mediates between the rigid append-only data stores and the flexible application requirements. This framework provides access control and data processing capabilities without directly modifying the immutable data storage structure, thus preserving both security and flexibility.
2Quantity of substance
If the system processes and stores large amounts of data from multiple sources, then data completeness and coverage are improved, but system complexity and difficulty of maintenance increase
Solution Approach 1:
The patent enforces homogeneous data schemas and structures within the append-only stores, ensuring that all data from multiple sources conforms to standardized formats. This homogeneity simplifies processing and maintenance while accommodating diverse data sources through consistent structuring.
Solution Approach 2:
The framework layer provides universal access control and data processing functions that work across all data types and sources. This multi-functional framework handles diverse data requirements through a unified interface, reducing the need for separate handling mechanisms for different data sources.
3Stability of the object's composition
If access control and processing requirements are integrated into a single data structure, then data consistency and integrity are improved, but data structure complexity increases
Solution Approach 1:
The patent merges access control metadata and processing requirements directly into the data records within the append-only stores. This integration ensures that all necessary control information travels with the data, guaranteeing consistency without requiring separate complex management systems.
Solution Approach 2:
Access control and processing requirements are predetermined and embedded within the data structure at the time of data ingestion. This preliminary action ensures that all control parameters are available when needed, eliminating the need for complex runtime determination processes.
Data Source
AI summary
The invention relates to a computer-implemented method for data processing control. The method comprises: —providing (102) at least one append-only store (224, 322); —providing (103) a framework (210); —using (104) an application program (226) for performing change operations (206, 208) on application-born external objects (202, 204, 304); —creating (106), by the framework, delta objects (216, 218, 310) being indicative of attribute changes of the application-born external objects caused by the change operations; —sequentially storing (108), by the framework, a sequence of data objects in the at least one append-only store, the sequence of data objects comprising a mixture of delta objects (211, 212, 214, 310, 312, 404, 406) and RS objects (216, 218, 314, 316, 318, 320), each RS object being a data object specifying a requirement in respect to how attribute information of one or more of the application-born external objects comprised in the delta objects must be processed and output by the framework; —executing (110) one or more of the framework-functions for returning an output (230) computed as a function of the attribute information in the delta objects which complies to the requirements specified in the RS objects.