Selective Metadata Persistence for Information Management
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional information management systems are inefficient in utilizing metadata, leading to unnecessary computing resource consumption and inadequate service provision for electronic data, resulting in potential liability and increased costs due to unknown data value and regulatory compliance issues.
Innovation Solution
Implementing a system that selectively persists metadata, allowing for automated data classification and service orchestration based on the value of data, enabling efficient management of services and reducing unnecessary processing by regenerating metadata only when needed.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional systems process all metadata to understand data value, then data management services can be provided, but computing resources are consumed inefficiently
Solution Approach 1:
The patent extracts and persists only the most critical metadata attributes (such as data classification, retention status, and compliance flags) rather than processing all metadata. This selective extraction reduces computing resource consumption while maintaining the essential information needed for data management services.
Solution Approach 2:
The system performs preliminary metadata processing and classification during data ingestion, establishing data value assessments before services are needed. This preliminary action eliminates the need for repeated full metadata processing, reducing ongoing computing resource consumption while ensuring services are provided based on pre-determined data characteristics.
2Reliability
If all metadata is persisted to enable data classification, then service provision is improved, but storage resources are wasted on low-value data
Solution Approach 1:
The patent applies different persistence strategies to different metadata based on their local quality and importance. Critical metadata attributes are persisted to enable service provision, while less important attributes are discarded. This selective persistence reduces stored metadata volume while maintaining the quality needed for reliable service provision.
Solution Approach 2:
The system extracts and stores only the essential metadata attributes that are necessary for data classification and service determination. By taking out only the high-value metadata elements, the system reduces storage requirements while ensuring that sufficient information remains for reliable service provision.
3Measurement precision
If metadata is regenerated frequently to ensure accuracy, then data classification remains current, but processing time increases
Solution Approach 1:
The system performs metadata generation and classification as a preliminary action during data ingestion or at scheduled intervals, rather than continuously regenerating it. This preliminary processing ensures classification accuracy is maintained while reducing processing time by avoiding frequent regeneration of already-processed metadata.
Solution Approach 2:
The patent implements periodic metadata regeneration rather than continuous regeneration. Metadata is regenerated at predetermined intervals or when data changes are detected, maintaining classification accuracy while reducing processing time by avoiding unnecessary frequent regeneration operations.
4Reliability
If comprehensive data services are provided to all data, then compliance is ensured, but costs increase due to unnecessary services
Solution Approach 1:
The patent applies different service levels to different data based on their local characteristics and value. Data with high value or regulatory sensitivity receives comprehensive services to ensure compliance, while low-value data receives minimal services. This local quality approach ensures compliance where needed while reducing overall service costs.
Solution Approach 2:
The system changes service parameters dynamically based on data characteristics. By adjusting service provision parameters according to data value, sensitivity, and compliance requirements, the system ensures adequate services for compliant data while eliminating unnecessary services for low-value data, thereby reducing overall costs.
Data Source
AI summary
Persisting metadata in an information management system. During information management, metadata is collected and generated for objects in the computing environment. The metadata is used to classify the objects in order to provide certain services to the objects. The metadata is then selectively persisted to improve performance of the information management system in providing the services. Selectively persisting metadata can also reduce storage requirements.


