Embedded Metadata Compression Using Threshold-Based Data Arrangement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Data compression operations are less efficient when input data includes embedded metadata, as it disrupts the pattern and prevents effective exploitation of metadata commonality by compression algorithms.
Innovation Solution
A method and system that preprocesses input data and metadata by determining a data threshold, arranging sectors of input data and associated metadata, and performing compression operations to improve efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If metadata is embedded throughout the input data, then data integrity and information completeness are maintained, but compression efficiency deteriorates due to disrupted patterns and inability to exploit metadata commonality
Solution Approach 1:
The patent segments the input data stream by identifying and separating metadata from regular data. The compression device extracts metadata portions from the input data, allowing them to be processed differently from the main data body. This segmentation enables the compression algorithm to focus on compressing the regular data while handling metadata separately, thus resolving the conflict between maintaining metadata information and achieving compression efficiency.
Solution Approach 2:
The patent applies extraction by removing metadata from the main data stream before compression. The compression device identifies metadata portions and extracts them, then processes the remaining data for compression. This extraction allows the compression algorithm to work more efficiently on the data portion without being disrupted by embedded metadata, while the extracted metadata can be handled separately to preserve its information content.
2Reliability
If compression algorithms process input data with embedded metadata, then complete data processing is achieved, but compression ratios deteriorate due to inability to exploit metadata commonality
Solution Approach 1:
The patent applies preliminary action by preprocessing the input data to separate metadata from regular data before the main compression operation. The compression device performs initial identification and extraction of metadata, preparing the data in a format that allows subsequent compression algorithms to achieve better compression ratios. This preliminary separation ensures that both data processing completeness and compression efficiency are maintained.
Solution Approach 2:
The patent introduces an intermediary processing stage between data reception and compression. This intermediary component identifies and separates metadata from the main data stream, acting as a mediator that enables the compression algorithm to process only the compressible data portions efficiently. This intermediary step ensures complete data processing while improving compression ratios by eliminating metadata-related compression inefficiencies.
Data Source
AI summary
A method may include obtaining input data to be compressed by a compression operation. The method may also include obtaining metadata associated with the input data to be compressed by the compression operation. The method may further include determining a data threshold of the input data and the metadata to be compressed by the compression operation. The method may also include preprocessing the metadata. The method may further include arranging the input data and the metadata based on the data threshold. The method may also include performing the compression operation on the arranged input data and the arranged metadata.