Multi-Algorithm Data Encoding for Compaction and Decode Security
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The rapid growth of data storage demand, exceeding the capacity for physical storage and transmission bandwidth, coupled with security concerns as existing encryption technologies are threatened by quantum computing, necessitates a more efficient and secure data encoding method.
Innovation Solution
A system and method using multiple encoding libraries to encode data, where different portions of the data are encoded by different libraries for maximum compaction and security, with additional security features like sourceblock size variations and random or pseudo-random rotation of libraries.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a single encoding algorithm is used for all data, then decoding is simplified and only a single decoding algorithm is needed, but maximum encoding compaction is not achieved and security vulnerabilities exist
Solution Approach 1:
The patent divides the data into multiple portions and applies different encoding algorithms to each portion. Each encoded portion is stored with its corresponding algorithm identifier. During decoding, the system retrieves the appropriate algorithm based on the identifier and decodes the corresponding portion, achieving both security through algorithm diversity and operational feasibility through systematic segmentation
Solution Approach 2:
Different portions of the data are encoded using different algorithms selected based on their specific characteristics. The system evaluates which algorithm provides the best compaction for each local portion of data, applying the most suitable algorithm locally rather than using a single algorithm globally, thereby achieving maximum overall compaction while maintaining security
2Quantity of substance
If data compression is applied to increase storage capacity, then storage demand is temporarily met, but compression ratios decrease for multi-media data and data degradation occurs with lossy compression
Solution Approach 1:
The patent changes the encoding parameters by applying different encoding algorithms with varying compression characteristics to different data portions. For multi-media data, algorithms optimized for that data type are selected, maintaining high compression ratios without data degradation. The system dynamically adjusts which algorithm is applied based on data characteristics, achieving both high compression and data integrity
3Quantity of substance
If physical storage capacity is increased to meet data storage demand, then storage capacity is temporarily expanded, but storage demand continues to outstrip manufacturing capacity
Solution Approach 1:
The patent fundamentally changes the storage parameter by applying multiple encoding algorithms that achieve superior compaction ratios compared to traditional compression. This transforms the storage capacity metric, allowing existing physical storage infrastructure to hold significantly more data, effectively increasing storage capacity without requiring proportional increases in physical manufacturing capacity
4Speed
If transmission bandwidth is increased to handle large data sets, then data transmission capability is improved, but bandwidth remains a bottleneck and transmission costs increase
Solution Approach 1:
The patent segments data into multiple portions and applies different encoding algorithms to each segment, achieving maximum compaction for the entire data set. This reduces the total volume of data that needs to be transmitted, thereby decreasing bandwidth requirements while maintaining transmission speed, and reducing transmission costs without sacrificing data transmission capability
Data Source
AI summary
A system and method for encoding data using a plurality of encoding libraries. Portions of the data are encoded by different encoding libraries, depending on which library provides the greatest compaction for a given portion of the data. This methodology not only provides substantial improvements in data compaction over use of a single data compaction algorithm with the highest average compaction, but provides substantial additional security in that multiple decoding libraries must be used to decode the data. In some embodiments, each portion of data may further be encoded using different sourceblock sizes, providing further security enhancements as decoding requires multiple decoding libraries and knowledge of the sourceblock size used for each portion of the data. In some embodiments, encoding libraries may be randomly or pseudo-randomly rotated to provide additional security.