Content File Deduplication with Hash-Based Storage References
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The increasing size of content files due to high visual detail requirements leads to storage and access time challenges, while data compression and optimization are inefficient or time-consuming.
Innovation Solution
A system and method for identifying redundant content using unique file identifiers, generating hash keys, and managing pointers to existing files, reducing storage redundancy and optimizing installation and uninstallation processes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If data compression is applied to reduce file sizes, then storage requirements are reduced, but processing burden increases during decompression
Solution Approach 1:
The system performs preliminary identification of redundant content using hash keys before actual content transfer or storage. By generating hash keys from content identifiers and comparing them in advance, the system determines which content is redundant before initiating download or storage operations, thereby avoiding unnecessary processing of compressed data later
2Quantity of substance
If manual data optimization is performed to reduce redundant data, then file sizes are reduced, but time investment increases
Solution Approach 1:
The system automatically identifies and manages redundant content through automated hash key generation and comparison processes. The content management system performs self-service by autonomously determining redundancy without requiring manual intervention from content creators or users, thereby eliminating time investment while achieving data optimization
3Quantity of substance
If high-capacity storage devices are purchased to accommodate large content files, then storage capacity increases, but cost increases
Solution Approach 1:
The system discards redundant content by identifying it through hash key comparison and replacing it with references to existing content. Instead of storing duplicate copies of content, the system recovers storage space by maintaining only single copies and using pointer references, thereby reducing the storage capacity needed without incurring additional costs
Data Source
Figure 1~2
Figure 3~4
Figure 5~6
AI summary
A content obtaining system for obtaining content comprising a plurality of files, the system comprising, a database obtaining unit configured to obtain a database of unique identifiers corresponding to respective files stored by the content obtaining system, an identifier receiving unit configured to receive unique identifiers for one or more of the plurality of files in the content to be obtained, an identifier comparison unit configured to compare the received unique identifiers with the database, and to identify whether any of the identifiers match, and a content management unit configured to, in the case that there is no match for a given identifier, obtain and store the corresponding file for that identifier, and, in the case that there is a match for a given identifier, generate and store a reference to the location of the file stored by the content obtaining system for which the match was identified.