File Transfer System Using Element Caching to Reduce Bandwidth
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Transporting large composite files across low-bandwidth or costly networks is inefficient due to repeated transfer of duplicate data elements, such as images and fonts, which increases time and cost.
Innovation Solution
A file transfer management system that deconstructs files into logical data elements, caches unique elements, and reconstructs them at the target system, ensuring that duplicate data is transferred only once, using data compression and caching techniques to minimize network utilization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If large composite files are transported directly over the network, then file delivery is achieved, but network bandwidth is excessively consumed and transport time increases
Solution Approach 1:
The system segments composite files into discrete data objects (fonts, images, macros, text streams) and identifies duplicate elements across multiple files. By segmenting the file structure and caching unique elements at the network server, the system reduces redundant data transmission while maintaining complete file functionality at the destination.
2Reliability
If duplicate data elements are included in each file transfer, then file integrity is maintained, but network costs and bandwidth consumption increase
Solution Approach 1:
The system introduces a network server as an intermediary that stores cached copies of unique data elements from composite files. When files are transferred, the system references this intermediary cache to identify and eliminate duplicate elements, transferring only unique or modified components while maintaining file integrity through proper reconstruction at the destination.
3Manufacturing precision
If all file elements are transferred to ensure complete reconstruction, then file reconstruction accuracy is maintained, but transfer time increases
Solution Approach 1:
The system performs preliminary analysis of composite files to identify unique versus duplicate data elements before transfer. By pre-processing files to extract only necessary unique elements and caching them at the network server, the system ensures accurate reconstruction at the destination while significantly reducing the actual transfer time, as the heavy lifting of data preparation occurs beforehand.
Data Source
AI summary
A system and method for file transfer management are disclosed. An example embodiment includes: initiating a transfer of a file from a source system to a target system; deconstructing a file into logical components based on the format of the file; storing the cacheable logical components in a parent cache; generating an element list including a component identifier of the cacheable logical components; and delivering the element list to the target system. The example embodiment includes: receiving, at the target system the element list; determining if cacheable logical components are present in a child cache; fetching the cacheable logical components from the child cache; fetching other cacheable logical components and non-cacheable gap components from the source system; reconstructing the file by combining the fetched components; storing the missing cacheable logical components into the child cache; and delivering the reconstructed file to a destination.