Document Transmission Encoding via Hash Value Repository
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for transmitting telemetry data from client devices to backends result in large document sizes, leading to high network bandwidth usage and storage requirements, while reducing report frequency compromises data comprehensiveness and immediacy.
Innovation Solution
A method that encodes and decodes documents by generating hash values for structured portions, allowing only changes to be sent, with the receiver restoring data from a hash repository, reducing redundant data transmission and storage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If all predefined structured portions are sent in every telemetry document, then data comprehensiveness is maintained, but document size increases and network bandwidth usage increases
Solution Approach 1:
The patent divides the telemetry document into structured portions (e.g., by JSON key or field), processes each portion independently through hashing, and transmits only the hash values for unchanged portions rather than the full data. This segmentation allows selective transmission of only necessary information while maintaining data comprehensiveness.
Solution Approach 2:
The patent extracts only the essential identification information (hash values) of structured portions that have changed from the complete document data. By taking out only the hash values instead of the full data, the system reduces transmission quantity while preserving the ability to reconstruct complete data at the receiver end.
2Loss of time
If telemetry data is transmitted at high frequency, then data immediacy is maintained, but network bandwidth consumption increases
Solution Approach 1:
The patent implements a feedback mechanism where the receiver sends back acknowledgment information about which structured portions have been successfully processed and stored. The sender uses this feedback to determine whether to transmit hash values or full data for subsequent portions, enabling intelligent frequency adjustment that maintains data immediacy while reducing unnecessary bandwidth consumption.
Solution Approach 2:
The patent changes the transmission parameter from transmitting full data to transmitting only hash values when portions are unchanged, and from transmitting nothing when portions are new to transmitting selective hash values. This parameter change allows high-frequency updates to be transmitted efficiently with minimal bandwidth overhead.
3Loss of information
If complete documents are transmitted to ensure data comprehensiveness, then no data is lost, but storage requirements at the backend increase
Solution Approach 1:
The patent creates a hash value repository at the receiver end that stores hash values of structured portions. Instead of storing complete documents, the system stores only the hash values (smaller copies) and reconstructs full data only when necessary. This copying approach reduces storage volume while maintaining the ability to access complete information when needed.
Solution Approach 2:
The patent performs preliminary action by pre-storing hash values of structured portions in the receiver's hash value repository before actual data transmission is needed. This preliminary preparation allows the system to quickly determine what needs to be transmitted and reduces the need for storing complete documents, as the hash repository is already in place for efficient lookup.
4Productivity
If hash values are generated and replaced for all structured portions, then data transmission efficiency improves, but computational load on the sender increases
Solution Approach 1:
The patent applies partial action by generating hash values only for structured portions that are likely to change or are required for the current transmission, rather than processing every possible portion. The system uses the hash value repository to identify which portions need hashing, avoiding unnecessary computational operations on unchanged portions and optimizing the balance between transmission efficiency and sender computational load.
Data Source
AI summary
Embodiments of the present disclosure relate to a method, a device, and a computer program product for document transmission. The method includes: selecting a portion to be encoded from a document that comprises structured portions, wherein each of the structured portions comprises an identifier and data associated with the identifier; acquiring at least one structured portion of the portion to be encoded; performing the following operations for a corresponding structured portion of the at least one structured portion to encode the document: generating a hash value of data of the corresponding structured portion; determining whether a hash value repository comprises the hash value; and replacing, based on a determination that the hash value repository comprises the hash value, the data of the corresponding structured portion in the document with the hash value; and sending the encoded document to a receiver.