File Transfer Segmentation and UDP Reliability

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional file transfer methods in Internet Data Centers face inefficiencies due to the unreliability of UDP and inefficiency of TCP, necessitating a method that balances speed and reliability for transferring files across different data centers.

Innovation Solution

A method and device that segment files into multiple segments, use UDP for efficient transfer, and implement retransfer requests to ensure reliability, with acknowledgement mechanisms to confirm successful transfer and adjust packet rates based on network conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If TCP is used for file transfer, then reliability is improved, but transfer efficiency deteriorates due to long connection establishment time

Engineering Contradiction:
Improvetransfer reliabilityVSAvoidtransfer efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The file is divided into multiple segments before transmission. Each segment can be independently transmitted using UDP, allowing parallel transfer without establishing separate TCP connections for each file, thus improving efficiency while maintaining reliability through segment-level acknowledgment and retransmission

Inventive Principle:
Principle #1Segmentation

2Productivity

If UDP is used for file transfer, then transfer efficiency is improved, but reliability deteriorates due to lack of connection and acknowledgment mechanisms

Engineering Contradiction:
Improvetransfer efficiencyVSAvoidtransfer reliability
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

An acknowledgment mechanism is implemented where the receiving device sends ACK packets for successfully received segments and NACK (negative acknowledgment) packets for missing or erroneous segments. This feedback loop enables the transmitting device to retransmit lost segments, ensuring reliability while maintaining UDP's efficiency

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The file is pre-segmented and numbered before transmission begins. The receiving device prepares to reconstruct the file by expecting segments in a specific order, allowing efficient reassembly once all segments are received, thus improving both efficiency and reliability

Inventive Principle:
Principle #10Preliminary action

3Device complexity

If files are transferred as single units, then simplicity is maintained, but transfer time increases and reliability decreases in complex network environments

Engineering Contradiction:
Improvetransfer process simplicityVSAvoidtransfer time
Core Design Contradiction:
Device complexityVSLoss of time

Solution Approach 1:

Large files are divided into smaller segments that can be transmitted in parallel. This segmentation reduces the time required for transfer and allows selective retransmission of only lost segments rather than the entire file, improving both speed and reliability while adding manageable complexity through segment management

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS9892124B2Method and device for transferring file
Publication Date: 2018.02.13 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • US9892124B2 patent drawing
  • US9892124B2 patent drawing
  • US9892124B2 patent drawing

AI summary

The disclosed invention relates generally to a method and device for transferring a file. In accordance with one embodiment, the method may include, receiving a file transfer request including information of a file and the file receiver; separating the file into multiple file segments; pushing the multiple file segments to the file receiver; if receiving a retransfer request sent by the file receiver, pushing the file segment assigned by the retransfer request to the file receiver; if receiving an acknowledgement sent by the file receiver, ending the file transferring, the acknowledgement indicating all of the multiple file segments being received by the file receiver. The method and device provided in the disclosed embodiments can transfer file more reliable.