Chained Data Distribution for Efficient Large File Transfer
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data transmission methods face inefficiencies, including slow data transmission rates and uneven LAN traffic and CPU usage, particularly in multi-point transmissions, which hinder the effective distribution of large files and the onboarding, expansion, and migration of virtual hosts.
Innovation Solution
A chained data distribution scheme is implemented, where a control device determines and manages a source node and selects the next nearest node as a destination, ensuring even data distribution across a list of nodes, thereby optimizing LAN traffic and CPU usage without manual intervention.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If manual point-to-point transmission is used, then data can be transmitted between hosts, but data transmission rate is slow and data transmission efficiency is low
Solution Approach 1:
The patent segments the data transmission process into multiple parallel transmission chains. Instead of manual point-to-point transmission, the system automatically divides data into segments and transmits them simultaneously through multiple nodes using a chained distribution mechanism, where each node receives data and forwards it to the next node in the chain, significantly improving overall transmission efficiency and speed.
2Adaptability or versatility
If multi-point transmission is implemented manually, then data can be distributed to multiple nodes, but nodes cannot be effectively controlled and transmission efficiency is low
Solution Approach 1:
The patent introduces a control device as an intermediary that automatically manages multi-point transmission. The control device coordinates multiple transmission chains, assigns data segments to different nodes, and monitors transmission progress, enabling effective automated control of multiple nodes without manual intervention while maintaining high adaptability for distributing data to various destinations.
3Speed
If port mapping by VIDC is used, then data transmission rate is improved, but LAN traffic and CPU usage are uneven across nodes
Solution Approach 1:
The patent applies local quality by assigning different roles and data segments to different nodes based on their capabilities and current load. Each node in the transmission chain receives and forwards specific portions of data, creating a balanced distribution of LAN traffic and CPU usage across the network. This segmented approach ensures that no single node becomes a bottleneck, maintaining uniform resource utilization while preserving high transmission rates.
4Quantity of substance
If port mapping by VIDC is used for large files, then data can be transmitted, but transmission time is long leading to low efficiency
Solution Approach 1:
The patent segments large files into multiple smaller data blocks that can be transmitted simultaneously through parallel chains. Each transmission chain handles a portion of the large file, allowing concurrent transmission across multiple nodes. This segmentation dramatically reduces overall transmission time compared to sequential transmission, while maintaining the capability to handle large files effectively.
Data Source
AI summary
The application discloses a method, system, control device and node device for data transmission. The method includes determining a source node for data transmission; selecting a node which has not been selected for reception of the data as a destination node for the data transmission, from a list of nodes for the reception of the data, wherein the destination node serves as the next nearest node of the source node; wherein the list of nodes comprises at least one identifier and an address of each node; and issuing a data transmission task to the source node, wherein the data transmission task comprises the identifier and the address of the destination node, so that the source node transmits the data to the destination node according to the address of the destination node. The technical solutions of the application can guarantee the data transmission speed and the data transmission efficiency.


