Chained Data Distribution for Efficient Large File Transfer

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing data transmission methods face inefficiencies, including slow data transmission rates and uneven LAN traffic and CPU usage, particularly in multi-point transmissions, which hinder the effective distribution of large files and the onboarding, expansion, and migration of virtual hosts.

Innovation Solution

A chained data distribution scheme is implemented, where a control device determines and manages a source node and selects the next nearest node as a destination, ensuring even data distribution across a list of nodes, thereby optimizing LAN traffic and CPU usage without manual intervention.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If manual point-to-point transmission is used, then data can be transmitted between hosts, but data transmission rate is slow and data transmission efficiency is low

Engineering Contradiction:
Improvedata transmission efficiencyVSAvoiddata transmission rate
Core Design Contradiction:
ProductivityVSSpeed

Solution Approach 1:

The patent segments the data transmission process into multiple parallel transmission chains. Instead of manual point-to-point transmission, the system automatically divides data into segments and transmits them simultaneously through multiple nodes using a chained distribution mechanism, where each node receives data and forwards it to the next node in the chain, significantly improving overall transmission efficiency and speed.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If multi-point transmission is implemented manually, then data can be distributed to multiple nodes, but nodes cannot be effectively controlled and transmission efficiency is low

Engineering Contradiction:
Improvemulti-point transmission capabilityVSAvoidnode control automation
Core Design Contradiction:
Adaptability or versatilityVSExtent of automation

Solution Approach 1:

The patent introduces a control device as an intermediary that automatically manages multi-point transmission. The control device coordinates multiple transmission chains, assigns data segments to different nodes, and monitors transmission progress, enabling effective automated control of multiple nodes without manual intervention while maintaining high adaptability for distributing data to various destinations.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Speed

If port mapping by VIDC is used, then data transmission rate is improved, but LAN traffic and CPU usage are uneven across nodes

Engineering Contradiction:
Improvedata transmission rateVSAvoidLAN traffic distribution uniformity
Core Design Contradiction:
SpeedVSEase of operation

Solution Approach 1:

The patent applies local quality by assigning different roles and data segments to different nodes based on their capabilities and current load. Each node in the transmission chain receives and forwards specific portions of data, creating a balanced distribution of LAN traffic and CPU usage across the network. This segmented approach ensures that no single node becomes a bottleneck, maintaining uniform resource utilization while preserving high transmission rates.

Inventive Principle:
Principle #3Local quality

4Quantity of substance

If port mapping by VIDC is used for large files, then data can be transmitted, but transmission time is long leading to low efficiency

Engineering Contradiction:
Improvelarge file transmission capabilityVSAvoidtransmission time
Core Design Contradiction:
Quantity of substanceVSLoss of time

Solution Approach 1:

The patent segments large files into multiple smaller data blocks that can be transmitted simultaneously through parallel chains. Each transmission chain handles a portion of the large file, allowing concurrent transmission across multiple nodes. This segmentation dramatically reduces overall transmission time compared to sequential transmission, while maintaining the capability to handle large files effectively.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS9838313B2Method, system, control device and node device for data transmission
Publication Date: 2017.12.05 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • US9838313B2 patent drawing
  • US9838313B2 patent drawing
  • US9838313B2 patent drawing

AI summary

The application discloses a method, system, control device and node device for data transmission. The method includes determining a source node for data transmission; selecting a node which has not been selected for reception of the data as a destination node for the data transmission, from a list of nodes for the reception of the data, wherein the destination node serves as the next nearest node of the source node; wherein the list of nodes comprises at least one identifier and an address of each node; and issuing a data transmission task to the source node, wherein the data transmission task comprises the identifier and the address of the destination node, so that the source node transmits the data to the destination node according to the address of the destination node. The technical solutions of the application can guarantee the data transmission speed and the data transmission efficiency.