Data transmission method and system

A data transmission method and hot data technology, applied in the field of data transmission methods and systems, can solve problems such as slow data transmission speed

CN112732175APending Publication Date: 2021-04-30HUALU OPTICAL STORAGE RES INST DALIAN CO LTD
0 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Current Assignee / Owner
Publication Date
2021-04-30

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention provides a data transmission method and system, and the method comprises the steps of obtaining to-be-transmitted data of an original storage position, and enabling the to-be-transmitted data to be composed of a plurality of KB-level storage objects; sorting the to-be-transmitted data according to the final modification time of each storage object in the to-be-transmitted data to generate a to-be-transmitted list; decomposing the to-be-transmitted data into a preset number of to-be-transmitted objects according to the to-be-transmitted list; and transmitting the plurality of to-be-transmitted objects to the target storage position in parallel; and sorting the to-be-transmitted data according to the final modification time of each storage object to generate a to-be-transmitted list; and after the to-be-transmitted list is generated, decomposing the transmission data into a plurality of to-be-transmitted objects for transmission, so that the data transmission mode is optimized, and the data transmission efficiency is improved.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention relates to the fields of big data storage and Blu-ray storage, in particular to a data transmission method and system. Background technique

[0002] In the existing Amazon S3 distributed system, a special performance optimization strategy is proposed for large-throughput data transmission or storage type conversion of stored objects to improve data transmission efficiency. However, the existing performance optimization strategies can only realize the data processing of storage objects at the MB level, GB level, or even TB level. When transferring data to these objects, the existing Amazon S3 distributed system will experience concurrent data transfer congestion, affecting data transfer efficiency. Contents of the invention

[0003] Therefore, the technical problem to be solved by the present invention is to overcome the defect in the prior art that the data transmission speed is relatively slow when the object performs data transmissio...

Examples

Embodiment Construction

[0024] The technical solutions of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Apparently, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0025] In addition, the technical features involved in the different embodiments of the present invention described below may be combined with each other as long as there is no conflict with each other.

[0026] An embodiment of the present invention provides a data transmission method, such as figure 1 shown, including the following steps:

[0027] Step S1: Obtain the data to be transmitted in the original storage location, and the data to be transmitted is composed of multiple KB-level storage objects.

[...