Method and device for quality guarantee on task-level-oriented large data distribution

Abstract

An embodiment of the invention discloses a method and a device for quality guarantee on task-level-oriented large data distribution. The method includes the steps of establishing a task distribution request by processing of a data distribution coordination server; partitioning and adjusting aggregate bandwidth according to currently running tasks to be distributed; transmitting a bandwidth adjustment instruction for the tasks to a bandwidth control server which is responsible for the tasks to be distributed; adjusting task data receiving rate to set bandwidth required by the instruction; transmitting a task establishment instruction to the task-assigned bandwidth control server; transmitting a task completion instruction to the data distribution coordination server; modifying the state of the tasks into the state of being completed, and re-calculating bandwidth occupied by the running tasks to be distributed. By the method and the device, bandwidth resources for the tasks in different priority levels for distribution can be customized and distributed when large data are distributed through network. Dynamic adjustment is available, so that task distribution bandwidth resources and transmission rate are guaranteed.

Description

technical field [0001] The invention belongs to the technical field of network data transmission service quality assurance, and in particular relates to a task-level big data distribution quality assurance method and device. Background technique [0002] With the continuous enrichment of media information, digital files as a medium for storing information content are also rapidly expanding. Facing the frequent user file exchange needs, computer network has become the main way of file transfer. In the computer network of mass data transmission, due to the best-effort service mechanism of the traditional computer network, it is easy to cause the following problems: [0003] Lost data packets: When a data packet arrives at a router whose buffer is full, it means that the transmission failed this time. The router will decide whether to discard part or all of the data packets according to the network conditions. The application at the receiving end The program must request a re...

AI Technical Summary

Problems solved by technology

With the development of broadband networks and the growth of applications, traditional service quality assurance technologies have great limitations, including only providing physical address level services but not application task level services, unable to dynamically adjust bandwidth occupancy, and unable to guarantee bandwidth utilization. optimization

At the same time, the traditional service quality assurance technology is highly dependent on manual participation, so there are defects in labor costs and scalability

Images