Task processing method, task processing system and data processing system

A technology for task processing and data processing, applied in the field of distributed computing, can solve problems such as increasing network burden

Inactive Publication Date: 2018-02-27
GUIZHOU BAISHANCLOUD TECH CO LTD
View PDF7 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When a processing node fails to process data, another processing node needs to obtain comple

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Task processing method, task processing system and data processing system
  • Task processing method, task processing system and data processing system
  • Task processing method, task processing system and data processing system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0052] Such as figure 1 As shown, a task processing method provided by an embodiment of the present invention is applied to a task processing system 002 communicatively connected to a storage system 001. The task processing system 002 includes a central node 100 and a plurality of processing nodes 200, such as figure 2 As shown, the method may include:

[0053] S100. The central node obtains tasks to be processed;

[0054] Optionally, there may be multiple ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Embodiments of the present invention provide a task processing method, system, and data processing system. The task processing system includes a central node and a plurality of processing nodes. The method includes: the central node obtains tasks to be processed; the central node obtains tasks from the storage system Obtain the data to be processed corresponding to the task to be processed; the central node splits the data to be processed into a plurality of sub-data; the central node assigns the plurality of sub-data to at least one of the processing nodes for data processing Processing: the central node merges the sub-data processed by each processing node. The present invention enables the processing nodes to obtain data directly from the central node through the setting of the central node. At the same time, since the central node has split the data, each processing node only needs to obtain the data it needs to process from the central node. Yes, the network burden is greatly reduced.

Description

technical field [0001] The invention relates to the technical field of distributed computing, in particular to a task processing method, system and data processing system. Background technique [0002] With the development of science and technology, distributed computing technology has also been widely used. For example: in the field of video transcoding, a video transcoding task is often assigned to multiple processing nodes for transcoding. [0003] When the existing distributed computing technology performs task processing, each processing node needs to obtain complete data to be processed from the storage system, and then select part of the data for processing, which undoubtedly increases the burden on the network. When a processing node fails to process data, another processing node needs to obtain complete data to be processed from the storage system again, which also increases the network load. [0004] How to solve this technical problem is still a technical proble...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04N21/234H04N21/2343H04N21/647
CPCH04N21/234336H04N21/234H04N21/64723
Inventor 李逸骏苗辉
Owner GUIZHOU BAISHANCLOUD TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap