Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Big data-based cloud data distributing and dispatching method

A technology of data allocation and scheduling method, applied in the direction of resource allocation, electrical digital data processing, program control design, etc., can solve problems such as large correlation, and achieve the effect of improving operation speed

Inactive Publication Date: 2018-05-22
成都博睿德科技有限公司
View PDF2 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

One of the main problems to overcome in parallel computing is data dependency, and the bitwise sum operation in the accumulation algorithm makes the algorithm itself have a big dependency problem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data-based cloud data distributing and dispatching method
  • Big data-based cloud data distributing and dispatching method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0015] The following appendices illustrate the principles of the present invention. Figure 1 A detailed description of one or more embodiments of the invention is provided. The present invention is described in conjunction with such embodiments, but the present invention is not limited to any embodiment. The scope of the invention is limited only by the claims, and the invention encompasses numerous alternatives, modifications and equivalents. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. These details are provided for the purpose of example and the invention may be practiced according to the claims without some or all of these specific details.

[0016] One aspect of the present invention provides a cloud data allocation and scheduling method based on big data. figure 1 It is a flow chart of the method for data allocation and scheduling in the cloud based on big data according t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a big data-based cloud data distributing and dispatching method. The method comprises the following steps of: determining a size of each sub-task and a size of a special sub-task according the number m of current available processes and a number n of digit-by-digit summation operations of a parallel calculation platform; and declaring and initializing an iteration variable to be 0, setting a value of the iteration variable to be 0-N-1, and after each iteration is completed, respectively multiplying the iteration variable by the sizes of the sub-tasks in the step (1) so as to obtain values which are initial points of the sub-tasks, wherein N is a number of terms of a cache queue. According to the big data-based cloud data distributing and dispatching method, the operation speed can be improved by sufficiently utilizing a distributed parallel environment on the basis of a multicore calculation platform.

Description

technical field [0001] The invention relates to parallel computing, in particular to a parallel processing method for massive data. Background technique [0002] The analysis and processing of big data has become an important IT capability for enterprises. Due to the large volume, high speed, and variety of big data, and a large amount of heterogeneous unstructured data, it is also difficult to analyze, process and utilize big data. In order to solve the problem of big data computing, software developers and research scholars all over the world have carried out a lot of research and practice. In recent years, more and more developers have begun to pay attention to the role of software engineering. In order to reduce duplication of work, improve software quality and code reuse, many excellent big data computing libraries have emerged. The existing big data operation libraries only provide mathematical operation functions, and only implement serial algorithms of various oper...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/50
CPCG06F9/5038G06F9/5072G06F2209/5017
Inventor 李垚霖
Owner 成都博睿德科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products