Modular management method and device of big-data processing process

A technology of big data processing and management methods, which is applied in the field of modularized management methods and devices for big data processing processes and automatic management of computer processing processes, and can solve the problems of lack of dynamic control of process tasks and unsupported data processing processes, etc.

Pending Publication Date: 2018-10-16
CITY UNIVERSITY OF HONG KONG
View PDF5 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of this, the technical problem to be solved by the present invention is to provide a modular management method and device for large data processing flow, which solves the problem that the existing data processing flow does not support centralized management of multi-user systems and lacks dynamic control of process tasks

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Modular management method and device of big-data processing process
  • Modular management method and device of big-data processing process
  • Modular management method and device of big-data processing process

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the spirit of the disclosure of the present invention will be clearly described below with the accompanying drawings and detailed descriptions. Any person skilled in the art will understand the embodiments of the present invention. , when it can be changed and modified by the technology taught in the content of the present invention, it does not depart from the spirit and scope of the content of the present invention.

[0020] The exemplary embodiments and descriptions of the present invention are used to explain the present invention, but not to limit the present invention. In addition, elements / members with the same or similar numbers used in the drawings and embodiments are used to represent the same or similar parts.

[0021] As used herein, "first", "second", ... etc. do not refer to a particular sequence or order, nor are they used to limit the pre...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a modular management method and device of a big-data processing process. The method includes: decomposing the process into one or more independent parts, and using each part asa module; establishing a tree-shape-like process structure according to dependency relationships among the modules, wherein each intermediate node of the tree-shape-like process structure has one or more child nodes and one or more parent nodes, and the modules correspond to the nodes one by one; splitting a sample list into multiple running units; and running scripts of the modules in turn according to configuration files, the tree-shape-like process structure and the running units. According to the method, modular management of the big-data processing process is realized, centralized management of a multi-user system is supported, and process tasks can be dynamically controlled.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a computer processing flow automatic management method, specifically a large data processing flow modular management method and device. Background technique [0002] In recent years, with the rapid development of computer and Internet technology, computers have become increasingly large and diverse. Some fields, including bioinformatics, have long faced the problem of large amount of analysis data, long time-consuming single analysis, many analysis items, and different analysis intervals. There are challenges such as dependencies that cannot be simply performed simultaneously. These challenges exist as the volume of data collected continues to increase despite rapid advances in computer performance. [0003] Faced with the problems of large amount of analyzed data, long time-consuming single analysis, many analysis items, and dependencies between different analyzes tha...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/46G06F11/32
CPCG06F9/466G06F11/328
Inventor 徐畅贾文龙李帅成
Owner CITY UNIVERSITY OF HONG KONG
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap