Unlock instant, AI-driven research and patent intelligence for your innovation.

Method and system for data analysis and processing

A data analysis processing and data transmission technology, applied in the field of big data processing, can solve the problems that the big data analysis system cannot be compatible with stand-alone operation and distributed operation mode, and the resource utilization efficiency is low

Active Publication Date: 2021-04-06
DATACANVAS LTD
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The embodiment of the present invention provides a data analysis and processing method and system to solve the problem that the existing big data analysis system cannot be compatible with stand-alone operation and distributed operation mode, and the resource utilization efficiency is low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for data analysis and processing
  • Method and system for data analysis and processing
  • Method and system for data analysis and processing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0100] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0101] Please refer to figure 1 , figure 1 It is a flowchart of a data analysis and processing method provided by an embodiment of the present invention. The method can be applied to data analysis and processing systems, such as figure 1 As shown, the method includes the following steps:

[0102] Step 101, acquiring configuration information of data analysis and processing workflow.

[0103] Here, in the data analysis and processing system, in orde...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a data analysis and processing method and system, which relate to the field of big data processing. The data analysis and processing method includes: obtaining configuration information of a data analysis and processing workflow; determining the operation of the data analysis and processing workflow according to the configuration information mode; the operation mode includes stand-alone or distributed; based on the determined operation mode, run the data analysis and processing workflow. The data analysis and processing system in the embodiment of the present invention can be compatible with the stand-alone operation mode and the distributed operation mode, flexibly use the stand-alone operation mode or the distributed operation mode to run the data analysis and processing workflow, and realize the resources in the big data analysis system The effective allocation of the system overcomes the resource bottleneck of the big data analysis system, improves the resource utilization efficiency of the big data analysis system, and makes the calculation speed of the big data analysis system faster and the amount of calculation larger.

Description

technical field [0001] The invention relates to the field of big data processing, in particular to a data processing method and system. Background technique [0002] As the level of social informatization and intelligence improves, using big data analysis systems to train business models and using trained business models to realize intelligent processing of big data services has gradually become a common method in the big data industry. Existing big data analysis systems can choose stand-alone or distributed mode to process data and train models when performing big data analysis. However, the existing big data analysis system cannot be compatible with stand-alone operation and distributed operation mode, and the resource utilization efficiency of the big data analysis system is low. Contents of the invention [0003] Embodiments of the present invention provide a data analysis and processing method and system to solve the problem that the existing big data analysis system...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F8/20G06F16/27G06F16/23
CPCG06F8/24G06F16/23G06F16/27
Inventor 路明奎刘汶成
Owner DATACANVAS LTD