Spark machine learning system and method based on task visual dragging
A machine learning and task technology, applied in machine learning, visual data mining, instruments, etc., can solve the problems of complex machine learning model building process, large learning cost and time cost, high learning cost, etc., to maximize marketing effect, The effect of reducing enterprise risk and cost
Pending Publication Date: 2020-06-05
TONGFANG KNOWLEDGE NETWORK TECH CO LTD (BEIJING) +1
View PDF0 Cites 12 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0003] The construction process of the existing machine learning model is relatively complicated. It needs to go through feature analysis, model training, model verification, model tuning, model export, model loading, and the learning cost is relatively high. Each module needs to be coded and debugged. For Organizations and individuals who urgently need to build machine learning systems have brought a lot of learning costs and time costs
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0023] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the embodiments and accompanying drawings.
[0024] Such as figure 1 As shown, the spark machine learning system structure based on task visualization drag-and-drop includes a process designer, a process parser and a process scheduler; the process designer is used to allow users to integrate data source components, data preprocessing components, machine Drag and drop the learning components and output components to the design area to build the machine learning process and generate a process description language; the process parser is used to analyze the machine learning flow chart constructed by the user, and analyze the relationship, input, and output between various components , and translate the flowchart into a set of data recognizable by the scheduler through the designed algorithm; the ...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a spark machine learning system and method based on task visual dragging. The system comprises a process designer, a process analyzer and a process scheduler. The method comprises the steps: dragging a data source assembly, a data preprocessing assembly, a machine learning assembly and a storage assembly to a design area to construct a machine learning process, and generating a process description language; analyzing a machine learning flow chart constructed by a user, analyzing the relationship, input and output among the components, and translating the flow chart intoa set of data which can be identified by a scheduler through a designed algorithm; and analyzing recognizable data, and submitting the constructed machine learning process to a spark cluster for training.
Description
technical field [0001] The invention relates to the technical fields of machine learning, data mining, and process control, and in particular to a spark machine learning system and learning method based on task visualization and dragging. Background technique [0002] With the accumulation of data and the spread of ideas such as data intelligence and data drive, machine learning algorithms are becoming a universal basic ability to export, involving probability theory, statistics, approximation theory, convex analysis, algorithm complexity theory, etc. In the future, with the development of algorithms and computing power, machine learning will have deeper applications in various fields such as finance, medical care, education, and security. [0003] The construction process of the existing machine learning model is relatively complicated. It needs to go through feature analysis, model training, model verification, model tuning, model export, model loading, and the learning co...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): G06F8/34G06F16/2458G06F16/26G06N20/00
CPCG06F8/34G06F16/26G06F16/2465G06N20/00Y02D10/00
Inventor 张文华段飞虎印东敏马学冬冯自强张宏伟
Owner TONGFANG KNOWLEDGE NETWORK TECH CO LTD (BEIJING)