Supercharge Your Innovation With Domain-Expert AI Agents!

Automatic data processing method and system based on Kubeflow

A technology of data processing and data processing operators, applied in the direction of electrical digital data processing, program control design, calculation model, etc., can solve the problems of time-consuming data processing, non-reusable, etc., and achieve the effect of improving correctness and processing efficiency

Pending Publication Date: 2021-11-26
STATE GRID SHANGHAI ENERGY INTERCONNECTION RES INST CO LTD +2
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

It is very time-consuming for grid technicians to deal with complex data processing, and most of the time it is not reusable

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Automatic data processing method and system based on Kubeflow
  • Automatic data processing method and system based on Kubeflow
  • Automatic data processing method and system based on Kubeflow

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] Exemplary embodiments of the present invention will now be described with reference to the drawings; however, the present invention may be embodied in many different forms and are not limited to the embodiments described herein, which are provided for the purpose of exhaustively and completely disclosing the present invention. invention and fully convey the scope of the invention to those skilled in the art. The terms used in the exemplary embodiments shown in the drawings do not limit the present invention. In the figures, the same units / elements are given the same reference numerals.

[0036] Unless otherwise specified, the terms (including scientific and technical terms) used herein have the commonly understood meanings to those skilled in the art. In addition, it can be understood that terms defined by commonly used dictionaries should be understood to have consistent meanings in the context of their related fields, and should not be understood as idealized or over...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an automatic data processing method and system based on Kubeflow, and belongs to the technical field of automatic data processing. The method comprises the following steps of: precipitating codes for processing data into data processing operators; determining a to-be-processed data set and a target data processing operator for processing the data set, and constructing the target data processing operator into a DAG according to a data processing flow of the to-be-processed data set; and calling a Kubeflow interface to execute the DAG to process the data set to be processed. According to the invention, the correctness and the processing efficiency of automatic data processing are improved.

Description

technical field [0001] The present invention relates to the technical field of automatic data processing, and more specifically, to a Kubeflow-based automatic data processing method and system. Background technique [0002] With the rapid development of machine learning and deep learning, all walks of life are beginning to embrace new technologies. Therefore, technologies such as machine learning and deep learning have been widely used in State Grid projects. Usually, complex data processing processes are involved in both machine learning and deep learning. It is very time-consuming for grid technicians to deal with complex data processing, and most of the time it is not reusable. Contents of the invention [0003] In view of the above problems, the present invention proposes a Kubeflow-based automated data processing method, including: [0004] Precipitate the code used to process data into a data processing operator; [0005] Determine the data set to be processed an...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F8/36G06F8/30G06F9/448G06N20/00
CPCG06F8/36G06F8/315G06F9/4482G06F9/449G06N20/00
Inventor 吕广宪刘鹏王国庆陆一鸣黄雨周旺杜建苏雪源
Owner STATE GRID SHANGHAI ENERGY INTERCONNECTION RES INST CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com