Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Comprehensive processing method and system for AI metadata

A comprehensive processing and metadata technology, applied in the field of machine learning, can solve problems such as no systematic solution, no versatility and scalability, etc., to achieve the effect of easy understanding, flexibility, and unified interface

Pending Publication Date: 2021-01-05
北京向量栈科技有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Some of the existing preliminary technical solutions are non-systematic and specific-purpose, targeting a specific computing platform, such as the opaque method of Google's Kubeflow / TFX, which is not universal and scalable, and is not systematic in the prior art technical solution to this problem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Comprehensive processing method and system for AI metadata
  • Comprehensive processing method and system for AI metadata
  • Comprehensive processing method and system for AI metadata

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0059] The principles and features of the present invention will be described below in conjunction with the accompanying drawings, and the examples given are only used to explain the present invention, and are not intended to limit the scope of the present invention.

[0060] Such as figure 1 As shown, an AI (Artificial Intelligence, artificial intelligence) metadata comprehensive processing method provided by an embodiment of the present invention, the method includes: S1, monitoring and collecting metadata of a preset task running process, wherein the metadata includes : The output of any step in the running process of the scheduled task, the subtasks of any step in the running process of the scheduled task and the data of the scheduled task. The metadata also includes: output and subtask dependency;

[0061] It should be noted that, in some instances, the output of any step in the running process of the preset task may include: various attributes of the output, such as nam...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a comprehensive processing method and system for AI metadata, and relates to the field of machine learning. The method comprises the steps of monitoring and collecting metadataof a preset task running process, recording a running state of the metadata of the preset task running process, performing instantiation processing on the collected metadata including the running state, and storing the metadata into a database for correspondingly storing a preset task, so that various calculation tasks and products in an AI platform are effectively managed, and automatic collection and persistent storage of metadata in the AI calculation process are achieved; and various large-scale distributed clusters and various AI calculation processes are supported, so that the process and calculation property of complex calculation can be understood conveniently, and important data of the complex calculation processes can be tracked and managed.

Description

technical field [0001] The present invention relates to the field of machine learning, in particular to a comprehensive processing method and system for AI metadata. Background technique [0002] In a complex intelligent computing process, including: these calculations themselves, the digital intelligent assets generated by them, and the environment of these calculations can all be described by Metadata. For example, the input, output, and related parameters of a computing task. Use these metadata, such as: intermediary data, relay data, to describe data (data about data), mainly to describe the information of data attributes (property), to support such as indicating storage location, historical data, resource lookup, File recording and other functions, after further processing and analysis, can realize the understanding of the process and nature of complex calculations, and achieve important functions such as tracking and managing the generation, source flow, and use of th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/30G06F16/901G06F16/907
CPCG06F11/3055G06F11/3086G06F16/901G06F16/907G06F2201/80Y02D10/00
Inventor 徐达杨卓恒王明亮
Owner 北京向量栈科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com