Machine learning automatic process management and optimization system and method based on micro-service

A machine learning and process management technology, applied in the field of data analysis in the automotive industry, can solve problems such as difficult management, consuming a lot of energy, and mutual interference, and achieve the effect of reducing post-maintenance costs, time costs, and workload.

Pending Publication Date: 2020-11-10
上海数策软件股份有限公司
View PDF8 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] (1) Algorithm development environment hardware and software environment interference problem: Multiple algorithm developers often share a development environment. If debugging and training are required at the same time, mutual software dependencies will interfere with each other. Manually limit task resource usage, or activate virtual machines separately
[0006] (2) Algorithm development has a low degree of automation and low versatility: Algorithm development requires professionals to spend a lot of energy and time on data cleaning and parameter tuning, and the algorithm is limited to specific scenarios, and needs to be redeveloped when the scenario changes The data cleaning process and algorithm program are time-consuming and labor-intensive
[0007] (3) The algorithm release process is complicated: professional microservice program developers are required to manually write codes for service-oriented packaging of algorithm modules, and to test and release
[0008] (4) The iterative comparison process of the algorithm model is long and complicated: the algorithm model needs to manually record the model results, compare the results manually, and then iterate continuously
[0009] (5) The online algorithm and offline algorithm service management process is cumbersome, and the service upgrade experience is poor: manual management algorithm service upgrade, online, algorithm service rollback and other processes, the difference between algorithm service versions is large, and the service management process is cumbersome. Difficult to manage

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Machine learning automatic process management and optimization system and method based on micro-service
  • Machine learning automatic process management and optimization system and method based on micro-service
  • Machine learning automatic process management and optimization system and method based on micro-service

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0063] Through the visualized abstract algorithm model and its service process, the system uses micro-service technology to realize the data preprocessing process of the algorithm model, the model training process, the model parameter adjustment process, the model comparison process, and the program automatic service package of the model running process. In order to reduce the entry standard of service development technical capabilities for building model services, reduce the cost of algorithm personnel learning service development technology, and reduce the development workload of manual service construction.

[0064] Microservice management of algorithm model programs enables algorithm model services to utilize the management capabilities of microservice operating platforms and microservice container management platforms, reducing the workload of managing algorithm model program versions and algorithm model program service O&M. Through the service orchestration technology of ...

Embodiment 2

[0172] Analysis of energy consumption in painting workshop of production line. The main goal is to analyze which controllable factors are related to the energy consumption of the painting workshop, so as to dynamically adjust the relevant factors, reduce energy consumption, and save natural gas costs. The following examples are processed by this system.

[0173] (1) The data preprocessing process and the model selection process use this system. Directly import and adapt data, and select historical energy consumption analysis model services. Quickly determine the feasibility of scene model construction, the consumption time is 1 day, and the model R2 value is less than 50%. It is determined that the data range is too small and additional data is required. The historical simulation time takes one week to consume. Reduce manual workload by 80%.

[0174] (2) After expanding the dimension of the simulated data, run the simulation again, and simply manually process and mark the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a machine learning automatic process management and optimization system and method based on micro-service. The system comprises a data set, a data processing flow constructor, adata processing flow service unit, an algorithm constructor, an algorithm service unit, a model constructor, a model service unit, a dirty data model constructor, a service unit orchestration optimizer and a container operation environment. Based on SQL-like data structure conversion, data type conversion, data mapping, data aggregation, data screening and data splitting processes, an algorithm input-oriented data conversion processing flow service unit is automatically constructed, the readability of the data processing process is improved, and the later maintenance cost is reduced.

Description

technical field [0001] The invention relates to the technical field of data analysis in the automobile industry, in particular to a microservice-based machine learning automation process management and optimization system and method. In particular, it relates to a microservice-based machine learning automation process management and optimization system and method for the automotive industry. Background technique [0002] A large number of related companies in the automotive industry lack tools for service-based packaging of algorithm models and digital management and monitoring. [0003] In the past 10 years, due to the development of big data distributed storage computing technology and parallel technology. Enterprises can perceive and accumulate data to grow exponentially. More and more enterprises have begun to carry out data mining, and even began to use complex algorithm models for data analysis, hoping to realize the value of these data. [0004] However, the proces...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F8/41G06F8/61G06F8/71G06N20/00
CPCG06F8/427G06F8/63G06F8/71G06N20/00
Inventor 刘峰麟周迪邦蒋筱丽王玺杜津徐真张椿琳
Owner 上海数策软件股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap