Unlock instant, AI-driven research and patent intelligence for your innovation.

Big Data Processing System

A technology of data and data volume, applied in the field of big data processing systems, can solve problems such as low accuracy, and achieve the effect of extensive use value

Active Publication Date: 2021-08-03
BEIJING TIANHUA XINGHANG TECH
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, since system resources are occupied in the future, the accuracy of such estimates is low, especially in heterogeneous situations

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big Data Processing System

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0016] In order to further explain the technical means and effects of the present invention to achieve the intended purpose of the invention, the specific implementation and effects of a big data processing system proposed according to the present invention will be described in detail below in conjunction with the accompanying drawings and preferred embodiments. The description is as follows.

[0017] The embodiment of the present invention provides a big data processing system, such as figure 1 As shown, it includes an analysis interface, a historical task database, a processor and a memory storing a computer program, wherein the historical task database is used to store task log information records, and the fields of the task log information records include task ID, data source , data volume, AI algorithm ID, task start time, task end time, and user ID. It can be understood that the task log information records may also include fields such as data types. The analysis interf...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention relates to a big data processing system, comprising an analysis interface, a historical task database, a processor and a memory storing computer programs, wherein the historical task database is used to store task log information records, and the task log information records Fields include task ID, data source, data volume, AI algorithm ID, task start time, task end time and user ID; the analysis interface is used to receive the data source, data volume and AI algorithm input by the user, and based on the input The data source, data volume and AI algorithm construct the task to be processed, and are also used to present the target estimated time data to the user, and the estimated target time data is the estimated execution time data required for executing the task to be processed. The present invention can quickly and accurately execute the estimated execution time data required by the task to be processed for user's reference.

Description

technical field [0001] The invention relates to the technical field of big data processing, in particular to a big data processing system. Background technique [0002] With the rapid development of big data technology, many big data intelligent analysis technologies have emerged, such as THE BDA big data intelligent analysis technology, which has data reading, ETL (Extraction-Transformation-Loading, data extraction, cleaning, conversion, Loading), feature engineering, model training, model application, model evaluation and other full-process drag-and-drop modeling capabilities, and visual modeling can be completed without writing code. [0003] During the intelligent analysis of big data, the AI ​​algorithm needs to process massive amounts of big data. When the AI ​​algorithm processes massive amounts of big data, it needs more running time, so it is usually necessary to prompt the user for the estimated time. An existing AI algorithm time estimation method is to estimate ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/17G06F16/2457G06F16/248
CPCG06F16/1734G06F16/2457G06F16/248
Inventor 岳国军王建业
Owner BEIJING TIANHUA XINGHANG TECH