A large data analysis system combining searching and calculation and an analysis method thereof
A technology of analysis system and analysis method, which is applied in the field of big data analysis system and its analysis that integrates search and calculation, and big data analysis and processing, to achieve the effects of improving efficiency, reducing complexity, and strong scalability
Inactive Publication Date: 2019-01-15
南京弹跳力信息技术有限公司
View PDF4 Cites 1 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0005] The technical problem to be solved by the present invention is to overcome the shortcomings of the prior art, provide a big data analysis system and analysis method that integrates search and calculation, and overcome the problem that professional programmers are required to implement programming when using traditional big data platforms. Greatly improved the practicability of the big data analysis platform
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment 1
[0036] This embodiment provides a big data analysis system that integrates search and calculation, such as figure 1 As shown, it includes data acquisition layer, preprocessing layer, analysis engine layer and display layer; among them, data acquisition layer is used to obtain data to be analyzed; sources of data to be analyzed include various files, network data streams, various servers, Various business systems; the preprocessing layer is used to preprocess the acquired data to be analyzed; the preprocessing layer includes a full-text retrieval module, a structured data processing module, and a distributed data interface module; the analysis engine layer realizes data classification and processing and store, and perform grammatical analysis, execution, and return data results on the search expressions of the display layer; the display layer is used to display the analysis results of big data that integrates search and calculation, and the display layer uses panels, charts, and...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention relates to a large data analysis system which combines searching and calculation, comprising a data acquisition layer, a preprocessing layer, an analysis engine layer and a display layer. A large data analysis result is obtained by searching and visualizing the expression language, which greatly reduces the professional requirements of the big data analysis platform.The invention reduces the cost of employing IT technicians and business analysts at the same time, and the expression language commands are independent and replaceable. Compared with the previous programming method using the traditional big data platform, the invention has strong scalability, greatly reduces the complexity and improves the analysis efficiency of the big data.
Description
technical field [0001] The invention relates to a big data analysis method, in particular to a big data analysis system and an analysis method that integrates search and calculation, and belongs to the technical field of big data analysis and processing. Background technique [0002] With the rapid development of the Internet, the amount of data collected by enterprises has also increased exponentially, including transaction data, location data, user interaction data, logistics data, supply chain data, business operation data, hardware monitoring data, application log data, etc. These data cannot be acquired and processed by conventional software in a short period of time, and a new processing mode is required to discover massive, high-growth and diversified information assets with more decision-making power from large amounts of data. With the development of modern measurement technology and smart devices, the form of data has evolved from traditional single structured data...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/951G06F16/9032G06F16/9038
Inventor 童欢欢
Owner 南京弹跳力信息技术有限公司