Big data storage, analysis and query system

A big data storage and query system technology, applied in database management systems, electronic digital data processing, structured data retrieval, etc., can solve problems affecting efficiency, query speed reduction, etc., and achieve improved processing efficiency and strong scalability Effect

Pending Publication Date: 2020-05-08
写逸网络科技(上海)有限公司
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The present invention provides a large data storage analysis query system to solve the problem that in the traditional database, in the case of a large amount of data growth, the database, in the case of a large amount of data growth, the query speed will be seriously reduced, thus affecting efficiency problem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data storage, analysis and query system
  • Big data storage, analysis and query system
  • Big data storage, analysis and query system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] In order to make the purpose, technical solutions and advantages of the present invention clearer, the technical solutions in the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the present invention.

[0039] Such as figure 1 As shown, a big data storage analysis query system includes a distributed data storage architecture, a distributed data analysis architecture, and a distributed data search architecture;

[0040] The distributed data storage architecture is used to provide high throughput access to data of applications with very large data sets;

[0041] The distributed data storage architecture of the present invention is a distributed file system suitable for running on general-purpose hardware. It has a lot in common with the existing distributed file system, but at the same time, its difference from other distributed file systems is also obvious. It is a highly fault-tolerant system suitable f...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The big data storage, analysis and query system comprises a distributed data storage framework, a distributed data analysis framework, a distributed data search framework and a data visual display framework; the distributed data storage architecture is used for providing high throughput to access data of an application program with a super-large data set; the distributed data analysis architectureis a general engine and is used for completing processing operation of large-scale data; the distributed data search architecture is used for a distributed mass data search engine in various scenes;and the data visualization display framework adopts an MVC structure. Through distributed storage and query, a plurality of nodes perform storage and querying at the same time, so that the efficiencyis improved, and the time is saved. the query in the mass data, compared with a traditional database in which full-table scanning is adopted and the time is slow, in distributed query technologies, the same data can reach the second-level speed, the analysis types are rich, various data samples are supported, distributed analysis is supported, and the analysis speed is greatly increased.

Description

technical field [0001] The invention relates to the technical field of big data processing, in particular to a big data storage, analysis and query system. Background technique [0002] With the rapid development of Internet technology, the application of big data has become more and more extensive, and it has attracted more and more attention. Big data is a collection of data that is so large that it exceeds the capabilities of traditional database software tools in terms of acquisition, storage, management, and analysis. great feature. These data will spend too much time and money in storage and analysis, and in the case of a large amount of data growth in traditional databases, the query speed will be severely reduced, thereby affecting efficiency. Contents of the invention [0003] The present invention provides a large data storage analysis query system to solve the problem that in the traditional database, in the case of a large amount of data growth, the database,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/27G06F16/25G06F16/182
CPCG06F16/27G06F16/252G06F16/182
Inventor 李文飞程俊
Owner 写逸网络科技(上海)有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap