Big-data parallel processing system and method based on column storage
A parallel processing and big data technology, applied in the field of big data processing, can solve problems such as inability to provide structured language query interface
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment Construction
[0021] The present invention will be described in further detail below in conjunction with the accompanying drawings and embodiments.
[0022] Such as figure 1 As shown, the large data parallel processing system based on column storage of the present invention adopts a distributed architecture, including a client, a master control node and a plurality of data nodes, and each node can be constructed by a server with an ordinary X86 architecture, and the data The number of nodes can be expanded linearly according to business needs. The master control node includes an HBase master controller and a SQL master engine. The HBase master controller is responsible for managing and maintaining the data nodes. The SQL master engine is responsible for parsing SQL statements and continuing to distribute SQL statements to data nodes. The HBase partition node is responsible for the storage and management of data on each data node, and the SQL slave engine is responsible for the parsing and ...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com