Unlock instant, AI-driven research and patent intelligence for your innovation.

HBase data persistence and query methods and HBase system

A data query and data technology, applied in the field of HBase system, can solve the problem that massive data writing and implementation of query cannot coexist, and achieve the effect of reducing the amount of code and convenient operation

Active Publication Date: 2014-07-30
SHANGHAI CTRIP COMMERCE CO LTD
View PDF3 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The technical problem to be solved in the present invention is to overcome the defect that the data mass writing and implementation query of HBase in the prior art cannot coexist, adopt a kind of HBase data persistence and query method and HBase system, and provide efficient data for HBase through Schema information Literacy

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • HBase data persistence and query methods and HBase system
  • HBase data persistence and query methods and HBase system
  • HBase data persistence and query methods and HBase system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0049] The HBase system of the present embodiment comprises an HBase database and N clients, wherein each client displays a web page, and the number of clients in the present embodiment is not limited, as long as all clients are within the loadable range of the HBase database cluster The number of ends is arbitrary.

[0050] like figure 1 As shown, the HBase data persistence process in the HBase system in this embodiment is as follows:

[0051] S1. Receive the input Schema information of the HBase data table from the pages of each client. The Schema information includes table name, families, columns, main table rowkey generation rules, index rowkey generation rules, and index columns. The page may be in the form of a web page or the like.

[0052] S2. Receive input data from the pages of each client and parse out the data to be written.

[0053] S3. Analyze the data to be written based on the Schema information, and obtain the rowkey, table name, families, colmu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses HBase data persistence and query methods and an HBase system. The HBase data persistence method comprises the following steps that Schema information is received; data to be written in is received and analyzed; analysis is carried out on the basis of the Schema information to obtain an Hbase data table; the HBase data table obtained through the analysis and the Schema information are written into an HBase data base. The HBase data query method comprises the following steps that an SQL (structured query language) statement is received; extraction is carried out, and query objects are formed; the Schema information is obtained through the query objects; analysis is carried out, and a Get object or an Scan object is generated; an API (application program interface) of the Hbase database is utilized for executing the Get object or Scan object, and in addition, execution results are returned. The HBase system uses the HBase data persistence and query methods. The HBase data persistence and query methods and the HBase system have the advantages that the code amount of a programmer is greatly reduced, and in addition, convenient and fast operation modes are provided for users.

Description

technical field [0001] The invention relates to an HBase data persistence and query method and an HBase system. Background technique [0002] HBase is a random read-write Key-value (key-value) database. In random read and write, HBase has very good performance. However, in some business scenarios, continuous reading and writing are often required. For example, based on time series, sorted based on price, etc. In such a scenario, the existing HBase usually has two approaches, but it is difficult to meet the fast writing and real-time query of massive data. [0003] (1) It satisfies real-time sequential query, but does not satisfy fast mass write. [0004] Write continuously according to a certain sequence, for example, according to the time sequence, continuously design continuous rowkey (row key), and write it into the HBase database. In this way, when the amount of data is small, it may have good read and write performance. If the amount of data is very large, then HBa...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
CPCG06F16/284G06F16/289
Inventor 李国刚涂振印许念费永军
Owner SHANGHAI CTRIP COMMERCE CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com