Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Generation method of pre-join table on ring-shaped schema database

A database and pre-connection technology, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve the problems of high query delay in HbaseSQL, high delay in MapReduce, unsupported data rewriting and adding, etc., to optimize the calculation process, The effect of reducing the cost of time and space and accelerating the calculation speed

Active Publication Date: 2012-01-18
NORTHEASTERN UNIV
View PDF3 Cites 36 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] For another common Key-Value database: Hbase, its data is stored on the distributed file system Hadoop, and its SQL query function is actually implemented with the help of Hadoop-based Hive, which is built on Hadoop It is a tool that can extract, transform and load data. Most of its query functions are completed by MapReduce, which leads to the following two shortcomings: First, because Hive itself is designed for data warehouse applications that read more and write less. Therefore, Hive does not support rewriting and adding data. If the data stored in the database is frequently updated, Hbase cannot support it. In addition, due to the high delay of MapReduce itself, the SQL query delay of Hbase is relatively slow. high
[0004] The currently popular ring-architecture Key-Value database: Cassandra, can support conditional queries on a single table by establishing a column value index for a specified column, but currently does not support multi-table join queries

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Generation method of pre-join table on ring-shaped schema database
  • Generation method of pre-join table on ring-shaped schema database
  • Generation method of pre-join table on ring-shaped schema database

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] The present invention will be described in further detail below in conjunction with the accompanying drawings.

[0033] In this embodiment, to enable mobile phone users to inquire about subscribed book information, a query condition is provided: query the names of mobile phone users who subscribe to the book "The Old Man and the Sea".

[0034] Use the Key-Value database to store mobile phone user information and user subscription book information, as shown in Table 1 and Table 2:

[0035] Table 1 is the mobile phone user information table user

[0036]

[0037] Table 2 is the user subscription book information table orderbook

[0038]

[0039]

[0040] This embodiment adopts the generation method of the pre-connection table on the Key-Value database of the ring structure to realize the connection of Table 1 and Table 2, and its process is as follows figure 1 shown, including the following steps:

[0041] Step 1: For Table 1, hundreds of millions of rows of dat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a generation method of a pre-join table on a ring-shaped schema database, belonging to the field of distributed data storage. The method comprises the following steps of: establishing a Key-Value database, forming a column value index of a key column and storing the column value index in the database; generating a pre-join table; if an original data table is updated, updating the corresponding pre-join table; and executing data query, and outputting query result. With the pre-join table generation method provided by the invention, the pre-join table can be efficiently generated in the ring-shaped schema Key-Value database, and a quick join query function is provided; by optimizing a computational process, time and space cost for generating the pre-join table is reduced, and calculation speed is accelerated; and simultaneously, query delay is reduced according to an updating and maintaining method, and real-time join query result can be provided.

Description

technical field [0001] The invention belongs to the field of distributed data storage, and mainly relates to a method for generating a pre-connection table on a ring-structured database. Background technique [0002] Document-oriented Key-Value databases like MongoDB store documents with structural and semantic information like XML and JSON, so at the cost of consuming more memory and disk space, the value An index has been established on the database, and through index retrieval, it can better support conditional queries on a single table. Even so, document-oriented databases like MongoDB do not support complex multi-table join queries. [0003] For another common Key-Value database: Hbase, its data is stored on the distributed file system Hadoop, and its SQL query function is actually implemented with the help of Hadoop-based Hive, which is built on Hadoop It is a tool that can extract, transform and load data. Most of its query functions are completed by MapReduce, which...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
Inventor 申德荣王习特聂铁铮于戈寇月王振华鲍玉斌
Owner NORTHEASTERN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com