Unlock instant, AI-driven research and patent intelligence for your innovation.

Cosharding and randomized cosharding

A shard and distributed storage technology, applied in the field of common sharding of tables, can solve problems such as reducing the efficiency of relational databases

Pending Publication Date: 2021-05-14
GOOGLE LLC
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, separating tables into different database servers may reduce the efficiency of relational databases when retrieving data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cosharding and randomized cosharding
  • Cosharding and randomized cosharding
  • Cosharding and randomized cosharding

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] overview

[0034] This technique generally involves sharding (ie, splitting) an index table such that entries are stored in shards based on the keys of another table, and maintaining these co-sharded indexes in a relational online database in a transactional manner. Maintaining an index transactionally in a relational online database can include: for each new row of data added to the storage system, atomically (transactionally) index the row using the operation of adding a document such that the row and index can become visible to queries when a transaction completes. As the amount of data increases, the distributed storage system can store data from the data table into an index table that indexes data from rows in the data table to individual keys in the index table. Each row in an index table can include a key and data that maps that key back to the row in the data table from which it was indexed. An index table can be sharded by row into multiple shards based on th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The technology relates to cosharding tables within a distributed storage system. A data table including one or more rows may be received. Each row in the data table may include an identifier key and pieces of data. Each piece of data in the data table may be indexed into individual rows of an index table, wherein each row in the index table includes data associated with the identifier key of the data table from which the piece of data in the respective row was indexed. The index table may be sharded into splits, wherein the sharding includes assigning each row of the index table into one of the splits based on the identifier key of the data table from which the piece of data in the respective row was indexed. The splits may be stored into two or more portions of the distributed storage system.

Description

[0001] Cross References to Related Applications [0002] This application claims the benefit of U.S. Provisional Application No. 62 / 821,156, entitled Cosharding and Randomized Cosharding, filed March 20, 2019, the disclosure of which is incorporated herein by reference. Background technique [0003] Relational databases typically operate with data arranged in tables for efficient storage and retrieval. As a table grows, data is often distributed across many database servers. However, separating tables into different database servers can reduce the efficiency of a relational database when retrieving data. In this regard, distributed operations (ie, operations that require communication between different database servers or components within a database center) may be required to locate and retrieve retrieved data. Contents of the invention [0004] This disclosure generally relates to cosharding tables. One aspect of the technology is directed to a method for co-sharding a ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/22
CPCG06F16/22G06F16/27G06F16/2282G06F16/2477
Inventor 亚历山大·凯辛亚历山大·劳埃德塞巴斯蒂安·坎塔克
Owner GOOGLE LLC