Unlock instant, AI-driven research and patent intelligence for your innovation.

Data query method and device based on row key salt value, equipment and storage medium

A data query and salt value technology, applied in the field of big data, can solve problems such as high resource usage, poor query performance, and low computing efficiency

Pending Publication Date: 2020-10-30
CHINA PING AN PROPERTY INSURANCE CO LTD
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The main purpose of the present invention is to solve the problem of poor query performance caused by low calculation efficiency and high resource occupancy rate in the prior art when querying data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data query method and device based on row key salt value, equipment and storage medium
  • Data query method and device based on row key salt value, equipment and storage medium
  • Data query method and device based on row key salt value, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The embodiment of the present invention provides a data query method, device, device and storage medium based on the row key salt value, which is used to distribute data to each partition by adding salt to the data row key, and obtain multiple salt value data row keys and the data start key and data end key, pack the corresponding salt value data row keys from the data start key to the data end key, obtain the salt value data row key package list, and then package the salt value data row key according to the target query mode Query the target salt value data row key in the list, which solves the problem of data hotspots in the data partition, reduces resource usage, improves computing efficiency, and thus improves data query performance.

[0028] The terms "first", "second", "third", "fourth", etc. (if any) in the description and claims of the present invention and the above drawings are used to distinguish similar objects, and not necessarily Used to describe a specifi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the technical field of big data, and discloses a data query method, device and equipment based on a row key salt value and a storage medium, which are used for solving the problem of data hotspots and reducing the resource occupancy rate so as to improve the query performance. The data query method based on the row key salt value comprises the steps: obtaining table data and a plurality of data row keys in a database; counting the number of the data partitions, obtaining a plurality of target salt values, and obtaining a plurality of salt value data row keys accordingto the plurality of target salt values and the plurality of data row keys; determining a plurality of target data partitions; obtaining a data start key and a data end key according to the data queryrequest; packaging a plurality of corresponding salt value data row keys from the data start key to the data end key into a salt value data row key packaging list; determining a target salt value datarow key according to the data query request of the target terminal, and transmitting the target salt value data row key to the target terminal. In addition, the invention also relates to the blockchain technology, and the target salt value data row key can be stored in the blockchain node.

Description

technical field [0001] The present invention relates to the technical field of big data, and in particular to a data query method, device, equipment and storage medium based on a row key salt value. Background technique [0002] Hbase is a distributed, column-oriented open source database and a distributed and scalable big data warehouse. HBase can integrate the key / value storage mode to bring real-time query capabilities, as well as offline or batch processing through MapReduce Capability, Hbase can quickly query records in a large amount of data, and can also obtain comprehensive analysis reports from it. Presto is a distributed query engine that performs calculations based on memory. It does not store data itself, but it can access multiple data sources and supports cascading queries across data sources. [0003] In the existing technology, data is usually queried based on Hbase and Presto, but when the data reaches the level of 100 million or more, hot spots will appear...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/2453G06F16/2455
CPCG06F16/2453G06F16/2455
Inventor 李慎刚
Owner CHINA PING AN PROPERTY INSURANCE CO LTD