Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data search method, device, equipment and computer program product

A search method and data technology, applied in the field of big data, can solve the problems of long time to obtain query results and long business scenarios, achieve real-time search feedback and improve customer experience.

Pending Publication Date: 2022-04-26
CHINA CONSTRUCTION BANK
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, as the user's demand for data search continues to increase, the search technology based solely on relational databases can no longer meet the user's needs. For example, for the Mysql database, when the data volume of a single table is greater than 10 million records, a simple SQL The query requires more than 1 second of query time. If it is a complex associated query, the time to obtain the query result will be longer, which is long for most business scenarios. Therefore, in the case of increasing data volume, Existing searches based on traditional relational databases can no longer meet the needs of users

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data search method, device, equipment and computer program product
  • Data search method, device, equipment and computer program product
  • Data search method, device, equipment and computer program product

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0029] Figure 1A It is a flow chart of the data search method provided by the embodiment of the present invention. This embodiment is applicable to the case of fast data search. The method can be executed by the data search device in the embodiment of the present invention. The device can use software and / or or hardware implementation. Such as Figure 1A As shown, the method specifically includes the following operations:

[0030] Step S101, preprocessing the raw data in the relational database to obtain hotspot data.

[0031] Optionally, preprocessing the original data in the relational database to obtain hotspot data includes: denoising the original data to obtain denoised original data; desensitizing the denoised original data to obtain hotspot data.

[0032] Among them, such as Figure 1B Shown is a schematic diagram of the application architecture in the implementation mode of this application. In the application architecture, cloud hosts and independent servers are ma...

Embodiment 2

[0061] figure 2 It is a flow chart of the data search method provided by the embodiment of the present invention. This embodiment is based on the above-mentioned embodiments. After obtaining the query result according to the matching ElasticSearch index, it also includes: detecting the query result. The method steps specifically include the following operations:

[0062] Step S201, preprocessing the raw data in the relational database to obtain hotspot data.

[0063] Optionally, preprocessing the original data in the relational database to obtain hotspot data includes: denoising the original data to obtain denoised original data; desensitizing the denoised original data to obtain hotspot data.

[0064] Step S202, assemble according to the hotspot data to obtain the ElasticSearch index, and save the hotspot data and the index in the ElasticSearch library.

[0065] Step S203, according to the search instruction sent by the user, the ElasticSearch library is remotely called thr...

Embodiment 3

[0077] image 3 It is a schematic structural diagram of a data search device provided by an embodiment of the present invention, the device includes: a hotspot data acquisition module 310 , an index construction module 320 , an index acquisition module 330 and a search module 340 .

[0078] Wherein, the hot data acquisition module 310 is used to preprocess the raw data in the relational database to obtain hot data;

[0079] An index building module 320, configured to assemble and obtain an ElasticSearch index according to the hot data, and store the hot data and the index in the ElasticSearch library;

[0080] The index acquisition module 330 is used to call the ElasticSearch library according to the search instruction sent by the user, and obtain the ElasticSearch index matched with the search instruction in the ElasticSearch library, wherein the search instruction includes a query statement and a user identifier;

[0081] The search module 340 is configured to acquire query...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a data search method, device and equipment and a computer program product, and relates to the technical field of big data, and the method comprises the following steps: preprocessing original data in a relational database to obtain hotspot data; carrying out assembly according to the hotspot data to obtain an ElasticSearch index, and storing the hotspot data and the index in an ElasticSearch library; the method comprises the steps that an ElasticSearch library is remotely called through load balancing according to a search instruction sent by a user, an ElasticSearch index matched with the search instruction is obtained in the ElasticSearch library, and the search instruction comprises a query statement and a user identifier; and obtaining a query result according to the matched ElasticSearch index. According to the technical scheme, the mass data in the relational database are preprocessed to obtain the hotspot data, the hotspot data are stored in the ElasticSearch library, efficient and real-time search feedback is achieved on the basis of a remote calling mode when the user query request is obtained, the service response efficiency is greatly improved while the strong correlation of the data is guaranteed, and the customer experience is improved.

Description

technical field [0001] Embodiments of the present invention relate to the field of big data technology, and in particular, to a data search method, device, device and computer program product. Background technique [0002] With the continuous development of information technology, the user-oriented data in the Internet has increased a lot. In order to obtain the effective information required by users from massive data, the application of search technology was born. At present, when searching, it is usually based on a relational database. Search technology, for example, the widely used relational database Mysql or Oracle database. [0003] However, as the user's demand for data search continues to increase, the search technology based solely on relational databases can no longer meet the user's needs. For example, for the Mysql database, when the data volume of a single table is greater than 10 million records, a simple SQL The query requires more than 1 second of query tim...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/2455G06F16/28G06F16/22G06F9/54
CPCG06F16/2455G06F16/284G06F16/2228G06F9/547
Inventor 段航傅强张舜华吴兴威
Owner CHINA CONSTRUCTION BANK
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products