Heterogeneous processing big data retrieval method combining historical data

A technology of historical data and big data, applied in the field of big data, can solve problems such as data heterogeneity in big data, achieve high precision and recall, avoid repeated searches, and improve efficiency

Inactive Publication Date: 2015-07-15
INST OF DONGGUAN SUN YAT SEN UNIV +1
View PDF4 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0011] The heterogeneous processing big data retrieval method combined with historical data proposed in this paper effectively solves the problem of data heterogeneity in big data while ensuring the recall and precision of data retrieval, and greatly improves It improves the retrieval efficiency and is a new type of big data search method

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Heterogeneous processing big data retrieval method combining historical data
  • Heterogeneous processing big data retrieval method combining historical data
  • Heterogeneous processing big data retrieval method combining historical data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0031] The heterogeneous processing big data retrieval method combined with historical data proposed in this paper effectively solves the problem of data heterogeneity in big data while ensuring the recall and precision of data retrieval, and greatly improves It improves the retrieval efficiency and is a new type of big data search method.

[0032] Therefore, this paper focuses on the following two issues: how to solve the heterogeneity of big data sources; how to ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a heterogeneous processing big data retrieval method combining historical data. The method comprises the following steps: receiving a key word sentence input by a user; retrieving in a historical record sheet in a Web server based on the key word sentence; judging whether the key word sentence of current search exists in the historical record sheet and directly taking out a result from the Web server if the key word sentence exists; performing distributed search in a database server by using a meta search engine if the key word sentence of the current search does not exist; feeding back a final search result to the user. By implementing the embodiment of the invention, the problem of heterogeneity in a big data source is effectively solved; the precision ratio and the recall ratio are extremely high; repeated search is avoided.

Description

technical field [0001] The invention relates to the technical field of big data, in particular to a method for searching big data through heterogeneous processing combined with historical data. Background technique [0002] As a new data management model in the field of cloud computing—big data, the key and bottleneck of data management lies in how to improve the loading efficiency and retrieval rate of data with the expansion of storage scale. However, since big data is generated with the supercomputing power of cloud computing, it has the following three characteristics: [0003] Large scale: That is, the amount of data is large, beyond people's imagination, and it is an ordinary social network. For example, Facebook's daily data volume reaches more than 500TB of new data. [0004] Data Heterogeneity: Data types in Big Data vary greatly. [0005] Low value density: In big data, the data that we can use is only a very small part of it. The most typical example is video ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 薛凯军周凡韩冠亚姜涛
Owner INST OF DONGGUAN SUN YAT SEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products