Big data fusion search method

Abstract

The invention discloses a big data fusion search method. The method comprises the following steps: constructing a search engine system; The application program APP of the application layer establishesTCP / IP connection with the analyzer of the data access layer and the data service component through Socket; the data access layer receives a library building request of an application program APP ofthe application layer; the parser parses the received message according to a protocol; determining a request type and constructing a query statement of a corresponding database according to the request parameter; The method comprises the following steps that a data service component receives a request from an application program APP of an application layer, then performs library building operationthrough a connection controller, then sends a request according to the established connection, performs result convergence after obtaining a request result, and finally returns a convergence result to the application program APP of the application layer. Compared with the prior art, connection management and data interaction are carried out through unification of the data access layer and the database, a unified access interface is provided for an application program APP of the application layer, a database solution is customized in an optimal mode, and various data requirements of an upper-layer application are met.

Description

technical field [0001] The invention relates to the field of Internet search, in particular to a big data fusion search method. Background technique [0002] After years of development, the traditional relational database has become very mature, and it is an effective tool for storing and managing structured data. The standard interface formed on top of this: structured query language SQL can conveniently query data between one table and multiple tables. Do very complex data queries. And the relational database's support for transactions enables the realization of data access requirements with high security performance. [0003] With the development of the Internet, the volume of data is getting larger and larger. Traditional relational databases are no longer suitable for such huge storage and computing requirements. Various big data storage databases have emerged as the times require, mainly including columnar databases and key-value databases. and graph databases. [0...

AI Technical Summary

Problems solved by technology

[0009] In the face of increasingly complex database requirements, especially those related to big data, it is difficult for a single database to meet the needs, and the type must be selected according to actual needs. However, when faced with multiple different types of data, developers of upper-level applications must deal with various Due to the differences in the database access API and the complexity of data types, it is also necessary to ensure the consistency of the returned results, and even the differences in different versions of the same database must be considered. It is difficult to achieve seamless integration of various databases, learning costs, development and maintenance. High, poor scalability

Images