Real-time big-data oriented search engine implementing method

A technology of search engine and implementation method, which is applied in the field of search engine and can solve the problems of frequently modifying data and not being suitable for user operations

Inactive Publication Date: 2017-01-04
SHENZHEN WANGAN COMP SECURITY DETECTION TECH CO LTD
View PDF5 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Suitable for batch processing tasks of massive data files, not suitable for scenarios with hi...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time big-data oriented search engine implementing method
  • Real-time big-data oriented search engine implementing method
  • Real-time big-data oriented search engine implementing method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0041] like figure 2 As shown, the present invention discloses a method for realizing a real-time big data search engine, comprising the following steps:

[0042] 1) Build ROSE (Real-time OceanData Search Engine) search engine system based on HTTP and Apache Lucene;

[0043] 2) Create an index of the ROSE search engine system, extract information from document information and database data in various formats, and select different text analyzers for text analysis ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a real-time big-data oriented search engine implementing method, and relates to the technical field of search engines. On the basis of Apache Lucene of HTTP, a ROSE search engine system is constructed; an index of the ROSE search engine system is created, after the index is created, a user can input a query condition for performing searching on file information, when the user inputs the query condition, firstly, text analysis is performed, then, an index database is searched for the index, and finally the obtained result is returned back to the user. The method can well complete real-time streaming data full-text search function, complete a computing task together with a distributed system, sufficiently utilize cluster high-speed operation and storage and increase the data analysis and processing response speed.

Description

technical field [0001] The invention relates to the technical field of search engines, in particular to an implementation method for a real-time big data search engine. Background technique [0002] Many network applications involve the analysis and processing of massive data. Generally, formatted massive data is stored in the database, and unformatted data is stored in the form of files, or in the form of mixed databases and files. When databases and file systems encounter terabytes of data or even larger data volumes, their analysis and processing speed will become very slow, and the response speed cannot meet the needs of users. [0003] The traditional network application system architecture mainly includes C / S mode (or B / S), S refers to Server (server side), B refers to Browser (browser side), C refers to Client (client side), the difference between the two It just depends on whether the main business logic is placed on the client side or on the server side. like fig...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/182G06F16/901G06F16/903G06F16/93
Inventor 张剑
Owner SHENZHEN WANGAN COMP SECURITY DETECTION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap