Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Distributed implementation method for search engine

An implementation method and search engine technology, applied in the field of distributed implementation of search engines, can solve problems such as inability to meet real-time information search requirements, achieve the effects of solving index data disaster recovery problems, improving search performance, and ensuring consistency and availability

Inactive Publication Date: 2017-05-10
SHANDONG INSPUR COMML SYST CO LTD
View PDF3 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The development of traditional information search technology is very mature, but there are many deficiencies in query accuracy and different query requirements, which cannot meet the real-time search requirements of information

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed implementation method for search engine

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] In order to make the technical problems, technical solutions and beneficial effects to be solved by the present invention clearer, the following describes the present invention in detail with reference to embodiments. It should be noted that the specific embodiments described here are only used to explain the present invention, but not to limit the present invention.

[0040] The distributed implementation method of the search engine is composed of a distributed m×n system model, index data construction and search function realization; the distributed cluster group adopts the m×n model, and each cluster adopts the Master / Slave model Ensure the consistency of a single set of data and the availability of search services; index construction adopts a model that combines primary disk index + memory index + secondary disk index to ensure that the latest data is displayed in real time, to achieve real-time search, and real-time index requests are written first CommitLog logs, to ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention particularly relates to a distributed implementation method for a search engine. According to the distributed implementation method for the search engine, a distributed cluster group adopts an m*n model, and each of clusters adopts an Master / Slave model to ensure the consistency single group of data and the availability of search service; index construction adopts a model of combination of a master disc index + a memory index + a slave disc index, and a CommitLog is firstly written for requiring a real-time index; search requests comprise four types: inquiry, update, addition and deletion which are separately positioned to one group of or more group of servers of the distributed cluster. According to the distributed implementation method for the search engine, distributed index data is constructed by importing a self-defined multi-dimensional grouping rule, so that the index search time is shortened, and the search performance is improved; by adopting a multi-index mechanism combining the memory and the disc index, the index merging expenditure of time is shortened, and the search response time is shortened; the problem of index data disaster tolerance in a distributed environment is solved, and the consistency and the availability of data are ensured.

Description

Technical field [0001] The invention relates to the technical field of Web data search, in particular to a distributed realization method of a search engine. Background technique [0002] The rapid development of Internet information technology has made people pay more attention to how to obtain effective data in the fastest time and dig out valuable information from it. There are two ways to obtain real-time information: one is to establish a real-time database to ensure strong data consistency (ACID) and high availability, but its ability to expand in a distributed environment is relatively limited; the other is to establish a real-time search engine, not only Theoretical value and significant application value. [0003] The development of traditional information search technology is very mature, but there are many shortcomings in query accuracy and different query requirements, which cannot meet the real-time search requirements of information. Real-time search is an extension...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 王涛富郭特宇杨培强
Owner SHANDONG INSPUR COMML SYST CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products