Method and device for loading index data of search engine

A technology for indexing data and search engines, applied in the Internet field, can solve problems affecting search response time, affecting user search experience, large amount of index data, etc., and achieve the effect of reducing memory usage

Active Publication Date: 2018-12-14
BEIJING QIYI CENTURY SCI & TECH CO LTD
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the amount of indexed data in the search engine is large, and the amount of indexed data continues to grow with time, and the memory resources of the physical machine are limited. If the indexed data is directly expanded into the data required by the sorting algorithm, a large amount of memory will be occupied
In addition, if the memory loads the compressed index data and decompresses the compressed index data when needed, it will seriously affect the response time of the search, thereby affecting the user search experience

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for loading index data of search engine
  • Method and device for loading index data of search engine
  • Method and device for loading index data of search engine

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0020] refer to figure 2 , which shows a flow chart of the steps of an embodiment of a search engine index data loading method embodiment of the present invention, which may specifically include the following steps:

[0021] Step S1, obtaining the first keyword entered into the search engine.

[0022] After the user inputs search information in the search engine, step S1 may obtain the first keyword in the search information by performing word segmentation on the search information. Go to step S2.

[0023] Step S2, inquire whether the first type of index data corresponding to the first keyword exists in the first cache space.

[0024] Wherein, the first type of index data corresponding to the first keyword in step S2 is the first type of index data with the first keyword, specifically, the key of the first type of index data is a keyword, and the value is related to the keyword A list of document IDs. In addition, the first cache space may be a memory space, or other high...

Embodiment 2

[0033] refer to image 3 , which shows a flow chart of the steps of another embodiment of the method for loading index data of a search engine according to the present invention, which may specifically include the following steps:

[0034] Step S21, read the compressed first-type index file, the compressed second-type index file and the compressed third-type index file from the preset disk to the first memory space, the second memory space and the third memory space respectively.

[0035] Wherein, the compressed index file of the first type, the index file of the second type compressed and the index file of the third type compressed can be stored in the memory space in addition to the disk.

[0036] Step S22, constructing compressed first-type index data, compressed second-type index data, and compressed The third type of index data.

[0037] Wherein, the preset data structure may be a map data structure, and the map data structure describes a key-value correspondence. Spec...

Embodiment 3

[0067] refer to Figure 4 , which shows a structural block diagram of an embodiment of an index data loading device for a search engine of the present invention, which may specifically include the following modules:

[0068] The keyword acquisition module 1 is used to acquire the first keyword input into the search engine.

[0069] After the user inputs search information in the search engine, the keyword acquisition module 1 can acquire the first keyword in the search information by performing word segmentation on the search information. Enter the first query module 2.

[0070] The first query module 2 is configured to query whether the first type of index data corresponding to the first keyword exists in the first cache space.

[0071] Wherein, the first type of index data corresponding to the first keyword in the first query module 2 is the first type of index data with the first keyword, specifically, the key of the first type of index data is the keyword, and the value is...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an index data loading method and device of a search engine. The method comprises the following steps of obtaining a first key word input into the search engine; inquiring whether first type of index data corresponding to the first key word exits in a first buffer memory space or not; if not, inquiring whether compressed first type of index data corresponding to the first key word exits in a first memory space or not; storing the compressed first type of index data into the first memory space; when the compressed first type of index data corresponding to the first key word exits in the first memory space, uncompressing the compressed first type of index data corresponding to the first key word, and loading the uncompressed first type of index data into the first buffer memory space; returning first type of index data corresponding to the first key word. The method and the device have the advantages that under the condition of not influencing the search experience, memory resources are saved; the search response time can be shortened under the condition of occupying the same memory resources.

Description

technical field [0001] The invention relates to the technical field of the Internet, in particular to a search engine index data loading method and a search engine index data loading device. Background technique [0002] With the development of Internet technology, the search function of search engines has become an essential function of websites. The amount of data processed by search engines is increasing, and the amount of indexed data is also increasing. The background of big data continues to pose challenges to search engines. When a search engine searches, it needs to ensure that the search experience is continuously improved while reducing the consumption of computing resources including CPU and memory. [0003] In order to ensure the search experience, the general search engine loads the index data directly into the memory first, instead of using the network database to obtain the index data. out response. [0004] However, the amount of indexed data in the search...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
CPCG06F16/951G06F16/9574
Inventor 邱学忠陈爱云姚婷
Owner BEIJING QIYI CENTURY SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap