Distributed parallel information retrieval system and distributed parallel information retrieval method

An information retrieval and distributed technology, applied in special data processing applications, instruments, electrical digital data processing, etc., can solve problems such as limited computer processing capabilities

Inactive Publication Date: 2011-09-28
SHANGHAI PUDONG TECH INFORMATION CENT
View PDF5 Cites 18 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

On the one hand, these geographically dispersed heterogeneous digital information contains a large number of valuable resources, and users urgently need to find the required information from these information; Under large-scale conditions, to retrieve such a massive amount of information, the processing power of a single computer is limited after all, and it is especially necessary for multiple computers to carry out "team operations"

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed parallel information retrieval system and distributed parallel information retrieval method
  • Distributed parallel information retrieval system and distributed parallel information retrieval method
  • Distributed parallel information retrieval system and distributed parallel information retrieval method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] The technical solutions of the present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0037] refer to figure 1 , figure 1 A distributed parallel information retrieval system 100 is shown comprising:

[0038] Data collection unit 110, described data collection unit 110 is responsible for gathering data from internet111, comprises three-layer structure: the first layer is collector 112, and described collector 112 is also called (web spider or network robot) is data data collection The terminal data collection device of unit 110, described single collector 112 has adopted multi-process, the mode of multi-thread carries out efficient data collection work to Web site; The second layer is collection controller 113, and described collection controller 113 is used for Manage and assign tasks to multiple collectors 112 ; the third layer is the data storage server 114 , which is used to store the data submitted by the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a distributed parallel information retrieval system and a distributed parallel information retrieval method. A data acquisition unit acquires data from the internet; an index unit processes and organizes the acquired data to establish a data structure and a storage mode which are suitable for retrieval; and a retrieval unit analyzes and processes query results which are submitted by a user, carries out similarity calculation and ranking, collects the query results and carries out mass data retrieval by using parallel processing and distributed processing technologies.

Description

technical field [0001] The invention relates to the field of information retrieval systems, in particular to a distributed parallel information retrieval system and its method. Background technique [0002] With the popularization of computers and the increasing development of networks, digital information has exploded. Taking WEB pages as an example, according to reliable estimates, the growth rate of WEB pages can reach doubling every 6 months. By the end of 2004, the number of WEB pages that the largest search engine could index was about 8 billion to 10 billion. And this number only accounts for a very small part of the total number of WEB pages. Most of the web pages that search engines can search are called surface pages. According to research, deep pages in the WEB (such as: web pages that require permission to enter, return pages for querying and calling network databases, multimedia documents such as images, audio, and video on the network, and documents in vario...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & AuthorityApplications(China)
IPC IPC(8): G06F17/30
Inventor鲍英郑修虹孔佳薇叶青程三艳
OwnerSHANGHAI PUDONG TECH INFORMATION CENT