Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and system for collecting forum reply increment

A collection method and forum technology, applied in the fields of instruments, network data retrieval, data processing applications, etc., can solve problems such as missing and missing searches, and achieve the effect of avoiding repeated collection.

Active Publication Date: 2012-07-11
新方正控股发展有限责任公司 +2
View PDF5 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Aiming at the deficiencies in the prior art, the technical problem to be solved by the present invention is to provide a method and system for incremental collection of forum replies, which can quickly, accurately and completely collect all the master / reply information of a post , overcoming the defect that the existing search engine misses or cannot find the information when searching for the page-turning reply information of the post, and the defect that the existing forum collection system only collects the home page information of the post and does not collect the reply information

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for collecting forum reply increment
  • Method and system for collecting forum reply increment
  • Method and system for collecting forum reply increment

Examples

Experimental program
Comparison scheme
Effect test

example 1

[0084] The URL of a post on the international forum channel of the Qiangguo Community of People’s Daily Online is:

[0085] http: / / bbs1.people.com.cn / postDetail.do? boardId=6&view=1&id=91384467

[0086] The page-turning link rules are:

[0087] / postDetail\.do\? id=\d+&view=\d+&pageNo=(\d+)&boardId=6

[0088] The starting page number nFirstPostPageIndex is 1, the page turning base nPageUsBaseNum is 1, N PerPage for 20.

[0089] According to the page turning link rule, the first part and the third part of the page turning URL are extracted, which are respectively: " / postDetail.do?id=91384467&view=1&pageNo=" and "&boardId=6".

[0090] According to the above information, assuming that when the post is collected for the first time, the post already has 210 replies, then there are 10 page-turning URLs acquired by splicing, which are:

[0091] / postDetail.do? id=91384467&view=1&pageNo=2&boardId=6

[0092] / postDetail.do? id=91384467&view=1&pageNo=3&boardId=6

[0093] / post...

example 2

[0097] The post URL of Baidu Tieba is: http: / / tieba.baidu.com / f? kz=919731090.

[0098] The page-turning link rules are:

[0099] / f? z=919731090&ct=335544320&lm=0&sc=0&rn=30&tn=baiduPostBrowser&word=%B6%B7%C6%C6%B2%D4%F1%B7&pn=30.

[0100] The starting page number is 0, and the page turning base is 30. According to the page-turning link rules, the first part of the page-turning URL extracted is:

[0101] / f? z=919731090&ct=335544320&lm=0&sc=0&rn=30&tn=baiduPostBrowser&word=%B6%B7%C6%C6%B2%D4%F1%B7&pn=. The third part has no content.

[0102] N PerPage for 30. According to the above information, assuming that when the post is collected for the first time, there are already 210 replies to the post, then there are 6 page turning URLs obtained by splicing, which are:

[0103] / f? z=919731090&ct=335544320&lm=0&sc=0&rn=30&tn=baiduPostBrowser&word=%B6%B7%C6%C6%B2%D4%F1%B7&pn=30

[0104] / f? z=919731090&ct=335544320&lm=0&sc=0&rn=30&tn=baiduPostBrowser&word=%B6%B7%C6%C6%B2...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method and a system for collecting the forum reply increment, which belong to the technical field of network information collection. The method provided by the invention periodically judges whether all the forum lists which are required to be collected have newly increased posts and the posts which have new reply or not; and if yes, main posts and reply information are extracted from the newly increased posts, and the new reply information is extracted from the posts which have new reply. The system provided by the invention comprises a judging device (11) and an extraction device (12), wherein the judging device (11) is used for periodically judging whether a forum list page which is required to be collected has newly increased posts and the posts which have new reply or not; and the extraction device (12) is used for extracting the main posts and the reply information from the newly increased posts and the new reply information from the posts which have new reply. The method and the system can quickly, accurately and completely collect all the main reply information of one post, and accordingly, the problem of omitted searching or no finding when the existing search engine searches the paging reply information of the post is solved.

Description

technical field [0001] The invention belongs to the technical field of network information collection, and in particular relates to a method and system for incremental collection of forum replies. Background technique [0002] With the emergence of the Internet, especially the extensive establishment of online forums and online communities, people all over the world can freely express and exchange various opinions together. There are more than one million online forums in China, and 80% of the websites have their own independent forums, and the number of people who regularly visit online forums has exceeded 100 million. Different from other forms, online forums have the characteristics of fast speed and wide range. A topic that attracts people's attention may reach tens of thousands of netizens' replies and discussions in a short period of time, and the reply information reaches hundreds or thousands of pages. At this time, the user not only wants to view the speeches of t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
CPCG06F17/30905G06F17/30876G06F17/3089G06Q10/10G06F16/9566G06F16/955G06F16/958
Inventor 吴新丽杨建武
Owner 新方正控股发展有限责任公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products