Chinese web page repeated document detection and filtration method based on full stop characteristic word string
A filtering method and feature word technology, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve the problems of repeated web page detection methods that are difficult to achieve the ideal processing effect at the same time, large amount of calculation, poor detection accuracy, etc., to achieve Simple and effective real-time detection and processing, the method is simple and easy to implement, and the effect of low cost is achieved
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Example Embodiment
[0044] In the following, the present invention will be further clarified with reference to the accompanying drawings and specific embodiments. It should be understood that these embodiments are only used to illustrate the present invention and not to limit the scope of the present invention. After reading the present invention, those skilled in the art will understand various aspects of the present invention. Modifications in equivalent forms fall within the scope defined by the appended claims of this application.
[0045] The main design idea and processing process of the Chinese duplicate document detection method in the present invention is: in order to perform duplicate document detection on a huge number of web pages searched by a search engine in response to a user’s search request, we propose and use a simple and effective Chinese period feature, using the use characteristics and statistical characteristics of Chinese period in web page text to complete the filtering of we...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap