Webpage topic sentence extraction method and apparatus

Abstract

An embodiment of the invention provides a webpage topic sentence extraction method. The method comprises: firstly, obtaining a to-be-determined webpage, wherein the to-be-determined webpage contains a plurality of alternative topic sentences, and each alternative topic sentence contains a plurality of segmented words; secondly, determining a word feature value of each segmented word, inputting the word feature value into a preset machine learning model to obtain a partial order value of the segmented word, and further according to the partial order value of the segmented word, determining a partial order value of each alternative topic sentence; and finally, determining the alternative topic sentence with the partial order value greater than a preset threshold as a target topic sentence. According to the embodiment of the invention, the partial order values of the alternative topic sentences are obtained by utilizing the machine learning model; the machine learning model can reflect a degree of correlation between a query statement and a recalled webpage, so that the determined partial order values are more accurate and the accuracy of selecting the target topic sentence is improved. In addition, the invention furthermore provides a webpage topic sentence extraction apparatus, which is used for ensuring the application and implementation of the method in practice.

Description

technical field [0001] The present application relates to the technical field of Internet applications, and more specifically, to a method and device for extracting topic sentences of webpages. Background technique [0002] With the rapid development of Internet technology, the Internet has become an important channel for people to obtain information. Specifically, the information query user can input a certain query term in the search engine, and the search engine recalls multiple web pages for the user to selectively view. It should be noted that, for the convenience of users to view, the recalled web pages are arranged in the search engine in order according to their relevance to the query statement. [0003] Wherein, the correlation is the similarity between the topic sentence of the recalled web page and the query sentence. For example, the query sentence is "symptoms of hepatitis B", the topic sentence of the recalled webpage 1 is "what are the symptoms of hepatitis ...

AI Technical Summary

Problems solved by technology

[0005] In view of this, this application provides a method for extracting topic sentences from webpages to solve the technical problem of low accuracy of topic sentences determined in the technology

Images