Text filtering method and device and computer storage medium
A text filtering and text technology, applied in computing, natural language data processing, special data processing applications, etc., can solve the problems of high cost, time-consuming and labor-intensive filtering of text, and low efficiency
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
no. 1 example
[0050] refer to figure 2 , figure 2 For the first embodiment of the text filtering method of the present application, the method includes:
[0051] Step S110: Obtain text fluency based on the language model.
[0052] The calculation of text fluency in this application uses a language model combined with perplexity as a fluency evaluation standard. The language model can be an N-gram language model, a topic model, a neural network model, and GPT (Generative Pre-Training), BERT (Bidirectional Encoder Representations from Transformers), XLnet and other pre-trained language models, this application uses the BERT model as an example for detailed process description, but the language model in this application is not limited to the above-mentioned language model, and can be other language models.
[0053] The goal of the BERT model is to use large-scale unlabeled corpus training to obtain text semantic representations containing rich semantic information, and then fine-tune the t...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com