Social media data processing method, model training method and related devices
What is Al technical title?
Al technical title is built by PatSnap Al team. It summarizes the technical point description of the patent document.
A social media and data processing technology, applied in data processing applications, special data processing applications, unstructured text data retrieval, etc., can solve the problems of difficulty in simultaneously identifying nested entities and insufficient recognition accuracy.
Active Publication Date: 2019-11-19
NEW H3C BIG DATA TECH CO LTD
View PDF10 Cites 4 Cited by
Summary
Abstract
Description
Claims
Application Information
AI Technical Summary
This helps you quickly interpret patents by identifying the three key elements:
Problems solved by technology
Method used
Benefits of technology
Problems solved by technology
Existing methods can better identify basic entities, but it is difficult to identify co
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more
Image
Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
Click on the blue label to locate the original text in one second.
Reading with bidirectional positioning of images and text.
Smart Image
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0025]The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. The components of the embodiments of the invention generally described and illustrated in the figures herein may be arranged and designed in a variety of different configurations. Accordingly, the following detailed description of the embodiments of the invention provided in the accompanying drawings is not intended to limit the scope of the claimed invention, but merely represents selected embodiments of the invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without making creative efforts belong to the protection scope of the present invention.
[0026] It should be noted that like numerals and lett...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more
PUM
Login to view more
Abstract
The embodiment of the invention relates to the technical field of natural language processing, and provides a social media data processing method, a model training method and related devices. The method comprises the steps: preprocessing obtained social media data into a plurality of to-be-recognized sequences; inputting each sequence to be identified into the trained entity recognition model; themethod comprises the steps of obtaining an embedded sequence of a to-be-identified sequence by utilizing an embedded layer, then inputting the embedded sequence into a dynamic neural network layer for multiple rounds of feature extraction and sequence prediction to obtain all entity sequences output by the dynamic neural network layer, and obtaining all basic entities and nested entities in the to-be-identified sequence according to all the entity sequences; and finally, obtaining a processing result corresponding to the social media data according to the entity results corresponding to all the to-be-identified sequences. Compared with the prior art, all the basic entities and the nested entities in the social media data can be obtained, and then people are helped to quickly know the latest dynamic and hot events of the current society.
Description
technical field [0001] Embodiments of the present invention relate to the technical field of natural language processing, and in particular, relate to a social media data processing method, a model training method, and related devices. Background technique [0002] With the advent of the information age, various social media have sprung up, for example, social networking sites, Weibo, WeChat, blogs, forums, encyclopedias, etc. People are becoming more and more accustomed to instantly obtaining and sharing information through various social media. Social media generates massive amounts of data every day, involving various fields such as politics, economy, military affairs, entertainment, and life. Analyzing these data can help people quickly perceive social hotspots. [0003] Named Entity Recognition (Named Entity Recognition) refers to the recognition of proper names such as person names, place names, organization names, and meaningful time, date, and other quantitative phr...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more
Application Information
Patent Timeline
Application Date:The date an application was filed.
Publication Date:The date a patent or application was officially published.
First Publication Date:The earliest publication date of a patent with the same application number.
Issue Date:Publication date of the patent grant document.
PCT Entry Date:The Entry date of PCT National Phase.
Estimated Expiry Date:The statutory expiry date of a patent right according to the Patent Law, and it is the longest term of protection that the patent right can achieve without the termination of the patent right due to other reasons(Term extension factor has been taken into account ).
Invalid Date:Actual expiry date is based on effective date or publication date of legal transaction data of invalid patent.