Social media data processing method, model training method and related devices

A social media and data processing technology, applied in data processing applications, special data processing applications, unstructured text data retrieval, etc., can solve the problems of difficulty in simultaneously identifying nested entities and insufficient recognition accuracy.

Active Publication Date: 2019-11-19
NEW H3C BIG DATA TECH CO LTD
View PDF10 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Existing methods can better identify basic entities, but it is difficult to identify co

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Social media data processing method, model training method and related devices
  • Social media data processing method, model training method and related devices
  • Social media data processing method, model training method and related devices

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025]The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. The components of the embodiments of the invention generally described and illustrated in the figures herein may be arranged and designed in a variety of different configurations. Accordingly, the following detailed description of the embodiments of the invention provided in the accompanying drawings is not intended to limit the scope of the claimed invention, but merely represents selected embodiments of the invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without making creative efforts belong to the protection scope of the present invention.

[0026] It should be noted that like numerals and lett...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention relates to the technical field of natural language processing, and provides a social media data processing method, a model training method and related devices. The method comprises the steps: preprocessing obtained social media data into a plurality of to-be-recognized sequences; inputting each sequence to be identified into the trained entity recognition model; themethod comprises the steps of obtaining an embedded sequence of a to-be-identified sequence by utilizing an embedded layer, then inputting the embedded sequence into a dynamic neural network layer for multiple rounds of feature extraction and sequence prediction to obtain all entity sequences output by the dynamic neural network layer, and obtaining all basic entities and nested entities in the to-be-identified sequence according to all the entity sequences; and finally, obtaining a processing result corresponding to the social media data according to the entity results corresponding to all the to-be-identified sequences. Compared with the prior art, all the basic entities and the nested entities in the social media data can be obtained, and then people are helped to quickly know the latest dynamic and hot events of the current society.

Description

technical field [0001] Embodiments of the present invention relate to the technical field of natural language processing, and in particular, relate to a social media data processing method, a model training method, and related devices. Background technique [0002] With the advent of the information age, various social media have sprung up, for example, social networking sites, Weibo, WeChat, blogs, forums, encyclopedias, etc. People are becoming more and more accustomed to instantly obtaining and sharing information through various social media. Social media generates massive amounts of data every day, involving various fields such as politics, economy, military affairs, entertainment, and life. Analyzing these data can help people quickly perceive social hotspots. [0003] Named Entity Recognition (Named Entity Recognition) refers to the recognition of proper names such as person names, place names, organization names, and meaningful time, date, and other quantitative phr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/36G06Q50/00
CPCG06F16/367G06Q50/01
Inventor 王李鹏
Owner NEW H3C BIG DATA TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products