Unlock instant, AI-driven research and patent intelligence for your innovation.

Massive microblog data distributed classification device and method with increment and decrement function

A distributed, microblogging technology, applied in text database clustering/classification, electronic digital data processing, special data processing applications, etc., can solve problems such as difficulty in dealing with the challenge of frequent updating of big data and the expiration of old data.

Active Publication Date: 2014-04-16
NORTHEASTERN UNIV
View PDF1 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In the existing research on massive microblog data, the distributed processing method can only achieve the purpose of processing massive microblog data. However, in many practical applications in the big data environment, there are often frequent data updates. , such as the continuous generation of new data, the expiration of old data, etc., it is difficult to deal with the challenges brought about by the frequent update of big data using existing distributed processing methods

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Massive microblog data distributed classification device and method with increment and decrement function
  • Massive microblog data distributed classification device and method with increment and decrement function
  • Massive microblog data distributed classification device and method with increment and decrement function

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0072] An embodiment of the present invention will be further described below in conjunction with the accompanying drawings.

[0073] In the embodiment of the present invention, the microblog data is classified according to the emotional tendency of the microblog data, and a large amount of microblog data is analyzed in a distributed environment, wherein the distributed architecture is as follows figure 1 As shown, including a master node n 0 and multiple slave nodes n 1 ,n 2 ,...,n s , where the primary node n 0 with multiple slave nodes n 1 ,n 2 ,...,n s interconnected, able to communicate with all slave nodes n 1 ,n 2 ,...,n s communicate with each other.

[0074] Such as figure 2 As shown, a massive microblog data distributed classification device with the function of increasing and decreasing volume includes multiple slave controllers (slave controller 1, slave controller 2, ..., slave controller m) and a master controller machine, and each slave control mach...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a massive microblog data distributed classification device and method with an increment and decrement function, belongs to the technical field of data mining, and overcomes the defects that massive microblog data can only be processed in a distributed manner instead of being effectively updated by means of the extreme learning machine technology in the past. Therefore, the problem about frequent data updating in the massive microblog data is well solved, the effectiveness of the massive microblog data is fully utilized, and better services for applications are achieved.

Description

technical field [0001] The invention belongs to the technical field of data mining, and in particular relates to a distributed classification device and method for massive microblog data with functions of increasing and decreasing amounts. Background technique [0002] At present, a large amount of information is generated on the Internet all the time, and the information can be expressed in various forms. Among them, the amount of information generated by the Weibo platform is also increasing rapidly. Anyone can become a Weibo user, and anyone can publish and read information on any client that supports Weibo at any time, making the update speed of Weibo data very fast. For this reason, how to take appropriate measures and technologies to mine useful information from massive microblog data, and at the same time effectively process continuously updated microblog data and make predictive judgments on future things has become the current field of data mining. Research hotspot...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
CPCG06F16/335G06F16/35
Inventor 王国仁信俊昌聂铁铮赵相国丁琳琳
Owner NORTHEASTERN UNIV