Social network graph compression method and system based on node classification sorting

Abstract

The invention discloses a social network graph compression method and system based on node classification sorting, and belongs to the field of big data processing, and the method comprises the steps:obtaining the in-degree of each node in a social network graph, so as to obtain a zero-in-degree node in the social network graph, enabling a top-k node with the highest in-degree to serve as a high-in-degree node, and enabling other nodes to serve as community nodes; dividing the high-in-degree nodes into different fields, and sorting the high-in-degree nodes in the same field together; dividingthe community nodes into different communities, and sorting the community nodes in the same community together; sorting all the zero-entry nodes to the end; establishing a graph adjacency matrix according to the sorted nodes, and taking continuous b bits in each row as a bit row; and for each node, only storing the bit line where the neighbor node is located, and encoding with a fixed length is carried out, so as to completing the compression of the social network graph. The operation performance of the graph calculation task can be ensured, and the compression rate of the social network graphis improved.

Description

technical field [0001] The invention belongs to the field of big data processing, and more specifically relates to a social network graph compression method and system based on node classification and sorting. Background technique [0002] Social networks are usually composed of social entities such as individuals or organizations, which are related through certain types of interdependence (such as kinship, friend, financial, interest, etc.). Driven by the World Wide Web, social network platforms have emerged one after another. Foreign social platforms such as Facebook, Twitter, LinkedIn, Instagram, Youtube, etc., and domestic social platforms such as QQ, WeChat, Sina Weibo, Douban, Baidu Tieba, etc. Social networks make people use the Internet from simple web browsing and information search to more diverse ways of making friends, joining communities, sharing content, and so on. It enriches the way of communication between people, and also affects people's lives. It has bec...

AI Technical Summary

Problems solved by technology

There are a variety of compression algorithms used in the node sorting stage of social network graphs, and some use complex coding techniques to improve the compression rate but cannot guarantee the performance of graph computing tasks, and some use simple coding techniques to ensure the operation of graph computing tasks Performance but at the expense of compression ratio, unable to balance both

Images