Unlock instant, AI-driven research and patent intelligence for your innovation.

A CAM structure storage system for graph computing application

A storage system and graph computing technology, applied in other database indexing, other database retrieval, etc., can solve the problems that memory access efficiency affects the overall performance of the graph computing model, and the proportion of memory access operations is large, so as to avoid redundant data movement, The effect of reducing memory access delay and flexible storage system structure

Active Publication Date: 2019-01-11
北京中科睿芯科技集团有限公司
View PDF5 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although there are methods such as on-chip storage and coarse-grained edge table information to optimize memory access, it is still unavoidable to avoid the overhead of a large number of memory access address calculations and data movement, as well as the memory access delay caused by id indirect addressing
Since the memory access operation in the graph computing algorithm usually accounts for a huge proportion, and most of them are random memory access, the memory access efficiency will greatly affect the overall performance of the graph computing model

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A CAM structure storage system for graph computing application
  • A CAM structure storage system for graph computing application
  • A CAM structure storage system for graph computing application

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0047] In a specific embodiment, the present invention provides a CAM structure storage system oriented to graph computing applications, and its specific structure can be set as the attached figure 2 shown. Multiple CAMs are used to store different types of data information to form a complete CAM structure storage system, and its internal behavior is controlled by the storage controller MEM_CON. While the storage system provides data for the processing unit, multiple CAMs can directly interact with each other.

[0048]The storage system in this embodiment contains three types of different information tables, and its specific structure is described as follows:

[0049] (1) Point information table (Vertex CAM)

[0050] Each data unit of Vertex CAM contains three fields, and the addresses are arranged from low to high, namely, the number Vertex id of the point, the property value Vproperty of the point, and the number Start_edge of the first edge with this point as the source ...

Embodiment 2

[0076] According to the characteristics of a large number of random indirect addressing memory accesses in graph computing applications, the present invention proposes a new type of CAM structure storage system that is more flexible, can effectively reduce memory access delays, reduce memory access address calculation operations, and avoid redundant data movement .

[0077] The CAM structure storage system oriented to graph computing application proposed by the present invention is as attached figure 2 shown. The system includes two types of CAM memories, point information table and edge information table, and an active node table composed of ordinary RAM.

[0078] The memory access method provided by the present invention can be carried out in the following manner,

[0079] A CAM structure storage method for graph computing applications, the method is applied to a CAM structure storage system, the storage system is connected to one or more processing units, and the storage...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a CAM structure storage system and method for graph computing application. The system adopts multi-block CAM to store different types of data information, and constitutes a complete CAM structure storage system, whose internal behavior is controlled by memory controller MEM_CON. The storage system contains two types of CAM memory, namely a point information table, a side information table, and an active node table composed of ordinary RAM. While the storage system provides data for the processing unit, the data can be exchanged directly between multiple CAMs. The systemhas the advantages of flexible structure, fast data access speed, effective reduction of address calculation operation caused by large amount of indirect addressing memory access in graph calculationapplication, avoidance of redundant data transfer caused by LOAD operation with dependency relation, reduction of memory access delay and the like, and is more suitable for graph calculation application with large amount of random memory access.

Description

technical field [0001] The invention relates to the field of storage structure design in hardware accelerators for graph computing applications, in particular to a CAM structure storage system and method for graph computing applications. Background technique [0002] With the vigorous development of the field of data science, graph computing has become a powerful tool for processing large-scale data with connected relationships, and has been widely used in application scenarios such as machine learning, data mining, social media, and e-commerce advertising recommendations. The graph data structure is composed of edges and points, which can visually display any information about things in the real world and the complex relationship between things. It has been highly valued by academia and industry. Graph computing frameworks such as Pregel, GrpahLab, PowerGraph, and GraphMat have achieved Good application effect. However, the continuous surge of data scale in the big data er...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/901
Inventor 李涵严明玉李文明叶笑春范东睿
Owner 北京中科睿芯科技集团有限公司