Hardware acceleration system and method based on 3D scene design

Abstract

The invention discloses a hardware acceleration system and method based on 3D scene design. The system comprises an acceleration device, a main processor, and a main memory, and the acceleration device comprises a cache module, a controller module, an embedding calculation module, a PE array module, a pulse array module, a scalar calculation module, an activation function module, and a softmax calculation module. The cache module comprises an input cache module and an output cache module, feature extraction, attention coding, external knowledge base retrieval, graph neural network reasoning and layout optimization for pictures and texts can be effectively achieved, and acceleration processing of high-precision real-time 3D scene design can be achieved.

Description

technical field [0001] The invention relates to the field of computers, in particular to a hardware acceleration system and method based on 3D scene design. Background technique [0002] With the continuous improvement of people's living standards and the development of visual processing technology, the demand for 3D scene visualization services is constantly increasing. Currently, there are a series of methods that can provide scene design and layout for 3D scene designers. However, due to virtual 3D scene In the calculation process of design, it involves text processing, image processing, attention calculation, knowledge base retrieval, graph neural network and other calculations, and there are problems of complex calculation and large storage resource consumption. In team design or user's autonomous scene construction, terminal equipment The designed virtual 3D scene works cannot be quickly displayed and interacted in real time, resulting in long design cycle, high design...

AI Technical Summary

Problems solved by technology

[0003] The technical problem to be solved by the present invention is that in the calculation process of the existing virtual 3D scene design, it involves calculations such as text processing, image processing, attention calculation, knowledge base retrieval, graph neural network, etc., and there are problems of complex calculation and large consumption of storage resources , in the team design or the user's own scene construction, the terminal device cannot quickly display and interact with the designed virtual 3D scene works in real time, resulting in long design cycle, high design cost and poor user experience

Images