Data processing method and device

Abstract

The embodiment of the invention provides a data processing method and device, the data processing method is applied to a server, the server comprises a network card, a central processing unit and a storage medium, the network card carries out shunting processing on received initial data, determines control data, index data and service data of the initial data, and stores the control data and the index data in the central processing unit; the central processing unit analyzes the control data, determines a data execution operator corresponding to the control data, issues the data execution operator to the network card, processes index data of the initial data, and stores the processed index data to a storage medium; and the network card calculates the business data based on the data execution operator, and stores target business data determined after calculation, index data of the target business data and metadata of the target business data and the index data into the storage medium.

Description

technical field [0001] The embodiments of this specification relate to the field of computer technology, and in particular to a data processing method. One or more embodiments of this specification also relate to a data processing apparatus, a computing device, and a computer-readable storage medium. Background technique [0002] In the era of big data, the amount of information data has grown explosively. The storage system under the traditional architecture has been difficult to meet the needs of information systems in different industries in terms of compatibility, unified management, scalability, security, and differentiated services. When the software-defined storage (SDS) field is widely used, because the general-purpose server does not consider the special requirements of storage IO (input output) processing, the overall performance of the storage system is lowered when the semiconductor storage performance is getting higher and higher. The bottleneck point is gradua...

AI Technical Summary

Problems solved by technology

[0002] In the era of big data, the amount of information data has grown explosively. The storage system under the traditional architecture has been difficult to meet the needs of information systems in different industries in terms of compatibility, unified management, scalability, security, and differentiated services. When the software-defined storage (SDS) field is widely used, because the general-purpose server does not consider the special requirements of storage IO (input output) processing, the overall performance of the storage system is lowered when the semiconductor storage performance is getting higher and higher. The bottleneck point is gradually shifting from the traditional hard disk to the CPU and network. Among them, the performance bottleneck of the CPU is becoming more and more prominent. The more complex calculation operations affect the processing speed of the CPU, which in turn reduces the performance of the entire storage system and affects the storage efficiency of users.

Images