Big data storage service sharing method and device, computer equipment and storage medium

Abstract

The invention relates to the field of big data application, in particular to a big data storage service sharing method and device. The method comprises the following steps: acquiring message data from any service user, wherein the message data comprises operation information and a working unit calling code; determining a data operation type corresponding to the message data; obtaining target working unit configuration information pre-configured by the service user and corresponding to the working unit calling code, and determining a target storage cluster according to the target working unit configuration information; according to the data operation type corresponding to the message data, assembling the operation information into an operation message meeting the message format requirement of the target storage cluster; sending the operation message to the target storage cluster, and when the feedback information returned after the target storage cluster processes the operation message is received, responding the service user according to the feedback information, so that the access difficulty of the big data storage technology is reduced, and each user can use the big data storage technology only by realizing a standardized interface.

Description

technical field [0001] The present application relates to the field of big data application, in particular to a big data storage service sharing method, device, computer equipment and storage medium. Background technique [0002] In the field of e-commerce, a large amount of data is generated every day, and it is difficult for ordinary databases to support tens of billions of data. Therefore, a set of big data storage methods has become an indispensable choice for various business systems. At present, big data There are many types of related technologies, and the methods of use and difficulty are different. Most of the practices of various systems in the industry are independently researched, studied, developed, and maintained by each system, which will lead to a lot of repetitive work, plus some technical applications. Improperness may also bring a series of problems. [0003] Some common problems encountered by various systems currently include at least the following: ...

AI Technical Summary

Problems solved by technology

[0004] (1) Do not understand big data related technologies, such as ES, hbase and other technical characteristics and syntax, development requires a lot of effort to get familiar with;

[0005] (2) Due to the lack of mature technical support, when some abnormalities occur, it is impossible to quickly locate the problem, and the operation and maintenance efficiency is low. Some problems can be avoided directly in the development stage, but they are brought online, and they are not known until the problem occurs;

[0006] (3) For the same type of technology, each system has to be learned and developed repeatedly, which wastes human efficiency and cost;

Images