HBase table data processing method and device

By automatically identifying and extracting operation information in the HBase table operation request data, the problem of poor operation complexity and convenience in the table data processing method of HBase database is solved, efficient and accurate data processing is achieved, and user experience is improved.

CN113342811BActive Publication Date: 2024-11-05INDUSTRIAL AND COMMERCIAL BANK OF CHINA
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202110605577.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-05-31
Publication Date
2024-11-05
Estimated Expiration
2041-05-31

AI Technical Summary

Technical Problem

The existing HBase database table data processing methods have high operating threshold, long time, low accuracy and poor convenience. Users need to master the usage syntax of HBase shell, which is complex and inconvenient.

Method used

Provide a HBase table data processing method, through data splitting processing and information acquisition module, automatically identify and extract operation information in table operation request data, perform table data processing according to preset format, lower user operation threshold, and improve data processing accuracy and intelligence.

Benefits of technology

It improves the convenience and accuracy of users' operation of HBase cluster tables, reduces operation time, enhances the intelligence and reliability of data processing, and improves the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113342811B_ABST
    Figure CN113342811B_ABST
Patent Text Reader

Abstract

The embodiment of the present application provides an HBase table data processing method and device, which can be used in the field of big data technology. The method includes: if it is determined that the table operation request data for the HBase cluster does not conform to the preset operation information format, the table operation request data is subjected to data splitting processing to obtain corresponding splitting information; based on the operation information format, the table operation information corresponding to the table operation request data is obtained from the splitting information; and the table data is processed in the HBase cluster according to the table operation information. The present application can effectively improve the convenience of users operating tables in the HBase cluster, improve the accuracy of HBase table data processing and reduce the operation time, and effectively improve the intelligence, reliability and effectiveness of the HBase table data processing process.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of data processing technology, in particular to the field of big data technology, and specifically to a method and device for processing HBase table data. Background Art

[0002] The distributed column storage database HBase is a component in the Hadoop ecosystem and is a distributed, column-oriented open source database. In actual business use, HBase is based on the multi-user management system of the Hadoop ecosystem and can provide differentiated services for different users by establishing multiple users, roles, and tenants.

[0003] Currently, the existing definition and use of HBase database tables requires users to log in to the cluster through the Hadoop client to operate, and the operating users are required to master the usage syntax of the HBase shell, etc. The operation threshold is high, time-consuming, low in accuracy and poor in convenience. Summary of the invention

[0004] In response to the problems in the prior art, the present application provides an HBase table data processing method and device, which can effectively improve the convenience of users operating tables in an HBase cluster, improve the accuracy of HBase table data processing and reduce operation time, and effectively improve the intelligence, reliability and effectiveness of the HBase table data processing process.

[0005] In order to solve the above technical problems, this application provides the following technical solutions:

[0006] In a first aspect, the present application provides an HBase table data processing method, comprising:

[0007] If it is determined that the table operation request data for the HBase cluster does not conform to the preset operation information format, the table operation request data is split and processed to obtain corresponding split information;

[0008] Based on the operation information format, obtaining the table operation information corresponding to the table operation request data from the split information;

[0009] Table data processing is performed in the HBase cluster according to the table operation information.

[0010] Furthermore, before performing table data processing in the HBase cluster according to the table operation information, the method further includes:

[0011] If it is determined that the table operation request data for the HBase cluster conforms to a preset operation information format, the table operation information corresponding to the table operation request data is extracted.

[0012] Furthermore, the data splitting process is performed on the table operation request data to obtain corresponding splitting information, including:

[0013] Preprocessing the form operation request data to obtain preprocessed form operation request data;

[0014] Based on the preset word segmentation method, the preprocessed table operation request data is split and processed to obtain corresponding split information.

[0015] Furthermore, the operation information format is a storage format of a preset operation information table, and the operation information table is used to store the corresponding relationship between the operation user identifier, the operation table name, the table operation type and the operation parameters;

[0016] Correspondingly, the table operation information includes: operation user identification, operation table name and table operation type;

[0017] The table operation type includes: creating a table, clearing table data, and deleting any one of the table;

[0018] If the table operation type is the creation of a table, the table operation information further includes: operation parameters.

[0019] Furthermore, before performing table data processing in the HBase cluster according to the table operation information, the method further includes:

[0020] storing the table operation information corresponding to the table operation request data into the operation information table;

[0021] Correspondingly, performing table data processing in the HBase cluster according to the table operation information includes:

[0022] Periodically extracting table operation information corresponding to newly added table operation request data for the HBase cluster from the operation information table;

[0023] Acquire a corresponding table operation type from the table operation information;

[0024] Table data processing is performed in the HBase cluster according to the table operation type.

[0025] Furthermore, performing table data processing in the HBase cluster according to the table operation type includes:

[0026] If the table operation type is to create a table, then obtain corresponding operation parameters from the table operation information;

[0027] Based on the operation parameters, an execution code adding a create table command and the table operation information is called in the HBase cluster to create a table.

[0028] Furthermore, performing table data processing in the HBase cluster according to the table operation type includes:

[0029] If the table operation type is to clear table data or delete a table, determine the target user authority information corresponding to the operation user identifier in the table operation information from a pre-stored authority configuration table, wherein the authority configuration table is used to store the correspondence between each operation user identifier and each type of user authority information;

[0030] Determine whether the table operation type corresponding to the table operation information has operation permission according to the target user's permission information. If so, call the table data cleanup command and the execution code of the table operation information in the HBase cluster based on the table operation type to clean up the table data, or call the table deletion command and the execution code of the table operation information in the HBase cluster based on the table operation type to delete the table.

[0031] Furthermore, it also includes:

[0032] Scan each data table in the HBase cluster and the corresponding user authority information regularly, and update the authority configuration table based on the scanned user authority information.

[0033] In a second aspect, the present application provides an HBase table data processing device, comprising:

[0034] A data splitting module is used to perform data splitting processing on the table operation request data for the HBase cluster to obtain corresponding splitting information if it is determined that the table operation request data for the HBase cluster does not conform to the preset operation information format;

[0035] An information acquisition module, configured to acquire, based on the operation information format, table operation information corresponding to the table operation request data from the split information;

[0036] The table processing module is used to process table data in the HBase cluster according to the table operation information.

[0037] In a third aspect, the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the HBase table data processing method when executing the program.

[0038] In a fourth aspect, the present application provides a computer-readable storage medium having a computer program stored thereon, which implements the HBase table data processing method when executed by a processor.

[0039] It can be seen from the above technical scheme that the present application provides an HBase table data processing method and device, the method comprising: if it is determined that the table operation request data for the HBase cluster does not conform to the preset operation information format, then the table operation request data is subjected to data splitting processing to obtain corresponding splitting information; based on the operation information format, the table operation information corresponding to the table operation request data is obtained from the splitting information; according to the table operation information, the table data is processed in the HBase cluster. By setting the operation information format and processing the table data in the HBase cluster according to the table operation information, the convenience of users operating tables in the HBase cluster can be effectively improved. There is no need for the operating user to master the usage syntax, and only the table operation request data is required, which can effectively reduce HB ase table data processing operation threshold, thereby effectively improving the accuracy of HBase table data processing and reducing operation time, so as to improve the operation user experience; at the same time, if it is determined that the table operation request data for the HBase cluster does not conform to the preset operation information format, the table operation request data is split and processed to obtain the corresponding split information; based on the operation information format, the processing method of the table operation information corresponding to the table operation request data is obtained from the split information, without the user providing data according to the operation information format, and the table operation information can be automatically and accurately obtained from the data provided by the user, which can effectively improve the intelligence, reliability and effectiveness of the HBase table data processing process, and further improve the convenience and user experience of users operating HBase table data. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0041] Figure 1 It is a schematic diagram of the interaction between the HBase table data processing device in the embodiment of the present application and the client device and the HBase cluster respectively.

[0042] Figure 2 This is a first flow chart of the HBase table data processing method in the embodiment of the present application.

[0043] Figure 3 It is a second flow chart of the HBase table data processing method in the embodiment of the present application.

[0044] Figure 4 It is a third flow chart of the HBase table data processing method in the embodiment of the present application.

[0045] Figure 5 This is a fourth flow chart of the HBase table data processing method in the embodiment of the present application.

[0046] Figure 6 This is a fifth flow chart of the HBase table data processing method in the embodiment of the present application.

[0047] Figure 7 This is a sixth flow chart of the HBase table data processing method in the embodiment of the present application.

[0048] Figure 8 This is the seventh flow chart of the HBase table data processing method in the embodiment of the present application.

[0049] Fig. 9 It is a structural diagram of the HBase table data processing device in an embodiment of the present application.

[0050] Fig.10 It is a flow chart of a method for processing HBase table data using a self-service table building system based on HBase multi-user management in an application example of the present application.

[0051] Fig.11 It is a schematic diagram of the structure of an electronic device in an embodiment of the present application. DETAILED DESCRIPTION

[0052] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0053] It should be noted that the HBase table data processing method and device disclosed in the present application can be used in the field of big data technology, and can also be used in any field other than the field of big data technology. The application field of the HBase table data processing method and device disclosed in the present application is not limited.

[0054] In view of the problems that the existing HBase table data processing methods have high operation threshold, long time consumption, low accuracy and poor convenience, the embodiments of the present application respectively provide an HBase table data processing method, an HBase table data processing device, and an electronic device computer-readable storage medium. If it is determined that the table operation request data for the HBase cluster does not conform to the preset operation information format, the table operation request data is subjected to data splitting processing to obtain corresponding splitting information; based on the operation information format, the table operation information corresponding to the table operation request data is obtained from the splitting information; the table data is processed in the HBase cluster according to the table operation information. By setting the operation information format and processing the table data in the HBase cluster according to the table operation information, the convenience of users operating tables in the HBase cluster can be effectively improved, and the user does not need to be proficient in the operation. Mastering the usage syntax and only providing table operation request data is required, which can effectively lower the operational threshold of HBase table data processing, and thus can effectively improve the accuracy of HBase table data processing and reduce operation time, so as to improve the operation user experience; at the same time, if it is determined that the table operation request data for the HBase cluster does not conform to the preset operation information format, the table operation request data is subjected to data splitting processing to obtain the corresponding splitting information; based on the operation information format, a processing method for obtaining the table operation information corresponding to the table operation request data from the splitting information is obtained, without the user providing data in the operation information format, and the table operation information can be automatically and accurately obtained from the data provided by the user, which can effectively improve the intelligence, reliability and effectiveness of the HBase table data processing process, and thus can further improve the convenience and user experience of users operating HBase table data.

[0055] In one or more embodiments of the present application, HBase (Hadoop Database) refers to a high-reliability, high-performance, column-oriented, scalable distributed storage system, which consists of a master node Master and slave nodes Region Server, where Master can also be specifically written as HMaster, and Region Server can also be written as HRegionServer or RegionServer, etc.

[0056] Based on the above content, the present application also provides an HBase table data processing device for implementing the HBase table data processing method provided in one or more embodiments of the present application, see Figure 1The HBase table data processing device can communicate with the client device held by the user and the master node of the HBase cluster by itself or through a third-party server, etc. The HBase table data processing device can be a server that receives the user's table operation instructions or requests for the HBase cluster from the client device, and can also obtain relevant configuration files pre-set by the user from the client device, a third-party database or locally, such as at least one of the permission configuration table, operation information table and string matching table mentioned in one or more embodiments of the present application. After performing table data processing in the HBase cluster according to the table operation information, the HBase table data processing device can also send the corresponding table data processing results to the client device for display, so that the user can promptly know the table operation results in the HBase cluster.

[0057] It is understandable that the client device may include a smart phone, a tablet electronic device, a network set-top box, a portable computer, a desktop computer, a personal digital assistant (PDA), a vehicle-mounted device, a smart wearable device, etc. Among them, the smart wearable device may include smart glasses, a smart watch, a smart bracelet, etc.

[0058] The client device may have a communication module (i.e., a communication unit) that can communicate with a remote server to achieve data transmission with the server. The server may include a server on the task scheduling center side, and other implementation scenarios may also include a server on an intermediate platform, such as a server on a third-party server platform that has a communication link with the task scheduling center server. The server may include a single computer device, or a server cluster consisting of multiple servers, or a server structure of a distributed device.

[0059] The server and the client device may communicate with each other using any suitable network protocol, including network protocols that have not yet been developed on the date of filing this application. The network protocols may include, for example, TCP / IP, UDP / IP, HTTP, HTTPS, etc. Of course, the network protocols may also include, for example, RPC (Remote Procedure Call Protocol) and REST (Representational State Transfer) protocols used on top of the above protocols.

[0060] The details are described in detail through the following embodiments and application examples.

[0061] In order to solve the problems of high operation threshold, long time consumption, low accuracy and poor convenience in the existing HBase table data processing method, the present application provides an embodiment of an HBase table data processing method, see Figure 2 The HBase table data processing method executed by the HBase table data processing device specifically includes the following contents:

[0062] Step 100: If it is determined that the table operation request data for the HBase cluster does not conform to a preset operation information format, data splitting processing is performed on the table operation request data to obtain corresponding splitting information.

[0063] In step 100, the HBase table data processing device can receive table operation requests for the HBase cluster respectively sent by the client devices held by each user, and obtain the corresponding table operation request data from these table operation requests respectively. Then, the preset operation information format is retrieved, and it is determined whether the table operation request data corresponding to each received table operation request conforms to the preset operation information format. If so, it means that the user has entered the table operation information according to the preset operation information format. If not, it means that the information provided by the user is custom data, so it is necessary to convert the custom data into data that conforms to the operation information format, that is, the table operation request data is split and processed to obtain the corresponding split information.

[0064] It is understandable that, in executing step 100, initialization settings may also be performed first to perform various preparatory work for users to create tables on the HBase cluster. Specifically, the Hadoop client may be installed on the server and Hadoop cluster authentication information may be configured, including: keytab files for authentication of each user in the cluster and cluster configuration files (for example: core-site.xml, HBase-site.xml, hdfs-site.xml, jaas.conf, krb5.conf, etc.), etc., for subsequent login operations to the HBase cluster.

[0065] Step 200: Based on the operation information format, obtain the table operation information corresponding to the table operation request data from the split information.

[0066] In step 200, the corresponding split information obtained by performing data splitting processing on the table operation request data may contain multiple information, some of which are not required for HBase table data processing. Therefore, it is necessary to obtain the information corresponding to the table operation request data from these split information, and arrange this information according to the operation information format to facilitate format unification and / or data storage.

[0067] Step 300: Perform table data processing in the HBase cluster according to the table operation information.

[0068] In step 300, a preset execution code (eg, Java code) may be automatically updated according to the table operation information, and the updated execution code may be triggered to execute to implement the table operation information corresponding to the table operation request data for the HBase cluster.

[0069] From the above description, it can be seen that the HBase table data processing method provided in the embodiment of the present application can effectively improve the convenience of users operating tables in the HBase cluster by setting the operation information format and performing table data processing in the HBase cluster according to the table operation information. It does not require the operating user to master the usage syntax, and only needs to provide table operation request data, which can effectively lower the operation threshold of HBase table data processing, thereby effectively improving the accuracy of HBase table data processing and reducing operation time, so as to improve the user experience of the operation; at the same time, if it is determined that the table operation request data for the HBase cluster does not conform to the preset operation information format, the table operation request data is subjected to data splitting processing to obtain corresponding splitting information; based on the operation information format, a processing method for obtaining the table operation information corresponding to the table operation request data from the splitting information, without the user providing data in accordance with the operation information format, can also automatically and accurately obtain the table operation information from the data provided by the user, which can effectively improve the intelligence, reliability and effectiveness of the HBase table data processing process, thereby further improving the convenience and user experience of users operating HBase table data.

[0070] In order to improve the efficiency of obtaining the table operation information corresponding to the table operation request data, an embodiment of the HBase table data processing method provided in this application is provided. Figure 3 , the HBase table data processing method further includes the following contents before step 300:

[0071] Step 400: If it is determined that the table operation request data for the HBase cluster conforms to a preset operation information format, then the table operation information corresponding to the table operation request data is extracted.

[0072] Specifically, the HBase table data processing device may first read the operation information submitted by the user, and compare it with the specified format of the operation information table. If the operation information matches the specified format, the operation information is directly stored in the operation information table.

[0073] From the above description, it can be seen that the HBase table data processing method provided in the embodiment of the present application can effectively improve the efficiency of obtaining the table operation information corresponding to the table operation request data by providing the user with an operation information format so that the user can directly provide the table operation request data that conforms to the operation information format, thereby effectively improving the efficiency of HBase table data processing.

[0074] In order to improve the accuracy and efficiency of data splitting, an embodiment of the HBase table data processing method provided in this application is provided. Figure 4 , step 100 in the HBase table data processing method specifically includes the following contents:

[0075] Step 110: If it is determined that the table operation request data for the HBase cluster does not conform to the preset operation information format, the table operation request data is preprocessed to obtain preprocessed table operation request data.

[0076] It is understandable that the method of preprocessing the table operation request data may be to perform data cleaning processing such as noise removal, outlier elimination, and missing value interpolation on the table operation request data based on preset data preprocessing rules.

[0077] Step 120: Based on a preset word segmentation method, the preprocessed table operation request data is subjected to data segmentation processing to obtain corresponding segmentation information.

[0078] It can be understood that the word segmentation method can adopt a dictionary-based method, a statistical method and a rule-based method, such as: a forward maximum matching algorithm, a full binary maximum matching algorithm, a probabilistic statistical algorithm of mutual information, an N2Gram model algorithm and an NLPIR big data semantic intelligent analysis platform, etc. The specific method can be selected according to the actual application scenario.

[0079] From the above description, it can be seen that the HBase table data processing method provided in the embodiment of the present application, by adopting a preset word segmentation method, performs data splitting processing on the pre-processed table operation request data, which can effectively improve the accuracy and efficiency of data splitting processing, and thus effectively improve the accuracy and efficiency of HBase table data processing.

[0080] In order to improve the efficiency and convenience of determining whether table operation request data for an HBase cluster conforms to a preset operation information format, in an embodiment of an HBase table data processing method provided in the present application, the operation information format in the HBase table data processing method is a storage format of a preset operation information table, and the operation information table is used to store the correspondence between the operation user identifier, the operation table name, the table operation type, and the operation parameters.

[0081] Correspondingly, the table operation information includes: operation user identification, operation table name and table operation type; the table operation type includes: any one of creating a table, clearing table data and deleting a table; wherein, if the table operation type is the creation of a table, the table operation information also includes: operation parameters.

[0082] Specifically, you can pre-configure an operation information table to maintain the operation information submitted by users on the table for subsequent table creation, table deletion, and data cleanup. The storage format of the table is as follows:

[0083] "Operation user ID, operation table name, table operation type, operation parameters (fill in only when the table operation type is create table create)"

[0084] For example, "etla, ABC_DEF, create, cf1, cf2" means that the user with the operating user ID of etla requests to create a table ABC_DEF with two column families, cf1 and cf2.

[0085] For example, "etla, ABC_DEF, drop" means: the user with the operation user ID of etla requests to delete the table ABC_DEF.

[0086] From the above description, it can be seen that the HBase table data processing method provided in the embodiment of the present application can effectively improve the efficiency and convenience of judging whether the table operation request data for the HBase cluster conforms to the preset operation information format through the pre-setting of the operation information table and the classification of the table operation types, and can effectively realize differentiated processing for HBase table data processing, which can further improve the convenience and wide applicability of users in processing HBase table data, so as to further improve the user experience of the operation.

[0087] In order to improve the effectiveness of HBase table data processing, an embodiment of the HBase table data processing method provided in this application is shown in FIG. Figure 5 , the HBase table data processing method further includes the following contents before step 300:

[0088] Step 010: storing the table operation information corresponding to the table operation request data into the operation information table;

[0089] Correspondingly, step 300 in the HBase table data processing method specifically includes the following contents:

[0090] Step 310: Periodically extracting table operation information corresponding to newly added table operation request data for the HBase cluster from the operation information table.

[0091] Specifically, the newly added request data in the operation information table may be scanned periodically and processed.

[0092] Step 320: Obtain the corresponding table operation type from the table operation information.

[0093] Step 330: Perform table data processing in the HBase cluster according to the table operation type.

[0094] From the above description, it can be seen that the HBase table data processing method provided in the embodiment of the present application can effectively improve the effectiveness of HBase table data processing by storing the table operation information corresponding to the table operation request data in the operation information table before performing table data processing, and then periodically extracting the newly added table operation information corresponding to the table operation request data for the HBase cluster from the operation information table. It does not require real-time detection, can effectively reduce data redundancy, and improve the operating stability of the HBase cluster.

[0095] In order to improve the convenience of users creating tables in the HBase cluster, an embodiment of the HBase table data processing method provided in this application is shown in FIG. Figure 6 , step 330 in the HBase table data processing method may specifically include the following content:

[0096] Step 331: If the table operation type is to create a table, then obtain corresponding operation parameters from the table operation information.

[0097] Step 332: Based on the operation parameters, the execution code of adding the create table command and the table operation information is called in the HBase cluster to create a table.

[0098] Specifically, it can receive instructions from the scheduled scanning module, read the new request information in the operation information table, and split the user name, table name, operation type and operation parameter information in each new request according to the specified format; if the above operation type is create, there is no need to perform authentication operations, directly read the operation type parameters after the demand split, call the Java code for table creation, introduce the HBase create command in the Java code, pass in the user, table name and operation parameters (names of each column family), and log in to the cluster to complete the table creation operation.

[0099] From the above description, it can be seen that the HBase table data processing method provided in the embodiment of the present application can further improve the convenience of users in creating tables in the HBase cluster by calling the execution code of the create table command in the HBase cluster based on the operation parameters to create a table, and can effectively improve the degree of automation of HBase table data processing.

[0100] In order to improve the security of table data cleaning or table deletion operations, an embodiment of the HBase table data processing method provided in this application is provided. Figure 7 , step 330 in the HBase table data processing method may further specifically include the following contents:

[0101] Step 333: If the table operation type is to clear table data or delete the table, determine the target user permission information corresponding to the operation user identifier in the table operation information from the pre-stored permission configuration table, wherein the permission configuration table is used to store the correspondence between each operation user identifier and each type of user permission information.

[0102] Step 334: Determine whether the table operation type corresponding to the table operation information has the operation permission based on the target user's permission information. If so, call the table data cleanup command and the execution code of the table operation information in the HBase cluster based on the table operation type to clean up the table data, or call the table deletion command and the execution code of the table operation information in the HBase cluster based on the table operation type to delete the table.

[0103] Specifically, a permission configuration table can be pre-set to maintain the tables, users, and corresponding permission information of the HBase cluster for subsequent user authentication. The storage format of the table is as follows:

[0104] "Table name, operation user ID, permission type";

[0105] For example, "ABC_DEF, etla, drop" means that the user with the operation user ID of etla has the drop permission for the ABC_DEF table.

[0106] It can receive instructions from the scheduled scanning module, read the newly added request information in the operation information table, split the user name, table name, operation type and operation parameter information in each newly added request according to the specified format, and if the above operation type is table deletion drop or table clearing truncate, the user, table, and operation type are passed to the user authentication module in parameter form, the operation request submitted by the user is authenticated, the operation type parameter after the requirement is split, and the Java code of table deletion drop or table clearing (truncate) is called, and then the drop command of HBase is introduced in the Java code, the user and table name parameters are passed in, and the cluster is logged in to complete the table deletion operation, or the truncate command of HBase is introduced in the Java code, the user and table name parameters are passed in, and the cluster is logged in to complete the table clearing operation.

[0107] From the above description, it can be seen that the HBase table data processing method provided in the embodiment of the present application, if the table operation type is to clean up table data or delete a table, then determines whether the table operation type corresponding to the table operation information has the operation permission based on the target user's permission information, which can effectively improve the security of cleaning up table data or deleting table operations, and can effectively improve the convenience of cleaning up table data or deleting tables, and can effectively improve the degree of automation of HBase table data processing.

[0108] In order to improve the security of table data cleaning or table deletion operations, an embodiment of the HBase table data processing method provided in this application is provided. Figure 8 The HBase table data processing method may further specifically include the following contents:

[0109] Step 500: Periodically scan each data table in the HBase cluster and the corresponding user authority information, and update the authority configuration table based on the scanned user authority information.

[0110] Specifically, you can periodically scan the tables and user permission information in the cluster and update them to the permission configuration table to ensure the validity of user authentication.

[0111] From the above description, it can be seen that the HBase table data processing method provided in the embodiment of the present application can effectively improve the accuracy and reliability of authentication processing for clearing table data or deleting table operations by regularly scanning and updating user permissions, thereby further improving the security of clearing table data or deleting table operations and improving the operating stability of the HBase cluster.

[0112] From the software level, in order to solve the problems of high operation threshold, long time consumption, low accuracy and poor convenience in the existing HBase table data processing method, the present application provides an embodiment of an HBase table data processing device for executing all or part of the contents of the HBase table data processing method, see Fig. 9 , the HBase table data processing device specifically includes the following contents:

[0113] The data splitting module 10 is used to perform data splitting processing on the table operation request data to obtain corresponding splitting information if it is determined that the table operation request data for the HBase cluster does not conform to a preset operation information format.

[0114] In the data splitting module 10, the data splitting module 10 can receive table operation requests for the HBase cluster respectively sent by the client devices held by each user, and obtain the corresponding table operation request data from these table operation requests respectively. Then, the preset operation information format is called, and it is determined whether the table operation request data corresponding to each received table operation request conforms to the preset operation information format. If so, it means that the user has entered the table operation information according to the preset operation information format. If not, it means that the information provided by the user is custom data, so it is necessary to convert the custom data into data that conforms to the operation information format, that is, the table operation request data is subjected to data splitting processing to obtain the corresponding splitting information.

[0115] The information acquisition module 20 is used to acquire the table operation information corresponding to the table operation request data from the split information based on the operation information format.

[0116] In the information acquisition module 20, the corresponding split information obtained by performing data splitting processing on the table operation request data may contain multiple information, some of which are not required for HBase table data processing. Therefore, it is necessary to obtain the information corresponding to the table operation request data from these split information, and arrange this information according to the operation information format to facilitate format unification and / or data storage.

[0117] The table processing module 30 is used to process table data in the HBase cluster according to the table operation information.

[0118] In the table processing module 30, a preset execution code (eg, Java code) may be automatically updated according to the table operation information, and the updated execution code may be triggered to execute to implement the table operation information corresponding to the table operation request data for the HBase cluster.

[0119] The embodiment of the HBase table data processing device provided in the present application can be specifically used to execute the processing flow of the embodiment of the HBase table data processing method in the above embodiment. Its functions will not be repeated here, and reference can be made to the detailed description of the above method embodiment.

[0120] From the above description, it can be seen that the HBase table data processing device provided in the embodiment of the present application can effectively improve the convenience of users operating tables in the HBase cluster by setting the operation information format and performing table data processing in the HBase cluster according to the table operation information. It does not require the operating user to master the usage syntax, and only needs to provide table operation request data. It can effectively lower the operation threshold of HBase table data processing, thereby effectively improving the accuracy of HBase table data processing and reducing operation time, so as to improve the user experience of the operation; at the same time, if it is determined that the table operation request data for the HBase cluster does not conform to the preset operation information format, the table operation request data is subjected to data splitting processing to obtain corresponding splitting information; based on the operation information format, a processing method for obtaining the table operation information corresponding to the table operation request data from the splitting information, without the user providing data in the operation information format, can also automatically and accurately obtain the table operation information from the data provided by the user, which can effectively improve the intelligence, reliability and effectiveness of the HBase table data processing process, thereby further improving the convenience and user experience of users operating HBase table data.

[0121] In order to further illustrate the present solution, the present application also provides a specific application example of an HBase table data processing method implemented by a self-service table creation system based on HBase multi-user management, which involves the field of distributed columnar storage HBase database, breaks the technical barriers in the use of HBase, and enables business and technical personnel to self-service definition and use of HBase database tables.

[0122] The application example of this application provides a self-service table creation system based on HBase multi-user management. It can configure the tables to be created and the operation content according to the needs of each user, and can be extended to operations such as deleting and cleaning HBase tables. The system is scalable and encapsulated as an external interface. Users can use it alone or call this interface in other programs to achieve more functions. For the specific process of implementing the HBase table data processing method based on the self-service table creation system of HBase multi-user management, see Fig.10, specifically including: service initialization, configuration of Hadoop cluster authentication information, maintenance of hbase_table_config configuration table, configuration of Hbase operation information, configuration of user, table, operation and other information in table.txt, logging into the cluster, performing Hbase operations, user authentication, whether there is operation permission, if yes, only Hbase shell operation, otherwise return prompt information, etc.

[0123] The self-service table creation system based on HBase multi-user management specifically includes the following modules:

[0124] 1. Initialization module: This module is deployed on the server where the self-service table building system is installed. It is mainly used for various preparations for users to build tables on the HBase cluster: install the Hadoop client on the server and configure the Hadoop cluster authentication information, including: keytab files for cluster user authentication, cluster configuration files (core-site.xml, HBase-site.xml, hdfs-site.xml, jaas.conf, krb5.conf), etc., for subsequent login cluster operations.

[0125] 2. Configuration management module: This module is used to manage various configurations and states when creating tables, deleting tables, and cleaning data in the HBase cluster, including the following functions:

[0126] (1) Permission configuration table: used to maintain the tables, users, and corresponding permission information of the HBase cluster for subsequent user authentication; the storage format of this table is as follows:

[0127] Table name, permission user, permission type

[0128] For example: ABC_DEF, etla, drop; it means that the etla user has the drop permission for the ABC_DEF table.

[0129] (2) Operation information table: used to maintain the operation information submitted by users for table creation, deletion, and data cleanup. The storage format of this table is as follows:

[0130] Operation user, operation table name, operation type, operation parameters (fill in only when the operation type is create);

[0131] For example: etla, ABC_DEF, create, cf1, cf2; it means that you need to use the etla user to create a table ABC_DEF with two column families, cf1 and cf2.

[0132] For example: etla, ABC_DEF, drop; it means that the table ABC_DEF needs to be deleted using the etla user.

[0133] (3) String matching table: used to maintain user, table name and operation type information when performing string matching; the table contains three fields: user name, table name and operation type. Each field is stored separately and there is no association between the fields.

[0134] 3. User demand conversion module: used to receive and identify the operation information submitted by the user, and convert the operation information into a specified format and store it in the operation information table of the configuration management module. It supports users to submit operation information in the specified format of the operation information table and in a custom format.

[0135] (1) The module first reads the operation information submitted by the user and compares it with the specified format of the operation information table. If it matches the specified format, the operation information is directly stored in the operation information table;

[0136] (2) If it does not match the specified format, the user, table name and operation type information in the string matching table are read, and the word segmentation method of string matching is used to segment the operation information submitted in the user-defined format, identify the user name, table name and operation type, and write them into the operation information table according to the specified format to complete the user demand conversion.

[0137] 4. Scheduled scanning module: used to regularly maintain cluster tables and user permission information, and regularly scan the operation requirements submitted by users, including the following functions:

[0138] (1) Maintain cluster permission information: regularly scan the tables and user permission information in the cluster and update them to the permission configuration table to ensure the validity of user authentication;

[0139] (2) Scan user operation information: regularly scan new requests in the operation information table and trigger the operation implementation module to respond to the request.

[0140] 5. User authentication module: It is mainly used to authenticate users during drop and truncate operations and is called by the operation implementation module. It receives the user, table, and operation type (drop or truncate) parameters passed in by the operation implementation module, reads the permission configuration table, and determines whether the user has the permission to operate the corresponding table; if the permission is insufficient, it returns the "Permission deny" message to the operation implementation module; if the permission meets the requirements, it returns the "Permission pass" message to the operation implementation module and proceeds to the next step.

[0141] 6. Operation implementation module: used to log in to the cluster to implement specific user needs. The HBase table operation implementation process mainly includes the following steps:

[0142] (1) Demand splitting: Receive instructions from the timed scanning module, read the newly added request information in the operation information table, and split the user name, table name, operation type, and operation parameter information in each newly added request according to the specified format;

[0143] (2) Demand judgment: If the above operation type is create, no authentication operation is required and the operation implementation step (4) is directly entered; if the above operation type is drop or truncate, the user, table, and operation type are passed to the user authentication module as parameters to authenticate the operation request submitted by the user;

[0144] (3) Authentication judgment: If the operation type is not create in step (2), the user authentication module returns the information; if the return information is "Permission deny", it means that the user does not have the right to implement the request submitted, and the "insufficient authority" message is returned to prompt the user; if the return information is "Permission pass", it means that the user has the right to submit the request, and the operation implementation step (4) is entered;

[0145] (4) Operation implementation: Read the operation type parameters after the demand is split, and call the Java codes for table creation, table deletion, and table truncate respectively:

[0146] a. Create a table: Introduce the HBase create command in the Java code, enter the user, table name, and operation parameters (names of each column family), and log in to the cluster to complete the table creation operation;

[0147] b. Delete table: Introduce the HBase drop command in the Java code, pass in the user and table name parameters, and log in to the cluster to complete the table deletion operation;

[0148] c. Clear the table: Introduce the HBase truncate command in the Java code, pass in the user and table name parameters, and log in to the cluster to complete the table clearing operation;

[0149] At this point, the entire HBase self-service table creation (table deletion / table clearing) process is completed.

[0150] Based on the above technical solution, the self-service table creation system based on HBase multi-user management provided in the application example of this application implements the HBase table data processing method, breaking the technical barriers in the use of HBase, and can be extended to operations such as deletion and cleanup of HBase tables; by encapsulating the system as an external interface, users can use it alone or call the interface in other programs to implement more functions, which greatly expands the scope of use of the system, realizes flexible operation of distributed column storage databases, and lowers the threshold for using HBase.

[0151] From the hardware level, in order to solve the problems of high operation threshold, long time consumption, low accuracy and poor convenience in the existing HBase table data processing method, the present application provides an embodiment of an electronic device for implementing all or part of the contents of the HBase table data processing method, and the electronic device specifically includes the following contents:

[0152] Fig.11 FIG. 9 is a schematic block diagram of the system structure of the electronic device 9600 according to an embodiment of the present application. Fig.11 As shown, the electronic device 9600 may include a central processor 9100 and a memory 9140; the memory 9140 is coupled to the central processor 9100. It is worth noting that Fig.11 is exemplary; other types of structures may also be used to supplement or replace this structure to implement telecommunication functions or other functions.

[0153] In one embodiment, the HBase table data processing function may be integrated into a central processing unit, wherein the central processing unit may be configured to perform the following control:

[0154] Step 100: If it is determined that the table operation request data for the HBase cluster does not conform to a preset operation information format, data splitting processing is performed on the table operation request data to obtain corresponding splitting information.

[0155] In step 100, the HBase table data processing device can receive table operation requests for the HBase cluster respectively sent by the client devices held by each user, and obtain the corresponding table operation request data from these table operation requests respectively. Then, the preset operation information format is retrieved, and it is determined whether the table operation request data corresponding to each received table operation request conforms to the preset operation information format. If so, it means that the user has entered the table operation information according to the preset operation information format. If not, it means that the information provided by the user is custom data, so it is necessary to convert the custom data into data that conforms to the operation information format, that is, the table operation request data is split and processed to obtain the corresponding split information.

[0156] It is understandable that, in executing step 100, initialization settings may also be performed first to perform various preparatory work for users to create tables on the HBase cluster. Specifically, the Hadoop client may be installed on the server and Hadoop cluster authentication information may be configured, including: keytab files for authentication of each user in the cluster and cluster configuration files (for example: core-site.xml, HBase-site.xml, hdfs-site.xml, jaas.conf, krb5.conf, etc.), etc., for subsequent login operations to the HBase cluster.

[0157] Step 200: Based on the operation information format, obtain the table operation information corresponding to the table operation request data from the split information.

[0158] In step 200, the corresponding split information obtained by performing data splitting processing on the table operation request data may contain multiple information, some of which are not required for HBase table data processing. Therefore, it is necessary to obtain the information corresponding to the table operation request data from these split information, and arrange this information according to the operation information format to facilitate format unification and / or data storage.

[0159] Step 300: Perform table data processing in the HBase cluster according to the table operation information.

[0160] In step 300, a preset execution code (eg, Java code) may be automatically updated according to the table operation information, and the updated execution code may be triggered to execute to implement the table operation information corresponding to the table operation request data for the HBase cluster.

[0161] From the above description, it can be seen that the electronic device provided in the embodiment of the present application can effectively improve the convenience of user operation of the table in the HBase cluster by setting the operation information format and performing table data processing in the HBase cluster according to the table operation information. The user does not need to be proficient in the usage syntax, and only needs to provide table operation request data. This can effectively lower the operation threshold of HBase table data processing, thereby effectively improving the accuracy of HBase table data processing and reducing operation time, so as to improve the user experience of the operation; at the same time, if it is determined that the table operation request data for the HBase cluster does not conform to the preset operation information format, the table operation request data is subjected to data splitting processing to obtain corresponding splitting information; based on the operation information format, a processing method for obtaining the table operation information corresponding to the table operation request data from the splitting information is used, without the user providing data in the operation information format, and the table operation information can be automatically and accurately obtained from the data provided by the user, which can effectively improve the intelligence, reliability and effectiveness of the HBase table data processing process, thereby further improving the convenience and user experience of the user operation of HBase table data.

[0162] In another embodiment, the HBase table data processing device may be configured separately from the central processing unit 9100. For example, the HBase table data processing device may be configured as a chip connected to the central processing unit 9100, and the HBase table data processing function may be implemented under the control of the central processing unit.

[0163] like Fig.11 As shown, the electronic device 9600 may also include: a communication module 9110, an input unit 9120, an audio processor 9130, a display 9160, and a power supply 9170. It is worth noting that the electronic device 9600 does not necessarily have to include Fig.11 In addition, the electronic device 9600 may also include Fig.11 For components not shown, reference may be made to the prior art.

[0164] like Fig.11 As shown, the central processing unit 9100 is sometimes also referred to as a controller or an operation control, and may include a microprocessor or other processor device and / or logic device. The central processing unit 9100 receives input and controls the operation of various components of the electronic device 9600.

[0165] The memory 9140 may be, for example, one or more of a cache, a flash memory, a hard drive, a removable medium, a volatile memory, a non-volatile memory or other suitable devices. The above-mentioned information related to the failure may be stored, and a program for executing the relevant information may also be stored. The CPU 9100 may execute the program stored in the memory 9140 to implement information storage or processing, etc.

[0166] The input unit 9120 provides input to the central processing unit 9100. The input unit 9120 is, for example, a key or a touch input device. The power supply 9170 is used to provide power to the electronic device 9600. The display 9160 is used to display display objects such as images and texts. The display may be, for example, an LCD display, but is not limited thereto.

[0167] The memory 9140 may be a solid-state memory, such as a read-only memory (ROM), a random access memory (RAM), a SIM card, etc. It may also be a memory that saves information even when the power is off, can be selectively erased, and is provided with more data, examples of which are sometimes referred to as EPROMs, etc. The memory 9140 may also be some other type of device. The memory 9140 includes a buffer memory 9141 (sometimes referred to as a buffer). The memory 9140 may include an application / function storage unit 9142, which is used to store application programs and function programs or processes for executing the operation of the electronic device 9600 through the central processor 9100.

[0168] The memory 9140 may also include a data storage unit 9143 for storing data, such as contacts, digital data, pictures, sounds, and / or any other data used by the electronic device. The driver storage unit 9144 of the memory 9140 may include various drivers for communication functions of the electronic device and / or for executing other functions of the electronic device (such as messaging applications, address book applications, etc.).

[0169] The communication module 9110 is a transmitter / receiver 9110 that sends and receives signals via an antenna 9111. The communication module (transmitter / receiver) 9110 is coupled to the central processor 9100 to provide input signals and receive output signals, which may be the same as the case of a conventional mobile communication terminal.

[0170] Based on different communication technologies, multiple communication modules 9110 may be provided in the same electronic device, such as a cellular network module, a Bluetooth module and / or a wireless LAN module, etc. The communication module (transmitter / receiver) 9110 is also coupled to a speaker 9131 and a microphone 9132 via an audio processor 9130 to provide an audio output via the speaker 9131 and receive an audio input from the microphone 9132, thereby realizing a common telecommunication function. The audio processor 9130 may include any suitable buffer, decoder, amplifier, etc. In addition, the audio processor 9130 is also coupled to the central processor 9100, so that recording can be performed on the local machine through the microphone 9132, and the sound stored on the local machine can be played through the speaker 9131.

[0171] The embodiments of the present application also provide a computer-readable storage medium capable of implementing all the steps in the HBase table data processing method in the above embodiments. The computer-readable storage medium stores a computer program. When the computer program is executed by a processor, all the steps in the HBase table data processing method in the above embodiments are implemented by the execution subject being a server or a client. For example, when the processor executes the computer program, the following steps are implemented:

[0172] Step 100: If it is determined that the table operation request data for the HBase cluster does not conform to a preset operation information format, data splitting processing is performed on the table operation request data to obtain corresponding splitting information.

[0173] In step 100, the HBase table data processing device can receive table operation requests for the HBase cluster respectively sent by the client devices held by each user, and obtain the corresponding table operation request data from these table operation requests respectively. Then, the preset operation information format is retrieved, and it is determined whether the table operation request data corresponding to each received table operation request conforms to the preset operation information format. If so, it means that the user has entered the table operation information according to the preset operation information format. If not, it means that the information provided by the user is custom data, so it is necessary to convert the custom data into data that conforms to the operation information format, that is, the table operation request data is split and processed to obtain the corresponding split information.

[0174] It is understandable that, in executing step 100, initialization settings may also be performed first to perform various preparatory work for users to create tables on the HBase cluster. Specifically, the Hadoop client may be installed on the server and Hadoop cluster authentication information may be configured, including: keytab files for authentication of each user in the cluster and cluster configuration files (for example: core-site.xml, HBase-site.xml, hdfs-site.xml, jaas.conf, krb5.conf, etc.), etc., for subsequent login operations to the HBase cluster.

[0175] Step 200: Based on the operation information format, obtain the table operation information corresponding to the table operation request data from the split information.

[0176] In step 200, the corresponding split information obtained by performing data splitting processing on the table operation request data may contain multiple information, some of which are not required for HBase table data processing. Therefore, it is necessary to obtain the information corresponding to the table operation request data from these split information, and arrange this information according to the operation information format to facilitate format unification and / or data storage.

[0177] Step 300: Perform table data processing in the HBase cluster according to the table operation information.

[0178] In step 300, a preset execution code (eg, Java code) may be automatically updated according to the table operation information, and the updated execution code may be triggered to execute to implement the table operation information corresponding to the table operation request data for the HBase cluster.

[0179] From the above description, it can be seen that the computer-readable storage medium provided in the embodiment of the present application can effectively improve the convenience of user operation of tables in the HBase cluster by setting the operation information format and performing table data processing in the HBase cluster according to the table operation information. It does not require the operating user to master the usage syntax, and only needs to provide table operation request data, which can effectively lower the operation threshold of HBase table data processing, thereby effectively improving the accuracy of HBase table data processing and reducing operation time, so as to improve the user experience of the operation; at the same time, if it is determined that the table operation request data for the HBase cluster does not conform to the preset operation information format, the table operation request data is subjected to data splitting processing to obtain corresponding splitting information; based on the operation information format, a processing method for obtaining the table operation information corresponding to the table operation request data from the splitting information, without the user providing data in the operation information format, can also automatically and accurately obtain the table operation information from the data provided by the user, which can effectively improve the intelligence, reliability and effectiveness of the HBase table data processing process, thereby further improving the convenience and user experience of the user operation of HBase table data.

[0180] It should be understood by those skilled in the art that the embodiments of the present invention may be provided as methods, devices, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes. The present invention is described with reference to the flowcharts and / or block diagrams of the methods, devices (devices), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, may be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the functions in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing device to work in a specific way, so that the instructions stored in the computer-readable memory produce a product including an instruction device, which implements the functions specified in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0181] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0182] The present invention uses specific embodiments to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. A method for processing HBase table data, characterized in that: include: If it is determined that the table operation request data for the HBase cluster does not conform to the preset operation information format, the table operation request data is subjected to data splitting processing to obtain corresponding split information, wherein the operation information format is the storage format of the preset operation information table, and the operation information table is used to store the corresponding relationship between the operation user identifier, the operation table name, the table operation type and the operation parameters; Based on the operation information format, obtaining form operation information corresponding to the form operation request data from the split information, the form operation information including: an operation user identifier, an operation table name, and a form operation type, the form operation type including: any one of creating a table, clearing table data, and deleting a table, wherein if the table operation type is the create table, the table operation information further includes: an operation parameter; Performing table data processing in the HBase cluster according to the table operation information; The performing table data processing in the HBase cluster according to the table operation information includes: If the table operation type is to create a table, then obtain corresponding operation parameters from the table operation information; Based on the operation parameters, calling the execution code of adding the table creation command and the table operation information in the HBase cluster to create a table; If the table operation type is to clear table data or delete a table, determine the target user authority information corresponding to the operation user identifier in the table operation information from a pre-stored authority configuration table, wherein the authority configuration table is used to store the correspondence between each operation user identifier and each type of user authority information; Determine whether the table operation type corresponding to the table operation information has operation permission according to the target user's permission information. If so, call the table data cleanup command and the execution code of the table operation information in the HBase cluster based on the table operation type to clean up the table data, or call the table deletion command and the execution code of the table operation information in the HBase cluster based on the table operation type to delete the table.

2. The HBase table data processing method according to claim 1, characterized in that: Before performing table data processing in the HBase cluster according to the table operation information, the method further includes: If it is determined that the table operation request data for the HBase cluster conforms to a preset operation information format, the table operation information corresponding to the table operation request data is extracted.

3. The HBase table data processing method according to claim 1, characterized in that: The performing data splitting processing on the table operation request data to obtain corresponding splitting information includes: Preprocessing the form operation request data to obtain preprocessed form operation request data; Based on the preset word segmentation method, the preprocessed table operation request data is split and processed to obtain corresponding split information.

4. The HBase table data processing method according to claim 1, characterized in that: Before performing table data processing in the HBase cluster according to the table operation information, the method further includes: storing the table operation information corresponding to the table operation request data into the operation information table; Correspondingly, performing table data processing in the HBase cluster according to the table operation information includes: Periodically extracting table operation information corresponding to newly added table operation request data for the HBase cluster from the operation information table; Acquire a corresponding table operation type from the table operation information; Table data processing is performed in the HBase cluster according to the table operation type.

5. The HBase table data processing method according to claim 1, characterized in that: Also includes: Scan each data table in the HBase cluster and the corresponding user authority information regularly, and update the authority configuration table based on the scanned user authority information.

6. An HBase table data processing device, characterized in that: include: A data splitting module is used to perform data splitting processing on the table operation request data for the HBase cluster if it is determined that the table operation request data does not conform to a preset operation information format, and obtain corresponding splitting information. The operation information format is a storage format of a preset operation information table, and the operation information table is used to store the corresponding relationship between the operation user identifier, the operation table name, the table operation type and the operation parameters; an information acquisition module, configured to acquire, based on the operation information format, form operation information corresponding to the form operation request data from the split information, the form operation information including: an operation user identifier, an operation table name, and a form operation type, the form operation type including: any one of creating a table, clearing table data, and deleting a table, wherein if the table operation type is the create table, the table operation information further includes: an operation parameter; A table processing module, used for processing table data in the HBase cluster according to the table operation information; The performing table data processing in the HBase cluster according to the table operation information includes: If the table operation type is to create a table, then obtain corresponding operation parameters from the table operation information; Based on the operation parameters, calling the execution code of adding the table creation command and the table operation information in the HBase cluster to create a table; If the table operation type is to clear table data or delete a table, determine the target user authority information corresponding to the operation user identifier in the table operation information from a pre-stored authority configuration table, wherein the authority configuration table is used to store the correspondence between each operation user identifier and each type of user authority information; Determine whether the table operation type corresponding to the table operation information has operation permission according to the target user's permission information. If so, call the table data cleanup command and the execution code of the table operation information in the HBase cluster based on the table operation type to clean up the table data, or call the table deletion command and the execution code of the table operation information in the HBase cluster based on the table operation type to delete the table.

7. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the HBase table data processing method according to any one of claims 1 to 5 is implemented.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the HBase table data processing method according to any one of claims 1 to 5 is implemented.

9. A computer program product comprising a computer program / instructions, characterized in that When the computer program / instructions are executed by a processor, the HBase table data processing method according to any one of claims 1 to 5 is implemented.