Cluster data loading tool for supporting rapid anticipating authority and method

A technology of data loading and permissions, applied in the field of cluster databases, can solve problems such as the inability to prejudge the permissions of loading tools, abnormal exit, and waste of time

Inactive Publication Date: 2017-01-25
TIANJIN NANKAI UNIV GENERAL DATA TECH
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The loading tool used at this stage cannot pre-judge whether the loading tool has the permissions of all the data files to be loaded, which often results in abnormal exits due to lack of permissions when reading data. Such loading failures will waste a lot of time
On the other hand, in the data files to be loaded, some files may have the same permission information. If the permission of one of the files can be predicted, the permission judgment results of all these files can be known, but at this stage there is no It is not possible to do this

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cluster data loading tool for supporting rapid anticipating authority and method
  • Cluster data loading tool for supporting rapid anticipating authority and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0030] Embodiment: An embodiment of the present invention is a data loading process with permission check including four data files to be loaded: file 1 to be loaded, file1, the owner is lee, the group is admin, and the permission configuration is 700; to be loaded File 2, file2, owner is zxm, group is manager, permission configuration is 660; file 3 to be loaded, file3, owner is lee, group is admin, permission configuration is 700; file 4 to be loaded, file1, owner is zxm, the group is admin, and the permission configuration is 700. The loading and running process is as follows:

[0031] 1. Start the loading tool.

[0032] 2. Get the list of data files to be loaded (file1, file2, file3, file4).

[0033] 3. Predict the permission of file1, access the data source, and the result is permission.

[0034] 4. Predict the permission of file2, access the data source, and the result is permission.

[0035]5. Predict the permission of file3, because it is the same as the permission...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a cluster data loading tool for supporting rapid anticipating authority and a method. The invention aims to provide a cluster data loading tool for supporting rapid anticipating authority and the method. The cluster data loading tool comprises a loading tool using interface, a loading task management module and a loading task executing module. A signal output end of the loading tool using interface is connected with a signal receiving end of the loading task management module, and a signal output end of the loading task management module is connected with a signal receiving end of the loading task executing module; the inner part of the loading task executing module also comprises an authority anticipating module; the signal output end of the authority anticipating module is respectively connected with a file list and an authority information list. The loading tool using interface is used for starting the loading task; the loading task management module is used for storing, maintaining and dispatching all loading tasks received; the loading task executing module is used for executing the specific loading task; the authority anticipating module is used for anticipating the authority of a data file.

Description

technical field [0001] The invention relates to the field of cluster databases, in particular to a centralized data loading tool and method that supports rapid prejudgment of authority. Background technique [0002] The cluster database uses multiple ordinary servers to provide high-performance database services, and is suitable for the storage, query and analysis of massive data. Because it is suitable for big data occasions, it needs to cooperate with high-performance data loading tools, which are responsible for reading data from various data sources and loading them into the cluster database. In practical applications, due to information security considerations, data sources often have a permission checking mechanism. If the loading tool does not have sufficient permissions to the data file to be loaded, it cannot read the data to be loaded, and will report an error, or even exit abnormally. If several data files are to be loaded, the loading tool may report an error a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & AuthorityApplications(China)
IPC IPC(8): G06F21/62G06F21/60
CPCG06F21/6227G06F21/604
Inventor赵伟武新杨丽莹
OwnerTIANJIN NANKAI UNIV GENERAL DATA TECH