A data access method and system

A data access and data access control technology, applied in database management systems, digital data protection, electronic digital data processing, etc., can solve the problems of low processing performance and efficiency, poor flexibility, poor data security, etc., and achieve high data processing performance , Improve the effect of processing unloading and ensuring security

Inactive Publication Date: 2019-01-04
BEIJING YUNXINGYU TRAFFIC SCI & TECH
View PDF2 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, Spark uses Kerberos for authentication and SSL for encryption. In this way, authorization operations can only be performed through HDFS ACL
When applied to a structured schema with columns and rows, data in the same data table may belong to two different groups, each with its own permission requirements, data may also have permission requirements for zone access, time-based availability Access permission requirements, department access permission requirements, etc., but Spark cannot provide such fine-grained permission control, making Spark less secure when fine-grained access to data; and currently Spark does not have a built-in authorization subsystem, if passed If an external system is used to control the authority of fine-grained access to data, the system complexity is high, the flexibility is poor, and the processing performance and efficiency are low, which is not of practical value

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data access method and system
  • A data access method and system
  • A data access method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] Exemplary embodiments of the present invention will now be described with reference to the drawings; however, the present invention may be embodied in many different forms and are not limited to the embodiments described herein, which are provided for the purpose of exhaustively and completely disclosing the present invention. invention and fully convey the scope of the invention to those skilled in the art. The terms used in the exemplary embodiments shown in the drawings do not limit the present invention. In the figures, the same units / elements are given the same reference numerals.

[0045] Unless otherwise specified, the terms (including scientific and technical terms) used herein have the commonly understood meanings to those skilled in the art. In addition, it can be understood that terms defined by commonly used dictionaries should be understood to have consistent meanings in the context of their related fields, and should not be understood as idealized or over...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data access method and a system, which are applied to a Spark, the Spark integrates an LLAP daemon. The method comprises the following steps of: receiving a data query statement; using the Apache Ranger LLAP plug-in, the access control rules stored in the Ranger being obtained; obtaining a data access plan corresponding to the data query statement by using the LLAP daemon; using the LLAP daemon, the data access plan being executed according to the access control rules. A Spark in the invention utilizes an integrated LLAP daemon to read data, and through Apache Rangerto LLAP daemon access rights control, Spark data fine-grained access rights control then can be achieved to protect the security of Spark data fine-grained access.

Description

technical field [0001] The present invention relates to the field of data query mining, and more specifically, to a data access method and system. Background technique [0002] Spark is a Hadoop-like MapReduce general-purpose parallel framework open sourced by UC Berkeley AMP lab (AMP Lab of the University of California, Berkeley), which plays a very important role in general-purpose distributed computing scenarios. [0003] Currently, Spark supports most of the mainstream programming languages ​​on the market, such as Python, Scala, Java and R languages. When Spark is used as a general computing framework, and when Java / Scala / Python is used to express logic services that cannot be encapsulated in SQL statements, it is more suitable to use Spark to execute data queries. However, Spark uses Kerberos for authentication and SSL for encryption. In this way, authorization operations can only be performed through HDFS ACL. When applied to a structured schema with columns and row...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/25G06F21/62
CPCG06F21/6218
Inventor 资明陈日强曹正凤李少丁
Owner BEIJING YUNXINGYU TRAFFIC SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap