A spark query method and system supporting trusted computing

一种可信计算、查询方法的技术，应用在支持可信计算的spark查询方法及系统领域，能够解决算子安全性没有任何保证、无法保证计算安全性等问题，达到实现安全性的效果

Active Publication Date: 2019-02-01
BAIDU ONLINE NETWORK TECH (BEIJIBG) CO LTD
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, in the existing technology, there is no guarantee for the security of the underlying operators in the spark query. During the running process, the data in the calculation can be obtained by dumping the memory (obtaining the memory image), and the security of the calculation cannot be guaranteed.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A spark query method and system supporting trusted computing
  • A spark query method and system supporting trusted computing
  • A spark query method and system supporting trusted computing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049] In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application.

[0050] figure 1 It is a flow chart of the spark query method based on trusted computing in the present invention, such as figure 1 shown, including the following steps:

[0051] Step S11, receiving the SQL query statement input by the user;

[0052] Step S12, analyzing the SQL query statement, analyzing the logical plan, optimizing the logical plan, and ge...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a spark inquiry method and a system supporting trusted calculation. The method comprises steps of receiving an SQL query sentence input by a user; Parsing the SQL query sentence, analyzing the logical plan, optimizing the logical plan and generating the physical plan; The operator in the physical plan is reimplemented by adopting the SGX API to generate an execution code; The enc lave trusted environment is invoked to implement trusted computation of the operator, and the execution code is executed. The invention ensures the safety of the data in the calculation processwhile processing the query request in parallel through the spark structure. Moreover, the spark interface provides users with more user-friendly services.

Description

【Technical field】 [0001] The invention relates to computer application technology, in particular to a spark query method and system supporting trusted computing. 【Background technique】 [0002] In recent years, with the popularization and application of the Internet, the Internet of Things, and smart terminal devices, data is generated faster and larger, and in order to provide TB-level big data queries, the spark architecture is mainly used to Process data in parallel at scale. Among them, Spark is a general parallel framework of Hadoop MapReduce open sourced by the AMP Laboratory of the University of California, Berkeley. [0003] However, in the existing technology, there is no guarantee for the security of the underlying operators in the spark query. During the running process, the data in the calculation can be obtained by dumping the memory (obtaining the memory image), and the security of the calculation cannot be guaranteed. 【Content of invention】 [0004] Variou...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/242G06F16/2453
CPCG06F21/123G06F21/53G06F21/57G06F21/76G06F16/2471G06F16/27G06F21/6227G06F16/2448G06F16/24545G06F16/252
Inventor 冯智张宇段然
Owner BAIDU ONLINE NETWORK TECH (BEIJIBG) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap