Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Big data processing method and system

A big data processing and data technology, applied in the field of big data processing methods and systems, can solve problems such as desensitization and inability to realize data

Inactive Publication Date: 2017-11-24
北京明朝万达科技股份有限公司
View PDF3 Cites 29 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0014] The present invention provides a big data processing method and system to solve the problem that the proxy server in the prior art can only pass on the accessed data but cannot achieve data desensitization

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data processing method and system
  • Big data processing method and system
  • Big data processing method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] In order to make the above objects, features and advantages of the present invention more comprehensible, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0037] refer to figure 2 , shows a flow chart of the steps of an embodiment of a big data processing method of the present invention, which is applied to such as image 3 The database proxy system shown, the database proxy system includes a database proxy module, a data detection module, and a data desensitization module, which may specifically include the following steps:

[0038] Step 101, the database proxy module receives a data access request from an application client, and determines the target data in the target source database and the type of operation on the target data according to the data access request;

[0039] Among them, such as image 3 As shown, when the application client (here is the application query client...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a big data processing method and system. The method is applied in a database agent system which includes a database agent module, a data detection module and a data desensitization module; the method includes the steps that the database agent module receives the data access request of the application client, and determines target data in a target source database and the operation type of the target data according to the data access request; the database agent module conducts operation on the target data according to the operation type, and obtained the operation result returned by the target source database; the data detection module detects the sensitive data of the operation result according to a target detection strategy and determines the sensitive data in the operation result; the data desensitization module desensitizes the sensitive data in the operation result according to the preset desensitization strategy and obtains response data after desensitization; the database agent module returns the response data to the application client. The big data processing method and system can enable the database agent system to conduct data transmission, and achieve the data desensitization of transmitted data at the same time.

Description

technical field [0001] The invention relates to the technical field of big data processing, in particular to a big data processing method and system. Background technique [0002] As the development of big data brings convenience to people's lives, the security of big data has attracted more and more attention. Big data may involve sensitive data, such as: name, ID number, address, phone number, bank account number, email address, city, zip code, password data, organization name, business license number, bank account number, transaction date, transaction amount, etc. [0003] In the current proxy server mechanism of various databases, such as figure 1 As shown, the client application implements the data query of the source database through the proxy server group, wherein the proxy server group only plays the role of data transmission, but cannot desensitize the sensitive data in the source database. [0004] Then, the way of implementing database proxy by integrating prox...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F21/62
CPCG06F21/6245
Inventor 李林喻波王志海董爱华安鹏
Owner 北京明朝万达科技股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com