Security Data Application for Distributed Dataset Access Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In distributed computing systems, fine-grained data security and access control are challenging to enforce, as data processing applications often bypass data access rules, leading to unauthorized data access and increased network traffic.

Innovation Solution

Implementing a security data application within the distributed execution framework that modifies data access requests based on user-specific policies, using a policy engine to enforce access control and ensure only authorized data is retrieved from distributed databases or file systems, thereby overriding direct data access methods and reducing the need for user permission checks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If data processing applications directly access distributed file systems or databases, then data access speed is improved, but data security and access control are compromised

Engineering Contradiction:
Improvedata access speedVSAvoiddata security
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

The patent introduces a security data application as an intermediary component between data processing applications and distributed file systems/databases. This security layer intercepts data access requests, modifies them according to user-specific policies retrieved from a policy engine, and enforces access control rules before data retrieval, thereby maintaining both access speed and security through a mediating security enforcement point.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If fine-grained access control policies are enforced at the distributed computing level, then data security is improved, but system complexity increases

Engineering Contradiction:
Improvedata securityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The security data application serves multiple functions: it acts as a policy enforcement point, a request modification engine, and an interface between data processing applications and distributed storage systems. By consolidating these security-related functions into a single multi-functional component, the patent reduces overall system complexity while maintaining fine-grained access control capabilities.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Loss of energy

If data access requests are modified based on user policies before retrieval, then network traffic is reduced, but processing time increases

Engineering Contradiction:
Improvenetwork trafficVSAvoidprocessing time
Core Design Contradiction:
Loss of energyVSLoss of time

Solution Approach 1:

The security data application performs preliminary modification of data access requests based on user policies before the actual data retrieval occurs. By pre-filtering and modifying requests according to access control rules, the system reduces the volume of data that needs to be transferred over the network and processed downstream, thereby reducing network traffic and energy consumption while the processing overhead is minimized through efficient policy evaluation.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11790099B1Policy enforcement for dataset access in distributed computing environment
Publication Date: 2023.10.17 MICROSOFT TECHNOLOGY LICENSING LLC
  • US11790099B1 patent drawing
  • US11790099B1 patent drawing
  • US11790099B1 patent drawing

AI summary

Techniques for improving data security and access control at the distributed execution level of distributed computing systems are provided. The techniques can include receiving a data access request from a data processing application to access data, directing the data access request to a security data application, modifying the data access request, executing the modified data access request to obtain data that is responsive to the modified data access request, and providing the obtained data to the data processing application.