Archetype Policy Access Control for Large Datasets

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional data systems face computational inefficiencies and increased processing times when evaluating user access to large datasets due to the need for individual evaluation of access control policies for each record, leading to slower performance and potential inability to execute queries on tables with millions of records.

Innovation Solution

Implementing archetype policies that define logical formulas based on user states and variables, allowing for the generation of filters to identify accessible records, thereby reducing the computational burden and enabling faster access control evaluations without the need for record-specific policies.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If individual access control policies are evaluated for each record in large datasets, then access control precision is maintained, but processing time and computational overhead increase significantly

Engineering Contradiction:
Improveaccess control precisionVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent combines multiple individual access control policies into a single archetype policy that represents a class of similar policies. Instead of evaluating each record against its own unique policy, the system evaluates user access once against the archetype policy, then applies the result to multiple records simultaneously. This merging approach maintains access control precision while dramatically reducing processing time for large datasets.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The archetype policy serves as a universal access control mechanism that can govern multiple records with similar access requirements. Rather than creating specialized policies for each record, the system uses a single multi-functional archetype policy that can be applied across entire datasets or subsets of records, reducing computational overhead while maintaining appropriate access control.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Reliability

If access control policies are applied to every record in a dataset, then security is maintained, but system performance and scalability deteriorate

Engineering Contradiction:
ImprovesecurityVSAvoidsystem performance
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent segments access control policies into hierarchical levels: archetype policies that govern classes of records and more specific policies for individual records when needed. This segmentation allows the system to apply coarse-grained archetype policies to most records for high performance, while maintaining the ability to apply fine-grained control to specific records when security requirements demand it.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system applies access control evaluation partially rather than completely to every record. By using archetype policies, the system performs access control evaluation on a representative subset (the archetype) rather than every individual record, achieving sufficient security coverage with reduced computational effort. This partial action approach maintains security for the majority of records while improving overall system performance.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11914623B2Approaches for managing access control permissions
Publication Date: 2024.02.27 PALANTIR TECHNOLOGIES INC
  • US11914623B2 patent drawing
  • US11914623B2 patent drawing
  • US11914623B2 patent drawing

AI summary

Systems and methods are provided for determining a query involving at least one dataset comprising a plurality of records, the query being submitted by a first user operating a computing device. An archetype policy that governs access to records of the at least one dataset can be determined, wherein the archetype policy includes at least one logical formula to be evaluated when determining whether a requesting user is permitted to access a given record, and wherein the at least one logical formula is satisfied based at least in part on a state associated with the requesting user and at least one first variable evaluated by the at least one logical formula. At least one record that the first user is permitted to access can be determined based at least in part on satisfaction of the at least one logical formula associated with the archetype policy.