Virtual Sandbox Database for Secure Big Data Access Testing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data access systems for large-scale data processing environments with multiple application and storage services are inefficient and cumbersome, requiring manual rebuilding of applications on different services and lacking effective access control, especially for sensitive data, which complicates data security and usability.
Innovation Solution
A virtual sandbox database system that allows users to access a virtual version of datasets with controlled access policies, enabling selective data viewing and manipulation within a sandbox environment, anonymizing sensitive information and providing tools similar to the actual database.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If users access large datasets directly from the database for experimentation and testing, then data usability and productivity are improved, but data security and risk mitigation deteriorate
Solution Approach 1:
A sandbox environment is introduced as an intermediary layer between users and the actual database. This sandbox provides a virtualized isolation environment where users can access and experiment with data copies or subsets without direct access to the production database, thereby maintaining productivity while mitigating security risks through environmental isolation.
Solution Approach 2:
Instead of providing direct access to the original dataset, the system creates and provides access to copies or virtual representations of the data within the sandbox environment. Users can perform experiments and testing on these copies, which eliminates the risk of accidental modification or exposure of sensitive information while maintaining full data usability.
2Ease of operation
If the system provides full access to all datasets for all users, then data usability is improved, but access control complexity and security management deteriorate
Solution Approach 1:
The system segments data access into different levels: full access within the sandbox environment for authorized operations, and controlled access to the actual database. This segmentation allows users to operate freely within the sandbox while the system manages database access controls centrally, reducing the complexity of permission management across diverse user needs.
Solution Approach 2:
The sandbox environment serves as a universal platform that provides standardized data access and experimentation capabilities to all users regardless of their specific roles or requirements. This multi-functional sandbox approach simplifies access control by providing a single, standardized interface for safe data interaction across the entire user base.
3Adaptability or versatility
If multiple application services operate on different deployment parameters, then service adaptability is improved, but manual configuration time and deployment complexity deteriorate
Solution Approach 1:
The system implements self-service capabilities where application services automatically adapt to different deployment environments and parameters without requiring manual reconfiguration. The sandbox environment and data access layer are designed to be automatically configurable, allowing services to deploy across diverse environments while maintaining compatibility and reducing manual intervention time.
Data Source
AI summary
Various embodiments of the present technology generally relate to management of big data storage and data access control systems. In some embodiments, a data access system for use in multiple application service and multiple storage service environments comprises a sandbox database for users, wherein the sandbox database is a virtual database environment via which a user may access datasets according to one or more access policies. In some embodiments, the data access system receives a user request to access a dataset stored in a database into the sandbox environment, wherein the database is associated with the data access system. In response to the request, the data access system may retrieve the corresponding data from the database, determine any associated sandbox access policies, and generate an anonymized data table in the sandbox environment.