Webform Crawling System for Data Model Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
There is a growing need for improved systems and methods to manage personal data in compliance with privacy and security policies, as frequent breaches and unauthorized access to sensitive information have become prevalent, and individuals seek tools to minimize data processing by entities they do not actively engage with.
Innovation Solution
A computer-implemented data processing method that modifies a data model by identifying and analyzing webforms to collect personal data, robotically completing them, determining processing activities, and modifying the data inventory and model to include associated data assets, while also managing data assets in a third-party repository with unique subject identifiers and digital storage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If webforms are manually analyzed to map data processing activities, then data model accuracy is improved, but time consumption and operational complexity increase
Solution Approach 1:
The system enables self-service by allowing the data mapping process to occur automatically without manual intervention. The robotic agent autonomously navigates webforms, extracts data elements, and maps them to the data model, eliminating the need for manual analysis while maintaining high accuracy through systematic automated processing
Solution Approach 2:
Manual mechanical analysis of webforms is replaced with an automated robotic system. The robotic agent uses automated navigation and data extraction techniques to perform functions that previously required human operators, substituting mechanical human labor with automated software-based processing
2Reliability
If comprehensive data inventory is maintained across all entities, then data security and compliance monitoring is improved, but system complexity and storage requirements increase
Solution Approach 1:
The comprehensive data inventory system is segmented into entity-specific data models. Each entity maintains its own data model containing only the data elements and processing activities relevant to that entity, rather than a single monolithic inventory. This segmentation reduces system complexity while maintaining security monitoring capability through distributed, modular data models
Solution Approach 2:
The data inventory approach transitions from a centralized flat structure to a multi-dimensional hierarchical structure organized by entities. Data elements are organized across multiple dimensions including entity ownership, processing activity, and data classification, enabling efficient monitoring without requiring complex centralized management
3Ease of operation
If individuals have full visibility and control over all data processing activities, then privacy control is improved, but user interface complexity and retrieval time increase
Solution Approach 1:
The data control interface is segmented into entity-specific views, allowing users to manage data processing activities on an entity-by-entity basis rather than viewing all activities simultaneously. This segmentation makes the interface more manageable and easier to navigate, improving ease of operation while maintaining comprehensive control capability
Solution Approach 2:
The system performs preliminary organization and categorization of data processing activities by entity and type before presenting them to the user. Data elements are pre-grouped and structured in the data model, so users receive organized, filtered information rather than raw unstructured data, reducing retrieval time while maintaining full visibility
Data Source
AI summary
In particular embodiments, a Data Access Webform Crawling System is configured to: (1) identify a webform used to collect one or more pieces of personal data; (2) robotically complete the identified webform; (3) analyze the completed webform to determine one or more processing activities that utilize the one or more pieces of personal data collected by the webform; (4) identify a first data asset in the data model that is associated with the one or more processing activities; (5) modify a data inventory for the first data asset in the data model to include data associated with the webform; and (6) modify the data model to include the modified data inventory for the first data asset.