Natural Language Query Processing With Policy-Based Document Filtering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing chat tools require the removal of content from a governed space and consolidation into a single location for analysis, disrupting existing data flows and slowing response times.
Innovation Solution
A system that allows for high-level control over content analysis by separating documents into restricted and accessible subsets, analyzing only the accessible subset to generate responses, thereby preserving computing resources and workflows.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If content is removed from governed space and consolidated into a single location for analysis, then response generation can be performed, but existing data flows are disrupted and response times are slowed
Solution Approach 1:
The patent segments the document collection into multiple subsets based on access policies, allowing the system to process only relevant portions of data rather than consolidating everything into a single location. This enables parallel processing and reduces the time required to analyze all content while maintaining response generation capability.
Solution Approach 2:
The patent introduces an intermediary access control mechanism that filters and selects documents based on user policies before they are processed. This intermediary layer allows the system to maintain existing data flows while selectively accessing only the necessary content for response generation, avoiding the need to disrupt overall data streams.
2Productivity
If all documents are made accessible for analysis, then comprehensive response generation is possible, but computing resources are wasted on restricted content
Solution Approach 1:
The patent divides the document collection into restricted and accessible subsets based on user policies. The system then processes only the accessible subset, significantly reducing computing resource consumption while maintaining the ability to generate comprehensive responses from relevant content.
Solution Approach 2:
The patent applies partial action by processing only the necessary portion of documents (accessible subset) rather than all documents. This selective processing approach reduces computing resource consumption while still providing sufficient information for accurate response generation.
3Reliability
If user policies are enforced on document access, then security and privacy are maintained, but document processing complexity increases
Solution Approach 1:
The patent performs preliminary action by pre-classifying documents into restricted and accessible subsets based on user policies before processing begins. This pre-sorting approach simplifies the actual processing phase, as the system only needs to handle the accessible subset without repeatedly evaluating complex access control rules during processing.
Solution Approach 2:
The patent segments the processing task into two distinct phases: policy evaluation (which determines accessibility) and content processing (which handles only accessible documents). This segmentation reduces overall processing complexity by separating the complex access control logic from the simpler content processing operations.
Data Source
AI summary
Systems and methods for processing a natural language query. The system includes at least one database storing a plurality of documents; an interface for receiving a natural language query from a user; and one or more processors executing instructions stored on memory and configured to reference at least one policy associated with the user, wherein the at least one policy defines a permission for the user with respect to accessing the plurality of documents, restrict access to a first subset of the plurality of documents based on the policy associated with the user such that only a second subset of the plurality of documents can be referenced to generate a response to the query, and reference the second subset of the plurality of documents to generate the response to the natural language query, wherein the interface is further configured to present the generated response to the user.