Document Q&A Retrieval Using Secure Transformed Content
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Organizations face challenges in efficiently navigating large document repositories for user queries due to the lack of a rich natural language interface and data security concerns when storing searchable documents centrally, especially for sensitive information.
Innovation Solution
A document processing system transforms source documents into a document object model (DOM) format, enabling question-and-answer searching with a question-answer cache, and applies Bidirectional Encoder Representations from Transformers (BERT) for accurate and secure document retrieval, using coarse and fine-detail transformations to enhance search speed and security.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If documents are stored in a centralized location for efficient searching, then search speed and accessibility are improved, but data security and privacy are compromised
Solution Approach 1:
The patent segments the document storage system into two parts: transformed content (searchable data) is stored centrally at the service provider's location, while original source documents remain distributed at customer locations. This segmentation allows fast searching of transformed content without compromising security of original documents.
Solution Approach 2:
The patent introduces transformed content as an intermediary between the original documents and the search function. The transformed content serves as a secure proxy that enables searching without exposing sensitive original documents to external systems.
2Ease of operation
If documents are transformed into searchable format, then question-answer searching capability is improved, but processing time and computational resources increase
Solution Approach 1:
The patent applies preliminary action by transforming documents into searchable format in advance, before any search queries are made. The transformation process converts original documents into structured formats with extracted entities, relationships, and concepts, so that when search queries arrive, the system can quickly match against pre-processed data rather than scanning raw documents.
3Measurement precision
If detailed transformations are applied to enhance search accuracy, then measurement precision is improved, but device complexity increases
Solution Approach 1:
The patent segments the transformation process into multiple distinct stages: extraction of entities, relationships, and concepts; conversion to structured data formats; and creation of searchable indexes. Each segment handles a specific aspect of the transformation, making the overall complex process more manageable and maintainable while achieving high search accuracy.
Data Source
AI summary
Disclosed are methods, systems, devices, apparatus, media, design structures, and other implementations, including a method that includes receiving, at a local device from a remote device, query data representative of a question relating to source content of a source document of a repository of a plurality of source documents, with the source content being associated with transformed content accessible from the local device. The method further includes generating, in response to determination, at the local device, of a match between the query data and at least one portion of the transformed content, output data comprising one or more of a pointer to access, in the source document accessible from the remote device, at least one portion of the source document corresponding to the at least one portion of the transformed content, or a copy of the at least one portion of the source document.