Backup Snapshot Vector Generation for Non-Disruptive RAG
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing retrieval augmented generation (RAG) systems rely on live enterprise data, which requires significant IT investment and can disrupt the host system, posing risks and complications.
Innovation Solution
A data management system (DMS) uses backup data from snapshots to generate vectors and metadata, storing them in a vector database accessible to communication applications, thereby avoiding system disruption and enabling streamlined, customizable RAG implementations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If RAG systems use live enterprise data, then response accuracy and relevance are improved, but system disruption and IT investment requirements increase
Solution Approach 1:
The patent creates a copy of enterprise data from backup systems rather than accessing live data directly. The DMS generates snapshots of computing systems and creates vector representations from these backup copies, allowing RAG operations to proceed without interfering with the live enterprise systems while maintaining data accuracy for improved response quality.
2Measurement precision
If RAG systems use live enterprise data, then response accuracy is improved, but IT investment and complexity increase
Solution Approach 1:
The patent makes the backup data management system multi-functional by enabling it to serve both its traditional backup/recovery purposes and new RAG functionality. The same DMS infrastructure that manages backups now also generates vectors and populates vector databases for AI applications, eliminating the need for separate dedicated RAG infrastructure and reducing overall IT investment.
Solution Approach 2:
The system enables the backup infrastructure to serve itself by generating vector representations from its own backup data. The DMS automatically processes snapshot data, generates vectors, and maintains vector databases without requiring separate external systems, allowing existing backup investments to directly support RAG capabilities.
3Object-affected harmful factors
If vectors are generated from backup snapshots, then system disruption is minimized, but data freshness may be compromised
Solution Approach 1:
The system implements periodic snapshot creation and vector regeneration to balance data freshness with system stability. By periodically updating snapshots from live systems and regenerating vectors from these updated snapshots, the system maintains relatively current data without requiring continuous live connections that would cause disruption.
Data Source
AI summary
Methods, apparatuses, and computer readable media are configured to perform operations comprising: obtaining, by a data management system (DMS), a first snapshot of a computing system; generating, by the DMS, one or more vectors based at least in part on data from the first snapshot; and adding, by the DMS, the one or more vectors to a vector database along with metadata or a pointer to the metadata, wherein the metadata is associated with the data from the first snapshot, and wherein the vector database comprises a knowledge repository that is accessible to an application associated with the DMS, the application further associated with communication with a large language model (LLM).