DPU Video Data Storage Tiering via Metadata Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current systems lack an efficient method for processing and storing video data across different storage tiers based on its relevance and compliance requirements, leading to inefficiencies in data retrieval and security.
Innovation Solution
A data processing unit (DPU) at an edge device processes video data into chunks and outcomes, generates storage tier metadata, and associates it with the data to determine the appropriate storage tier, ensuring efficient storage and retrieval across primary, secondary, and archival storage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If video data is stored uniformly across storage devices, then storage management is simplified, but storage efficiency and retrieval performance deteriorate due to inability to prioritize relevant data
Solution Approach 1:
The patent segments video data into different storage tiers (hot, warm, cold storage) based on relevance and access patterns. The DPU divides video data into chunks and assigns different storage tier metadata to different segments, enabling differentiated storage management that optimizes both efficiency and complexity.
Solution Approach 2:
The system changes the storage parameter (storage tier) based on video data characteristics such as relevance scores, compliance requirements, and access frequency. The DPU dynamically adjusts storage tier assignments by processing video data and generating appropriate storage tier metadata that reflects current data priorities.
2Speed
If all video data is kept in fast-access storage, then data retrieval speed is improved, but storage cost increases significantly
Solution Approach 1:
The patent applies local quality by assigning different storage qualities to different video data chunks based on their specific characteristics. Highly relevant video data with high retrieval probability is placed in fast-access storage, while less relevant data is stored in slower, more cost-effective storage media.
Solution Approach 2:
The system dynamically changes the storage parameter (access speed vs. cost) based on video data relevance scores and access patterns. The DPU processes video data to determine optimal storage tier assignments, changing storage parameters adaptively rather than using a fixed storage configuration.
3Ease of operation
If video data is processed and stored without metadata classification, then processing complexity is reduced, but data retrieval and compliance management become inefficient
Solution Approach 1:
The patent applies preliminary action by generating storage tier metadata during the initial video data processing stage rather than adding it later. The DPU processes video data and creates appropriate metadata classifications upfront, enabling efficient retrieval and compliance management without significant additional processing complexity.
Solution Approach 2:
The storage tier metadata acts as an intermediary that bridges video data and storage management systems. This metadata layer enables efficient data retrieval and compliance management by providing structured information about data characteristics, access patterns, and storage requirements without requiring complex direct analysis of the video content itself.
Data Source
AI summary
A method for processing video data is performed by a data processing unit (DPU). The method includes obtaining, by the DPU of an edge device, video data; processing the video data to obtain video data chunks and video processing engine outcomes; generating storage tier metadata based on the video data chunks and the video processing engine outcomes; associating the storage tier metadata with the video data chunks; and storing the storage tier metadata and the video data chunks in the appropriate storage based on the storage tier metadata.