Storage Controller Entropy Analysis for Video Playback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Surveillance systems face inefficiencies in searching for video frames of interest within stored video data, as they typically require retrieving and analyzing the entire video stream, leading to substantial workload and unnecessary data transfer.

Innovation Solution

A storage system with a controller that identifies and sends only frames with significant entropy changes, creating an 'album' of frames of interest, which can be requested by the host for quick playback, minimizing data transfer and optimizing playback analysis.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If the host retrieves the entire stored video from the storage system for search, then complete video data is available for analysis, but data transfer volume and processing workload increase substantially

Engineering Contradiction:
Improvecompleteness of video data for analysisVSAvoidvolume of data transfer
Core Design Contradiction:
Loss of informationVSQuantity of substance

Solution Approach 1:

The storage system extracts and identifies only the key frames (I-frames) from the video stream using entropy analysis, sending only these extracted frames to the host for analysis. This extraction principle reduces data transfer volume while maintaining the essential information needed for surveillance purposes.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The storage system performs preliminary entropy analysis and frame identification before data transfer. By pre-processing the video stream to identify significant frames and storing metadata about these frames, the system prepares the data in advance, allowing the host to receive only relevant information rather than the entire video stream.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If the host retrieves the entire stored video for search, then all video frames are available for analysis, but processing time and computational workload increase

Engineering Contradiction:
Improveaccuracy of video frame searchVSAvoidtime for video playback and analysis
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system extracts only the significant frames (I-frames with high entropy changes) from the complete video stream. By removing redundant P-frames and B-frames that contain minimal new information, the system reduces the number of frames requiring processing while maintaining search accuracy for events of interest.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The storage system performs preliminary entropy analysis to identify and tag key frames before the host receives the data. This pre-processing creates an index of significant frames, allowing the host to jump directly to relevant frames for analysis rather than processing the entire video stream sequentially.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If entropy analysis is performed on all video frames, then all frames of interest are identified, but processing complexity and computational resources increase

Engineering Contradiction:
Improveaccuracy of frame identificationVSAvoidcomplexity of entropy analysis process
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The video stream is segmented into different frame types (I-frames, P-frames, B-frames) based on their structural characteristics. The entropy analysis is applied selectively to I-frames only, which are the key reference frames, rather than analyzing every frame type. This segmentation reduces computational complexity while maintaining identification accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different processing approaches are applied to different parts of the video stream based on local characteristics. I-frames receive full entropy analysis as they contain critical information, while P-frames and B-frames are handled differently or skipped, as they are predictive frames that depend on reference frames. This local quality approach optimizes processing resources.

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach reduces the workload by sending only frames of interest to the host, optimizing playback and analysis, and enabling faster data retrieval and automation in surveillance systems.

Implementation Method 1

The controller is further configured to identify the plurality of frames based on entropy changes in the video data

Methodology Applied
Scientific EffectEntropy change detection:

Data Source

PatentUS11328511B2Storage system and method for improved playback analysis
Publication Date: 2022.05.10 SANDISK TECHNOLOGIES LLC
  • US11328511B2 patent drawing
  • US11328511B2 patent drawing
  • US11328511B2 patent drawing

AI summary

A storage system and method for improved playback analysis are provided. In one embodiment, a storage system is provided comprising a memory and a controller. The controller is configured to identify a plurality of frames in video data stored in the memory that differ from surrounding frames by more than a threshold amount; receive a request from a host for quick playback of the video data; and send the plurality of frames to the host. Other embodiments are provided.