Video Moment Detection via Packet Size Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Detecting moments of interest in videos is computationally expensive due to the need to decode video frames, which is resource-intensive and costly in terms of processing time and power.

Innovation Solution

A system that identifies moments within videos by analyzing the sizes of video packets rather than decoding frames, using size criteria to determine sets of packets that indicate moments of interest, allowing for moment detection without frame decoding.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If video frames are decoded and analyzed to detect moments, then moment detection accuracy is improved, but computational cost and processing time increase

Engineering Contradiction:
Improvemoment detection accuracyVSAvoidprocessing efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent extracts and analyzes only the video packet size information without decoding the actual video frames. By taking out just the necessary size metadata from the encoded video stream, the system achieves moment detection without the computational burden of full frame decoding, resolving the contradiction between accuracy and efficiency

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent performs preliminary analysis of video packet sizes during the encoding phase or in advance of moment detection. By pre-computing and storing size information, the system prepares the data needed for moment detection beforehand, enabling fast real-time detection without expensive on-demand decoding

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If video frames are decoded to analyze content, then moment detection capability is improved, but energy consumption increases

Engineering Contradiction:
Improvemoment detection capabilityVSAvoidprocessing power consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system extracts only the essential size information from video packets without performing energy-intensive frame decoding. This selective extraction of minimal necessary data dramatically reduces power consumption while maintaining moment detection capability

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent uses inexpensive size metadata instead of expensive decoded frame data. The size information acts as a cheap proxy that provides sufficient information for moment detection without requiring the high-energy operation of full frame decoding

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Data Source

PatentUS10957359B2Systems and methods for detecting moments within videos
Publication Date: 2021.03.23 GOPRO INC
  • US10957359B2 patent drawing
  • US10957359B2 patent drawing
  • US10957359B2 patent drawing

AI summary

Video information defining video content may be obtained. The video content may include video frames and may have a progress length. The video frames may be encoded into video packets, with the video packets being of particular sizes. One or more size criteria for detecting a given moment within the video content may be obtained. The sizes of the video packets may be compared with the one or more size criteria. One or more sets of the video packets that satisfy the one or more size criteria may be identified. One or more portions of the video content having video frames defined by the set(s) of video packets that satisfy the one or more size criteria may be identified as the given moment within the video content. Storage of the identification of the given moment within the video content in a storage medium may be effectuated.