Video Clip Extraction via Siamese Scoring Model

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for extracting video clips are hindered by noisy data and complex network structures, leading to inaccurate and time-consuming model training, which affects user experience and increases training costs.

Innovation Solution

A method involving a pre-trained scoring model that splits videos into clips based on labeled data pairs with target attributes, using a siamese network with multi-layer perceptron models to quickly identify target clips, reducing the need for complex network structures and improving data quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a complex network structure is used to improve the accuracy of clip selection, then the accuracy of clip extraction is improved, but the training time and training cost increase significantly

Engineering Contradiction:
Improveaccuracy of clip selectionVSAvoidtraining time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-labeling video clips with target attributes (such as highlight, ordinary, or transition clips) before training the model. This preprocessing step creates clean, structured data pairs that guide the model training process, allowing the model to learn effective clip selection without requiring complex network structures or extensive training time. The labeled data pairs are prepared in advance to reflect user preferences, enabling the model to quickly converge to accurate clip extraction performance.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If a complex network structure is used to handle noisy data, then the accuracy of clip selection is improved, but the device complexity and training difficulty increase

Engineering Contradiction:
Improveaccuracy of clip selectionVSAvoidnetwork structure complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts and removes the noisy data from the training process by using pre-labeled clips with target attributes. Instead of attempting to handle noisy data through complex network structures, the solution extracts clean, labeled data pairs that directly represent the desired clip selection criteria. This extraction of clean data eliminates the need for complex noise-handling mechanisms while maintaining high accuracy in clip selection.

Inventive Principle:
Principle #2Taking out (Extraction)

3Measurement precision

If more data is collected to improve model training, then the model accuracy is improved, but the data quality decreases due to noisy data

Engineering Contradiction:
Improvemodel accuracyVSAvoiddata quality
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent applies local quality by differentiating between different types of clips and assigning specific target attributes to each type. Instead of treating all video data uniformly, the solution labels clips locally with specific attributes (highlight, ordinary, transition) based on their characteristics. This localized quality assignment ensures that only relevant, high-quality labeled data is used for training specific clip types, improving both model accuracy and data quality by avoiding the dilution effect of noisy, unlabeled data.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11847818B2Method for extracting video clip, device for extracting video clip, and storage medium
Publication Date: 2023.12.19 BEIJING XIAOMI PINECONE ELECTRONICS CO LTD
  • US11847818B2 patent drawing
  • US11847818B2 patent drawing
  • US11847818B2 patent drawing

AI summary

A method for extracting a video clip includes obtaining a video and splitting the video into multiple clips. The multiple clips are input into a pre-trained scoring model, to obtain a score of each of the multiple clips. The scoring model is obtained by training based on data pairs including first clips and second clips, the data pairs including first clips and second clips are obtained based on labeled clips labeled with target attributes, and the target attributes include attributes that characterize clips as target clips or non-target clips. A target clip is extracted from the multiple clips based on the score of each of the multiple clips. An apparatus for extracting a video clip and a computer readable storage medium are also disclosed.