Live Stream Sampling Method Using Forward Similar Image Screening

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current live streaming sampling methods face challenges with high data volume and leakage conditions due to high or low Frames Per Second (FPS) rates, leading to inefficiencies and increased workload in content regulation checks.

Innovation Solution

A live streaming sampling method that extracts multi-frame sampled images, screens out forward similar images by computing hash codes, and retains the rest as sampled images, effectively eliminating similar frames to reduce data volume and workload.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If uniform sampling with high FPS is used, then sampling coverage is improved, but data volume increases causing pressure on checking

Engineering Contradiction:
Improvesampling coverageVSAvoiddata volume
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent extracts and removes duplicate frames from the sampled video stream by comparing each frame with previously sampled frames. When a duplicate frame is detected (through hash code comparison), it is excluded from the sampled output. This extraction principle reduces the quantity of sampled data while maintaining comprehensive coverage of unique content moments.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent changes the sampling parameter from fixed FPS to dynamic sampling based on frame uniqueness. Instead of sampling at a constant rate, the system adjusts sampling decisions based on whether each frame contains new information compared to previous frames, thereby reducing overall data volume while preserving sampling coverage.

Inventive Principle:
Principle #35Parameter changes

2Quantity of substance

If uniform sampling with low FPS is used, then data volume is reduced, but leakage conditions increase

Engineering Contradiction:
Improvedata volumeVSAvoidleakage conditions
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The patent extracts duplicate frames from the video stream and removes them from the sampled output. By identifying and eliminating redundant frames through hash code comparison, the system reduces data volume while ensuring that each unique frame is captured, thereby preventing leakage conditions without requiring low FPS sampling.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent performs preliminary sampling at a relatively high FPS to capture all potential frames, then subsequently removes duplicates in a second processing stage. This preliminary comprehensive sampling ensures no leakage occurs, while the subsequent deduplication step reduces the final data volume to manageable levels.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If high FPS sampling is used, then sampling coverage is improved, but checking workload increases

Engineering Contradiction:
Improvesampling coverageVSAvoidchecking workload
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent extracts and removes duplicate frames from the sampled sequence by comparing each frame with previously kept frames. This extraction of redundant data significantly reduces the number of frames that require manual or automated checking, thereby reducing checking workload while maintaining comprehensive sampling coverage of unique content.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent performs preliminary automatic deduplication processing on the sampled frames before they enter the checking workflow. By automatically removing duplicate frames in advance, the system reduces the volume of data that requires human checking effort, thereby improving productivity in the content review process.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12020482B2Live streaming sampling method and apparatus, and electronic device
Publication Date: 2024.06.25 DOUYIN VISION CO LTD
  • US12020482B2 patent drawing
  • US12020482B2 patent drawing
  • US12020482B2 patent drawing

AI summary

An embodiment of the disclosure provides a live steam sampling method and device and electronic equipment, which belong to the technical field of image processing. The method comprises: extracting multi-frame sampled images from live stream; screening out forward similar images from all sampled images, wherein the forward similar images are sampled images similar to a sampled image of a previous adjacent frame; and taking the rest of the sampled images, except from the forward similar images, in all sampled images as sampled images of the live stream. According to the solution of the disclosure, a solution of effectively eliminating the forward similar images in sampling operation based on a FPS is realized, thereby avoiding the leakage conditions, reducing total workload of sampling and checking, and improving efficiency of live stream sampling.