Browser-Based WebAssembly Frame Extraction for Faster Video Covers

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing browsers cannot perform frame extraction operations on videos of various encoding formats, leading to inefficient server resource consumption and prolonged processing times for generating video covers.

Innovation Solution

Implementing a WebAssembly video parser in the browser to extract frames from local video files, allowing independent frame extraction without server involvement, supporting multiple encoding formats and reducing server load.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If server performs frame extraction operation, then video cover can be generated, but server resource consumption increases severely

Engineering Contradiction:

Improvevideo cover generation capabilityVSAvoidserver resource consumption

Core Design Contradiction:

ProductivityVSUse of energy by stationary object

Solution Approach 1:

The browser performs frame extraction locally using WebAssembly video parser, making the system self-sufficient without requiring server resources for this operation. The user's browser independently processes the video file to extract frames and generate covers.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent replaces the traditional server-based mechanical processing system with a browser-based WebAssembly system. This substitution moves the frame extraction computation from server infrastructure to the user's browser environment, eliminating the need for server resources.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If existing browser performs frame extraction, then video cover can be generated, but processing time is prolonged

Engineering Contradiction:

Improvevideo cover generation capabilityVSAvoidprocessing time

Core Design Contradiction:

ProductivityVSLoss of time

Solution Approach 1:

The WebAssembly video parser is pre-compiled and loaded into the browser before actual frame extraction is needed. This preliminary preparation allows for rapid frame extraction processing without time-consuming compilation or initialization delays during the actual video cover generation task.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent changes the execution environment parameter from traditional JavaScript to WebAssembly, which provides superior computational performance. This parameter change enables faster frame extraction processing while maintaining the same functional output.

Inventive Principle:

Principle #35Parameter changes

3Adaptability or versatility

If browser supports multiple video encoding formats, then frame extraction capability improves, but browser complexity increases

Engineering Contradiction:

Improvevideo encoding format supportVSAvoidbrowser structure complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The WebAssembly video parser is designed as a universal solution that can handle multiple video encoding formats through a single integrated framework. This multi-functional approach allows the browser to support various formats without requiring separate processing mechanisms for each format.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

WebAssembly acts as an intermediary layer between the browser and video files of different encoding formats. This intermediary provides a standardized interface that translates and processes various video formats uniformly, simplifying the browser's internal complexity while maintaining broad compatibility.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS12361712B2Browser-based frame extraction method and system

Publication Date: 2025.07.15 SHANGHAI BILIBILI TECH CO LTD

AI summary

Embodiments of the present application provide a browser-based frame extraction method. The method includes: monitoring a target operation of a user on a target page of a browser; obtaining a local video file associated with the target operation; and extracting a plurality of target frames from the local video file using a WebAssembly video parser in the browser. This disclosure enables a browser to independently complete operations such as frame extraction on videos in various encoding formats so as to reduce server load.