Board-Writing Video Composition Using Parallel Frame Extraction

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Real-time processing of teaching videos with board-writing data is poor due to complex calculations, leading to video stuttering issues when processing and playing the video.

Innovation Solution

A processing method utilizing two threads to transmit frames and board-writing images between an extraction and composition module, allowing for frame skipping and parallel execution to ensure real-time composited image output without missing board-writing data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the extraction module processes every frame to extract complete board-writing images, then board-writing data completeness is improved, but processing time increases and real-time performance deteriorates

Engineering Contradiction:

Improveboard-writing data completenessVSAvoidreal-time processing performance

Core Design Contradiction:

ReliabilityVSProductivity

Solution Approach 1:

The extraction module does not process every frame continuously, but instead operates periodically by detecting idle states of the composition module and processing frames at appropriate intervals. This periodic action ensures complete board-writing images are extracted when needed while avoiding continuous processing that would degrade real-time performance.

Inventive Principle:

Principle #19Periodic action

Solution Approach 2:

The system dynamically adjusts the extraction module's processing frequency based on the composition module's operational state. When the composition module is idle, the extraction module processes frames to extract complete board-writing images. When the composition module is busy, the extraction module waits, creating a dynamic balance between data completeness and processing speed.

Inventive Principle:

Principle #15Dynamics

2Stability of the object's composition

If the composition module processes every frame to composite board-writing images, then video continuity is improved, but processing delay increases and video stuttering occurs

Engineering Contradiction:

Improvevideo continuityVSAvoidprocessing delay

Core Design Contradiction:

Stability of the object's compositionVSLoss of time

Solution Approach 1:

The extraction module performs preliminary action by extracting complete board-writing images in advance when the composition module is idle. This preliminary extraction ensures that when the composition module needs to process frames, the board-writing images are ready, reducing processing delay and preventing video stuttering while maintaining video continuity.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system maintains continuity of useful action by ensuring the composition module receives complete board-writing images at appropriate intervals. The extraction module's periodic operation ensures that the composition module can continuously process frames without interruption or delay, maintaining smooth video output without stuttering.

Inventive Principle:

Principle #20Continuity of useful action

3Reliability

If the extraction module operates continuously to extract board-writing images, then data completeness is improved, but system resource consumption increases

Engineering Contradiction:

Improveboard-writing data completenessVSAvoidsystem resource consumption

Core Design Contradiction:

ReliabilityVSUse of energy by moving object

Solution Approach 1:

The extraction module operates periodically rather than continuously, activating only when the composition module is in an idle state. This periodic operation maintains board-writing data completeness by extracting images at appropriate intervals while significantly reducing system resource consumption compared to continuous processing.

Inventive Principle:

Principle #19Periodic action

Solution Approach 2:

The extraction module's operation is self-regulated by detecting the composition module's idle state. When the composition module is idle, the extraction module automatically processes frames to extract complete board-writing images. This self-service mechanism ensures data completeness is maintained only when necessary, optimizing resource consumption.

Inventive Principle:

Principle #25Self-service

Data Source

PatentUS12542861B2Processing method for board-writing display and related apparatus

Publication Date: 2026.02.03 BEIJING ESWIN COMPUTING TECH CO LTD

AI summary

Disclosed is a processing method for board-writing display and a related apparatus. The processing method includes: outputting a composited image frame of a current frame according to the current frame and a complete board-writing image most recently outputted by an extraction module transmitted by a first thread; transmitting, in a case that the extraction module is in an idle state, a previous frame and the current frame to the extraction module by a second thread, to output a complete board-writing image again; determining, in a case that the current frame is not a last frame, a next frame of the current frame as a next current frame by the first thread, and returning to perform above steps. Thus, technical problem of poor real-time video processing performance is solved, effectively avoiding video stuttering in an application which performs video processing while playing a video.