Board-Writing Video Frame Reconstruction for Occlusion-Free Teaching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Video recordings of teaching scenes often result in incomplete presentation of writing board contents due to the teacher obstructing the view, and the bouncing of handwriting edges in consecutive frames affects the clarity and immersion of the content.
Innovation Solution
A method to process video frames by calculating differences between consecutive board writing images, replacing corresponding image blocks, and adjusting the background color of the writing board to create a stable and complete presentation of the writing content, thereby eliminating handwriting bounce and enhancing the visual experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the teacher obstructs the writing board during teaching, then the teaching interaction is enhanced, but the completeness of board writing content presentation deteriorates
Solution Approach 1:
The system performs preliminary actions by detecting and recording the writing board content in advance when not obstructed, then completes the obstructed content by referencing previous frames. This allows the teacher to interact naturally while the system proactively captures and reconstructs the complete board content for presentation.
2Speed
If consecutive video frames are used to present board writing content, then the dynamic teaching process is captured, but handwriting edge bouncing occurs affecting clarity
Solution Approach 1:
The system applies local quality by detecting difference areas between consecutive frames and selectively replacing only those specific regions with corresponding blocks from reference frames. This localized processing stabilizes handwriting edges in the difference areas while preserving the dynamic teaching process in other regions.
Solution Approach 2:
The system creates a stable copy of handwriting content by identifying difference areas and replacing them with corresponding image blocks from reference frames. This copying mechanism eliminates handwriting edge bouncing while maintaining the overall dynamic presentation of the teaching process.
3Adaptability or versatility
If the writing board background color varies in video frames, then the real classroom environment is reflected, but the visual consistency of board content deteriorates
Solution Approach 1:
The system introduces an intermediary processing step that detects the writing board background color in each frame and adjusts it to match a reference color. This intermediary color adjustment mechanism maintains visual consistency of the board content while preserving the authentic classroom environment through selective color normalization.
Data Source
AI summary
A video processing method and related devices are provided. The method includes: acquiring board writing images of consecutive frames from a video with unobstructed board writing; calculating a difference area between the image of a current frame and a reference image; replacing a corresponding image block in the board writing image of the current frame with a corresponding image block in the reference image to obtain a new board writing image for each of the difference area; outputting the new board writing image to form a new video. The board writing image of the current frame are sequentially each board writing image after the board writing image of a first frame in the board writing images of the consecutive frames, and the reference image is the board writing image associated with a previous board writing image.