Board Writing Display Occlusion Handling via Image Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In teaching videos, when a teacher occludes the writing board, the board-writing data is not completely presented, leading to incomplete understanding of the educational content.
Innovation Solution
A processing device comprising an extraction unit to extract complete and occluded board-writing images, a supplement unit to determine and replace occlusion areas with corresponding areas from the complete image, and an output unit to generate an output image frame with transparentized board writing content, ensuring complete presentation of board-writing data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the teacher occludes the writing board while teaching, then the teaching video captures the teacher's actions and expressions, but the board-writing data becomes incomplete and cannot be fully presented
Solution Approach 1:
The system extracts board-writing images in advance from video frames and stores them. When occlusion is detected, the pre-extracted complete board-writing images are used to supplement the occluded areas, eliminating the need for real-time extraction during occlusion events.
Solution Approach 2:
The system creates copies of board-writing images from different time points and uses these copies to replace occluded portions. The extraction unit obtains multiple board-writing images, and the supplement unit selects appropriate copies to fill in missing data, ensuring complete information presentation.
2Loss of information
If the system extracts and processes board-writing images to ensure complete data presentation, then the completeness of board-writing data is improved, but the processing complexity and computational resources increase
Solution Approach 1:
The extraction unit separates board-writing images from the original video frames by detecting the writing board area and extracting only the relevant content. This extraction process isolates the essential information (board-writing data) from the complex video stream, reducing subsequent processing complexity.
Solution Approach 2:
The system segments the video content into distinct components: the writing board area and the surrounding area. By dividing the image processing task into segmentation (identifying board boundaries) and extraction (obtaining board-writing content), the system manages complexity through modular processing steps.
3Loss of information
If the system replaces occlusion areas with corresponding areas from previous frames, then the completeness of board-writing data is improved, but the temporal consistency and accuracy may be reduced
Solution Approach 1:
The supplement unit performs partial replacement, substituting only the occluded portions of the board-writing image while leaving the non-occluded areas unchanged. This selective approach ensures that accurate, up-to-date information is preserved where available, while only supplementing the specific missing areas, thus maintaining overall accuracy.
Solution Approach 2:
The system extracts and stores multiple board-writing images in advance from different time points. When occlusion occurs, it selects from these pre-extracted images rather than relying solely on temporal interpolation, improving accuracy by choosing the most appropriate historical frame that matches the current teaching context.
Data Source
AI summary
Disclosed is a processing device, a system, a method for board writing display. The processing device comprises: an extraction unit to extract a first board-writing image from a first image frame in a video and a second board-writing image from a second image frame in the video; a supplement unit to determine an occlusion area of the second board-writing image based on a target object segmentation image of the second image frame, and replace the occlusion area of the second board-writing image with a corresponding area of the first board-writing image to obtain a third board-writing image; an output unit to generate an output image frame based on the second image frame and the third board-writing image, the output image frame presents an image with a target object located behind a transparentized board writing content. The present disclosure enables the board-writing data in the video to be presented completely.