Background Image Selection for Occluded Blackboard Content
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing technologies fail to effectively display blackboard content when a lecturer shields it with their body, leading to delayed visibility and hindered understanding during lectures.
Innovation Solution
An image processing apparatus that specifies and outputs background images by analyzing differences in foreground regions across frames, allowing real-time display of hidden blackboard content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If the lecturer writes on the blackboard while staying at the place, then the lecture content can be delivered, but the blackboard content becomes invisible after a while due to the lecturer shielding it
Solution Approach 1:
The system performs preliminary extraction and storage of blackboard content information from video frames before the lecturer's body shields it. By proactively capturing and preserving the content in advance, the system ensures the information remains accessible even when temporarily obscured during the lecture delivery process.
Solution Approach 2:
The system creates a copy of the blackboard content by extracting it from the video stream and representing it as separate visual information. This copied content can then be displayed independently through overlay or split-screen techniques, ensuring the original blackboard content remains visible even when the lecturer's body shields it.
2Loss of information
If the lecturer shields the blackboard content with head or body, then the lecturer can be seen, but the blackboard content becomes invisible
Solution Approach 1:
The system transitions the blackboard content from the spatial dimension (physical blackboard) to the temporal dimension (video frame sequence) for extraction and storage. This dimensional transformation allows the content to be separated from the lecturer's body in time, enabling independent display without interrupting the lecture delivery flow.
Solution Approach 2:
The system introduces an intermediary processing layer that extracts blackboard content from the video stream and represents it as separate visual information. This intermediary layer acts as a mediator between the original video and the final display, allowing the blackboard content to be presented independently without being blocked by the lecturer's body.
3Measurement precision
If the blackboard content is displayed only after it becomes visible, then the content accuracy is maintained, but the lecture understanding is hindered due to speech advancement
Solution Approach 1:
The system performs preliminary extraction and storage of blackboard content from video frames before the content becomes obscured. This advance preparation ensures that when the content needs to be displayed, it is already extracted and ready for immediate presentation, eliminating display delays while maintaining content accuracy through faithful reproduction from the extracted data.
Data Source
AI summary
An image processing apparatus comprises one or more processors, and one or more memories storing executable instructions which, when executed by the one or more processors, cause the image processing apparatus to function as: a specification unit configured to specify, on a basis of a difference between a first region, corresponding to a foreground region of a target frame, in a background image corresponding to the target frame in a buffered frame group and a second region, corresponding to the foreground region, in a background image of each of frames after the target frame in the buffered frame group, a background image among the background images of the frames; and an output unit configured to output the specified background image.