Physical Whiteboard Perspective Detection with Color-Enhanced Foreground Masks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing whiteboard detection and perspective methods face issues of instability due to dense color blocks, false corner detection, high computational complexity, and hardware requirements, leading to inefficient and costly operations.
Innovation Solution
A method involving color enhancement, motion and chromatic aberration maps, and weighted fusion to improve whiteboard perspective accuracy and efficiency, using algorithms like Hoffman straight-line detection and homography transformation to enhance image processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional edge information extraction and affine transformation are used for whiteboard detection and perspective, then the whiteboard can be located and corrected, but the method is time-consuming and has high hardware performance requirements
Solution Approach 1:
The patent extracts only the essential geometric features (four corner points) needed for whiteboard perspective transformation, rather than processing all edge information. By focusing on extracting just the critical corner points through color block detection and line intersection methods, the algorithm reduces computational load while maintaining detection accuracy, thereby resolving the contradiction between measurement precision and processing time
Solution Approach 2:
The patent segments the whiteboard detection process into distinct stages: color block detection, line extraction, corner point identification, and perspective transformation. This segmentation allows each stage to be optimized independently, reducing overall processing time while maintaining accuracy at each step
2Measurement precision
If traditional corner detection methods are used on whiteboards with many lines, then comprehensive edge information is captured, but false corner detection occurs making correct affine transformation impossible
Solution Approach 1:
The patent applies local quality by focusing detection efforts on specific regions where corner points are likely to exist (color block intersections) rather than uniformly processing the entire whiteboard. By concentrating computational resources on critical local areas and using color information to guide detection, the method achieves high corner detection accuracy while avoiding false detections from irrelevant lines
Solution Approach 2:
The patent introduces color block detection as an intermediary step between edge detection and corner identification. These color blocks serve as mediators that filter and organize line information, making it easier to reliably identify true corner points while excluding false detections from incidental lines or markings
3Productivity
If dense color blocks are used in the whiteboard for information display, then more content can be presented, but the color blocks become unstable and constantly change affecting detection reliability
Solution Approach 1:
The patent performs preliminary action by detecting and establishing color block regions before the actual whiteboard content is drawn. By pre-identifying the geometric framework of color blocks and their intersection points, the system creates a stable reference structure that remains valid even as content within those blocks changes, thereby maintaining detection reliability while allowing high information display capacity
Data Source
AI summary
Disclosed are a perspective method for a physical whiteboard and a generation method for a virtual whiteboard. A Hoffman straight-line detection method is used, statistics are taken on a quantity of overlapping times of a straight line, and a determining dimension of a whiteboard-related straight line is increased. On a basis of generating a high-precision virtual whiteboard, purity of a whiteboard color is improved through color enhancement, and a virtual whiteboard corresponding to each frame of a physical whiteboard image is processed based on a preset algorithm to obtain a background-color image, a motion map, and a chromatic aberration map, so as to obtain a foreground mask. A character is perspective and smoothed based on a foreground mask of a current frame, a color-enhanced image of the current frame, and a fully perspective image of a previous frame.