Live Classroom Camera Control via Region-Based Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In live classroom video streaming, frequent camera adjustments due to changes in the teacher's position cause visual discomfort for viewers, as the camera angle needs to be constantly adjusted to maintain the teacher's image on a preset coordinate point, leading to jittery video frames.
Innovation Solution
A method and apparatus for controlling video frame images in a live classroom, which involves acquiring image information of a target person, determining detection points based on the image contour, calculating distribution information of these points relative to a preset area, and adjusting the camera to ensure the target person's image remains within the area, thereby reducing unnecessary adjustments and avoiding visual discomfort.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the camera angle is constantly adjusted to maintain the teacher's image on a preset coordinate point, then the teacher's position is tracked accurately, but the video frames become jittery and cause visual discomfort
Solution Approach 1:
The patent introduces an intermediary region (first region and second region) between the target object and the coordinate point. Instead of directly tracking the coordinate point, the system tracks the target object's position within the intermediary region and adjusts the camera based on the object's distribution in this region. This intermediary mechanism smooths out position fluctuations and reduces direct coordinate point tracking that causes jitter.
Solution Approach 2:
The patent performs preliminary determination of the first region and second region before coordinate point tracking. By pre-establishing these regions based on the target object's initial position and size, the system creates a buffer zone that allows for smoother camera adjustments. The camera angle is adjusted based on the target's distribution within these pre-established regions rather than making continuous adjustments to maintain exact coordinate point alignment.
2Adaptability or versatility
If the camera adjusts frequently to follow the teacher's movements, then the teacher remains in focus, but viewer comfort decreases due to visual jitter
Solution Approach 1:
The patent applies partial action by adjusting the camera angle based on the target object's distribution within the first region rather than making full adjustments to maintain exact coordinate point alignment. When the target is within the first region, the camera makes smaller adjustments compared to traditional coordinate point tracking, reducing the frequency and magnitude of camera movements while still keeping the target in view.
Solution Approach 2:
By pre-establishing the first and second regions before tracking begins, the system creates a buffer zone that allows for smoother, less frequent camera adjustments. The regions are determined based on the target's initial position and size, allowing the camera to adapt to position changes within these regions without making continuous adjustments, thereby reducing visual jitter while maintaining target visibility.
3Measurement precision
If detection points are determined based on image contour, then the target position is accurately identified, but the system complexity increases
Solution Approach 1:
The patent segments the detection process by dividing the image into multiple detection points along the target object's contour. Instead of treating the entire target as a single entity, the system identifies multiple discrete detection points (e.g., leftmost, rightmost, topmost, bottommost points) along the contour. This segmentation allows for more accurate position and size determination while keeping each individual detection point calculation relatively simple.
Solution Approach 2:
The patent transitions from two-dimensional contour detection to three-dimensional spatial reasoning by establishing the first and second regions in 3D space and determining the target's distribution within these regions. This dimensional transformation allows the system to calculate camera adjustment angles more accurately by considering the target's position, size, and orientation in three-dimensional space, while the underlying contour detection remains a relatively simple 2D image processing task.
Data Source
AI summary
A method and an apparatus for controlling a video frame image in a live classroom, and a computer readable storage medium and an electronic device are provided. The method includes: acquiring image information of a target person in the video frame image; determining a plurality of detection points according to the image information; determining distribution information of the plurality of detection points based on relationship between the plurality of detection points and a preset first area; determining adjustment information of a camera based on the distribution information and camera parameters; and adjusting the camera according to the adjustment information, so that at least a part of the image information of the target person in the video frame image is located in a preset second area, wherein the second area is located in the first area.


