Video Framing System Using Camera Motion and Object Position Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for capturing and framing video streams struggle with effectively tracking moving subjects and maintaining aesthetically pleasing compositions, especially when objects are in motion or obscured, due to limitations in camera preview visibility and object presence detection.
Innovation Solution
A method and system that capture video streams, detect camera motion and object presence, determine the object's position, and generate a framed video stream by adjusting framing based on both camera motion and object position, using algorithms like histogram of oriented gradients and support vector machines, with relative weighting factors to balance object tracking and camera stabilization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the camera operator manually frames the video stream, then the framing may reflect the operator's intent, but the operator may not move the camera smoothly or track the object's motion accurately
Solution Approach 1:
The system performs automatic framing by detecting object position and camera motion independently, without requiring manual operator intervention. The processing unit automatically determines framing parameters based on detected object positions and camera motion data, enabling the system to frame itself accurately while tracking moving objects.
Solution Approach 2:
The patent replaces manual mechanical camera operation with automated digital processing. Instead of relying on the operator's physical camera handling skills, the system uses image processing algorithms to detect object positions and calculate appropriate framing adjustments, substituting mechanical operator control with computational automation.
2Loss of information
If a preview of the video stream is provided to the user, then the user can see what is being captured, but the preview may be invisible or difficult to see under bright light or when the camera is held at certain angles
Solution Approach 1:
The system introduces an intermediary processing step that detects object positions and camera motion to determine framing parameters independently of the preview display. This intermediary framing determination process ensures that the final framed video stream maintains proper composition regardless of preview visibility issues caused by environmental factors.
3Stability of the object's composition
If the framing follows the object when present, then aesthetically pleasing composition is achieved when objects are present, but the framing becomes unstable when objects are not present or obscured
Solution Approach 1:
The system dynamically adjusts framing based on real-time detection of object presence. When an object is detected, the framing follows the object's position; when the object is absent or obscured, the system transitions to using camera motion data to maintain stable framing. This dynamic switching between framing strategies ensures both aesthetic composition when objects are present and stability when objects are absent.
Solution Approach 2:
The system changes the parameters used for framing determination based on object detection results. When an object is present, the framing parameters are determined by object position; when the object is absent, the parameters switch to being determined by camera motion compensation. This parameter switching allows the system to adapt to different scenarios while maintaining framing stability.
4Measurement precision
If automatic object detection is used to improve framing when objects are present, then object tracking is improved, but the system complexity increases
Solution Approach 1:
The system segments the framing determination process into distinct functional components: object detection module, camera motion detection module, and framing parameter determination module. Each module performs a specific function independently, and the processing unit integrates their outputs. This segmentation allows for improved object detection accuracy while managing system complexity through modular architecture.
Data Source
AI summary
A method to frame a video stream is provided. A video stream is captured, then motion of the camera, object presence in the video stream, and position of the object are detected. A framed video stream is generated using a framing in dependence on the motion of the camera and the position of the object. A system for framing a video stream is also provided, wherein the system comprises a camera and a processing unit, and the processing unit comprises at least one processor and at least on memory including computer program instructions to execute a method to frame a video stream.