Region of Interest Tracking via Periodic Detection and Motion Estimation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for determining a region of interest in videos are computationally intensive, requiring significant processing and power resources, especially as video resolution and frame rate increase, making them inefficient for real-time applications such as obstacle tracking in automated vehicles.
Innovation Solution
The method involves detecting a region of interest in a detection frame using a convolutional neural network and estimating its motion into subsequent estimation frames based on tracking characteristics, reducing the need for full detection in each frame and thus minimizing processing and power consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If full detection is performed on every video frame to track region of interest, then measurement precision and reliability are improved, but use of energy and processing resources increase significantly
Solution Approach 1:
The system alternates between performing full detection on detection frames and motion estimation on estimation frames. This periodic action reduces average power consumption while maintaining detection accuracy by using full detection only when necessary (detection frames) and lighter computation for tracking (estimation frames).
Solution Approach 2:
The system performs detection on detection frames to obtain accurate region of interest locations, then uses this information as a starting point for motion estimation in subsequent estimation frames. This preliminary action allows the system to avoid full detection on every frame while maintaining tracking accuracy.
2Measurement precision
If full detection is performed on every video frame to track region of interest, then measurement precision is improved, but productivity decreases due to computational intensity
Solution Approach 1:
The system implements periodic full detection on detection frames combined with faster motion estimation on estimation frames. This approach maintains high detection accuracy while increasing overall processing speed and frame rate by reducing the computational burden on every frame.
Solution Approach 2:
By performing detection on detection frames to establish accurate region of interest locations, then using motion estimation for subsequent frames, the system achieves high measurement precision while improving productivity through reduced per-frame computation time.
3Reliability
If detection is performed on every frame to track moving objects, then reliability of tracking is improved, but use of energy increases
Solution Approach 1:
The system uses periodic full detection on detection frames combined with motion estimation on estimation frames to maintain reliable object tracking while reducing average energy consumption. The alternating pattern ensures tracking reliability is maintained through regular full detection while energy usage is reduced during estimation phases.
Solution Approach 2:
The system performs detection on detection frames to establish reliable region of interest locations, then uses this information for motion estimation in subsequent frames. This preliminary detection action ensures tracking reliability while reducing energy consumption by avoiding repeated full detection on every frame.
Data Source
AI summary
A method of processing a video is provided. The method includes detecting a region of interest in a detection frame of the video. The method includes estimating a motion of the region of interest between the detection frame and an estimation frame of the video subsequent to the detection frame. The estimating is based on tracking of a characteristic of the detected region of interest into at least one portion of the estimation frame. The method includes, based on the estimated motion, estimating a location of the region of interest in the estimation frame. An apparatus for processing a video is also provided. A related non-transitory computer-readable storage medium comprising a set of computer-readable instructions is also provided.