Video Detection Tracking Dual-Thread Real-Time Performance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video processing methods face challenges in achieving real-time detection and tracking of objects in video streams due to the time-consuming nature of detecting each video frame, which hinders the timely output of bounding boxes and object types.
Innovation Solution
The method divides the detection and tracking process into two threads, where feature point analysis and target detection are performed in one thread, and target box tracking is done in another, allowing for real-time output of target boxes even if the detection thread takes longer, by extracting frames at a target step size and using feature points for tracking.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If target detection is performed on each video frame, then detection accuracy is improved, but processing time increases and real-time performance deteriorates
Solution Approach 1:
The patent segments the video frame sequence into multiple sub-sequences, with only certain sub-sequences selected for target detection while others undergo only tracking. This segmentation allows the system to maintain detection accuracy on key frames while reducing overall processing time by skipping detection on intermediate frames.
Solution Approach 2:
The patent implements periodic target detection at specific intervals (every N frames) rather than continuous detection on every frame. This periodic action maintains sufficient detection accuracy while significantly reducing processing time and improving real-time performance.
2Measurement precision
If target detection is performed on each video frame, then detection completeness is improved, but processing speed deteriorates
Solution Approach 1:
The patent divides the video stream into multiple processing threads, where only specific threads perform target detection while others perform tracking. This segmentation maintains detection completeness for selected frames while improving overall processing speed through parallel operations.
Solution Approach 2:
The patent performs preliminary tracking on all frames and only performs detailed target detection on selected frames where detection is most needed. This preliminary action ensures detection completeness is maintained while processing speed is improved by avoiding redundant detection operations.
3Productivity
If multi-threading is used for detection and tracking, then processing efficiency is improved, but system complexity increases
Solution Approach 1:
The patent segments processing into multiple threads with clear division of labor: some threads handle target detection while others handle tracking. This segmentation improves processing efficiency through parallel execution while managing system complexity through modular thread design with well-defined interfaces.
Data Source
AI summary
In the field of video processing, a detection and tracking method and apparatus, and a storage medium, are provided. The method includes: performing feature point analysis on a video frame sequence, to obtain feature points on each video frame thereof; performing target detection on an extracted frame through a first thread based on the feature points, to obtain a target box in the extracted frame; performing target box tracking in a current frame through a second thread based on the feature points and the target box in the extracted frame, to obtain a result target box in the current frame; and outputting the result target box. As the target detection and the target tracking are divided into two threads, a tracking frame rate is unaffected by a detection algorithm, and the target box of the video frame can be outputted in real time, improving real-time performance and stability.