Panoramic Video Target Tracking With Occlusion Recovery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Panoramic videos require users to manually adjust viewing angles to track specific targets, which is cumbersome and can cause dizziness due to rapid changes in target position.
Innovation Solution
A target tracking method for panoramic video that includes target detection, tracker initialization, confidence and occlusion score calculation, and adaptive tracking strategies to maintain continuous tracking.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual viewing angle adjustment is used to track targets in panoramic video, then target tracking capability is achieved, but operation convenience deteriorates and user experience worsens due to troublesome operations and dizziness from rapid changes
Solution Approach 1:
The system performs automatic target detection and tracking without requiring manual user intervention. The tracker automatically adjusts viewing angles to follow targets, eliminating the need for users to manually control display rotation, thereby resolving the contradiction between tracking capability and operational convenience
Solution Approach 2:
The patent replaces manual mechanical adjustment of viewing angles with an automated computer vision system that uses target detection algorithms and tracking methods to automatically adjust and maintain optimal viewing angles, substituting human operation with automated computational processes
2Reliability
If target tracking is implemented in panoramic video, then continuous target monitoring is achieved, but computational complexity increases due to the need for target detection, confidence calculation, and occlusion handling
Solution Approach 1:
The system performs target detection and initializes trackers in advance before full tracking begins. By pre-detecting targets and preparing tracking parameters, the system reduces computational burden during the actual tracking process while maintaining reliable continuous monitoring
Solution Approach 2:
The patent implements selective tracking by evaluating confidence scores and occlusion probabilities, applying full tracking only when necessary (when targets are detectable and not occluded). This partial action approach reduces overall computational complexity while maintaining tracking reliability for visible targets
3Ease of operation
If automatic target tracking is implemented, then operational convenience is improved, but tracking reliability deteriorates due to target loss and occlusion in panoramic video
Solution Approach 1:
The system continuously monitors tracking quality by calculating confidence scores and occlusion probabilities at each frame. This feedback mechanism allows the tracker to detect when targets are lost or occluded and automatically adjust tracking parameters or reinitialize tracking to maintain reliability
Solution Approach 2:
The patent prepares multiple candidate targets and pre-calculates tracking parameters before tracking failures occur. When occlusion or target loss is detected, the system can immediately switch to pre-prepared alternative targets or reset tracking, cushioning against reliability deterioration from tracking failures
Data Source
AI summary
The present application is applicable to the field of video processing. Provided are a target tracking method for a panoramic video, a readable storage medium, and a computer device. The method comprises: using a tracker to track and detect a target to be tracked to obtain a predicted tracking position of said target in the next panoramic video frame, calculating the reliability of the predicted tracking position, and using an occlusion detector to calculate an occlusion score of the predicted tracking position; determining whether the reliability of the predicated tracking position is greater than a preset reliability threshold value, and determining whether the occlusion score of the predicted tracking position is greater than a preset occlusion score threshold value; and using a corresponding tracking strategy according to the reliability and the occlusion score. By means of the present application, whether a tracking failure is caused by the loss of a target or occlusion can be determined, such that a corresponding tracking recovery strategy can be used, and tracking can be automatically recovered when tracking fails, thereby achieving the effect of performing tracking continuously for a long time. In addition, the method of the present invention has a low operation complexity and a good real-time performance.