Video Call Object Label Tracking Across Camera and Screen Changes
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The inability to track and maintain the position of labels added to objects in video calls, particularly in scenarios involving augmented reality, leads to misplacement or loss of labels when the camera or screen interface changes.
Innovation Solution
A method and system for video data transmission that involves receiving labeled data from a second terminal, determining the target object, adding the label to the corresponding position in the video data, and transmitting it to the second terminal, ensuring the label remains associated with the correct object during video calls.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a label is added to a target object in a video frame during remote cooperation, then the label can be used for communication and annotation purposes, but when the user moves the mobile phone or the screen interface changes, the labeled target object will change causing the label to be misplaced or lost
Solution Approach 1:
The system pre-establishes the correspondence between target objects and their positions in video frames before the video call begins. By determining the target object and its position in advance, the label can be accurately placed even when the video interface changes during the call, preventing label misplacement or loss
Solution Approach 2:
The system continuously monitors and determines the target object in real-time video data during the video call. By comparing the current video data with the previously established target object correspondence, the system can dynamically adjust and maintain accurate label positioning despite camera movement or interface changes
2Adaptability or versatility
If the screen interface changes or the camera moves during a video call, then the video display can adapt to different viewing conditions, but the labeled target object will change leading to label dislocation or loss
Solution Approach 1:
The system pre-determines the target object and establishes its position correspondence before interface changes occur. This preliminary establishment of target-object mapping ensures that when the screen interface adapts to different viewing conditions, the label remains correctly positioned on the intended target object
Solution Approach 2:
The system creates and maintains a correspondence model that copies the relationship between target objects and their positions across different video frames. This correspondence model allows the label position information to be preserved and accurately transferred even when the screen interface changes or camera movement occurs
Data Source
AI summary
Provided are a video data transmission method and a system, and an electronic device and a storage medium. The video data transmission method includes: performing a video call with a second terminal through a first data channel; receiving labeled data which is sent by the second terminal through a second data channel, wherein the labeled data is used for indicating a target label added to a target object in a video frame shared by the first terminal; determining, based on the labeled data, the target object labeled by the second terminal; determining the target object in video data which is to be transmitted through the first data channel, and adding the target label to a position, corresponding to the target object, in the video data; and transmitting, to the second terminal through the first data channel or the second data channel, the video data added with the target label.