Video Collaboration Annotation Data Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video collaboration services face challenges in efficiently communicating drawing annotations and co-presence data among client devices without degrading the quality of shared video/audio data, particularly due to the high bandwidth requirements for transmitting image data.
Innovation Solution
The system maintains joint state data for a video collaboration session, which includes incremental updates of video data, current frame numbers, and annotations, allowing client devices to recreate drawing annotations using lightweight instructions rather than bulky image data, and includes co-presence data to enhance communication efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If image data for drawing annotations is transmitted among client devices, then communication accuracy is improved, but network bandwidth consumption increases
Solution Approach 1:
The patent extracts only the essential information needed to recreate drawing annotations (coordinates, colors, stroke width) from the complete image data, transmitting this minimal data set instead of full images. This extraction approach maintains communication accuracy while dramatically reducing network bandwidth consumption.
Solution Approach 2:
Instead of transmitting actual image data, the patent uses lightweight instructions that enable client devices to locally recreate the drawing annotations. This copying approach transmits minimal data (coordinates, colors, stroke parameters) that can be rendered into accurate visual representations, resolving the contradiction between communication accuracy and bandwidth usage.
2Loss of information
If complete annotation data is stored at each client device, then information completeness is improved, but storage space consumption increases
Solution Approach 1:
The patent extracts only the essential parameters needed to represent drawing annotations (coordinates, colors, stroke width, text content) and stores this minimal data set at each client device. This extraction ensures information completeness for recreating annotations while minimizing storage space consumption.
3Measurement precision
If video collaboration services stream video data to multiple client devices, then communication quality is improved, but network bandwidth consumption increases
Solution Approach 1:
The patent segments the data transmission into two distinct streams: (1) video data streaming to multiple clients, and (2) lightweight annotation instruction transmission to multiple clients. This segmentation allows optimized bandwidth allocation, maintaining high communication quality for video while using minimal bandwidth for annotation data.
Solution Approach 2:
Instead of transmitting heavy image data for annotations, the patent uses lightweight copying instructions that enable each client to locally recreate annotations from minimal data (coordinates, colors, stroke parameters). This approach maintains annotation quality while dramatically reducing the bandwidth required for annotation data transmission.
Data Source
AI summary
Techniques are disclosed for allowing remote participation in collaborative video review based on joint state data, for a video collaboration session, maintained by a video collaboration service. A user at a participant client device may provide one or more annotations, such as a drawing annotation, for the video data via a client application. The client application transmits computer-readable instructions for re-creating the drawing annotation to the service, which distributes the drawing instructions to the other participant client devices. Using the drawing instructions, the client applications at the client devices are configured to re-create the drawing annotation on the associated video frame displayed at the client devices. The joint state data communicated to client devices for a given session may include co-presence data that efficiently increases communication among the participants in a session. Co-presence data received by a participant client device may be depicted in a GUI of the client application.