Electronic Whiteboard Annotation Bandwidth Reduction via GPU Overlay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic whiteboards in conference systems require high network bandwidth and data transmission due to the need to send complete video streams for annotation, which limits real-time interactivity and efficiency in both local and teleconferences.
Innovation Solution
An information interaction method where only handwriting data is serialized and sent during writing, with the host processing and transmitting this data to display terminals for real-time display, using a GPU to overlay annotation information on the video image, reducing bandwidth requirements and enabling multi-party interactive whiteboard collaboration.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If complete video stream is captured and transmitted for annotation, then annotation functionality is achieved, but bandwidth consumption increases and network requirements become high
Solution Approach 1:
The patent extracts only the necessary annotation data from the complete video stream. Instead of transmitting the entire video frame for annotation, the system captures only the annotation-related information (such as annotation coordinates, content, and timing) and transmits this extracted data separately, significantly reducing bandwidth consumption while maintaining annotation functionality
Solution Approach 2:
The patent segments the video transmission and annotation transmission into separate data streams. The main video stream is transmitted independently, while annotation data is captured, processed, and transmitted as separate data packets. This segmentation allows the system to avoid transmitting redundant video data for annotation purposes, thereby reducing overall bandwidth requirements
2Productivity
If video stream is continuously transmitted for annotation, then annotation interactivity is improved, but data transmission volume increases
Solution Approach 1:
The patent implements periodic or event-driven annotation data transmission rather than continuous video stream transmission for annotation. Annotation data is captured and transmitted periodically or triggered by specific annotation events, maintaining real-time interactivity while significantly reducing the volume of data that needs to be transmitted compared to continuous video streaming
Solution Approach 2:
The system extracts only the essential annotation interaction data (annotation actions, positions, and content changes) from the continuous video stream and transmits this extracted information separately. This extraction approach maintains annotation interactivity by transmitting only when annotation events occur, rather than continuously transmitting the entire video stream
3Manufacturing precision
If annotation data is transmitted in complete image format, then display accuracy is maintained, but transmission bandwidth is occupied
Solution Approach 1:
The patent changes the data format parameters for annotation transmission. Instead of transmitting annotation data in complete image format, the system transforms annotation information into compressed parameter representations (such as coordinate points, vector descriptions, or simplified graphic elements). This parameter transformation maintains display accuracy when rendered at the receiving end while dramatically reducing the bandwidth required for transmission
Data Source
AI summary
The present disclosure discloses an information interaction method, an information interaction system, and an application thereof, and belongs to the field of electronic whiteboards. In view of the problems in the prior art that an electronic whiteboard in a conference system has a large amount of data to be transmitted, requires a large interaction bandwidth, and has high network requirements, the present disclosure provides an information interaction method: When an image is annotated on the local device, the host serializes the annotation on the local device. The remote device combines the serialized data and corresponding coordinates and pressure sensing values, to calculate and draw an image for display from the data by using a GPU. The interaction method is applied to the electronic whiteboard in the conference system, thereby realizing multi-party real-time interactive whiteboard collaboration, which is supported in both local conferences and teleconferences.