Virtual Canvas Real-Time Collaboration Synchronization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current collaboration tools over multiple locations, such as web-based conferencing and cloud-based collaboration, are limited in allowing real-time collaboration, especially with live video feeds, and do not enable simultaneous control and synchronization of shared content across all participants.

Innovation Solution

Establishing a virtual canvas that allows peer-to-peer connections between computers, enabling direct sharing and synchronization of file-based and live source objects, with metadata management for live sources, allowing multiple users to edit and control shared content simultaneously.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If cloud-based collaboration tools are used to host sessions and share documents, then multiple users can access and edit documents from different locations, but real-time synchronization of live video feeds and simultaneous control of shared content is not achieved

Engineering Contradiction:
Improvemulti-location collaboration capabilityVSAvoidreal-time synchronization performance
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The system segments the shared content into file-based objects and live source objects, allowing different synchronization mechanisms to be applied to each type. File-based objects are transferred completely between computers, while live source objects use metadata streaming for real-time updates, enabling simultaneous control without full content synchronization.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a peer-to-peer connection as an intermediary between computers, enabling direct real-time communication for live source objects without relying on cloud servers. This intermediary mechanism allows simultaneous control and synchronization while reducing latency compared to cloud-based solutions.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Speed

If the entire screen is streamed to remote computers at full refresh rate, then real-time visual collaboration is achieved, but bandwidth consumption increases significantly

Engineering Contradiction:
Improvescreen update speedVSAvoidbandwidth consumption
Core Design Contradiction:
SpeedVSLoss of energy

Solution Approach 1:

The system extracts only the essential metadata (position, size, content changes) from live source objects and streams this extracted information to remote computers. This eliminates the need to transmit the entire screen content at full resolution, dramatically reducing bandwidth consumption while maintaining real-time update capability.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Different quality levels are applied to different types of content: file-based objects are transferred completely for high fidelity, while live source objects use compressed metadata for efficient transmission. This local quality approach optimizes bandwidth usage based on the specific requirements of each content type.

Inventive Principle:
Principle #3Local quality

3Reliability

If only one computer can be the presenter at a time, then control conflict is avoided, but collaboration efficiency decreases due to waiting turns

Engineering Contradiction:
Improvecontrol synchronizationVSAvoidcollaboration efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system dynamically allows multiple computers to simultaneously control different live source objects based on their authorization status. Instead of a static single-presenter model, the system enables dynamic multi-user control where each authorized user can manipulate their own live source objects in real-time without conflict.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

Each computer in the network can function as both a viewer and a controller of live source objects simultaneously. The system provides universal control capability to all authorized participants, allowing them to switch between consuming and producing content roles as needed, thereby improving collaboration efficiency.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Productivity

If live source objects requiring authorization are streamed to all computers, then real-time collaboration is enabled, but security risks increase for sensitive content

Engineering Contradiction:
Improvereal-time collaboration capabilityVSAvoidunauthorized access risk
Core Design Contradiction:
ProductivityVSObject-affected harmful factors

Solution Approach 1:

The system performs preliminary authorization verification before allowing a computer to control or view a live source object. Authorization credentials are checked in advance, and only authenticated users receive the metadata streams for sensitive content, preventing unauthorized access before it can occur.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The peer-to-peer connection acts as a secure intermediary that establishes encrypted direct communication channels between authorized participants. This intermediary mechanism ensures that sensitive live source objects are transmitted only to verified users through secure connections, reducing security risks compared to public cloud-based streaming.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS12124762B2Real time collaboration over multiple locations
Publication Date: 2024.10.22 KARL STORZ SE & CO KG
  • US12124762B2 patent drawing
  • US12124762B2 patent drawing
  • US12124762B2 patent drawing

AI summary

A first or second computer viewing a virtual canvas may be a host computer for a live source object requiring authorization between a host and a non-host computer by creating a live source window for the live source object requiring authorization (ARLSW) within the virtual canvas on the host computer, sending metadata information for the ARLSW to the non-host computer so that the ARLSW is at the same location on the virtual canvas for the first and second computers, and streaming the live source object requiring authorization to the ARLSW from the host computer to the non-host computer. When the host computer for the ARLSW leaves the virtual canvas and no other non-host computer for ARLSW in the canvas is known to have authorization to view the ARLSW, a placeholder screen is displayed in the ARLSW on the virtual canvas.