Proxy Feed Editing for Live Media Latency Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current live editing systems for media content, such as Sony's Virtual Production service, face significant time delays between content capture and editing, which hinder real-time feedback and efficiency in distributed production environments due to high network latency and bandwidth requirements.

Innovation Solution

The method involves generating a smaller-sized representation of captured content (proxy feed) and sending it over a lower latency network path, while the original content is sent over a higher latency network path, allowing for quicker editing based on the representation, and using network slicing and edge computing to optimize data transfer and processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If captured content is sent over the network for editing, then editing can be performed remotely, but network latency causes time delay between content capture and editing

Engineering Contradiction:
Improveremote editing capabilityVSAvoidtime delay between capture and editing
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system segments the content data into two parts: a compressed representation (proxy feed) and the original captured content. The representation is sent over the high-latency network path for remote editing, while the original content is transmitted separately. This segmentation allows the editing process to work with smaller data that requires less transmission time, reducing the overall delay while maintaining remote editing capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system creates a compressed representation (copy) of the captured content that contains sufficient information for editing decisions. This copy is transmitted over the network to enable remote editing without requiring the full original content to be transmitted and processed in real-time, thereby reducing latency while preserving editing functionality.

Inventive Principle:
Principle #26Copying

2Manufacturing precision

If high definition content is transmitted over the network, then content quality is maintained, but large amounts of bandwidth and network resources are required

Engineering Contradiction:
Improvecontent qualityVSAvoidnetwork bandwidth requirement
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The system divides the content transmission into two streams: a compressed representation with reduced data size for editing operations, and the original high-definition content for final output. This segmentation allows the network to handle smaller data volumes for the critical editing path while preserving full quality for the content delivery path.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A compressed representation (proxy feed) is created as a copy of the original content. This copy uses less bandwidth to transmit the essential visual information needed for editing decisions, while the original high-definition content is preserved separately for final production, thus reducing network resource requirements without sacrificing content quality.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11699462B2Method, apparatus and computer program
Publication Date: 2023.07.11 SONY GROUP CORP
  • US11699462B2 patent drawing
  • US11699462B2 patent drawing
  • US11699462B2 patent drawing

AI summary

A method of providing edited media content is described. The method comprises: generating captured content and a representation of the captured content, the representation of the captured content having a smaller size than the captured content; providing the captured content over a first network path across a network and the representation of the captured content over a second network path across the network, the first network path having a higher latency than the second network path; generating an edited version of the received representation of the captured content; and providing an edited version of the captured content, the editing of the captured content being based on the editing of the representation of the captured content.