Browser-Based Video Editing with Real-Time Streaming Rendering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video editing software is limited in handling high-definition media, lacks customization options, and requires significant computing resources for rendering, especially when editing media stored locally or incorporating internet-based media streams, which can be cumbersome and resource-intensive.

Innovation Solution

A browser-based video editing and rendering system that allows real-time editing and rendering of media projects using streaming assets, with project data associating assets with timespans and spatial relationships, enabling concurrent rendering of video and graphic assets without the need for extensive computing resources or local storage, and supports non-destructive editing and live editing during playback.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If video editing is performed using server-based editing tools with large video rendering farms, then editing capability and customization are improved, but computing resources and infrastructure requirements increase significantly

Engineering Contradiction:
Improveediting capabilityVSAvoidcomputing resources
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The system allows the client device to perform video editing and rendering operations locally using its own computing resources. The video editing application executable on the client device enables users to edit video clips and apply effects without requiring external rendering farms, making the system self-sufficient and eliminating the need for heavy server infrastructure.

Inventive Principle:
Principle #25Self-service

2Manufacturing precision

If high-definition media data is edited using local computing systems, then media quality is improved, but system power requirements and processing demands increase

Engineering Contradiction:
Improvemedia qualityVSAvoidsystem power requirements
Core Design Contradiction:
Manufacturing precisionVSPower

Solution Approach 1:

The system streams video clips from remote storage locations directly to the client device for editing, rather than requiring local storage of high-definition media. The video editing application works with streamed content, allowing high-quality editing without the need to maintain large local media libraries or perform intensive local transcoding operations.

Inventive Principle:
Principle #26Copying

3Adaptability or versatility

If internet-based media streams are incorporated into video projects, then content variety and sharing capability are improved, but processing time and resource requirements increase due to downloading and re-encoding

Engineering Contradiction:
Improvecontent varietyVSAvoidprocessing time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system maintains continuous streaming of video clips from remote storage during the editing process. Instead of downloading and re-encoding media streams, the video editing application works directly with the streamed content, allowing real-time editing operations and immediate visualization of effects without interrupting the streaming flow or requiring intermediate processing steps.

Inventive Principle:
Principle #20Continuity of useful action

4Productivity

If video rendering is performed in real-time during playback, then editing efficiency and immediate feedback are improved, but computing performance requirements increase

Engineering Contradiction:
Improveediting efficiencyVSAvoidcomputing performance
Core Design Contradiction:
ProductivityVSPower

Solution Approach 1:

The system performs rendering operations selectively during playback rather than pre-rendering entire sequences. The video editing application renders only the portions of video clips that are currently being displayed, applying effects and compositing operations in real-time as needed. This partial rendering approach provides immediate feedback to users while reducing overall computing demands compared to full pre-rendering.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS9583140B1Real-time playback of an edited sequence of remote media and three-dimensional assets
Publication Date: 2017.02.28 RADY PATENT & LICENSING LLC
  • US9583140B1 patent drawing
  • US9583140B1 patent drawing
  • US9583140B1 patent drawing

AI summary

A video editing project includes multiple assets, such as animated three-dimensional geometries and streaming video clips. Assets are rendered during associated timespans in a timeline. Video clips are streamed from sources while the project is rendered, rather than in advance. Rendered video data is played in real-time during rendering. Rendering the project may further involve rendering assets in a three-dimensional space. Streaming video clip(s) may be mapped to a geometry. Effects or transformations may be applied the video clip(s) in real-time during rendering and playback. Non-destructive, non-linear editing techniques are described—edits are specified for assets without changing the assets at their sources or having to download and modify a working copy. The editor may support live editing of the project during the real-time playback. The video editor may be, for example, a web browser-based application requiring no direct software installation by the user, and streaming media from remote servers.