Real-Time Video Transcoding with Lossless Frame Streaming

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing remote desktop monitoring approaches face challenges in maintaining high image fidelity during real-time video transcoding, as lossy compression formats like JPEG degrade image quality, while converting to non-lossy formats like PNG is computationally intensive and resource-heavy, making real-time playback difficult.

Innovation Solution

A method and system for receiving a video stream, decoding frames, and asynchronously encoding them into a lossless compression format like PNG for streaming, which reduces the computational burden and ensures high image fidelity by leveraging available processing resources for efficient encoding and streaming.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If lossy compression format (JPEG) is used for video transcoding, then processing speed and resource efficiency are improved, but image fidelity deteriorates

Engineering Contradiction:

Improveprocessing speedVSAvoidimage fidelity

Core Design Contradiction:

ProductivityVSManufacturing precision

Solution Approach 1:

The system dynamically adjusts compression settings and encoding parameters during video transcoding based on scene complexity, motion detection, and bandwidth conditions. This allows the system to maintain high image fidelity when needed while improving processing speed when possible, resolving the contradiction between productivity and manufacturing precision adaptively

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system changes multiple encoding parameters including compression ratio, bitrate, resolution, and format based on content analysis and playback requirements. By adjusting these parameters dynamically, the system can optimize the balance between processing speed and image fidelity for different video segments and playback scenarios

Inventive Principle:

Principle #35Parameter changes

2Manufacturing precision

If non-lossy compression format (PNG) is used for video transcoding, then image fidelity is improved, but computational cost and processing time increase

Engineering Contradiction:

Improveimage fidelityVSAvoidcomputational cost

Core Design Contradiction:

Manufacturing precisionVSPower

Solution Approach 1:

The video stream is segmented into multiple segments or frames, and different compression formats are applied to different segments based on their importance, motion content, and playback timing requirements. Critical frames may use non-lossy PNG encoding while less important frames use more efficient lossy compression, reducing overall computational cost while maintaining necessary image fidelity

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system performs preliminary analysis of video content including motion detection, scene change detection, and frame importance assessment before encoding. This allows pre-planning of encoding strategies, identifying which frames require non-lossy compression and which can use lossy compression, thereby optimizing computational resource allocation while ensuring image fidelity where needed

Inventive Principle:

Principle #10Preliminary action

3Power

If real-time video transcoding is performed in web browser, then processing load on server is reduced, but browser resource consumption increases

Engineering Contradiction:

Improveserver processing loadVSAvoidbrowser resource consumption

Core Design Contradiction:

PowerVSUse of energy by moving object

Solution Approach 1:

The system introduces an intermediary encoding layer or proxy server that performs initial video transcoding and preparation. This intermediary handles the computationally intensive tasks of format conversion and compression, then delivers pre-processed video streams to browsers. This approach reduces both server processing load and browser resource consumption by distributing the computational burden across multiple layers

Inventive Principle:

Principle #24Intermediary (Mediator)

4Device complexity

If video encoding and streaming are performed synchronously, then processing simplicity is maintained, but playback latency increases

Engineering Contradiction:

Improveprocessing simplicityVSAvoidplayback latency

Core Design Contradiction:

Device complexityVSLoss of time

Solution Approach 1:

The video processing pipeline is segmented into independent parallel stages: decoding, encoding, and streaming. Each stage processes video frames independently and can operate concurrently with other stages. This segmentation allows the system to maintain processing simplicity through modular design while significantly reducing playback latency through parallel execution of encoding and streaming operations

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system implements continuous processing where encoding of the next video frame begins before the current frame's streaming is complete. This overlapping of operations ensures that processing resources are continuously utilized without idle wait time, maintaining simplicity while minimizing latency through efficient pipeline utilization

Inventive Principle:

Principle #20Continuity of useful action

Data Source

PatentUS10931959B2Systems and methods for real-time video transcoding of streaming image data

Publication Date: 2021.02.23 EVERFOX HOLDINGS LLC

AI summary

A method, system, and computer-usable medium are usable for receiving a video stream of image frames in a video format, decoding image frames of the video stream from the video format, for each respective frame of the image frames, upon completion of decoding of the respective frame, asynchronously encoding the respective frame into a lossless compression format, and asynchronously streaming all of the respective frames as encoded into the lossless compression format as a resulting video stream for display to a video display device.