An electron video rendering optimization method and system based on media source extensions

By offloading the decoding work of Electron audio and video applications to the Chromium kernel and leveraging MSE and HTML5 <video> The tag's native rendering pipeline solves the problems of high resource consumption and insufficient performance in Electron audio and video applications, achieving efficient audio and video synchronization and stable rendering.</video>

CN122179420APending Publication Date: 2026-06-09RAYTHEON (WUHAN) NETWORK TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202610199085.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2026-02-11
Publication Date
2026-06-09

AI Technical Summary

Technical Problem

In existing Electron audio and video applications, decoding is concentrated in the SDK, resulting in high CPU/GPU resource consumption, high bandwidth usage for video frame data transmission, and significant memory copy overhead, all of which impact performance. Furthermore, WebGL rendering is not as optimized as that of browser kernels.

Method used

The decoding work is offloaded to the Chromium kernel, leveraging the hardware decoding capabilities of the browser and operating system. Audio and video synchronization and data rendering are performed through Media Source Extensions (MSE), avoiding inter-process transmission of raw video data, and utilizing HTML5.

Benefits of technology

Significantly reduces CPU and GPU usage, memory usage by over 40%, system bandwidth usage by 50%, audio and video synchronization error is controlled within 10ms, improving application stability and supporting multiple protocols and operating systems.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122179420A_ABST
    Figure CN122179420A_ABST
Patent Text Reader

Abstract

The application discloses an Electron video rendering optimization method and system based on Media Source Extensions, and relates to the technical field of video rendering. <video>The element and MediaSource object will be created <video>The element and the src attribute of the MediaSource object are bound, and the application requests the SDK to start the audio and video stream pull stream; S2: the SDK receives the audio and video stream, performs protocol and encapsulation, separates the audio frame and the H.264 video frame; S3: the SDK internally uses the audio playback clock and the audio system clock as the master clock, calculates the expected display timestamp of each H.264 video frame, and completes the synchronization of the H.264 video frame. The decoding work with the most resource consumption is transferred from the SDK to the Chromium kernel, which utilizes the hardware decoding and rendering capabilities of the browser and the operating system underlying depth optimization, is extremely efficient, and significantly reduces the CPU and GPU occupancy.< / video> < / video>
Need to check novelty before this filing date? Find Prior Art