Mobile Device Synchronous Audio Video Streaming to Multiple RTMP Servers

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current multimedia streaming technologies using mobile devices face challenges in synchronously transmitting audio and video streams to multiple RTMP servers due to high CPU and memory loading, complex compression processes, and limitations in ffmpeg development kits, which prevent simultaneous streaming across multiple servers.

Innovation Solution

A method utilizing separate audio and video controlling modules within a mobile device's hardware abstraction layer to manage and synchronize multimedia streams, employing timestamp correction and shared hardware coding to reduce processing load, and independent thread management for efficient data transmission across multiple servers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If ffmpeg development kit is used for multimedia stream compression and transformation, then digital stream format compliance is achieved, but CPU loading and memory consumption increase significantly

Engineering Contradiction:

Improvedigital stream format complianceVSAvoidCPU loading and power consumption

Core Design Contradiction:

ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent extracts the complex compression and transformation operations from the mobile device by using ffmpeg to generate a static mapping relationship file offline. This file contains pre-calculated parameter mappings between different video formats, allowing the mobile device to simply perform parameter substitution rather than real-time compression, thereby dramatically reducing CPU and memory usage while maintaining format compliance.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent performs the complex compression and transformation work in advance using ffmpeg on a powerful computer to generate the mapping relationship file. This preliminary action transfers the computational burden from the mobile device to an offline preprocessing stage, enabling the mobile device to achieve format compliance with minimal processing resources.

Inventive Principle:

Principle #10Preliminary action

2Reliability

If ffmpeg development kit is used for multimedia stream processing, then stream format compliance is achieved, but device power consumption increases

Engineering Contradiction:

Improvestream format complianceVSAvoiddevice power consumption

Core Design Contradiction:

ReliabilityVSUse of energy by stationary object

Solution Approach 1:

The patent extracts the energy-intensive compression and transformation operations from the mobile device by pre-generating a mapping relationship file using ffmpeg on a powerful computer. This allows the mobile device to perform only lightweight parameter substitution operations, dramatically reducing power consumption while maintaining stream format compliance.

Inventive Principle:

Principle #2Taking out (Extraction)

3Productivity

If conventional multimedia stream technology is used, then stream processing is achieved, but synchronous streaming to multiple RTMP servers is impossible

Engineering Contradiction:

Improvestream processing capabilityVSAvoidmulti-server streaming capability

Core Design Contradiction:

ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent segments the streaming process into independent parallel threads, each responsible for connecting to and streaming data to a specific RTMP server. This thread-based architecture allows the system to maintain stream processing capability while simultaneously adapting to multiple servers, as each thread operates independently without interfering with others.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent creates a universal streaming framework that can simultaneously stream to multiple RTMP servers with different configurations. The system uses a common mapping relationship file and data source while adapting to different server requirements through parameter substitution, achieving multi-functionality without sacrificing processing efficiency.

Inventive Principle:

Principle #6Universality (Multi-functionality)

4Adaptability or versatility

If ffmpeg kits with huge codes are used, then comprehensive stream processing is achieved, but operation loading on CPU increases

Engineering Contradiction:

Improvestream processing functionalityVSAvoidoperation loading on CPU

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent extracts the complex processing logic from the mobile device by pre-generating a mapping relationship file that contains all necessary parameter mappings. This reduces the operational complexity on the device from implementing full compression algorithms to simply performing parameter substitution, while maintaining comprehensive stream processing functionality through the pre-computed mappings.

Inventive Principle:

Principle #2Taking out (Extraction)

Data Source

PatentUS10177958B2Method for synchronously taking audio and video in order to proceed one-to-multi multimedia stream

Publication Date: 2019.01.08 DA SHENG INC

AI summary

A one-to-multi multimedia stream method separately gets video and audio sources form the video and audio chips of a mobile device and reanalyzes related source data to correct the timestamp of video and audio data to ensure the synchronization of the output video and audio. Thus the incapability caused by not synchronized audio and video in stream decoding server can be solved. The present invention is configured to retrieve video and audio via mobile device without ffmpeg open source kits for format transformation, which greatly reduces operation and power consumption of CPU of mobile phone, and the mobile device can proceed one-to-multi video and audio transmission to a plurality of multimedia stream servers simultaneously.