Cloud Gaming Livestream Audio-Video Synchronization via Cloud Mixing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In traditional game livestreaming, audio-video synchronization in data transmission between different terminals is challenging, especially when transitioning from traditional 2D games to cloud gaming, as mobile terminals often lack the performance required for direct livestreaming of cloud gaming.
Innovation Solution
A method and apparatus for game data processing that establishes a livestreaming service connection between a cloud server and a livestreaming server, acquires and mixes game audio and image data with synchronized timestamps, and delivers the synchronized livestreaming data to a client through a livestreaming server, utilizing cloud computing to handle the rendering and synchronization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Power
If cloud gaming is livestreamed directly using traditional game livestreaming manner, then the mobile terminal can push the coded livestream, but the mobile terminal lacks sufficient performance to handle cloud gaming rendering and livestreaming simultaneously
Solution Approach 1:
The patent introduces a cloud server as an intermediary between the cloud gaming client and the livestreaming server. The cloud server receives game data from the cloud gaming client, performs rendering and audio-video synchronization, then pushes the processed livestream to the livestreaming server. This mediator approach allows the mobile terminal to function as a lightweight client without bearing the heavy rendering and synchronization workload, resolving the performance bottleneck while maintaining reliable livestreaming capability.
2Productivity
If audio and video data are transmitted separately from different terminals, then data transmission can be achieved, but audio-video synchronization becomes difficult to maintain
Solution Approach 1:
The patent merges the audio data stream and video data stream at the cloud server level. The cloud server receives game data, separates audio and video components, processes them independently with appropriate encoding, then combines them into a synchronized livestream with unified timestamp synchronization. This combining approach ensures that audio and video remain synchronized throughout transmission, resolving the synchronization accuracy problem while maintaining transmission efficiency.
Solution Approach 2:
The patent implements timestamp feedback mechanisms where the cloud server assigns synchronized timestamps to both audio and video data packets, and the livestreaming server uses these timestamps to maintain synchronization during playback. The system continuously monitors and adjusts timing based on feedback from the transmission channel, ensuring audio-video synchronization is maintained even under varying network conditions.
3Ease of operation
If the mobile terminal handles both cloud gaming rendering and livestreaming encoding, then direct livestreaming is possible, but the device complexity and performance requirements become excessively high
Solution Approach 1:
The patent segments the livestreaming system into distinct functional components: the cloud gaming client handles game interaction and data transmission, the cloud server handles rendering, audio processing, and video encoding, and the livestreaming server handles stream distribution. This segmentation allows the mobile terminal to focus solely on lightweight client functions, dramatically reducing device complexity and performance requirements while maintaining ease of operation for users.
Data Source
AI summary
This application discloses a game data processing method performed by a computer device. The method includes: establishing a livestreaming service connection between a cloud server and a livestreaming server associated with a target cloud gaming; acquiring game image data and game audio data of the target cloud gaming based on the livestreaming service connection; acquiring audio data of a livestreamer object transmitted by a cloud gaming client of the target cloud gaming; mixing the game audio data and the audio data to obtain mixed audio data; obtaining a livestreaming data stream corresponding to the target cloud gaming based on the mixed audio data; and delivering the livestreaming data stream to a livestreaming client associated with the cloud gaming client through the livestreaming server.