Smart Client Streaming for Scene-Based Media in Game Engines

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing media distribution systems struggle to efficiently distribute immersive media to heterogeneous client devices, particularly those utilizing game engines, due to the diverse capabilities and formats required by these devices, leading to suboptimal network performance and resource wastage.

Innovation Solution

A 'smart client' mechanism on the client device interacts with the network to provide real-time information about its capabilities and resource availability, enabling intelligent media transformation and caching to optimize the distribution of scene-based media, using a well-defined protocol to manage asset reuse and streaming.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If immersive media is distributed to heterogeneous client devices with diverse capabilities, then the user experience is improved, but network performance deteriorates and resource wastage increases

Engineering Contradiction:

Improvecompatibility with heterogeneous devicesVSAvoidnetwork distribution efficiency

Core Design Contradiction:

Adaptability or versatilityVSProductivity

Solution Approach 1:

The system performs preliminary actions by having the client device send capability information to the server before media distribution. The server pre-adapts the immersive media content based on these capabilities, preparing transformed versions in advance to avoid runtime transformations and improve network distribution efficiency.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The server changes media parameters by transforming immersive media into different formats based on client capabilities. The system adjusts parameters such as resolution, format, and quality levels to match specific device requirements, enabling efficient distribution across heterogeneous devices without overwhelming the network.

Inventive Principle:

Principle #35Parameter changes

2Adaptability or versatility

If media transformations are performed to adapt to different client capabilities, then device compatibility is improved, but network resources are wasted

Engineering Contradiction:

Improvedevice capability compatibilityVSAvoidnetwork resource consumption

Core Design Contradiction:

Adaptability or versatilityVSLoss of energy

Solution Approach 1:

The system applies local quality by performing transformations only when necessary for specific clients. The server selectively transforms media based on individual client capability information, avoiding unnecessary transformations for clients that can handle the original format, thus reducing overall network resource consumption.

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

The server performs capability assessment and media transformation planning in advance before actual media distribution. By pre-determining which transformations are needed based on client capabilities, the system avoids redundant transformations and optimizes network resource usage.

Inventive Principle:

Principle #10Preliminary action

3Ease of operation

If immersive media is streamed to game engines, then interactive experience is improved, but the complexity of media distribution increases

Engineering Contradiction:

Improveinteractive media playbackVSAvoidmedia distribution system complexity

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The server acts as an intermediary between the media source and game engine clients. It handles the complexity of capability assessment, media transformation, and format adaptation, while game engines receive pre-processed media through standardized interfaces, simplifying their operation and maintaining ease of interactive playback.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS12515125B2Smart client for streaming of scene-based immersive media to game engine

Publication Date: 2026.01.06 TENCENT AMERICA LLC

AI summary

Aspects of the disclosure provide methods and apparatuses (electronic devices) for media processing. In some examples, an electronic device includes processing circuitry to perform a process of a smart client that is a client interface of the electronic device to an immersive media streaming network. A method for media processing includes transmitting, by the client interface of the electronic device and to a server device in the immersive media streaming network, capability and availability information of the electronic device for playing back a scene-based immersive media. Further, the method includes receiving, by the client interface, a media stream carrying adapted media content for the scene-based immersive media. The adapted media content is generated from the scene-based immersive media by the server device based on the capability and availability information. The method then includes playing back the scene-based immersive media according to the adapted media content.