Device-Cloud Rendering With Intermediate-Result Encoding

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional rendering technologies face high interaction delays and inefficient bit rate overheads due to the reliance on cloud-side servers for image/video processing, which is exacerbated by increasing image quality demands and network bandwidth requirements.

Innovation Solution

A device-cloud collaboration system where the terminal device performs initial rendering and encoding based on intermediate rendering results, encoding residual blocks, and reconstructing images using optimized encoders and decoders to reduce interaction delays and bit rate overheads.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If cloud-side server performs rendering and transmits compressed rendered image/video, then rendering quality is improved, but network bandwidth occupation is increased and interaction delay is large

Engineering Contradiction:

Improverendering qualityVSAvoidnetwork bandwidth occupation

Core Design Contradiction:

Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent segments the rendering process into two parts: cloud-side rendering (performed by server) and device-side rendering (performed by terminal device). The terminal device performs initial rendering to generate intermediate rendering results, then the cloud server performs additional rendering processing on these intermediates. This segmentation allows the terminal device to handle basic rendering tasks locally, reducing the amount of data that needs to be transmitted over the network while still benefiting from cloud-side computational power for complex rendering operations.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The terminal device performs preliminary rendering to generate intermediate rendering results before transmitting data to the cloud server. This preliminary action is performed locally on the terminal device, so that only the essential rendering data needs to be transmitted rather than complete high-resolution rendered images, thereby reducing network bandwidth requirements while maintaining rendering quality.

Inventive Principle:

Principle #10Preliminary action

2Quantity of substance

If cloud-side server transmits intermediate rendering result for upsampling, then bit rate overheads are reduced, but encoding efficiency is still low and interaction delay remains large

Engineering Contradiction:

Improvebit rate overheadsVSAvoidencoding efficiency

Core Design Contradiction:

Quantity of substanceVSProductivity

Solution Approach 1:

The terminal device generates intermediate rendering results and feeds them back to the cloud server for further processing. The cloud server uses these feedback intermediates to perform additional rendering operations and generates final rendered images. This feedback mechanism enables the system to leverage both local terminal rendering capabilities and cloud server computational power efficiently, improving encoding efficiency while reducing the amount of data that needs to be transmitted.

Inventive Principle:

Principle #23Feedback

3Power

If rendering is performed on cloud-side server, then computational power is sufficient, but device size and power consumption are limited

Engineering Contradiction:

Improvecomputational powerVSAvoiddevice size

Core Design Contradiction:

PowerVSWeight of moving object

Solution Approach 1:

The rendering workload is segmented between the cloud server and the terminal device. The terminal device performs basic rendering operations locally (generating intermediate results), while the cloud server handles complex rendering tasks that require significant computational power. This segmentation allows the system to leverage cloud computational resources for heavy lifting while keeping the terminal device size and power consumption manageable.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent introduces intermediate rendering results as an intermediary between terminal device rendering and cloud server rendering. These intermediates serve as a bridge that allows the terminal device to perform initial rendering locally while the cloud server performs additional processing. This intermediary mechanism enables efficient collaboration between device-side and cloud-side, optimizing both computational power utilization and device resource consumption.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS20250329056A1Device-cloud collaboration system, encoding and decoding method, and electronic device

Publication Date: 2025.10.23 HUAWEI TECH CO LTD

AI summary

Embodiments of this application provide a device-cloud collaboration system, an encoding and decoding method, and an electronic device. The encoding method includes: performing rendering processing on a three-dimensional scene based on a rendering parameter, to obtain a rendered image; selecting a first intermediate rendering result based on an intermediate rendering result generated in a rendering processing process; encoding the rendered image based on the first intermediate rendering result, to obtain encoded data of a residual block, and encode the encoded data of the residual block into a bitstream. The first intermediate rendering result acts on at least one type of the following processing in an encoding process: partitioning, prediction, or filtering, the bitstream does not include encoded data of the first intermediate rendering result, and a second intermediate rendering result is a part of the first intermediate rendering result.