Server-Side Rendering with Intermediate Value Maps for Video Coding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing multiuser online network games require high-performance client devices for rendering, limiting user access due to the need for expensive hardware and inefficient moving image coding processes that hinder real-time rendering and user interaction.

Innovation Solution

A moving image distribution server that performs rendering in two stages, generating intermediate value maps and using them to determine the best coding method for each block, either intra-frame or inter-frame coding, based on similarity with previous frames, allowing for efficient coding and reduced latency in data transmission.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of substance

If inter-frame coding with motion compensation is used to achieve high compression efficiency, then compression ratio is improved, but coding time increases due to analysis processing

Engineering Contradiction:
Improvedata amountVSAvoidcoding time
Core Design Contradiction:
Loss of substanceVSLoss of time

Solution Approach 1:

The patent applies preliminary action by performing motion compensation analysis during the rendering process before actual image coding. The server calculates motion vectors and identifies matching blocks in advance, so that when inter-frame coding is performed, the analysis is already complete. This resolves the contradiction by shifting the time-consuming analysis to occur during rendering rather than during coding, maintaining high compression efficiency without increasing coding time.

Inventive Principle:
Principle #10Preliminary action

2Ease of operation

If server-side rendering is implemented to improve game accessibility, then ease of operation is improved, but device complexity increases

Engineering Contradiction:
Improvegame accessibilityVSAvoidserver system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing the rendering process into distinct stages: geometry processing, motion compensation analysis, intermediate map generation, and final image coding. Each stage is handled by specialized components within the server system. This modular segmentation manages device complexity by organizing functions into manageable units while maintaining the overall benefit of server-side rendering for game accessibility.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces intermediary elements such as intermediate value maps and motion vector data that facilitate communication between the rendering process and coding process. These intermediaries allow the server to efficiently transfer processed information without requiring complex direct interactions between all system components, thus managing complexity while enabling server-side rendering.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Manufacturing precision

If high-performance client devices are required for rendering, then manufacturing precision is improved, but ease of manufacture worsens due to limited user access

Engineering Contradiction:
Improverendering performanceVSAvoiduser accessibility
Core Design Contradiction:
Manufacturing precisionVSEase of manufacture

Solution Approach 1:

The patent applies inversion by reversing the traditional rendering architecture. Instead of requiring high-performance client devices to perform rendering, the server performs all rendering operations and sends only compressed image data to clients. This inverts the performance requirement from the client side to the server side, enabling users with basic devices to access high-quality rendered games while the server handles the complex rendering tasks.

Inventive Principle:
Principle #13The other way round (Inversion)

Data Source

PatentUS9008187B2Moving image distribution server, moving image reproduction apparatus, control method, program, and recording medium
Publication Date: 2015.04.14 SQUARE ENIX HLDG CO LTD
  • US9008187B2 patent drawing
  • US9008187B2 patent drawing
  • US9008187B2 patent drawing

AI summary

A moving image distribution server selects an intermediate value map of at least one channel during execution of a rendering processing of a subsequent stage for a first screen, and determines, for each set block, whether to perform inter-frame coding by referring to a corresponding intermediate value map generated for a second screen rendered before the first screen. The moving image distribution server performs coding in accordance with the determination result and sends coded moving image data to an external device after the rendering processing of the subsequent stage for the first screen has ended. The determination result is sent to the external device before generation of the coded moving image data of the first screen is completed.