3D to 2D Video Encoding for Mobile Game Streaming

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current mobile network games are limited by the inability of typical mobile clients to render high-quality 3D graphics, restricting both active participants and observers to simplistic and less desirable visual experiences due to hardware constraints.

Innovation Solution

A method and device for three-dimensional graphics to two-dimensional video encoding, where a 3D model is rendered into a 2D frame, and composition information is used to generate a weighting factor for intelligent bit allocation, enhancing visual quality by prioritizing regions of interest in the encoding process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If 3D graphics rendering is performed on mobile clients, then visual quality of network games is improved, but hardware complexity and power consumption increase beyond typical mobile device capabilities

Engineering Contradiction:
Improvevisual qualityVSAvoidhardware capability
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent creates 2D video copies of the 3D game rendering from a centralized server rather than requiring each mobile client to perform 3D rendering. The server generates high-quality 2D video frames from the 3D game data and transmits them to mobile clients, which only need to decode and display the video. This eliminates the need for powerful 3D graphics hardware on mobile devices while maintaining high visual quality.

Inventive Principle:
Principle #26Copying

2Manufacturing precision

If high-quality 3D graphics are streamed to mobile observers, then viewing experience is improved, but network bandwidth and data transmission requirements increase

Engineering Contradiction:
Improvevisual qualityVSAvoiddata volume
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent transforms the data representation from 3D graphical models requiring complex client-side rendering into 2D video frames with associated composition information. This parameter change allows the same visual information to be transmitted more efficiently as pre-rendered video data rather than raw 3D model data, reducing the effective data volume needed to achieve high visual quality on mobile devices.

Inventive Principle:
Principle #35Parameter changes

3Ease of operation

If mobile clients perform real-time 3D rendering for game participation, then interactivity is maintained, but computing power requirements exceed mobile device capabilities

Engineering Contradiction:
ImproveinteractivityVSAvoidcomputing power
Core Design Contradiction:
Ease of operationVSPower

Solution Approach 1:

The patent introduces a centralized server as an intermediary that performs the computationally intensive 3D rendering and game logic processing. The server acts as a mediator between the game data and mobile clients, handling all heavy computational tasks and transmitting only the resulting 2D video frames to clients. This allows mobile devices to maintain interactivity through video decoding and display while offloading computing power requirements to the server.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS7426304B2Method and device for three-dimensional graphics to two-dimensional video encoding
Publication Date: 2008.09.16 VL COLLECTIVE IP LLC
  • US7426304B2 patent drawing
  • US7426304B2 patent drawing
  • US7426304B2 patent drawing

AI summary

A method and device for three-dimensional graphics to two-dimensional video encoding. A three-dimensional model representing at least one three-dimensional object is received. The three-dimensional model is rendered into a two-dimensional frame. Composition information for the two-dimensional frame is extracted from the three-dimensional model. A bit stream is encoded based on the two-dimensional frame and the composition information.