Epipolar Geometry Motion Coding for Cloud Gaming

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding techniques for cloud gaming struggle with efficient motion prediction, particularly in environments where 3D graphics rendering is distributed across servers and clients with limited computation capabilities, leading to suboptimal rendering quality and increased bitrates.

Innovation Solution

The implementation of a video coding system that uses epipolar geometry to determine motion parameters for motion prediction between frames, allowing for more accurate and efficient prediction of pixel blocks between a current frame and a reference frame, thereby reducing the need for explicit motion vector coding and improving compression efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If conventional motion prediction techniques are used in cloud gaming, then the system can operate with distributed rendering, but the bitrate required for motion information increases and rendering quality deteriorates

Engineering Contradiction:
Improvebitrate for motion informationVSAvoidrendering quality
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The patent changes the parameters used for motion prediction from conventional approaches to epipolar geometry-based parameters. By using epipolar lines and geometric constraints to derive motion vectors, the system achieves more accurate motion prediction with reduced bitrate requirements, directly resolving the contradiction between quantity of data and rendering quality.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If explicit motion vector coding is used, then motion information can be transmitted, but compression efficiency decreases

Engineering Contradiction:
Improvecompression efficiencyVSAvoidmotion information redundancy
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The patent extracts and utilizes geometric constraints from the image structure itself to derive motion vectors. By taking out the motion information implicitly present in the epipolar geometry of the image pairs, the system eliminates the need for explicit motion vector coding, thereby improving compression efficiency while maintaining motion information accuracy.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS20230403406A1Motion coding using a geometrical model for video compression
Publication Date: 2023.12.14 INTERDIGITAL MADISON PATENT HLDG
  • US20230403406A1 patent drawing
  • US20230403406A1 patent drawing
  • US20230403406A1 patent drawing

AI summary

A video coding system performs motion prediction based on epipolar geometry. A first camera corresponds to a current frame, a second camera corresponds to a reference frame and epipolar geometry is used to determine motion parameters allowing to perform a prediction between the reference frame and the current frame.