Transmission Device Rate Control for Image Quality Priority

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional rate control methods in cloud gaming services and similar applications fail to effectively prioritize image quality during scene changes, leading to inadequate handling of image quality priority images and uncertainty in balancing data size and latency.

Innovation Solution

A transmission device and method that includes an acquisition section, a determination section, and encoding sections to identify and handle image quality priority images by adjusting encoding parameters, skipping encoding of subsequent frames, and applying PID control to manage data size and latency, ensuring suitable rate control for image quality priority images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If conventional rate control is applied to all frame images uniformly, then data size and latency are controlled overall, but image quality priority images (such as those after scene changes) cannot be exceptionally handled

Engineering Contradiction:
Improveimage qualityVSAvoidrate control adaptability
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The patent applies different encoding parameters to different types of frame images. Image quality priority images (such as those after scene changes) are encoded with parameters that prioritize quality (lower QP values), while other frames use parameters optimized for data size and latency control. This local differentiation resolves the contradiction by allowing high quality where needed while maintaining overall rate control efficiency.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent dynamically adjusts encoding parameters based on the type of frame image being processed. The system determines whether a frame is an image quality priority image and switches between different parameter sets accordingly. This dynamic adaptation enables the system to respond to changing quality requirements in real-time while maintaining overall rate control.

Inventive Principle:
Principle #15Dynamics

2Manufacturing precision

If image quality is prioritized for scene change frames, then image quality improves, but data size and latency increase

Engineering Contradiction:
Improveimage qualityVSAvoiddata size
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent applies higher quality encoding parameters specifically to image quality priority images (frames after scene changes) while maintaining standard or lower quality parameters for other frames. This localized quality enhancement ensures that data size and latency increase only for the necessary frames, minimizing overall impact while maintaining quality where critical.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent applies excessive quality encoding (lower QP values) only to the extent necessary for image quality priority images, rather than applying it universally. This partial application of quality enhancement ensures that data size and latency are increased only when and where necessary, rather than continuously.

Inventive Principle:
Principle #16Partial or excessive action

3Manufacturing precision

If encoding parameters are adjusted for each frame type, then image quality priority is achieved, but device complexity increases

Engineering Contradiction:
Improveimage qualityVSAvoidencoding system complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the frame encoding process into distinct paths: image quality priority images and other frames. A determination unit identifies which path to follow based on frame type, and corresponding parameter sets are selected accordingly. This segmentation simplifies the overall system by using clear decision logic rather than complex continuous adjustment mechanisms.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS12113968B2Transmission device, transmission method, and program
Publication Date: 2024.10.08 SONY INTERACTIVE ENTERTAINMENT LLC
  • US12113968B2 patent drawing
  • US12113968B2 patent drawing
  • US12113968B2 patent drawing

AI summary

Provided are a transmission device, a transmission method, and a program capable of performing rate control suitable for an image quality priority image. A basic parameter value decision section (28a) decides, for a frame image that is not an image quality priority image, values of parameters used for encoding an encoding unit that is a part or whole of the frame image, by applying the difference between a control amount and a target value to a predetermined control rule. An image quality priority parameter value decision section (28b) decides, for the frame image that is the image quality priority image, values by which the data size of the generated image data becomes larger than those decided by applying the difference between the control amount and the target value to the predetermined control rule as the values of the parameters used for the encoding unit of the frame image.