Dynamic Bit Allocation for Real-Time Image Delivery

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image delivery technologies face delays during real-time applications like games, as scalable video coding incurs large encoding and decoding delays, and HEVC struggles to adapt to real-time requirements due to its resolution-switching approach.

Innovation Solution

An image delivery device with operation information acquisition, image information acquisition, allocation information generation, compression, and transmission, which allocates bits dynamically based on operation information and image quality, using base information and weighting to optimize compression and reduce delays.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If scalable video coding is used to reduce transfer size, then compression efficiency is improved, but encoding and decoding delay increases significantly

Engineering Contradiction:
Improvetransfer sizeVSAvoidencoding and decoding delay
Core Design Contradiction:
Quantity of substanceVSLoss of time

Solution Approach 1:

The patent applies dynamic bit allocation strategy where the encoder dynamically adjusts the number of bits allocated to different regions based on operation information and image quality requirements. This dynamic adaptation allows the system to maintain real-time performance while achieving efficient compression, resolving the contradiction between transfer size reduction and encoding delay.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent divides the image into multiple regions and allocates different numbers of bits to each region based on local image quality characteristics and operation information. This local quality approach enables selective compression that maintains real-time processing speed while reducing overall transfer size, addressing the delay issue without sacrificing compression efficiency.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If HEVC prepares streams with multiple resolutions in advance, then image quality is improved, but adaptability to real-time requirements deteriorates

Engineering Contradiction:
Improveimage qualityVSAvoidreal-time adaptability
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamic bit allocation that adapts to real-time operation information and image quality requirements. Instead of pre-preparing multiple resolution streams, the system dynamically adjusts compression parameters based on current game state and user operations, achieving both high image quality and real-time adaptability.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes compression parameters dynamically based on operation information and image quality assessments. By adjusting bit allocation parameters in real-time rather than using fixed pre-prepared streams, the system achieves both high image quality and adaptability to real-time requirements.

Inventive Principle:
Principle #35Parameter changes

3Loss of time

If dynamic bit allocation based on operation information is implemented, then real-time performance is improved, but device complexity increases

Engineering Contradiction:
Improvecompression delayVSAvoidbit allocation mechanism complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The patent implements a feedback mechanism where operation information is continuously monitored and fed back into the bit allocation decision process. This feedback loop enables real-time adaptation while using a systematic approach to complexity management, as the feedback mechanism provides structured guidance for dynamic bit allocation decisions.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs self-service by automatically adjusting bit allocation based on operation information and image quality assessments without requiring complex external control. The encoder autonomously makes allocation decisions using built-in analysis of operation patterns and image characteristics, reducing overall system complexity while maintaining real-time performance.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10951889B2Image delivery device, image delivery program, and image delivery method
Publication Date: 2021.03.16 SONY INTERACTIVE ENTERTAINMENT LLC
  • US10951889B2 patent drawing
  • US10951889B2 patent drawing
  • US10951889B2 patent drawing

AI summary

An image delivery device is, for example, implemented which is capable of better preventing delays even when real-timeness is required. The image delivery device includes operation information acquisition means, image information acquisition means, allocation information generation means, compression means, and transmission means. The operation information acquisition means acquires operation information. The image information acquisition means acquires image information generated on the basis of the operation information. The allocation information generation means generates allocation information representing allocation of numbers of bits during compression of the image information on the basis of the operation information. The compression means compresses the image information on the basis of the allocation information. The transmission means transmits the compressed image information.