Visual Data Coding via Dynamic Neural Network Module Switching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Neural network-based image and video compression technologies face challenges in flexibility and efficiency due to fixed network architectures, limiting their performance in encoding and decoding processes.

Innovation Solution

A method and apparatus for visual data processing that enables or disables modules implemented with neural networks in a coding system based on syntax elements in the bitstream, allowing for a flexible coding system architecture.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a fixed neural network architecture is used in image/video compression, then the coding system structure is simple, but the adaptability to different coding scenarios is limited

Engineering Contradiction:
Improveadaptability to different coding scenariosVSAvoidcoding system structure
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements dynamic module enabling/disabling mechanisms where neural network modules can be selectively activated or deactivated based on coding scenarios. The syntax elements in the bitstream control whether specific neural network modules (such as autoregressive models) are enabled, allowing the coding system to adapt its architecture dynamically rather than being fixed, thus resolving the contradiction between adaptability and structural simplicity.

Inventive Principle:
Principle #15Dynamics

2Manufacturing precision

If neural network modules are always enabled, then coding effectiveness is improved, but computational efficiency decreases

Engineering Contradiction:
Improvecoding effectivenessVSAvoidcomputational efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent applies partial action by selectively enabling neural network modules only when needed rather than always activating them. Through syntax elements in the bitstream, the system determines whether to enable specific modules (such as autoregressive models), applying neural network processing only in scenarios where it provides necessary coding effectiveness, thus balancing coding performance with computational efficiency.

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If modular neural network components are added to improve performance, then coding efficiency is enhanced, but system complexity increases

Engineering Contradiction:
Improvecoding efficiencyVSAvoidsystem architecture
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the neural network coding system into modular components that can be independently enabled or disabled. By dividing the system into separate functional modules (such as autoregressive model modules, entropy coding modules, etc.), each with specific functions, the system can selectively activate only the necessary segments for a given coding task, thereby enhancing coding efficiency through specialized modules while managing overall system complexity through selective activation.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20250247552A1Method, apparatus, and medium for visual data processing
Publication Date: 2025.07.31 DOUYIN VISION CO LTD
  • US20250247552A1 patent drawing
  • US20250247552A1 patent drawing
  • US20250247552A1 patent drawing

AI summary

Embodiments of the present disclosure provide a solution for visual data processing. A method for visual data processing is proposed. The method comprises: determining, for a conversion between visual data and a bitstream of the visual data, whether to enable a first module implemented with a first neural network in a coding system, the coding system being implemented with at least one neural network; and performing the conversion by using the coding system based on the determining.