Visual Data Coding via Dynamic Neural Network Module Switching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Neural network-based image and video compression technologies face challenges in flexibility and efficiency due to fixed network architectures, limiting their performance in encoding and decoding processes.
Innovation Solution
A method and apparatus for visual data processing that enables or disables modules implemented with neural networks in a coding system based on syntax elements in the bitstream, allowing for a flexible coding system architecture.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a fixed neural network architecture is used in image/video compression, then the coding system structure is simple, but the adaptability to different coding scenarios is limited
Solution Approach 1:
The patent implements dynamic module enabling/disabling mechanisms where neural network modules can be selectively activated or deactivated based on coding scenarios. The syntax elements in the bitstream control whether specific neural network modules (such as autoregressive models) are enabled, allowing the coding system to adapt its architecture dynamically rather than being fixed, thus resolving the contradiction between adaptability and structural simplicity.
2Manufacturing precision
If neural network modules are always enabled, then coding effectiveness is improved, but computational efficiency decreases
Solution Approach 1:
The patent applies partial action by selectively enabling neural network modules only when needed rather than always activating them. Through syntax elements in the bitstream, the system determines whether to enable specific modules (such as autoregressive models), applying neural network processing only in scenarios where it provides necessary coding effectiveness, thus balancing coding performance with computational efficiency.
3Productivity
If modular neural network components are added to improve performance, then coding efficiency is enhanced, but system complexity increases
Solution Approach 1:
The patent segments the neural network coding system into modular components that can be independently enabled or disabled. By dividing the system into separate functional modules (such as autoregressive model modules, entropy coding modules, etc.), each with specific functions, the system can selectively activate only the necessary segments for a given coding task, thereby enhancing coding efficiency through specialized modules while managing overall system complexity through selective activation.
Data Source
AI summary
Embodiments of the present disclosure provide a solution for visual data processing. A method for visual data processing is proposed. The method comprises: determining, for a conversion between visual data and a bitstream of the visual data, whether to enable a first module implemented with a first neural network in a coding system, the coding system being implemented with at least one neural network; and performing the conversion by using the coding system based on the determining.


