Neural Pre-Codec Processor for Image Quality and Format Compatibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image and video coding technologies face challenges in efficiently encoding and decoding high-resolution images and videos over communications channels with limited bandwidth, particularly when the source image has a higher resolution or bit-depth than the operative image format of the encoder or decoder.
Innovation Solution
The proposed solution involves nonlinear peri-codec optimization, which includes a neural pre-codec processor that converts the source image into a neural latent space image, and a nonlinear post-codec image processor that converts the reconstructed neuralized image back into the original image space, ensuring compatibility with standard image coding formats.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the source image has a higher resolution or bit-depth than the operative image format of the encoder, then image quality is improved, but compatibility with standard coding formats deteriorates
Solution Approach 1:
The patent introduces a neural pre-codec processor as an intermediary component between the high-resolution source image and the standard codec. This processor converts the source image into a neural latent space representation that is compatible with standard coding formats, enabling both high image quality preservation and format compatibility. The neural processor acts as a mediator that translates between different image representations.
Solution Approach 2:
The patent transforms the image representation by changing parameters through neural network processing. The source image parameters (high resolution, high bit-depth) are converted into neural latent space parameters that maintain information content while being compatible with standard codec operative formats. This parameter transformation enables compatibility without losing image quality.
2Productivity
If nonlinear neural processing is applied around the codec, then compression efficiency is improved, but device complexity increases
Solution Approach 1:
The patent applies preliminary action by performing neural processing before the encoding stage (pre-codec) and after the decoding stage (post-codec). The pre-codec neural processor prepares the image data in an optimized neural latent space before standard encoding, improving compression efficiency. The post-codec processor restores the compressed image back to the original image space, maintaining quality while using standard coding formats.
3Measurement precision
If high-resolution images are transmitted over limited bandwidth channels, then image quality is improved, but data transmission requirements worsen
Solution Approach 1:
The neural pre-codec processor serves as an intermediary that transforms high-resolution images into a compact neural latent space representation. This transformation maintains the essential image information and quality characteristics while significantly reducing the data quantity required for transmission over bandwidth-limited channels. The standard codec then efficiently compresses this already-optimized representation.
Data Source
AI summary
Nonlinear peri-codec optimization for image and video coding includes obtaining a source image including pixel values expressed in a first defined image sample space, generating a neuralized image representing the source image, the neuralized image including pixel values that are expressed as neural latent space values, encoding the input image wherein the neural latent space values are used as pixel values in a second defined image sample space and the input image is in an operative image format of the encoder, such that a decoder decodes the encoded image to obtain a reconstructed image in the second defined image sample space, wherein the reconstructed image is a reconstructed neuralized image including reconstructed neural latent space values, such that a deneuralized reconstructed image corresponding to the source image is obtained by a nonlinear post-codec image processor in the first defined image sample space.