Image Encoder Metadata for Wide-Angle Distortion Correction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional encoders and decoders struggle to properly handle images captured with wide angle lenses, leading to inefficiencies in encoding and decoding processes, particularly for next-generation video formats like 360-degree video.
Innovation Solution
An encoder and decoder system that includes processing circuitry and memory to correct distortion and stitch multiple images, generating encoded images with adaptive encoding and decoding tools tailored to the specific image processing techniques used, such as those applied to wide angle lens images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If image processing techniques are used to correct distortion and stitch images, then the image can be properly handled and coding efficiency is improved, but the device complexity increases
Solution Approach 1:
The encoder performs distortion correction and image stitching as preliminary actions before the actual encoding process. By pre-processing the image to convert it from equirectangular projection to a format suitable for conventional encoders, the system enables proper handling of wide angle lens images without requiring complex real-time processing during encoding, thus improving coding efficiency while managing device complexity
Solution Approach 2:
The patent introduces an intermediary processing stage that converts equirectangular projection images into a format compatible with conventional encoders. This intermediary transformation layer acts as a mediator between the wide angle lens capture and the encoding process, allowing standard encoding tools to handle distorted images effectively by first rectifying them
2Device complexity
If conventional encoders are used without adaptive tools, then the device complexity is reduced, but the image cannot be properly handled and coding efficiency deteriorates
Solution Approach 1:
By performing distortion correction and stitching as preliminary actions before encoding, the system prepares the image data in advance, allowing conventional encoders to process the rectified image efficiently without requiring complex adaptive tools during the actual encoding phase
Data Source
AI summary
An encoder capable of properly handling an image to be encoded or decoded includes processing circuitry and memory connected to the processing circuitry. Using the memory, the processing circuitry: obtains parameters including at least one of (i) one or more parameters related to a first process for correcting distortion in an image captured with a wide angle lens and (ii) one or more parameters related to a second process for stitching a plurality of images; generates an encoded image by encoding a current image to be processed that is based on the image or the plurality of images; and writes the parameters into a bitstream including the encoded image.