Multi-viewpoint Image Encoding via Sub-band Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing techniques for multi-viewpoint images face challenges in reducing data volume while maintaining flexibility in image processing, particularly in allowing refocusing across the entire image region rather than just the region of interest (ROI).
Innovation Solution
The proposed solution involves an image processing apparatus that divides difference images and composite images into sub-bands with and without high-frequency components, encoding only the high-frequency components of difference images and encoding all sub-bands of the composite image, allowing for efficient data reduction and flexible image processing, including refocusing across any image area.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If all data of plurality of images (sub-images) are transmitted, then image processing flexibility is maintained, but data amount increases significantly
Solution Approach 1:
The patent segments the image data into a composite image (base layer) and difference images (detail layers). The composite image contains the majority of visual information, while difference images capture only the variations between viewpoints. By transmitting both components, the system achieves data reduction while preserving processing flexibility through selective reconstruction of parallax images from the composite and difference data.
2Quantity of substance
If data of composite image and difference images are transmitted, then data amount is reduced, but refocusing is limited to ROI only
Solution Approach 1:
The patent implements dynamic refocusing capability by storing difference images that capture the variations between multiple viewpoint images. These difference images can be applied to any region of the composite image, enabling dynamic refocusing at any position rather than being fixed to a predetermined ROI. The system allows flexible selection of refocusing regions based on user needs, transforming a static limitation into a dynamic capability.
3Measurement precision
If difference images are encoded with high-frequency components, then refocusing quality is improved, but encoding complexity increases
Solution Approach 1:
The patent applies local quality by differentiating the encoding treatment between the composite image and difference images. The composite image is encoded with all sub-bands to preserve overall image quality, while difference images are encoded selectively with only high-frequency components (HL, LH, HH sub-bands). This localized encoding strategy optimizes refocusing quality in regions where it matters most while reducing overall encoding complexity by avoiding redundant encoding of low-frequency information that is already present in the composite image.
Data Source
AI summary
An image processing apparatus divides a plurality of difference images that are based on addition and subtraction between a plurality of parallax images, and a composite image that is based on addition between a plurality of parallax images, into a plurality of sub-bands including a sub-band that includes high-frequency components and a sub-band that does not include high-frequency components. When encoding the plurality of difference images and the composite image, as for the plurality of difference images, the image processing apparatus encodes data of the sub-band that includes high-frequency components, and, as for the composite image, the image processing apparatus encodes data of the plurality of sub-bands.