Super-Resolution Assistance Image Generation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing super-resolution processing techniques face challenges in generating high-resolution images from low-resolution images due to uneven pixel density, making it difficult for users to acquire optimal low-resolution image sets, and existing solutions do not provide adequate assistance for proper sub-pixel displacement determination.
Innovation Solution
An image processing apparatus that includes an image input unit, basis image selecting unit, displacement amount computing unit, deformed image generating unit, composed image and weighted image generating unit, and assistance image generating unit to help users acquire optimal low-resolution image sets by displaying assistance images and adjusting parameters based on user feedback.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If multiple low-resolution images are registered and synthesized using existing super-resolution processing techniques, then a high-resolution image can be generated, but the pixel density on the high-resolution image space becomes uneven due to motion estimation errors and pixel selection processing
Solution Approach 1:
The patent applies preliminary action by providing assistance images to users before they capture the final low-resolution image set. These assistance images simulate the super-resolution processing result, allowing users to adjust their shooting parameters (displacement amounts, number of images) in advance to achieve more uniform pixel density distribution, thereby preventing the unevenness problem from occurring in the first place
Solution Approach 2:
The patent implements feedback by displaying assistance images that show the expected pixel density distribution and super-resolution quality before the user finalizes their image capture. This feedback loop allows users to adjust their shooting strategy based on the simulated results, enabling them to achieve more uniform pixel density and higher image quality through iterative refinement
2Manufacturing precision
If users capture multiple low-resolution images with sub-pixel displacements for super-resolution processing, then high-resolution image generation is enabled, but users cannot know whether optimal low-resolution images are sufficiently obtained
Solution Approach 1:
The patent applies self-service by enabling users to independently evaluate the quality and optimality of their captured low-resolution image sets. The assistance images provide users with the capability to self-assess whether their images have sufficient sub-pixel displacement and uniform pixel density distribution, allowing them to make informed decisions about whether to capture additional images without requiring expert knowledge
Solution Approach 2:
The assistance image acts as an intermediary between the raw low-resolution images and the final super-resolution result. It provides users with a visual representation that bridges the gap between capturing images and understanding their quality, making the evaluation process intuitive and accessible to users without specialized knowledge
3Ease of operation
If interpolation processing is performed to fill lacking pixels on the high-resolution image space, then the image can be completed, but the high-resolutionization is not always correct due to estimated values
Solution Approach 1:
The patent applies preliminary action by helping users achieve more uniform pixel density distribution before interpolation is needed. By providing assistance images that simulate the processing outcome, users can adjust their capture strategy to minimize the number of lacking pixels, thereby reducing the reliance on interpolation and improving the accuracy of the final high-resolution image
Data Source
AI summary
An image processing apparatus comprises a processing unit for computing displacement amounts between a basis image and each reference image, a processing unit for generating multiple deformed images based on the displacement amounts, the basis image and multiple reference images, a processing unit for setting a threshold of a parameter, a processing unit for selecting image information from the reference image by the threshold, a processing unit for generating composed images and weighted images based on the basis image, the displacement amounts and the image information, a processing unit for generating high-resolution grid images by dividing the composed image by the weighted image, a processing unit for generating simplified interpolation images based on high-resolution grid images, a processing unit for generating assistance images, a display unit for displaying the assistance images and a control unit that controls the necessary processing as necessary.