Image Processing Shake Correction and Cropping via Celestial Sphere
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing technologies fail to effectively perform high-quality image processing that accounts for shake correction and cropping, particularly in mobile devices, leading to suboptimal image output quality.
Innovation Solution
An information processing device with a shake correction unit, effective cropping area setting unit, and effective cropping area image generation unit that uses posture information to correct and crop images on a celestial sphere model, ensuring the cropping area does not protrude from the effective shake correction range, allowing for high-quality image processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If shake correction is performed on the entire image frame, then shake correction coverage is improved, but cropping area accuracy deteriorates due to protrusion from movable area
Solution Approach 1:
The image processing is segmented into two distinct stages: first, shake correction is applied to the entire image frame using posture information; second, cropping is performed on the shake-corrected image. This segmentation allows each process to operate optimally without interfering with the other, resolving the contradiction between comprehensive shake correction and precise cropping area control
Solution Approach 2:
Shake correction is performed as a preliminary action before cropping. By correcting the shake in the entire frame first, then applying cropping to the already-corrected image, the system ensures that the cropping area remains accurate and does not protrude from the movable area, while still benefiting from comprehensive shake correction coverage
2Area of stationary object
If cropping area is expanded to include more content, then image content coverage is improved, but shake correction quality deteriorates due to inclusion of unstable regions
Solution Approach 1:
The system dynamically determines the cropping area based on the shake correction results. After performing shake correction on the entire frame, the cropping area is calculated to be within the movable area where effective shake correction is maintained. This dynamic approach allows the cropping area to be as large as possible while ensuring it only includes regions with effective shake correction, resolving the contradiction between content coverage and correction quality
3Measurement precision
If celestial sphere model is used for shake correction, then shake correction accuracy is improved, but processing complexity increases due to coordinate transformation
Solution Approach 1:
The image is transformed to the celestial sphere model and shake correction is performed in this coordinate system as a preliminary action. The correction amount is calculated based on posture information in the celestial sphere model, then the corrected image is transformed back to the planar model for cropping. This preliminary action in the celestial sphere model ensures high accuracy while the subsequent automated transformation processes manage the complexity
Data Source
AI summary
Shake correction is performed using posture information corresponding to each frame of image data constituting a moving image on each frame, the frame having been subjected to processing of pasting to a celestial sphere model. Further, protrusion prevention processing for correcting an effective cropping area from each frame so that the effective cropping area does not protrude from a movable area in which the effective shake correction is maintained is performed on a requested cropping area to set an effective cropping area applied to each frame. Processing for generating an effective cropping area image is performed, the effective cropping area image being an image subjected to the shake correction and then projected onto a plane model from the celestial sphere model and being an image of the set effective cropping area.