Image Correction Using Sensor-Based Yaw Estimation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional image correction processing requires manual operator intervention, leading to high workloads and processing times, and is not suitable for portable devices like smartphones due to processing limitations, especially when photographing display shelves from non-facial angles causing distortion.
Innovation Solution
An information processing system that automates image correction by calculating a regression line using pitch, roll, and yaw angles to deform image information, enabling correction on portable devices with low processing capabilities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If manual trapezoid correction processing is performed, then image distortion can be corrected, but operator workload increases and processing time is required
Solution Approach 1:
The system automatically detects the display shelf edges and calculates correction parameters without operator intervention. The correction processing unit autonomously performs trapezoid correction by detecting vertical lines in the image, calculating their deviations, and applying appropriate transformations, thereby eliminating manual workload while maintaining correction accuracy
Solution Approach 2:
The patent replaces manual mechanical operations (operator clicking vertices, dragging points) with automated image processing algorithms. The system uses edge detection, vertical line extraction, and mathematical calculations to automatically determine correction parameters, substituting human mechanical interaction with computational processes
2Manufacturing precision
If conventional correction processing is used, then image distortion is corrected, but processing load is too high for portable devices
Solution Approach 1:
The patent extracts only the essential correction parameters (horizontal shift amounts for left and right edges) from the full image correction process. By focusing solely on correcting horizontal deviations of vertical lines rather than performing comprehensive geometric transformations, the processing load is significantly reduced while maintaining effective distortion correction
Solution Approach 2:
The system performs partial correction by addressing only the specific distortion issue (horizontal misalignment of vertical lines) rather than进行全面 geometric correction. This selective approach reduces computational requirements while still achieving the necessary correction quality for display shelf imaging
3Adaptability or versatility
If photographing from non-facing position is performed, then photographing flexibility increases, but image distortion occurs
Solution Approach 1:
The patent converts the harmful effect of photographing from non-facing positions (image distortion) into a beneficial automatic correction opportunity. The system detects the distortion characteristics through vertical line analysis and automatically calculates correction parameters, transforming the problem of unavoidable distortion into an automated solution that enables flexible photographing without compromising final image quality
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
An object is to provide an information processing system that performs correction processing on image information. An information processing system that corrects image information photographed by a photographing device to a directly facing position, the information processing system including: an image information input acceptance processing unit that accepts an input of image information to be corrected; a sensor information input acceptance processing unit that accepts an input of information on a pitch angle and a roll angle of the photographing device or the information processing device and distance information to an arbitrary point in a photographing object; a correction processing unit that performs correction processing on the image information; and an output processing unit that outputs the image information on which the correction processing has been performed, in which the correction processing unit calculates a regression line of a point group including a plurality of the points by using the distance information and the information on a pitch angle and a roll angle, and estimates information on a yaw angle of the photographing device or the information processing device, and deforms the image information using the information on the estimated yaw angle so as to be at a position facing the photographing device.