Mobile Device Image Reproduction via Keypoint Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for image mapping using mobile devices with attitude measurement capabilities are not efficient in accurately reproducing past shooting situations, as they lack a reliable way to align live view outputs with previously shot images based on detailed shooting parameters.
Innovation Solution
A method and system that extracts keypoints from both live view and previously shot images, calculates the tilt of the mobile device to align them within a critical range, and synthesizes the images using guide information to adjust the device's configuration, including location, orientation, and camera settings.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If image mapping is performed using mobile device attitude measurement, then location and direction information can be obtained, but the accuracy of reproducing past shooting situations is insufficient
Solution Approach 1:
The patent introduces keypoint matching as an intermediary mechanism between the mobile device's attitude measurement and the final image mapping. By extracting and matching keypoints from both the live view and previously shot image, the system creates an intermediate reference framework that bridges the gap between rough attitude data and precise situation reproduction, thereby improving accuracy without requiring direct complex interactions between all system components
Solution Approach 2:
The patent performs preliminary extraction of keypoints from the previously shot image and stores them for later comparison. This preliminary action allows the system to have reference data ready before the actual situation reproduction attempt, enabling more accurate alignment by comparing live view keypoints against pre-extracted reference keypoints, thus improving reproduction accuracy without increasing real-time system complexity
2Manufacturing precision
If multiple shooting parameters are tagged to images, then image mapping accuracy is improved, but the ease of operation deteriorates
Solution Approach 1:
The system automatically extracts shooting parameters such as location, direction, and attitude information directly from the mobile device's sensors and tags them to images without requiring manual input. This self-service approach maintains high image mapping precision through accurate parameter collection while preserving ease of operation by eliminating manual parameter entry requirements
Solution Approach 2:
The shooting parameters are automatically captured and tagged to images at the moment of image acquisition as a preliminary action. This ensures that all necessary mapping information is already embedded in the image data before the situation reproduction process begins, improving mapping precision while requiring no additional operational steps from the user
3Measurement precision
If the mobile device is adjusted to match shooting conditions, then situation reproduction accuracy is improved, but the time required for adjustment increases
Solution Approach 1:
The system provides real-time feedback by comparing keypoints from the live view with keypoints from the previously shot image, and guides the user's device adjustment through displayed guidance information. This feedback mechanism enables the user to make precise adjustments without trial and error, improving situation reproduction accuracy while minimizing adjustment time through directed, informed modifications
Solution Approach 2:
The system performs preliminary calculation of the required device tilt and orientation adjustments by comparing keypoint positions between the live view and reference image. This preliminary computation provides the user with specific adjustment targets before actual device manipulation begins, reducing the time needed to achieve accurate situation reproduction by eliminating guesswork and iterative adjustments
Data Source
AI summary
Provided is a method for reproducing a situation using a mobile device having an image shooting function. The method may include extracting first keypoints from a live view output to a display of the mobile device, extracting second keypoints from a previously shot image, calculating a tilt of the mobile device at which the first keypoints are mapped to the second keypoints within a critical range, and synthesizing the previously shot image with the live view in a state where the mobile device has been adjusted according to guide information based on a result of the calculating.