Panoramic Image Progress Feedback via Sensor Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing panoramic image pickup methods suffer from inaccuracies in progress information due to errors in inertial data from gyro sensors, leading to delayed detection of the maximum panning range and a long time lag between user operations and progress display, making it difficult for users to track the progress of panoramic image creation in real time.
Innovation Solution
An image pickup apparatus equipped with an image sensor, first and second detection units, and a display control unit that combines images based on positional deviations and accurately displays the progress of panoramic image pickup by using both inertial movement data and actual image alignment information, allowing for timely feedback to the user.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If progress information is displayed based on actual combining completion timing, then accuracy of progress information is improved, but time lag between user operation and progress display increases
Solution Approach 1:
The system performs preliminary action by detecting camera movement in advance using the gyro sensor during image pickup, and uses this detected movement information to predict and display progress before the actual combining processing is completed. This allows progress information to be displayed with minimal time lag while maintaining reasonable accuracy through subsequent correction.
Solution Approach 2:
The system implements feedback by continuously monitoring both the gyro sensor data and the actual combining progress, then using this feedback to correct and update the displayed progress information. The progress display is adjusted based on the difference between predicted progress (from gyro data) and actual progress (from combining completion), ensuring accuracy while maintaining real-time responsiveness.
2Speed
If inertial information from gyro sensor is used to detect progress, then real-time progress information can be displayed, but accuracy of progress information deteriorates due to errors in inertial data
Solution Approach 1:
The system uses feedback by continuously comparing the progress predicted from gyro sensor data with the actual combining progress, then correcting the displayed progress based on this comparison. This feedback mechanism maintains real-time responsiveness while compensating for errors in the inertial information.
Solution Approach 2:
The system replaces reliance on the mechanical gyro sensor alone with a hybrid approach that substitutes inertial measurement with actual image combining progress detection. The final progress information is derived from the digital image processing results rather than purely from mechanical sensor data, eliminating the accumulation of inertial errors.
3Quantity of substance
If detection of maximum panning range is delayed, then more images can be captured, but user continues unnecessary panning operations
Solution Approach 1:
The system performs preliminary action by detecting camera movement during image pickup and using this information to predict when the maximum panning range will be reached. This allows the system to prepare and signal the user in advance before the actual limit is reached, preventing unnecessary panning operations while ensuring maximum image capture.
Solution Approach 2:
The system implements feedback by continuously monitoring the combining progress and providing real-time information to the user about proximity to the maximum panning range. This feedback enables the user to stop panning at the appropriate time, avoiding unnecessary operations while capturing the maximum useful images.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution provides accurate and timely progress information to users, preventing unnecessary panning operations and enabling the creation of panoramic images within the maximum range by balancing real-time feedback with accurate positional data, thus enhancing user experience and image capture efficiency.
Implementation Method 1
The first detection unit is configured to detect movement of the image sensor in performing image pickup by using inertial information
Implementation Method 2
The second detection unit is configured to detect a positional deviation of the plurality of images by comparing at least some of the plurality of images
Data Source
AI summary
An image pickup apparatus includes: an image sensor; a first detection unit configured to detect movement of the image sensor; a second detection unit configured to compare images to detect a positional deviation thereof; a combining unit configured to combine the images on a basis of the detected positional deviation and to generate a panoramic image; and a display control unit, in which in a case where combining of images up to an Nth frame is completed by the combining unit, on a basis of information about a size of the panoramic image generated by combining the images up to the Nth frame and the movement of the image sensor, which is detected by the first detection unit and corresponds to frames from an (N+1)th frame to an (N+M)th frame, the display control unit generates information indicating progress of combining of the panoramic image.