Viewpoint Image Inclination Correction via Marker Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing techniques for generating images based on viewpoint information often result in decreased visibility due to camera shake and unintended inclination, making it difficult to accurately operate mobile terminals and maintain desired viewpoints.
Innovation Solution
An image processing apparatus that acquires viewpoint information, performs inclination correction on the generated images, and outputs corrected images, using a system comprising an image capturing apparatus and an image processing apparatus that communicate to ensure accurate viewpoint representation and improved image visibility.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If viewpoint information is acquired based on the position and orientation of the mobile terminal, then the user can arbitrarily designate the viewpoint, but the visibility of the output image is decreased due to camera shake and unintended inclination
Solution Approach 1:
A marker is introduced as an intermediary object between the user and the viewpoint designation system. The marker serves as a stable reference that mediates the relationship between the mobile terminal's physical position and the virtual camera's viewpoint, allowing accurate viewpoint determination independent of terminal stability
Solution Approach 2:
The system captures an image of the marker and creates a digital representation (coordinate information) that copies the marker's spatial position. This copied information is then used to determine the viewpoint, separating the viewpoint designation from the physical terminal position and eliminating camera shake effects
2Ease of operation
If the user physically operates the mobile terminal to control position and orientation, then the viewpoint can be designated, but it is difficult to accurately operate the mobile terminal as intended
Solution Approach 1:
The marker acts as an intermediary that simplifies the operation. Instead of precisely controlling the mobile terminal's position and orientation, the user only needs to capture an image of the marker, which automatically provides accurate coordinate information for viewpoint designation
Solution Approach 2:
The physical mechanical operation of precisely positioning and orienting the mobile terminal is replaced by a simpler image capture operation. The system substitutes complex mechanical control with automated image processing and coordinate extraction from the captured marker image
3Adaptability or versatility
If viewpoint information is used to generate the determined-viewpoint image, then the image depicts the view from the arbitrary viewpoint, but the output image has unintended inclination
Solution Approach 1:
The system uses the captured marker image as feedback to determine the viewpoint. The coordinate information extracted from the marker image provides feedback on the correct orientation, which is then used to generate the determined-viewpoint image with proper inclination correction
Solution Approach 2:
The marker image is captured in advance before generating the determined-viewpoint image. This preliminary capture provides the coordinate information needed to pre-calculate the correct viewpoint and orientation, allowing the final image to be generated with proper inclination already accounted for
Data Source
AI summary
An image processing apparatus includes: an acquisition unit configured to acquire viewpoint information indicating a viewpoint; a generation unit configured to generate a determined-viewpoint image based on a plurality of captured images captured from a plurality of directions and the viewpoint information acquired by the acquisition unit, wherein the generation unit performs an inclination correction process for correcting an inclination, according to the viewpoint information, of the determined-viewpoint image; and an output unit configured to output the determined-viewpoint image generated by the generation unit.