Stereo Image Rotation Correction for VR Parallax Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing VR imaging technologies face challenges in accurately correcting rotational shifts in captured images, leading to issues like reversed horizontal parallax and vertical parallax, which can cause VR sickness and hinder stereoscopic viewing.
Innovation Solution
An image processing apparatus that acquires first and second images with parallax, and outputs stereoscopic viewable images by setting the images as left-eye and right-eye images in different modes, including a mode where the images are rotated around the optical axis to correct for rotational shifts.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If rotational shift correction is performed using acceleration sensor data, then horizontal parallax can be corrected for small rotational shifts, but vertical parallax cannot be removed and horizontal parallax may be reversed for large rotational shifts
Solution Approach 1:
The system dynamically switches between two operational modes based on the detected rotational shift amount: a first mode for small rotational shifts that applies rotational shift correction, and a second mode for large rotational shifts that performs 180-degree rotation and lens switching. This dynamic adaptation ensures reliable stereoscopic viewing across the full range of rotational shifts.
Solution Approach 2:
The system changes the processing parameters based on the rotational shift amount threshold. When the rotational shift exceeds the threshold, the system switches from applying rotational correction to performing 180-degree rotation and lens switching, thereby adapting the correction strategy to the magnitude of the distortion.
2Adaptability or versatility
If the camera is fixed in various attitudes (e.g., upside down, vertical), then imaging versatility is improved, but horizontal parallax may be reversed or vertical parallax cannot be removed
Solution Approach 1:
The system dynamically determines the operational mode based on the camera's attitude and rotational shift amount. For cameras fixed in various attitudes, the system automatically selects whether to apply rotational shift correction or perform 180-degree rotation with lens switching, ensuring correct stereoscopic viewing regardless of mounting orientation.
Solution Approach 2:
The system provides universal stereoscopic imaging capability across multiple camera attitudes by implementing two complementary correction modes. The first mode handles small rotational shifts through rotational correction, while the second mode handles large rotational shifts and upside-down orientations through 180-degree rotation and lens switching, making the system adaptable to diverse mounting scenarios.
3Area of moving object
If a fisheye lens captures an image with an angle of view exceeding 180 degrees, then the angle of view is improved, but image distortion increases requiring correction
Solution Approach 1:
The system performs preliminary determination of the operational mode based on the detected rotational shift amount before executing the correction. This preliminary action allows the system to select the appropriate correction strategy (rotational shift correction or 180-degree rotation with lens switching) to minimize distortion in the final stereoscopic image.
Solution Approach 2:
The system changes the correction parameters based on the rotational shift amount. For small rotational shifts, rotational shift correction is applied; for large rotational shifts, 180-degree rotation and lens switching are performed. This parameter adaptation effectively reduces image distortion while preserving the wide angle of view capability of the fisheye lens.
Data Source
AI summary
An image processing apparatus includes a memory storing instructions, and a processor configured to execute the instruction to acquire a first image and a second image with parallax, or one image including the first image and the second image, output one stereoscopic viewable image by setting the first image as a right-eye image and the second image as a left-eye image in a first mode, and output one stereoscopic viewable image by setting the first image as the left-eye image and the second image as the right-eye image, and by rotating the first image and the second image around an optical axis in a second mode.