Panoramic VR Image Stitching Using Multi-Camera Calibration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems face difficulties in generating 360-degree panoramic virtual reality images from photographs captured by cameras with different imaging characteristics, as they struggle to convert and stitch images with varying view angles, zooming ratios, brightness, and resolutions into cohesive panoramic views.
Innovation Solution
A system and method that involves multiple image capturing devices capturing and transmitting photographs, with an image conversion device calibrating and stitching the images using characteristic information such as view angle, zooming ratio, brightness, and resolution to generate a 360-degree panoramic VR image, allowing for real-time generation and immersive viewing experiences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If multiple image capturing devices with different imaging characteristics are used to capture photographs, then the coverage area and viewpoints increase, but the difficulty of stitching and calibrating images increases
Solution Approach 1:
The system changes parameters by introducing characteristic information (view angle, zooming ratio, brightness, resolution) for each image capturing device and using calibration values to normalize these parameters. This allows images from devices with different imaging characteristics to be standardized and stitched together effectively, resolving the contradiction between increased coverage area and stitching complexity.
2Area of stationary object
If images with different view angles and zooming ratios are stitched, then the panoramic coverage increases, but the image quality and consistency deteriorate
Solution Approach 1:
The system applies parameter changes by calibrating images using characteristic information including view angle and zooming ratio. Each image is adjusted according to its specific parameters to ensure consistent projection and stitching, maintaining image quality and consistency across the entire panoramic coverage.
Solution Approach 2:
The system introduces an intermediary calibration process that mediates between images with different view angles and zooming ratios. The characteristic information acts as an intermediary parameter set that translates and harmonizes diverse image parameters into a unified coordinate system, enabling consistent stitching while preserving panoramic coverage.
3Productivity
If real-time panoramic VR image generation is implemented, then the user experience improves, but the processing time and computational load increase
Solution Approach 1:
The system applies preliminary action by pre-establishing the relationship between characteristic information and calibration values for each image capturing device. This pre-calibration approach allows the system to quickly process and stitch images in real-time without performing complex calculations during the actual stitching operation, thereby reducing processing time while maintaining real-time generation capability.
Data Source
AI summary
The described technology provides a system and method of generating a 360-degree panoramic virtual reality (VR) image by using a plurality of photograph images. A plurality of image capturing devices capture and transmit the plurality of photograph images, respectively. An image conversion device receives the plurality of photograph images from the plurality of image capturing devices, calibrates each of the plurality of photograph images using characteristic information of respective one of the plurality of image capturing devices, and stitches calibrated photograph images to generate the 360-degree panoramic VR image. According to embodiments, the user can check a situation of a monitoring area while changing the viewpoint of the 360-degree panoramic VR image or enjoy the generated VR contents at a high degree of immersion.