Virtual Camera Calibration for AR Image Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality technologies face difficulties in efficiently displaying complex virtual images due to the need for coordinate rotation, which can lead to processing inefficiencies and poor display effects, especially in interactive scenarios with multiple virtual objects.
Innovation Solution
The method involves detecting a target object in a real-scene captured image to determine the real capturing direction of a terminal camera, calibrating the virtual capturing direction of a virtual camera, and performing rendering processing to superimpose the adjusted virtual image on the real-scene image, eliminating the need for coordinate rotation and enhancing processing efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If coordinate rotation processing is applied to the virtual image to adjust display angle, then the display angle can be changed, but the processing complexity increases and efficiency decreases
Solution Approach 1:
Instead of rotating the virtual image coordinates to change display angle, the patent inverts the approach by rotating the virtual camera's capturing direction. The virtual camera's direction is adjusted according to the real camera's capturing direction, and the virtual image is rendered from this rotated camera perspective, avoiding complex coordinate rotation processing while achieving the same display angle adjustment effect
Solution Approach 2:
The patent replaces the mechanical coordinate rotation system with a virtual camera orientation system. Rather than physically rotating image coordinates through mathematical transformations, the system uses a virtual camera model whose capturing direction can be dynamically adjusted, substituting complex coordinate processing with simpler camera parameter adjustment
2Adaptability or versatility
If coordinate rotation processing is applied to the virtual image, then display direction can be adjusted, but the display effect deteriorates for complex virtual images
Solution Approach 1:
The patent inverts the processing approach from image-based coordinate rotation to camera-based direction adjustment. By rotating the virtual camera's capturing direction rather than the virtual image coordinates, the system maintains better display quality for complex virtual images while achieving the required display direction adjustment
3Productivity
If virtual camera capturing direction is calibrated according to real camera capturing direction, then processing efficiency improves, but system complexity increases
Solution Approach 1:
The patent introduces a virtual camera as an intermediary between the real camera and the virtual image rendering system. The virtual camera's capturing direction serves as a mediator that is calibrated based on the real camera's direction, simplifying the overall processing by providing a clear transformation pathway without requiring complex direct coordinate mapping between real and virtual spaces
Data Source
AI summary
Provided are a virtual image displaying method and apparatus, an electronic device, and a storage medium; by detecting a target object in a real-scene captured image captured by a terminal camera to determine a real capturing direction of the terminal camera according to a position of the target object in the real-scene captured image, calibrating, according to the real-scene capturing direction, a virtual capturing direction of a virtual camera, and performing, according to the calibrated virtual capturing direction, rendering processing on a shared virtual image corresponding to the target object to superimpose and display the processed shared virtual image on the real-scene captured image, the virtual capturing direction of the virtual camera is processed, which can be more suitable for a complex virtual image to making it can be applied to more interactive scenarios.