Vehicle XR Navigation Calibration for Stable AR Object Positioning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing extended reality (XR) devices face challenges in rendering accurate augmented reality (AR) views during navigation due to camera position changes and vibrations, especially in vehicles, leading to difficulties in displaying AR objects correctly.
Innovation Solution
An XR device equipped with a camera module, position information detector, and sensing module, utilizing a processor for calibration based on camera view, vanish points, and bonnet lines to accurately position virtual objects, with optional manual or automatic calibration using deep neural networks, ensuring proper display of AR objects and obstacle cropping.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a camera is installed in a vehicle to capture real space for AR navigation, then the navigation function is provided, but the camera position changes due to vehicle movement and vibration causing inaccurate AR object positioning
Solution Approach 1:
The patent replaces the mechanical camera mounting system with a sensor-based detection and calibration system. Instead of physically securing the camera to prevent movement, the system uses sensors to detect camera position changes and software calibration to compensate, substituting mechanical stability with electronic correction.
Solution Approach 2:
The system changes the parameter of camera position from a fixed physical state to a dynamically detected and corrected state. By continuously monitoring position parameters through sensors and adjusting calibration data, the system maintains positioning accuracy despite physical movement.
2Measurement precision
If calibration is performed using camera view and vanishing points, then AR object positioning accuracy is improved, but the calibration process complexity increases
Solution Approach 1:
The system performs self-calibration by automatically detecting vanishing points and road geometry from camera images without requiring manual intervention. The calibration process serves itself by using the camera's own captured images to determine positioning parameters, eliminating the need for external calibration tools or procedures.
Solution Approach 2:
The patent introduces vanishing points and road geometry as intermediary elements between the camera and AR objects. These intermediaries serve as reference frameworks that simplify the calibration process by providing natural geometric constraints that automatically define the correct positioning relationship.
3Loss of information
If obstacle elements are displayed on the camera preview screen, then comprehensive information is provided, but driver visibility of the road screen is reduced causing confusion
Solution Approach 1:
The system extracts obstacle elements from the main camera preview display and separates them into a different presentation format or location. This extraction removes the distracting elements from the primary road view while preserving the information, allowing drivers to access obstacle data without it interfering with road visibility.
Solution Approach 2:
The display is segmented into distinct regions: the primary camera preview for road visibility and separate indicator regions for obstacle information. This segmentation allows both comprehensive information display and clear road visibility to coexist by spatially separating different types of information presentation.
Data Source
AI summary
The present disclosure relates to an XR device and a method for controlling the same, and more particularly, is applicable to a 5G communication technology field, a robot technology field, an autonomous technology field and an artificial intelligence (AI) technology field. The method for controlling an XR device of a vehicle includes acquiring a camera view by capturing an image in front of the vehicle; acquiring position information of the vehicle by detecting a position of the vehicle, acquiring movement information of the vehicle by detecting movement of the vehicle, and providing navigation of an augmented reality (AR) mode displaying at least one virtual object for guiding a path by overlapping the at least one virtual object on the camera view based on at least the position information of the vehicle or the movement information of the vehicle.