Vehicle-Mounted AR Navigation Alignment for Head Movement Compensation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing AR navigation technologies face issues with position offset due to user head movement, affecting the accuracy and user experience when projecting navigation information onto vehicle-mounted glasses.

Innovation Solution

A navigation method and apparatus that acquires real-world images and navigation information, converts them to match the eyebox of vehicle-mounted glasses, and superimposes navigation data for accurate display, using positional relationships between image capturing devices and the glasses to adjust for head movement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If AR navigation information is projected onto vehicle-mounted glasses, then the user can observe navigation information in the real world, but position offset occurs due to head movement affecting accuracy

Engineering Contradiction:
ImproveAR navigation observabilityVSAvoidnavigation information position accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system continuously tracks the real-world image and calculates the positional relationship between the first image capturing device (IVI system) and the second image capturing device (glasses). This feedback mechanism dynamically adjusts the projection image to compensate for head movement, maintaining accurate alignment between navigation information and the user's field of view.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system pre-calculates the positional relationship between the two image capturing devices and establishes the transformation matrix in advance. By preparing the projection image conversion beforehand based on anticipated head movement patterns, the system reduces latency and maintains positioning accuracy during actual navigation.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If the projection image is converted to match the eyebox of vehicle-mounted glasses, then the navigation information aligns with the user's field of view, but the system complexity increases due to multiple image capturing devices

Engineering Contradiction:
Improveprojection image alignment accuracyVSAvoidimage capturing device configuration
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system uses a universal coordinate transformation approach that can handle multiple image capturing devices with different positions and orientations. The transformation matrix methodology provides a unified framework for converting images from various sources to match the eyebox, reducing the need for device-specific processing logic.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system introduces an intermediate processing step where the first real-world image is converted to a second real-world image coordinate system, which then serves as the basis for generating the projection image. This intermediary transformation simplifies the overall conversion process by breaking it into manageable stages.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If real-time image conversion is performed to compensate for head movement, then navigation accuracy is maintained, but the processing time and computational load increase

Engineering Contradiction:
Improvenavigation information positioning accuracyVSAvoidimage processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system pre-calculates and stores the transformation matrix between the first and second image capturing devices. By preparing these conversion parameters in advance rather than computing them in real-time during navigation, the system significantly reduces processing time while maintaining positioning accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically adjusts the projection image based on real-time head movement detection, but uses pre-computed transformation matrices to minimize computational overhead. This dynamic adaptation with pre-prepared data structures allows the system to respond quickly to head movements without excessive processing delays.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP4086102B1Navigation method and apparatus, electronic device, readable storage medium and computer program product
Publication Date: 2024.05.22 APOLLO INTELLIGENT CONNECTIVITY (BEIJING) TECH CO LTD
  • EP4086102B1 patent drawingFigure 1
  • EP4086102B1 patent drawingFigure 2~3
  • EP4086102B1 patent drawingFigure 4~5

AI summary

A navigation method and apparatus, an electronic device, a readable storage medium, and a computer program product are provided, which relate to a field of vehicle networking technology, and in particular to a field of navigation technology. The navigation method includes: acquiring a real world image and a navigation information; converting the real world image to obtain a projection image, wherein the projection image is matched with an eyebox of at least one pair of vehicle-mounted glasses; superimposing the navigation information on the projection image to obtain a navigation image; and transmitting to the vehicle-mounted glasses the navigation image so that the navigation image is displayed by the vehicle-mounted glasses. In the solution, the AR navigation is implemented based on the vehicle-mounted glasses, and an influence on the effect of the AR navigation caused by the change of the position of the user's head may be avoided, so as to ensure the effect of the AR navigation and the user's experience.