Interaction method, system and mobile carrier for augmented reality head-up display

By combining voice input with timestamp information of the gaze area, the system analyzes the user's intent and the virtual objects within the gaze area, solving the problems of low accuracy and poor security in existing augmented reality head-up display interactions, and achieving an efficient and secure interaction method.

CN121187478BActive Publication Date: 2026-07-14GREAT WALL MOTOR CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
GREAT WALL MOTOR CO LTD
Filing Date
2025-09-30
Publication Date
2026-07-14

AI Technical Summary

Technical Problem

Existing technologies for interactive methods of augmented reality head-up displays in dynamic scenarios suffer from low interaction accuracy and poor safety. Traditional interaction methods require drivers to pay extra attention to operation and are difficult to adapt to the dynamic characteristics of virtual objects in augmented reality head-up displays.

Method used

By acquiring timestamped voice input commands and the user's line-of-sight area within a preset time window, and combining this with a multimodal information processing module to analyze the voice intent and virtual objects within the line-of-sight area, control commands are generated, achieving temporal fusion of voice and line of sight.

Benefits of technology

It significantly improves the accuracy and responsiveness of augmented reality head-up display interaction, reduces the demand on user attention, and ensures driving safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121187478B_ABST
    Figure CN121187478B_ABST
Patent Text Reader

Abstract

The application relates to an interaction method, system and mobile carrier for an augmented reality head-up display, and belongs to the technical field of intelligent interaction. The interaction method comprises the following steps: acquiring a voice input instruction of a user; acquiring a line-of-sight area range of the user within a preset time window; the preset time window comprises a first preset time length before the start of the voice input instruction to a second preset time length after the end of the voice input instruction; identifying a candidate object set from augmented reality virtual objects in the line-of-sight area range; analyzing a user intention and an indicating word in the voice input instruction, extracting an augmented reality virtual object associated with the indicating word in the candidate object set as a target object, and generating a control instruction containing the user intention and the target object; and executing a preset interaction operation corresponding to the user intention and the target object based on the control instruction.
Need to check novelty before this filing date? Find Prior Art