A cursor control method for an augmented reality display device

Abstract

The invention discloses a cursor control method of an augmented reality display device. By presetting the aiming area in the display screen of the AR display device, the field of view is adjusted by the change of the user's head posture, so that the aiming area is the same as that selected by the user according to the application scene. The preset reference target overlaps, and then according to the position information of the aiming area in the display screen and the real image in the current field of view, the area where the aiming area overlaps with the preset reference target is used as the reference target, and the reference target is set as the enhancement The cursor area of ​​the real display device adopts the feature screen of the real image as the cursor area of ​​the display screen, which saves the external hardware in the operation of the AR display device, improves the user experience at the same time, and expands the AR display device and the real world. range of interaction.

Description

technical field [0001] Embodiments of the present invention relate to the field of display technologies, and in particular, to a cursor control method for an augmented reality display device. Background technique [0002] Augmented Reality (AR) display devices need to control the system during use. Cursor area-based operation is the current mainstream system control method. AR display devices are equivalent to external screens, and cursor area operation is the most basic solution. It is a mouse or a touchpad, and further, there will be a "hover" screen operation based on the posture sensor of the head and neck. [0003] Existing technology one uses an external mouse or touchpad to perform traditional mouse control, which is consistent with the use method of an ordinary computer; using a handheld Bluetooth device with a motion sensor, the rotation of the handheld device points to two moving axes corresponding to the cursor area in the screen, This technical solution has the ...

AI Technical Summary

Problems solved by technology

[0003] The existing technology uses an external mouse or touchpad to perform traditional mouse control, which is consistent with the use method of ordinary computers; using a handheld Bluetooth device with a motion sensor, the rotation of the handheld device points to two moving axes corresponding to the cursor area in the screen, This technical solution requires external equipment, cannot realize complete offline display, and has the problem of redundancy

[0004] In prior art 2, the motion sensor is used to capture the posture and orientation of the device in real time, such as using the yaw angle and pitch angle to correspond to the movement of the horizontal axis and the vertical axis respectively. This solution usually fixes the center position of the display area as the cursor area, according to The calculation of the head posture makes the corresponding offset of the projection screen. For example, if the head turns to the left, the screen will move to the right. In the case of transmissive display combined with the real world, a screen "hovering" into the space is formed. The illusion of a certain position in the AR display area, and the movement of the head drives the mouse in the center of the display area to move on the "hovering" screen, so as to realize the designation of the position. Due to the limited field of view of the AR display device, this technical solution cannot be displayed on the projected screen. When moving in the display area, there is usually a problem that part of the screen will exceed the display area of ​​the device

Images