A local image recognition method and system based on AR smart glasses

Abstract

The invention belongs to the technical field of AR smart glasses application, and discloses a local image recognition method and system based on AR smart glasses, which can calibrate the consistency of the smart glasses imaging screen, the front camera picture of the smart glasses, and the visual domain picture of the surrounding real environment Calibration; identify human eye images and calculate eye movement vectors, and obtain eye movement coordinates; identify whether the focal point of the extension line of human binocular vision falls on the imaging screen or the real three-dimensional space; obtain the mapping relationship of human eyes in the surrounding real world; according to the embedded mapping algorithm The coordinate positions of the gaze point of the human eye on the imaging screen of the glasses and the picture of the front camera are obtained respectively. The present invention obtains the eye diagram information of the human eye through the eye tracker, and performs synchronous calibration of the eye diagram of the human eye and the scene camera, obtains the gaze point area of ​​the human eye in the real scene, and only performs image recognition on the gaze point area during processing , which greatly reduces the image processing pressure of the GPU and improves image processing efficiency.

Description

technical field [0001] The invention belongs to the technical field of AR smart glasses application, and in particular relates to a partial image recognition method and system based on AR smart glasses. Background technique [0002] At present, the existing technologies commonly used in the industry are as follows: [0003] With the rapid development of the AR / VR industry in recent years, we have noticed that AR smart glasses will be the next generation of smart terminals that will eliminate smartphones. The apps on AR smart glasses are just like the apps on smart phones when they first emerged. with huge market value. We understand that eye tracking technology is an important human-computer interaction method for AR smart glasses in the future. Based on this environment, we think that there may be potential markets for future applications, and huge market value may explode when the future era comes. [0004] In the existing technology, in VR virtual reality technology, th...

Images