The invention discloses an AR glasses
control system and method, and belongs to the field of
artificial intelligence and AR glasses application, and the method comprises the steps: capturing a user face image, combining a
voice assistant, collecting user voiceprint data, and carrying out the matching through a
recurrent neural network; constructing a three-dimensional environment model, positioning and marking obstacles and interactive objects, and identifying objects in the environment; the method comprises the following steps of: tracking a gesture, acquiring a key point coordinate by adopting an OpenPose
algorithm, identifying a predefined gesture by utilizing a
support vector machine, and mapping the gesture into a specific operation instruction; analyzing the user intention based on
natural language processing, and calling a corresponding function module according to an analysis result; acquiring a gazing direction of a user by using an
eye movement tracking sensor, calculating a screen focus position through an
algorithm, and dynamically highlighting options or displaying information according to a gazing point position; through multi-
modal data fusion, gestures, voices and
fixation point input are analyzed in a unified manner. By accurately understanding the intention of the user, the interaction precision of the AR glasses is improved, and the user experience is optimized.