Intelligent glasses interaction method and system based on pupil tracking

Abstract

The invention discloses an intelligent glasses interaction method based on pupil tracking, and the method comprises the steps: setting a reference coordinate system of intelligent glasses for tracking pupil movement glasses, monitoring and analyzing pupil movement state data, and obtaining pupil movement state monitoring and analysis data; according to the pupil motion state monitoring analysis data, automatically creating an association relationship between the pupil tracking position of the intelligent glasses and glasses interaction information; according to the association relationship between the pupil position and glasses interaction information, automatically tracking the pupil position of the pupil movement, marking the coordinate value in a glasses reference coordinate system, and obtaining an intelligent glasses pupil tracking monitoring tracking pupil position used for triggering an interaction control instruction; performing individual adaptive pupil tracking and intelligent glasses stereoscopic image display control interaction according to the pupil tracking position monitoring of the intelligent glasses; the invention discloses an intelligent glasses interaction system based on pupil tracking. The adaptation intelligence degree and the interaction accuracy of various scenes are remarkably improved, and the control interaction diversification is remarkably improved.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent interaction automatic control, and particularly relates to an intelligent glasses interaction method and system based on pupil tracking. Background Art

[0002] Currently, it is still difficult to form a systematic linkage mechanism for intelligent glasses interaction; and there are some of the following problems: how to obtain the linkage pupil tracking of external pupil tracking and intelligent linkage and amplify the signal power of external pupil tracking and linkage pupil tracking, how to perform transform analysis on the sampling values to analyze the spectral characteristics of pupil tracking, how to perform arithmetic processing and call different intelligent glasses and intelligent linkage control scenarios, etc. Therefore, it is necessary to propose an intelligent glasses interaction method and system based on pupil tracking to at least partially solve the problems existing in the prior art. Summary of the Invention

[0003] A series of simplified concepts are introduced in the Summary of the Invention part, which will be further elaborated in the Detailed Description of the Invention part; the Summary of the Invention part of the present invention does not mean to attempt to define the key features and essential technical features of the claimed technical relationship, nor does it mean to attempt to determine the protection scope of the claimed technical relationship.

[0004] To at least partially solve the above problems, the present invention provides an intelligent glasses interaction method based on pupil tracking, including:

[0005] S100, set a reference coordinate system for the intelligent glasses to track pupil movement, monitor and analyze pupil movement state data, and obtain pupil movement state monitoring and analysis data;

[0006] S200, automatically create an association relationship between the intelligent glasses tracking pupil position and the glasses interaction information according to the pupil movement state monitoring and analysis data;

[0007] S300, automatically track the pupil movement pupil position according to the association relationship between the pupil position and the glasses interaction information and mark the coordinate values in the glasses reference coordinate system to obtain the intelligent glasses tracking pupil monitoring and tracking pupil position for triggering an interaction control instruction;

[0008] S400, perform individual adaptive pupil tracking and intelligent glasses stereoscopic image display control interaction according to the intelligent glasses tracking pupil monitoring and tracking pupil position.

[0009] Preferably, the S100 includes:

[0010] S101, set a reference coordinate system for the intelligent glasses to track pupil movement according to the basic intelligent glasses interaction data, intelligent glasses interaction statistics, and intelligent glasses interaction conditions;

[0011] S102. Monitor and analyze the pupil movement state information through fast camera pupil tracking monitoring and tracking analysis;

[0012] S103. Output the pupil movement state information to the storage unit of the smart glasses to obtain the pupil movement state monitoring and analysis data.

[0013] Preferably, the S200 includes:

[0014] S201. Transmit the pupil movement state monitoring and analysis data through the wireless transmission unit of the smart glasses for mutual transmission between the smart glasses wireless network and the mobile terminal;

[0015] S202. According to the pupil movement state monitoring and analysis data, perform intelligent adaptation between the device and the pupil movement state by adapting the pupil movement state of the smart glasses to the state of the smart glasses to obtain the intelligent adaptation information between the device and the pupil movement state;

[0016] S203. According to the intelligent adaptation information between the device and the pupil movement state, automatically create the association relationship between the pupil position tracked by the smart glasses and the glasses interaction information.

[0017] Preferably, the S300 includes:

[0018] S301. Import the association relationship between the pupil position and the glasses interaction information into the smart glasses, perform the selection of associated environmental features, and obtain the individual-adaptive associated environmental features;

[0019] S302. Match the corresponding pupil tracking index information according to the individual-adaptive associated environmental features;

[0020] S303. According to the pupil tracking index information, automatically track the pupil movement pupil position and mark the coordinate values in the glasses reference coordinate system to obtain the smart glasses tracking pupil monitoring and tracking pupil position for triggering the interaction control instruction.

[0021] Preferably, the S400 includes:

[0022] S401. According to the smart glasses tracking pupil monitoring and tracking pupil position, project the pupil tracking smart glasses interaction scene through the smart glasses pupil tracking scene display unit;

[0023] S402. Monitor the adaptation degree of the pupil tracking adaptation scene according to the pupil tracking smart glasses interaction scene;

[0024] S403. According to the adaptation degree of the pupil tracking adaptation scene, adjust the change of the pupil tracking smart glasses interaction scene, execute the pupil tracking smart glasses interaction program, and perform individual-adaptive pupil tracking and smart glasses stereoscopic image display control interaction.

[0025] The present invention provides an intelligent glasses interaction system based on pupil tracking, including:

[0026] A pupil tracking monitoring and analysis subsystem, which sets a glasses reference coordinate system for the intelligent glasses to track pupil movement, monitors and analyzes pupil movement state data, and obtains pupil movement state monitoring and analysis data;

[0027] An intelligent glasses interaction association subsystem, which automatically creates an association relationship between the position of the intelligent glasses tracking the pupil and the glasses interaction information according to the pupil movement state monitoring and analysis data;

[0028] A pupil tracking scene selection subsystem, which automatically tracks the pupil movement pupil position according to the association relationship between the pupil position and the glasses interaction information and marks the coordinate value in the glasses reference coordinate system, and obtains the intelligent glasses tracking pupil monitoring and tracking pupil position for triggering an interaction control instruction;

[0029] An environmental scene intelligent glasses interaction subsystem, which performs individual adaptive pupil tracking and intelligent glasses stereoscopic image display control interaction according to the intelligent glasses tracking pupil monitoring and tracking pupil position.

[0030] Preferably, the pupil tracking monitoring and analysis subsystem includes:

[0031] A pupil movement glasses reference coordinate system subsystem, which sets a glasses reference coordinate system for the intelligent glasses to track pupil movement according to the basic intelligent glasses interaction data, intelligent glasses interaction statistics and intelligent glasses interaction conditions;

[0032] A pupil movement state monitoring and analysis subsystem, which monitors and analyzes pupil movement state information through fast camera pupil tracking monitoring and tracking analysis;

[0033] A monitoring and analysis data acquisition subsystem, which outputs the pupil movement state information to the intelligent glasses storage unit to obtain pupil movement state monitoring and analysis data.

[0034] Preferably, the intelligent glasses interaction association subsystem includes:

[0035] A pupil movement state data transmission subsystem, which transmits the pupil movement state monitoring and analysis data through the wireless transmission unit of the intelligent glasses for mutual transmission between the intelligent glasses wireless network and the mobile terminal;

[0036] A device wearing intelligent adaptation subsystem, which performs intelligent adaptation between the device and the pupil movement state according to the pupil movement state monitoring and analysis data through the pupil movement state of the intelligent glasses and the state of the intelligent glasses, and obtains intelligent adaptation information between the device and the pupil movement state;

[0037] An adaptation interaction association subsystem, which automatically creates an association relationship between the position of the intelligent glasses tracking the pupil and the glasses interaction information according to the intelligent adaptation information between the device and the pupil movement state.

[0038] Preferably, the pupil tracking scenario selection subsystem includes:

[0039] An intelligent glasses interaction association import subsystem that imports the association relationship between the pupil position and the glasses interaction information into the intelligent glasses, performs association environment feature selection, and obtains individual adaptive association environment features;

[0040] An association environment feature matching subsystem that matches corresponding pupil tracking index information according to the individual adaptive association environment features;

[0041] An intelligent glasses interaction statistics selection subsystem that automatically tracks the pupil movement and pupil position according to the pupil tracking index information and marks the coordinate values in the glasses reference coordinate system, and obtains the intelligent glasses tracking pupil monitoring and tracking pupil position for triggering the interaction control instruction.

[0042] Preferably, the environmental scenario intelligent glasses interaction subsystem includes:

[0043] An intelligent glasses tracking pupil position subsystem that projects a pupil tracking intelligent glasses interaction scenario through the intelligent glasses pupil tracking scenario display unit according to the intelligent glasses tracking pupil monitoring and tracking pupil position;

[0044] A pupil tracking adaptation subsystem that monitors the adaptation degree of the pupil tracking adaptation scenario according to the pupil tracking intelligent glasses interaction scenario;

[0045] An environmental guidance intelligent interaction subsystem that adjusts the change of the pupil tracking intelligent glasses interaction scenario according to the adaptation degree of the pupil tracking adaptation scenario, executes the pupil tracking intelligent glasses interaction program, and performs individual adaptive pupil tracking and intelligent glasses stereoscopic image display control interaction.

[0046] Compared with the prior art, the present invention has at least the following beneficial effects:

[0047] The present invention provides an intelligent glasses interaction method and system based on pupil tracking, including: setting up a glasses reference coordinate system for the intelligent glasses to track pupil movement, monitoring and analyzing pupil movement state data to obtain pupil movement state monitoring and analysis data; automatically creating an association relationship between the intelligent glasses' tracked pupil position and glasses interaction information according to the pupil movement state monitoring and analysis data; automatically tracking the pupil movement pupil position according to the association relationship between the pupil position and glasses interaction information and marking the coordinate values in the glasses reference coordinate system to obtain the intelligent glasses' tracked pupil monitoring and tracking pupil position for triggering an interaction control instruction; performing individual adaptive pupil tracking and intelligent glasses stereoscopic image display control interaction according to the intelligent glasses' tracked pupil monitoring and tracking pupil position; setting up the glasses reference coordinate system for the intelligent glasses to track pupil movement according to the intelligent glasses interaction basic data, intelligent glasses interaction statistics and intelligent glasses interaction conditions; monitoring and analyzing pupil movement state information through fast camera pupil tracking monitoring and tracking analysis; outputting the pupil movement state information to the intelligent glasses storage unit to obtain pupil movement state monitoring and analysis data; transmitting the pupil movement state monitoring and analysis data mutually between the intelligent glasses wireless network and the mobile terminal through the wireless transmission unit of the intelligent glasses; performing device and pupil movement state intelligent adaptation according to the pupil movement state monitoring and analysis data and the state of the intelligent glasses to obtain device and pupil movement state intelligent adaptation information; automatically creating an association relationship between the intelligent glasses' tracked pupil position and glasses interaction information according to the device and pupil movement state intelligent adaptation information; importing the association relationship between the pupil position and glasses interaction information into the intelligent glasses, performing associated environment feature selection to obtain individual adaptive associated environment features; matching corresponding pupil tracking index information according to the individual adaptive associated environment features; automatically tracking the pupil movement pupil position according to the pupil tracking index information and marking the coordinate values in the glasses reference coordinate system to obtain the intelligent glasses' tracked pupil monitoring and tracking pupil position for triggering an interaction control instruction; projecting a pupil tracking intelligent glasses interaction scene through the intelligent glasses pupil tracking scene display unit according to the intelligent glasses' tracked pupil monitoring and tracking pupil position; monitoring the adaptation degree of the pupil tracking adaptation scene according to the pupil tracking intelligent glasses interaction scene; adjusting the change of the pupil tracking intelligent glasses interaction scene according to the adaptation degree of the pupil tracking adaptation scene, executing the pupil tracking intelligent glasses interaction program, and performing individual adaptive pupil tracking and intelligent glasses stereoscopic image display control interaction; the intelligent degree of various scene adaptations and the interaction accuracy are significantly improved, the diversification of control interactions is significantly enhanced, the intelligent degree of various scene adaptations of the intelligent glasses and the interaction accuracy are greatly improved, and the diversification of control interactions is significantly enhanced.

[0048] An intelligent glasses interaction method and system based on pupil tracking according to the present invention. Other advantages, objectives, and features of the present invention will be partially reflected by the following description and partially understood by those skilled in the art through the research and practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] The drawings are used to provide a further understanding of the present invention and constitute a part of the specification. They are used together with the embodiments of the present invention to explain the present invention and do not constitute a limitation to the present invention. In the drawings:

[0050] Figure 1 It is a diagram of an intelligent glasses interaction method based on pupil tracking according to the present invention.

[0051] Figure 2 It is a diagram of an embodiment of an intelligent glasses interaction method based on pupil tracking according to the present invention.

[0052] Figure 3 It is a block diagram of an intelligent glasses interaction system based on pupil tracking according to the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0053] The following further describes the present invention in detail in conjunction with the drawings and embodiments, so that those skilled in the art can implement it according to the description in the specification; as Figures 1-3 shown, the present invention provides an intelligent glasses interaction method based on pupil tracking, including:

[0054] S100, set a glasses reference coordinate system for the intelligent glasses to track pupil movement, monitor and analyze pupil movement state data, and obtain pupil movement state monitoring and analysis data;

[0055] S200, automatically create an association relationship between the pupil position tracked by the intelligent glasses and the glasses interaction information according to the pupil movement state monitoring and analysis data;

[0056] S300, automatically track the pupil movement pupil position according to the association relationship between the pupil position and the glasses interaction information and mark the coordinate values in the glasses reference coordinate system to obtain the intelligent glasses tracking pupil monitoring and tracking pupil position for triggering an interaction control instruction;

[0057] S400, perform individual adaptive pupil tracking and intelligent glasses stereoscopic image display control interaction according to the intelligent glasses tracking pupil monitoring and tracking pupil position.

[0058] The working principle of the above technical solution is as follows: The present invention provides an intelligent glasses interaction method based on pupil tracking, including: setting up a glasses reference coordinate system for the intelligent glasses to track pupil movement, monitoring and analyzing pupil movement state data to obtain pupil movement state monitoring and analysis data; automatically creating an association relationship between the intelligent glasses tracking pupil position and the glasses interaction information according to the pupil movement state monitoring and analysis data; automatically tracking the pupil movement pupil position according to the association relationship between the pupil position and the glasses interaction information and marking the coordinate values in the glasses reference coordinate system to obtain the intelligent glasses tracking pupil monitoring and tracking pupil position for triggering an interaction control instruction; and performing individual adaptive pupil tracking and intelligent glasses stereoscopic image display control interaction according to the intelligent glasses tracking pupil monitoring and tracking pupil position.

[0059] The beneficial effects of the above technical solution are as follows: The present invention provides an intelligent glasses interaction method based on pupil tracking, including: setting a glasses reference coordinate system for the intelligent glasses to track pupil movement, monitoring and analyzing pupil movement state data to obtain pupil movement state monitoring and analysis data; automatically creating an association relationship between the intelligent glasses tracking pupil position and the glasses interaction information according to the pupil movement state monitoring and analysis data; automatically tracking the pupil movement pupil position according to the association relationship between the pupil position and the glasses interaction information and marking the coordinate values in the glasses reference coordinate system to obtain the intelligent glasses tracking pupil monitoring and tracking pupil position for triggering an interaction control instruction; performing individual adaptive pupil tracking and intelligent glasses stereoscopic image display control interaction according to the intelligent glasses tracking pupil monitoring and tracking pupil position; setting the glasses reference coordinate system for the intelligent glasses to track pupil movement according to the intelligent glasses interaction basic data, intelligent glasses interaction statistics, and intelligent glasses interaction conditions; monitoring and analyzing pupil movement state information through fast camera pupil tracking monitoring and tracking analysis; outputting the pupil movement state information to the intelligent glasses storage unit to obtain pupil movement state monitoring and analysis data; transmitting the pupil movement state monitoring and analysis data between the intelligent glasses wireless network and the mobile terminal through the wireless transmission unit of the intelligent glasses; performing device and pupil movement state intelligent adaptation according to the pupil movement state monitoring and analysis data and the state of the intelligent glasses to obtain device and pupil movement state intelligent adaptation information; automatically creating an association relationship between the intelligent glasses tracking pupil position and the glasses interaction information according to the device and pupil movement state intelligent adaptation information; importing the association relationship between the pupil position and the glasses interaction information into the intelligent glasses, performing associated environment feature selection to obtain individual adaptive associated environment features; matching corresponding pupil tracking index information according to the individual adaptive associated environment features; automatically tracking the pupil movement pupil position according to the pupil tracking index information and marking the coordinate values in the glasses reference coordinate system to obtain the intelligent glasses tracking pupil monitoring and tracking pupil position for triggering an interaction control instruction; projecting a pupil tracking intelligent glasses interaction scene through the intelligent glasses pupil tracking scene display unit according to the intelligent glasses tracking pupil monitoring and tracking pupil position; monitoring the adaptation degree of the pupil tracking adaptation scene according to the pupil tracking intelligent glasses interaction scene; adjusting the change of the pupil tracking intelligent glasses interaction scene according to the adaptation degree of the pupil tracking adaptation scene, executing the pupil tracking intelligent glasses interaction program, and performing individual adaptive pupil tracking and intelligent glasses stereoscopic image display control interaction; the intelligent degree of various scene adaptations and the interaction accuracy are significantly improved, the control interaction diversification is significantly enhanced, the intelligent degree of various scene adaptations of the intelligent glasses and the interaction accuracy are greatly improved, and the control interaction diversification is significantly enhanced.

[0060] In one embodiment, the S100 includes:

[0061] S101. Set the reference coordinate system for the smart glasses to track pupil movement based on the basic data of smart glasses interaction, the statistics of smart glasses interaction, and the conditions of smart glasses interaction;

[0062] S102. Monitor and analyze the pupil movement state information through fast camera pupil tracking monitoring and analysis;

[0063] S103. Output the pupil movement state information to the storage unit of the smart glasses to obtain the monitoring and analysis data of the pupil movement state.

[0064] The working principle of the above technical solution is as follows: Set the reference coordinate system for the smart glasses to track pupil movement based on the basic data of smart glasses interaction, the statistics of smart glasses interaction, and the conditions of smart glasses interaction; Monitor and analyze the pupil movement state information through fast camera pupil tracking monitoring and analysis; Output the pupil movement state information to the storage unit of the smart glasses to obtain the monitoring and analysis data of the pupil movement state; Monitor and analyze the pupil movement state information through fast camera pupil tracking monitoring and analysis, including: A part of the reflected light generated by the pupil passes through the optical imaging lens of the fast camera system and irradiates onto the photoelectric image sensing surface of the optoelectronic imaging device, and a pupil target image is formed on the photoelectric image sensing surface. The fast drive circuit controls the optoelectronic device to quickly respond to the pupil target image. According to the light energy distribution of the pupil target image on the photoelectric image sensing surface, charge packets corresponding to the light energy distribution are generated at the fast sensing pixel points to perform fast distributed pixel point optoelectronic conversion of the pupil target image; The charge packets corresponding to the light energy distribution with pupil target image information are quickly transferred to the readout register and a pupil target image readout signal is generated. The pupil target image readout signal is processed to obtain the pupil movement state information.

[0065] The beneficial effects of the above technical solution are as follows: According to the basic data of smart glasses interaction, the statistics of smart glasses interaction, and the conditions of smart glasses interaction, a reference coordinate system for the smart glasses to track pupil movement is set; through fast camera pupil tracking monitoring and analysis, the pupil movement state information is monitored and analyzed; the pupil movement state information is output to the storage unit of the smart glasses to obtain the monitoring and analysis data of the pupil movement state; through fast camera pupil tracking monitoring and analysis, the monitored and analyzed pupil movement state information includes: a part of the reflected light generated by the pupil passes through the optical imaging lens of the fast camera system and irradiates the photoelectric image induction surface of the photoelectric imaging device, and a pupil target image is formed on the photoelectric image induction surface. The fast drive circuit controls the optoelectronic device to quickly respond to the pupil target image. According to the light energy distribution of the pupil target image on the photoelectric image induction surface, charge packets corresponding to the light energy distribution are generated at the fast induction pixel points, and fast distributed pixel point optoelectronic conversion of the pupil target image is performed; the charge packets corresponding to the light energy distribution with the pupil target image information are quickly transferred to the readout register and a pupil target image readout signal is generated. After the pupil target image readout signal is processed, the pupil movement state information is obtained; it can greatly increase the reasonable adaptability of smart glasses interaction.

[0066] In one embodiment, the S200 includes:

[0067] S201, transmitting the monitoring and analysis data of the pupil movement state through the wireless transmission unit of the smart glasses for mutual transmission between the smart glasses wireless network and the mobile terminal;

[0068] S202, according to the monitoring and analysis data of the pupil movement state, performing intelligent adaptation between the device and the pupil movement state through the pupil movement state of the smart glasses and the state of the smart glasses to obtain the intelligent adaptation information between the device and the pupil movement state;

[0069] S203, automatically creating an association relationship between the smart glasses tracking pupil position and the glasses interaction information according to the intelligent adaptation information between the device and the pupil movement state.

[0070] The working principle of the above technical solution is as follows: Transmitting the monitoring and analysis data of the pupil movement state through the wireless transmission unit of the smart glasses for mutual transmission between the smart glasses wireless network and the mobile terminal; according to the monitoring and analysis data of the pupil movement state, performing intelligent adaptation between the device and the pupil movement state through the pupil movement state of the smart glasses and the state of the smart glasses to obtain the intelligent adaptation information between the device and the pupil movement state; automatically creating an association relationship between the smart glasses tracking pupil position and the glasses interaction information according to the intelligent adaptation information between the device and the pupil movement state.

[0071] The beneficial effects of the above technical solution are as follows: The monitoring and analysis data of the pupil movement state are transmitted between the wireless network of the smart glasses and the mobile terminal through the wireless transmission unit of the smart glasses; according to the monitoring and analysis data of the pupil movement state, the device and the pupil movement state are intelligently adapted and adapted by the pupil movement state of the smart glasses and the state of the smart glasses, and the intelligent adaptation and adaptation information of the device and the pupil movement state is obtained; according to the intelligent adaptation and adaptation information of the device and the pupil movement state, the association relationship between the pupil position tracked by the smart glasses and the glasses interaction information is automatically created; the pupil tracking accuracy is higher.

[0072] In one embodiment, the S300 includes:

[0073] S301, import the association relationship between the pupil position and the glasses interaction information into the smart glasses, perform the selection of associated environmental features, and obtain the individual-adaptive associated environmental features;

[0074] S302, match the corresponding pupil tracking index information according to the individual-adaptive associated environmental features;

[0075] S303, automatically track the pupil movement pupil position according to the pupil tracking index information and mark the coordinate value in the glasses reference coordinate system, and obtain the smart glasses tracking pupil monitoring and tracking pupil position for triggering the interaction control instruction.

[0076] The working principle of the above technical solution is as follows: import the association relationship between the pupil position and the glasses interaction information into the smart glasses, perform the selection of associated environmental features, and obtain the individual-adaptive associated environmental features; match the corresponding pupil tracking index information according to the individual-adaptive associated environmental features; automatically track the pupil movement pupil position according to the pupil tracking index information and mark the coordinate value in the glasses reference coordinate system, and obtain the smart glasses tracking pupil monitoring and tracking pupil position for triggering the interaction control instruction.

[0077] The beneficial effects of the above technical solution are as follows: import the association relationship between the pupil position and the glasses interaction information into the smart glasses, perform the selection of associated environmental features, and obtain the individual-adaptive associated environmental features; match the corresponding pupil tracking index information according to the individual-adaptive associated environmental features; automatically track the pupil movement pupil position according to the pupil tracking index information and mark the coordinate value in the glasses reference coordinate system, and obtain the smart glasses tracking pupil monitoring and tracking pupil position for triggering the interaction control instruction.

[0078] In one embodiment, the S400 includes:

[0079] S401, project the pupil tracking smart glasses interaction scene through the smart glasses pupil tracking scene display unit according to the smart glasses tracking pupil monitoring and tracking pupil position;

[0080] S402. Monitor the adaptability of the pupil tracking adaptation scenario according to the interaction scenario of the pupil tracking smart glasses;

[0081] S403. Adjust the change of the interaction scenario of the pupil tracking smart glasses according to the adaptability of the pupil tracking adaptation scenario, execute the interaction program of the pupil tracking smart glasses, and perform the interaction between individual adaptive pupil tracking and the control of the stereoscopic image display of the smart glasses.

[0082] The working principle of the above technical solution is as follows: The position of the tracked pupil is monitored according to the pupil tracked by the smart glasses, and the interaction scenario of the pupil tracking smart glasses is projected through the pupil tracking scene display unit of the smart glasses; the adaptability of the pupil tracking adaptation scenario is monitored according to the interaction scenario of the pupil tracking smart glasses; the change of the interaction scenario of the pupil tracking smart glasses is adjusted according to the adaptability of the pupil tracking adaptation scenario, the interaction program of the pupil tracking smart glasses is executed, and the interaction between individual adaptive pupil tracking and the control of the stereoscopic image display of the smart glasses is performed;

[0083] Performing the interaction between individual adaptive pupil tracking and the control of the stereoscopic image display of the smart glasses includes: classifying the pupil tracking information based on the interaction scenario features of the pupil tracking smart glasses in multiple dimensions; transmitting the pupil tracking information after data classification to the artificial intelligence module, interpreting and analyzing the pupil tracking information through the artificial intelligence module, and projecting the corresponding interaction scenario of the pupil tracking smart glasses based on the pupil tracking information after data classification and the interpretation and analysis from the artificial intelligence module; uniformly classifying and processing the pupil tracking information and the content of the interpretation and analysis of the pupil tracking information by the artificial intelligence module; storing the information according to the unified classification result by category to form an interaction knowledge base of the pupil tracking smart glasses, where the categories include smart glasses 3D stereoscopic control 4031, smart glasses voice control 4032, and smart glasses and cloud data transmission interaction 4033; performing the interaction between individual adaptive pupil tracking and the control of the stereoscopic image display of the smart glasses.

[0084] The beneficial effects of the above technical solution are as follows: The pupil position is tracked according to the pupil monitoring of the smart glasses, and the pupil tracking smart glasses interaction scene is projected through the pupil tracking scene display unit of the smart glasses; According to the pupil tracking smart glasses interaction scene, the adaptability of the pupil tracking adaptation scene is monitored; According to the adaptability of the pupil tracking adaptation scene, the change of the pupil tracking smart glasses interaction scene is adjusted, and the pupil tracking smart glasses interaction program is executed to perform the interaction between individual adaptive pupil tracking and the stereoscopic image display control of the smart glasses; The interaction between individual adaptive pupil tracking and the stereoscopic image display control of the smart glasses includes: classifying the pupil tracking information based on the characteristics of the pupil tracking smart glasses interaction scene in multiple dimensions; Transmitting the pupil tracking information after data classification to the artificial intelligence module, interpreting and analyzing the pupil tracking information through the artificial intelligence module, and projecting the corresponding pupil tracking smart glasses interaction scene based on the pupil tracking information after data classification and the interpretation and analysis from the artificial intelligence module; Uniformly classifying and processing the pupil tracking information and the content of the interpretation and analysis of the pupil tracking information by the artificial intelligence module; Storing the information according to the unified classification result by category to form a pupil tracking smart glasses interaction knowledge base, and the categories include smart glasses 3D stereoscopic control 4031, smart glasses voice control 4032, and smart glasses and cloud data transmission interaction 4033; Performing the interaction between individual adaptive pupil tracking and the stereoscopic image display control of the smart glasses; Greatly improving the adaptability intelligence level and interaction accuracy of various scenes of the smart glasses, and significantly enhancing the diversification of control interaction.

[0085] The present invention provides a smart glasses interaction system based on pupil tracking, including:

[0086] The pupil tracking monitoring and analysis subsystem sets a reference coordinate system for the smart glasses to track pupil movement, monitors and analyzes the pupil movement state data, and obtains the pupil movement state monitoring and analysis data;

[0087] The smart glasses interaction association subsystem automatically creates an association relationship between the pupil position tracked by the smart glasses and the glasses interaction information according to the pupil movement state monitoring and analysis data;

[0088] The pupil tracking scene selection subsystem automatically tracks the pupil movement pupil position according to the association relationship between the pupil position and the glasses interaction information and marks the coordinate value in the glasses reference coordinate system, and obtains the smart glasses tracking pupil monitoring and tracking pupil position for triggering the interaction control instruction;

[0089] The environmental scene smart glasses interaction subsystem performs the interaction between individual adaptive pupil tracking and the stereoscopic image display control of the smart glasses according to the smart glasses tracking pupil monitoring and tracking pupil position.

[0090] The working principle of the above technical solution is as follows: The present invention provides an intelligent glasses interaction system based on pupil tracking, including: a pupil tracking monitoring and analysis subsystem, which sets up a glasses reference coordinate system for the intelligent glasses to track pupil movement, monitors and analyzes pupil movement state data, and obtains pupil movement state monitoring and analysis data; an intelligent glasses interaction association subsystem, which automatically creates an association relationship between the intelligent glasses tracking pupil position and the glasses interaction information according to the pupil movement state monitoring and analysis data; a pupil tracking scene selection subsystem, which automatically tracks the pupil movement pupil position according to the association relationship between the pupil position and the glasses interaction information and marks the coordinate value in the glasses reference coordinate system, and obtains the intelligent glasses tracking pupil monitoring and tracking pupil position for triggering an interaction control instruction; an environmental scene intelligent glasses interaction subsystem, which performs individual adaptive pupil tracking and intelligent glasses stereoscopic image display control interaction according to the intelligent glasses tracking pupil monitoring and tracking pupil position.

[0091] The beneficial effects of the above technical solution are as follows: The present invention provides an intelligent glasses interaction system based on pupil tracking, including: a pupil tracking monitoring and analysis subsystem, which sets up a glasses reference coordinate system for the intelligent glasses to track pupil movement, monitors and analyzes pupil movement state data, and obtains pupil movement state monitoring and analysis data; an intelligent glasses interaction association subsystem, which automatically creates an association relationship between the pupil position tracked by the intelligent glasses and the glasses interaction information according to the pupil movement state monitoring and analysis data; a pupil tracking scene selection subsystem, which automatically tracks the pupil movement pupil position according to the association relationship between the pupil position and the glasses interaction information and marks the coordinate value in the glasses reference coordinate system, and obtains the intelligent glasses tracking pupil monitoring and tracking pupil position for triggering an interaction control instruction; an environmental scene intelligent glasses interaction subsystem, which performs individual adaptive pupil tracking and intelligent glasses stereoscopic image display control interaction according to the intelligent glasses tracking pupil monitoring and tracking pupil position; sets up a glasses reference coordinate system for the intelligent glasses to track pupil movement according to the intelligent glasses interaction basic data, intelligent glasses interaction statistics, and intelligent glasses interaction conditions; monitors and analyzes pupil movement state information through fast camera pupil tracking monitoring and tracking analysis; outputs the pupil movement state information to the intelligent glasses storage unit to obtain pupil movement state monitoring and analysis data; transmits the pupil movement state monitoring and analysis data through the wireless transmission unit of the intelligent glasses for mutual transmission between the intelligent glasses wireless network and the mobile terminal; performs device and pupil movement state intelligent adaptation according to the pupil movement state monitoring and analysis data and the state of the intelligent glasses to obtain device and pupil movement state intelligent adaptation information; automatically creates an association relationship between the pupil position tracked by the intelligent glasses and the glasses interaction information according to the device and pupil movement state intelligent adaptation information; imports the association relationship between the pupil position and the glasses interaction information into the intelligent glasses to perform associated environmental feature selection and obtain individual adaptive associated environmental features; matches the corresponding pupil tracking index information according to the individual adaptive associated environmental features; automatically tracks the pupil movement pupil position according to the pupil tracking index information and marks the coordinate value in the glasses reference coordinate system to obtain the intelligent glasses tracking pupil monitoring and tracking pupil position for triggering an interaction control instruction; projects a pupil tracking intelligent glasses interaction scene through the intelligent glasses pupil tracking scene display unit according to the intelligent glasses tracking pupil monitoring and tracking pupil position; monitors the adaptability of the pupil tracking adaptation scene according to the pupil tracking intelligent glasses interaction scene; adjusts the change of the pupil tracking intelligent glasses interaction scene according to the adaptability of the pupil tracking adaptation scene, executes the pupil tracking intelligent glasses interaction program, and performs individual adaptive pupil tracking and intelligent glasses stereoscopic image display control interaction; the intelligent degree of adaptation to various scenes and the interaction accuracy are significantly improved, the diversification of control interaction is significantly enhanced, the intelligent degree of adaptation to various scenes of the intelligent glasses and the interaction accuracy are greatly improved, and the diversification of control interaction is significantly enhanced.

[0092] In one embodiment, the pupil tracking monitoring and analysis subsystem includes:

[0093] A pupil movement glasses reference coordinate system subsystem that sets a smart glasses tracking pupil movement glasses reference coordinate system according to the basic smart glasses interaction data, smart glasses interaction statistics, and smart glasses interaction conditions;

[0094] A pupil movement state monitoring and analysis subsystem that monitors and analyzes pupil movement state information through fast camera pupil tracking monitoring and analysis;

[0095] A monitoring and analysis data acquisition subsystem that outputs pupil movement state information to the smart glasses storage unit to obtain pupil movement state monitoring and analysis data.

[0096] The working principle of the above technical solution is as follows: The pupil tracking monitoring and analysis subsystem includes: a pupil movement glasses reference coordinate system subsystem that sets a smart glasses tracking pupil movement glasses reference coordinate system according to the basic smart glasses interaction data, smart glasses interaction statistics, and smart glasses interaction conditions; a pupil movement state monitoring and analysis subsystem that monitors and analyzes pupil movement state information through fast camera pupil tracking monitoring and analysis; a monitoring and analysis data acquisition subsystem that outputs pupil movement state information to the smart glasses storage unit to obtain pupil movement state monitoring and analysis data; through fast camera pupil tracking monitoring and analysis, the monitored and analyzed pupil movement state information includes: a part of the reflected light generated by the pupil passes through the optical imaging lens of the fast camera system and irradiates the photoelectric image induction surface of the photoelectric imaging device, and a pupil target image is formed on the photoelectric image induction surface. The fast drive circuit controls the optoelectronic device to quickly respond to the pupil target image. According to the light energy distribution of the pupil target image on the photoelectric image induction surface, light energy distribution corresponding charge packets are generated at the fast induction pixel points to perform fast distributed pixel point optoelectronic conversion of the pupil target image; the light energy distribution corresponding charge packets with pupil target image information are quickly transferred to the readout register and a pupil target image readout signal is generated. The pupil target image readout signal is processed to obtain pupil movement state information.

[0097] The beneficial effects of the above technical solution are as follows: The pupil tracking and monitoring analysis subsystem includes: a pupil movement glasses reference coordinate system subsystem, which sets a smart glasses tracking pupil movement glasses reference coordinate system according to the basic smart glasses interaction data, smart glasses interaction statistics, and smart glasses interaction conditions; a pupil movement state monitoring and analysis subsystem, which monitors and analyzes pupil movement state information through fast camera pupil tracking monitoring and tracking analysis; a monitoring and analysis data acquisition subsystem, which outputs the pupil movement state information to the smart glasses storage unit to obtain pupil movement state monitoring and analysis data; the monitoring and analysis of pupil movement state information through fast camera pupil tracking monitoring and tracking analysis includes: a part of the reflected light generated by the pupil passes through the optical imaging lens of the fast camera system and irradiates the photoelectric image induction surface of the photoelectric imaging device, and a pupil target image is formed on the photoelectric image induction surface. The fast drive circuit controls the optoelectronic device to quickly respond to the pupil target image. According to the light energy distribution of the pupil target image on the photoelectric image induction surface, charge packets corresponding to the light energy distribution are generated at the fast induction pixel points, and fast distributed pixel point optoelectronic conversion of the pupil target image is performed; the charge packets corresponding to the light energy distribution with pupil target image information are quickly transferred to the readout register and a pupil target image readout signal is generated. The pupil target image readout signal is processed to obtain pupil movement state information; it can greatly increase the reasonable adaptability of smart glasses interaction.

[0098] In one embodiment, the smart glasses interaction association subsystem includes:

[0099] A pupil movement state data transmission subsystem, which mutually transmits the pupil movement state monitoring and analysis data through the wireless transmission unit of the smart glasses to the smart glasses wireless network and the mobile terminal;

[0100] A device wearing intelligent adaptation subsystem, which performs intelligent adaptation of the device and the pupil movement state according to the pupil movement state monitoring and analysis data through the pupil movement state of the smart glasses and the state of the smart glasses to obtain device and pupil movement state intelligent adaptation information;

[0101] An adaptation interaction association subsystem, which automatically creates an association relationship between the smart glasses tracking pupil position and the glasses interaction information according to the device and pupil movement state intelligent adaptation information.

[0102] The working principle of the above technical solution is as follows: The smart glasses interaction association subsystem includes:

[0103] A pupil movement state data transmission subsystem, which mutually transmits the pupil movement state monitoring and analysis data through the wireless transmission unit of the smart glasses to the smart glasses wireless network and the mobile terminal;

[0104] The device - wearing intelligent adaptation subsystem monitors and analyzes data according to the pupil movement state, and performs intelligent adaptation between the device and the pupil movement state through the pupil movement state of the smart glasses and the state of the smart glasses, obtaining the intelligent adaptation information between the device and the pupil movement state;

[0105] The adaptation interaction association subsystem automatically creates an association relationship between the smart glasses tracking the pupil position and the glasses interaction information according to the intelligent adaptation information between the device and the pupil movement state.

[0106] The beneficial effects of the above - mentioned technical solution are as follows: The smart glasses interaction association subsystem includes: The pupil movement state data transmission subsystem transmits the pupil movement state monitoring and analysis data through the wireless transmission unit of the smart glasses for mutual transmission between the smart glasses wireless network and the mobile terminal; The device - wearing intelligent adaptation subsystem monitors and analyzes data according to the pupil movement state, and performs intelligent adaptation between the device and the pupil movement state through the pupil movement state of the smart glasses and the state of the smart glasses, obtaining the intelligent adaptation information between the device and the pupil movement state; The adaptation interaction association subsystem automatically creates an association relationship between the smart glasses tracking the pupil position and the glasses interaction information according to the intelligent adaptation information between the device and the pupil movement state; The pupil tracking accuracy is higher.

[0107] In one embodiment, the pupil tracking scenario selection subsystem includes:

[0108] The smart glasses interaction association import subsystem imports the association relationship between the pupil position and the glasses interaction information into the smart glasses, selects the associated environmental features, and obtains the individual - adaptable associated environmental features;

[0109] The associated environmental feature matching subsystem matches the corresponding pupil tracking index information according to the individual - adaptable associated environmental features;

[0110] The smart glasses interaction statistics selection subsystem automatically tracks the pupil movement and pupil position and marks the coordinate values in the glasses reference coordinate system according to the pupil tracking index information, obtaining the smart glasses tracking pupil monitoring and tracking pupil position for triggering the interaction control instruction.

[0111] The working principle of the above - mentioned technical solution is as follows: The pupil tracking scenario selection subsystem includes: The smart glasses interaction association import subsystem imports the association relationship between the pupil position and the glasses interaction information into the smart glasses, selects the associated environmental features, and obtains the individual - adaptable associated environmental features; The associated environmental feature matching subsystem matches the corresponding pupil tracking index information according to the individual - adaptable associated environmental features; The smart glasses interaction statistics selection subsystem automatically tracks the pupil movement and pupil position and marks the coordinate values in the glasses reference coordinate system according to the pupil tracking index information, obtaining the smart glasses tracking pupil monitoring and tracking pupil position for triggering the interaction control instruction.

[0112] The beneficial effects of the above technical solution are as follows: The intelligent glasses interaction correlation import subsystem imports the correlation between the pupil position and the glasses interaction information into the intelligent glasses, performs correlation environment feature selection, and obtains individual adaptive correlation environment features; the correlation environment feature matching subsystem matches the corresponding pupil tracking index information according to the individual adaptive correlation environment features; the intelligent glasses interaction statistics selection subsystem automatically tracks the pupil movement pupil position according to the pupil tracking index information and marks the coordinate values in the glasses reference coordinate system, and obtains the intelligent glasses tracking pupil monitoring and tracking pupil position for triggering the interaction control instruction.

[0113] In one embodiment, the environmental scene intelligent glasses interaction subsystem includes:

[0114] The intelligent glasses tracking pupil position subsystem projects the pupil tracking intelligent glasses interaction scene through the intelligent glasses pupil tracking scene display unit according to the intelligent glasses tracking pupil monitoring and tracking pupil position.

[0115] The pupil tracking adaptation subsystem monitors the adaptation degree of the pupil tracking adaptation scene according to the pupil tracking intelligent glasses interaction scene.

[0116] The environmental guidance intelligent interaction subsystem adjusts the change of the pupil tracking intelligent glasses interaction scene according to the adaptation degree of the pupil tracking adaptation scene, executes the pupil tracking intelligent glasses interaction program, and performs individual adaptive pupil tracking and intelligent glasses stereoscopic image display control interaction.

[0117] The working principle of the above technical solution is as follows: The environmental scene intelligent glasses interaction subsystem includes:

[0118] The intelligent glasses tracking pupil position subsystem projects the pupil tracking intelligent glasses interaction scene through the intelligent glasses pupil tracking scene display unit according to the intelligent glasses tracking pupil monitoring and tracking pupil position.

[0119] The pupil tracking adaptation subsystem monitors the adaptation degree of the pupil tracking adaptation scene according to the pupil tracking intelligent glasses interaction scene.

[0120] The environmental guidance intelligent interaction subsystem adjusts the change of the pupil tracking intelligent glasses interaction scene according to the adaptation degree of the pupil tracking adaptation scene, executes the pupil tracking intelligent glasses interaction program, and performs individual adaptive pupil tracking and intelligent glasses stereoscopic image display control interaction.

[0121] Performing individual adaptive pupil tracking and intelligent glasses stereoscopic image display control interaction includes: classifying pupil tracking information based on pupil tracking intelligent glasses interaction scene features in multiple dimensions; transmitting the classified pupil tracking information to an artificial intelligence module, interpreting and analyzing the pupil tracking information through the artificial intelligence module, and projecting a corresponding pupil tracking intelligent glasses interaction scene based on the classified pupil tracking information and the interpretation and analysis from the artificial intelligence module; performing unified classification processing on the pupil tracking information and the content of the artificial intelligence module's interpretation and analysis of the pupil tracking information; storing information by category according to the unified classification result to form a pupil tracking intelligent glasses interaction knowledge base, where the categories include intelligent glasses 3D stereoscopic control 4031, intelligent glasses voice control 4032, and intelligent glasses and cloud data transmission interaction 4033; performing individual adaptive pupil tracking and intelligent glasses stereoscopic image display control interaction.

[0122] The beneficial effects of the above technical solution are as follows: The environmental scene intelligent glasses interaction subsystem includes: an intelligent glasses pupil position tracking subsystem that monitors and tracks the pupil position according to the intelligent glasses pupil tracking, and projects a pupil tracking intelligent glasses interaction scene through the intelligent glasses pupil tracking scene display unit; a pupil tracking adaptation subsystem that monitors the adaptation degree of the pupil tracking adaptation scene according to the pupil tracking intelligent glasses interaction scene; an environmental guidance intelligent interaction subsystem that adjusts the change of the pupil tracking intelligent glasses interaction scene according to the adaptation degree of the pupil tracking adaptation scene, executes the pupil tracking intelligent glasses interaction program, and performs individual adaptive pupil tracking and intelligent glasses stereoscopic image display control interaction; performing individual adaptive pupil tracking and intelligent glasses stereoscopic image display control interaction includes: classifying pupil tracking information based on pupil tracking intelligent glasses interaction scene features in multiple dimensions; transmitting the classified pupil tracking information to an artificial intelligence module, interpreting and analyzing the pupil tracking information through the artificial intelligence module, and projecting a corresponding pupil tracking intelligent glasses interaction scene based on the classified pupil tracking information and the interpretation and analysis from the artificial intelligence module; performing unified classification processing on the pupil tracking information and the content of the artificial intelligence module's interpretation and analysis of the pupil tracking information; storing information by category according to the unified classification result to form a pupil tracking intelligent glasses interaction knowledge base, where the categories include intelligent glasses 3D stereoscopic control 4031, intelligent glasses voice control 4032, and intelligent glasses and cloud data transmission interaction 4033; performing individual adaptive pupil tracking and intelligent glasses stereoscopic image display control interaction; significantly improving the intelligent degree of various scene adaptations and the interaction accuracy of intelligent glasses, and significantly enhancing the diversification of control interaction.

[0123] The embodiments of the present invention are not limited solely to the applications listed in the specification and the embodiments. It can be fully applied to various fields suitable for the present invention, and those skilled in the art can easily make additional modifications. Therefore, without departing from the general concept defined by the claims and the equivalent scope, the present invention is not limited to the specific details and the examples shown and described herein.

Claims

1. A smart glasses interaction method based on pupil tracking, characterized in that: include: S100, setting a reference coordinate system for the smart glasses to track pupil movement, monitoring and analyzing pupil movement state data, and obtaining pupil movement state monitoring and analysis data; S200, automatically creating a correlation relationship between the pupil position tracked by the smart glasses and the glasses interaction information based on the pupil movement status monitoring and analysis data; S300, according to the correlation between the pupil position and the glasses interaction information, automatically track the pupil movement and pupil position and mark the coordinate value in the glasses reference coordinate system, and obtain the smart glasses tracking pupil monitoring and tracking pupil position for triggering the interaction control command; S400, tracking pupil position according to pupil tracking by smart glasses, performing individual adaptive pupil tracking and smart glasses stereoscopic image display control interaction.

2. The method for smart glasses interaction based on pupil tracking according to claim 1, characterized in that: The S100 includes: S101, setting a glasses reference coordinate system for tracking pupil movement of smart glasses according to basic smart glasses interaction data, smart glasses interaction statistics and smart glasses interaction conditions; S102, monitoring and analyzing pupil movement status information through rapid camera pupil tracking monitoring and analysis; S103, outputting pupil movement status information to a storage unit of the smart glasses to obtain pupil movement status monitoring and analysis data.

3. The method for smart glasses interaction based on pupil tracking according to claim 1, characterized in that: The S200 includes: S201, transmitting pupil movement status monitoring and analysis data to and from a smart glasses wireless network and a mobile terminal through a wireless transmission unit of the smart glasses; S202, according to the pupil movement state monitoring and analysis data, the device and the pupil movement state are intelligently adapted through the pupil movement state of the smart glasses and the state of the smart glasses to obtain the device and the pupil movement state intelligent adaptation information; S203, automatically creating an association between the pupil position tracking of the smart glasses and the glasses interaction information according to the intelligent adaptation information of the device and the pupil movement state.

4. The method for smart glasses interaction based on pupil tracking according to claim 1, characterized in that: The S300 includes: S301, importing the correlation relationship between pupil position and glasses interaction information into smart glasses, performing correlation environment feature selection, and obtaining individual adaptive correlation environment features; S302, matching corresponding pupil tracking index information according to individual adaptability and associated environmental features; S303, according to the pupil tracking index information, automatically track the pupil movement and pupil position and mark the coordinate value in the glasses reference coordinate system, and obtain the smart glasses tracking pupil monitoring and tracking pupil position for triggering the interactive control instruction.

5. The method for smart glasses interaction based on pupil tracking according to claim 1, characterized in that: The S400 includes: S401, tracking the pupil position according to the pupil tracking of the smart glasses, and projecting the pupil tracking smart glasses interaction scene through the smart glasses pupil tracking scene display unit; S402, monitoring the adaptability of pupil tracking to the scene according to the pupil tracking smart glasses interaction scene; S403, adjusting pupil tracking smart glasses interaction scene changes according to pupil tracking adaptation scene adaptability, executing pupil tracking smart glasses interaction program, and performing individual adaptive pupil tracking and smart glasses stereoscopic image display control interaction.

6. A smart glasses interaction system based on pupil tracking, characterized in that: include: The pupil tracking monitoring and analysis subsystem sets a reference coordinate system for the smart glasses to track pupil movement, monitors and analyzes pupil movement status data, and obtains pupil movement status monitoring and analysis data; The smart glasses interaction association subsystem automatically creates an association between the smart glasses tracking pupil position and glasses interaction information based on the pupil movement status monitoring and analysis data; The pupil tracking scene selection subsystem automatically tracks pupil movement and pupil position according to the correlation between pupil position and glasses interaction information and marks the coordinate value in the glasses reference coordinate system to obtain the smart glasses tracking pupil monitoring tracking pupil position for triggering interactive control instructions; The environmental scene smart glasses interaction subsystem tracks the pupil position based on the smart glasses' pupil tracking monitoring, and performs individual adaptive pupil tracking and smart glasses' stereoscopic image display control interaction.

7. The pupil tracking-based smart glasses interaction system according to claim 6, characterized in that: The pupil tracking monitoring and analysis subsystem includes: The pupil movement glasses reference coordinate system subsystem sets the smart glasses reference coordinate system for tracking pupil movement according to the smart glasses interaction basic data, smart glasses interaction statistics and smart glasses interaction conditions; The pupil movement status monitoring and analysis subsystem monitors and analyzes pupil movement status information through rapid camera pupil tracking monitoring and analysis; The monitoring and analysis data acquisition subsystem outputs pupil movement status information to the smart glasses storage unit to obtain pupil movement status monitoring and analysis data.

8. The pupil tracking-based smart glasses interaction system according to claim 6, characterized in that: The smart glasses interactive association subsystem includes: The pupil movement state data transmission subsystem transmits the pupil movement state monitoring and analysis data to the smart glasses wireless network and the mobile terminal through the wireless transmission unit of the smart glasses; The device wearable intelligent adaptation subsystem monitors and analyzes the data of pupil movement status, and intelligently adapts the device to the pupil movement status through the pupil movement status of the smart glasses and the status of the smart glasses, thereby obtaining the intelligent adaptation information of the device to the pupil movement status; The adaptive interaction association subsystem intelligently adapts the adaptation information according to the device and pupil movement status, and automatically creates an association relationship between the pupil position tracked by the smart glasses and the glasses interaction information.

9. The pupil tracking-based smart glasses interaction system according to claim 6, characterized in that: The pupil tracking scene selection subsystem includes: The smart glasses interactive association import subsystem imports the association relationship between pupil position and glasses interaction information into the smart glasses, selects the associated environment features, and obtains the individual adaptive associated environment features; The associated environment feature matching subsystem matches the corresponding pupil tracking index information according to the associated environment features of the individual adaptability; The smart glasses interactive statistics selection subsystem automatically tracks pupil movement and pupil position according to pupil tracking index information and marks the coordinate value in the glasses reference coordinate system to obtain the smart glasses tracking pupil monitoring tracking pupil position for triggering interactive control instructions.

10. The pupil tracking-based smart glasses interaction system according to claim 6, characterized in that: The environment scene smart glasses interaction subsystem includes: A smart glasses pupil tracking subsystem tracks pupil positions according to the smart glasses pupil tracking monitoring, and projects pupil tracking smart glasses interaction scenes through a smart glasses pupil tracking scene display unit; The pupil tracking adaptation subsystem monitors the adaptability of pupil tracking to the scene according to the pupil tracking smart glasses interaction scene; The environment-guided intelligent interaction subsystem adapts to the scene adaptability of pupil tracking, adjusts the pupil tracking smart glasses interaction scene changes, executes the pupil tracking smart glasses interaction program, and performs individual adaptive pupil tracking and smart glasses stereoscopic image display control interaction.

Images