1725 results about "Pupil" patented technology

The invention discloses an intelligent control method and system for AR equipment, and the method specifically comprises the steps: determining a pupil center position coordinate and a cornea reflection point position coordinate of a user according to an eye image of the user, and inputting the pupil center position coordinate and the cornea reflection point position coordinate into a geometric mapping model for matching, obtaining user sight direction information; acquiring image brightness value distribution of an area near a user fixation point, determining a plurality of candidate saliency areas according to the image brightness value distribution, and comparing the candidate saliency areas with a preset saliency area template to determine a user attention focus; and acquiring head posture information of the user in real time by adopting a head posture tracking algorithm, and dynamically controlling the shooting direction of a camera of the AR equipment according to the head posture information, the sight direction information of the user and the attention focus of the user. According to the method and the device, accurate alignment of the AR content and the visual focus of the user is realized, and the immersion and interaction experience of the AR application are greatly improved.

The invention relates to the field of electronic photo frames, and discloses an electronic photo frame intelligent interaction control method and system based on eye movement tracking, and the method comprises the steps: carrying out the real-time tracking of an eyeball position based on the eye image data of a user, and obtaining an eye movement track sequence according to the pupil center coordinate change and the eyelid opening and closing state change; calculating a fixation point coordinate, a fixation time length and an eye hopping frequency based on the eye movement track sequence; the current eye movement behavior type of the user is obtained through a personalized recognition model; matching with a preset eye movement pattern library based on the current eye movement behavior type of the user to obtain a candidate instruction set; and executing photo frame function operation according to the control instruction. The method has the following effect that the convenience and accuracy of man-machine interaction are improved based on non-contact intelligent control of eye movement.

The invention provides a self-adaptive eye movement tracking method and device. The method comprises the steps that a calibration target position matrix and a historical center position are initialized; obtaining state information of the contact lenses, a calibration eye image sequence and a calibration sensing position sequence by using the intelligent head-mounted equipment, the intelligent contact lenses and the calibration target position matrix; processing the calibration target position matrix, the historical center position, the contact lens state information, the calibration eye image sequence and the calibration sensing position sequence to obtain a prediction target matrix, a prediction pupil center position matrix, a post-processing mark and an updated historical center position and calibration target position matrix; the post-processing mark is judged, and the calibration target position matrix is updated; and extracting the calibration target position matrix to obtain M predicted fixation point positions. Therefore, according to the method provided by the invention, the eye movement tracking mode can be adaptively selected, the defect of a single tracking method is overcome, and the accuracy and smoothness of eye movement tracking are improved.

The invention belongs to the technical field of retina imaging and fundus three-dimensional reconstruction, and particularly relates to a color three-dimensional fundus imager optical system. Comprising a large eye objective lens, a dichroscope, a hollow reflector, a focusing lens, a spectroscope, a retina lens, a retina imaging chip, a fixation lens, a sighting mark lamp, an illumination lens, an annular light source, a pupil lens, a pupil imaging chip, an infrared lens, an infrared dodging lens, an infrared light source, a scanning lens, a three-dimensional galvanometer, a collimator, a coupler, a frequency sweeping light source and a dispersion compensator. A polarization controller, a coupler and a photoelectric detector. The system is mainly composed of a visible light imaging light path, an infrared imaging light path and a laser imaging light path, the visible light imaging light path is used for shooting color fundus two-dimensional images, the infrared imaging light path is used for real-time positioning and focusing of human eye pupils, and the laser imaging light path is used for three-dimensional tomography of retinas. The objective of the invention is to solve the problem that existing medical equipment cannot acquire fundus color three-dimensional images.

The invention discloses a pilot dangerous driving behavior monitoring method based on multi-modal data fusion, and belongs to the field of multi-modal data fusion monitoring, and the method comprises the steps: obtaining the physiological data of a pilot in the take-off and landing states through a multi-element sensor, judging the fatigue state of the pilot, and obtaining the dangerous driving behavior of the pilot. An eye tracker and a camera are used for conducting data collection on a pilot in the take-off and landing states, behavior data of the blinking frequency, the eyelid closure degree, the pupil change, the yawning frequency, the nodding frequency, the average moving speed of an operating lever and the moving direction of the pilot are obtained, and the fatigue state of the pilot is judged; the method comprises the following steps: constructing a multi-modal data fusion network based on Transform, and training the multi-modal data fusion network; the driving behavior of a pilot is monitored by using the trained network based on the Transform multi-modal data fusion; through a multi-channel interaction technology, the comprehensiveness and accuracy of information are improved, the influence of environment and individual differences is reduced, and the stability and robustness are enhanced.

The invention discloses an eye movement tracking method, an eye movement tracking device, eye movement tracking equipment, computer equipment and a storage medium. The method comprises the following steps: calculating calibration gaze information and a calibration pupil position according to first event data collected by an event camera; determining a region of interest based on the calibrated pupil position; processing second event data collected by the event camera according to the region of interest to generate region of interest data, the collection time of the second event data being later than the collection time of the first event data; according to the region-of-interest data, calculating a current fixation position offset; according to the calibration gaze information and the current gaze position offset, the current gaze information is determined, the calibrated pupil position is updated based on the current gaze position offset, the gaze direction, the moving direction and the moving distance of the pupil are accurately captured in real time by utilizing the characteristics of high time resolution and the like of the event camera, and the eye movement tracking effect is effectively improved.

The invention belongs to the technical field of fundus imaging, and discloses an ultra-wide-angle ellipsoid confocal laser scanning fundus imaging system, which comprises a light splitting module, a light condensing module, a scanning module, a transmitting mirror group, an ellipsoid reflector and a detection module, wherein the center of the scanning module and the center of the transmitting mirror group are located on the same optical axis A, the pupil of the human eye is located at the first focus of the ellipsoidal reflector, and the entrance pupil of the transmitting mirror group is located at the second focus of the ellipsoidal reflector; and the transmitting lens group comprises a movable focusing lens and is used for changing the position of a first image surface of light reflected by the retina of the human eyes when moving along the optical axis A so as to realize clear imaging of the retina of the human eyes with different diopters. Under the condition that a free-form surface is not introduced, ultra-wide-angle multi-wavelength confocal laser scanning fundus imaging with the single intraocular field angle of 200 degrees is achieved, and the full-field optical resolution reaches 15 micrometers. And by moving the focusing lens, imaging compensation can be carried out on human eyes with diopters of-15D to + 15D.

A system for gathering fixation distance calibration data may include eyeglasses with adjustable lenses and an electronic device with a depth sensor. During fixation distance calibration operations, a user wearing the eyeglasses may view the electronic device while the electronic device provides instructions for the user to hold the electronic device at different distances from the user. At each distance, a depth sensor in the electronic device may determine the distance to the eyeglasses and a camera in the eyeglasses may be used to determine a distance between the user's pupils. The calibration measurements may be used to generate calibration data that maps different pupil locations to different fixation distances. The calibration data may be stored in the eyeglasses so that control circuitry in the eyeglasses can determine a user's fixation distance and adjust lens power accordingly without requiring an outward facing depth sensor in the eyeglasses.

The invention relates to a self-adaptive visual training method based on eye features, and belongs to the technical field of visual health and artificial intelligence. In order to solve the problems that traditional visual training equipment is heavy in structure, single in training mode and lack of personalized regulation and control and concentration state monitoring, the visual training equipment obtains eye images of a user in real time through an image acquisition module, adopts visual intelligent analysis, extracts double features of eye contours and pupil positions, calculates the visual concentration degree, and improves the visual training efficiency. And a concentration state is judged by combining a dynamic self-adaptive threshold value. When the concentration degree is insufficient, the control module triggers intervention mechanisms such as prompt or training pause and the like, and the remote interaction module uploads data to the cloud platform to generate a personalized training scheme. Intelligent and personalized regulation and control of the training process are achieved, the training effect and compliance are improved, the system is compact in structure and suitable for various scenes, and an efficient solution is provided for vision health.

The invention relates to the technical field of tunnel lighting, in particular to a tunnel portal lighting control method and system, and the method comprises the steps: S1, obtaining a first image in a short exposure time mode; obtaining a second image in a long exposure mode; s2, synthesizing the second image and the first image into a high-dynamic-range image, and dividing the high-dynamic-range image into a low-brightness area, a transition area and a high-brightness area; s3, generating a brightness transition curve of the transition area; s4, determining a brightness adjusting curve of the transition area according to the maximum brightness of the tunnel portal and the light and shade adaptive pupil area change rate; s5, determining the target brightness of each part of the transition area according to the brightness transition curve and the brightness adjustment curve; and S6, adjusting the brightness of the illumination lamp in the transition area to enable the brightness of each part of the transition area to reach the target brightness. The target brightness is determined according to the brightness transition curve in combination with the brightness adjustment curve, the influence of the brightness adaptive pupil area change rate on the sight line is fully considered, and the change of the brightness of the tunnel portal is more adaptive to the function of human eyes.

The invention relates to the technical field of head-up display, in particular to an HUD optical aberration correction method, system and device and a vehicle. The correction method comprises the following steps: generating a light beam through an LED light source or a laser light source, and adjusting the brightness and color parameters of the LED light source or the laser light source through a control circuit so as to adapt to different display requirements and environmental conditions; and the light beam is preliminarily shaped and collimated by the light beam shaping element until a proper divergence angle and a proper light spot size are met so as to meet the requirements of a coupling element. According to the invention, the light beam emitted by the light machine is subjected to one-dimensional or two-dimensional pupil expansion through the optical waveguide, and then view field expansion and aberration correction are carried out through the free-form surface mirror, so that the problems of large size, limited view field angle, small eye box range and insufficient imaging definition in the prior art are effectively solved.

The present application provides an iris recognition method and apparatus, an electronic device, and a storage medium. The method comprises: obtaining an iris image group acquired for an object to be recognized, wherein the iris image group comprises at least two iris images acquired at different acquisition angles for a same eye region of said object; performing stereo matching on the at least two iris images to obtain a disparity map between the at least two iris images, wherein the disparity map comprises disparity elements, and each disparity element represents a displacement amount in a specified direction between two pixel points corresponding to a same eye region element in the at least two iris images; in one iris image among the at least two iris images, determining a pupil edge on the basis of the displacement amounts; determining an iris region in the iris image on the basis of the pupil edge, and performing feature extraction on the iris region to obtain an iris feature; and performing identity recognition on said object on the basis of the iris feature.

The invention discloses a pupil color and skin color variable expression robot. The eyebrow mechanism, the eye mechanism, the nose mechanism and the mouth mechanism are all connected with the shell mechanism, the eyebrow mechanism and the mouth mechanism are installed at the top end and the bottom end of the eye mechanism respectively, the nose mechanism is installed on the mouth mechanism, the eyebrow mechanism, the eye mechanism and the mouth mechanism are all connected with the deformation mechanism, and the eye mechanism is mainly driven by an electromagnet. Rotation of eyeballs and opening and closing of eyelids in the eye mechanism are controlled through an electromagnet, the pupil color changing unit is arranged in the eyeballs and used for achieving pupil color changing of the robot, and the skin color changing mechanism is attached to the shell mechanism and used for achieving skin color changing of the robot. Electromagnet driving is adopted, rapid and real-time driving response can be achieved, the requirement for the frequency needed by facial expressions and mouth actions is met, eyebrow and mouth deformation can be achieved through a worm and gear structure, the face can be enlarged and shrunk, different face types can be matched, and skin color changing is achieved through the skin color changing mechanism.

The physical microscope comprises an eyepiece, a pupil distance adjusting group, an optical hinge group, a prism steering group, a continuous zoom objective lens group and a light source group which are connected from top to bottom, the upper end and the lower end of the optical hinge group are provided with a first hinge shaft and a second hinge shaft respectively, and the optical hinge group further comprises a holder and a prism frame which are distributed left and right. A rotary disc and a fixed disc are fixed to the left end of the first hinge shaft and the left end of the second hinge shaft respectively, a first arc-shaped rack is arranged at the lower end of the rotary disc, a second arc-shaped rack meshed with the first arc-shaped rack is arranged at the upper end of the fixed disc, and a torsional spring is installed between the first hinge shaft and the second hinge shaft. According to the invention, the angle can be flexibly adjusted, and final imaging or positive imaging can be realized.

The invention relates to the technical field of image processing, and discloses an image correction method and system for binocular diffraction AR intelligent glasses. The method comprises the following steps: calculating a dispersion response parameter of a diffractive optical element in the AR glasses in a visible light wave band; respectively carrying out dispersion distortion detection on the left eye image and the right eye image in the AR glasses to obtain a left eye dispersion distortion feature and a right eye dispersion distortion feature; interpupillary distance change data of a user is obtained, effective aperture offset calculation is carried out on the diffractive optical element, and interpupillary distance compensation parameters are obtained; performing coupling calculation on the left eye dispersion distortion feature, the right eye dispersion distortion feature and the interpupillary distance compensation parameter to obtain a binocular dispersion correction matrix; and performing dispersion compensation on the left eye image and the right eye image to obtain a dispersion correction image, and outputting the dispersion correction image to a display module of the AR glasses. The method can respond to the pupil distance change of the user in real time, automatically adjust dispersion correction parameters, realize accurate and comprehensive dispersion correction, and ensure the stability of dispersion correction performance.

The invention relates to the technical field of optical detection, in particular to a bright and dark field detection device and method.First illumination light emitted by a bright field light source is modulated through an illumination modulation assembly, then the first illumination light and second illumination light emitted by a dark field light source are guided to irradiate the surface of a to-be-detected sample, and the first illumination light is reflected by the to-be-detected sample to form bright field signal light; the second illumination light is scattered by the sample to be detected to form dark field signal light, and the bright field signal light and the dark field signal light are transmitted along a common light path and are mutually separated in space; an objective lens matched with the illumination modulation assembly receives and microscopically amplifies the bright field signal light and the dark field signal light; the imaging assembly receives the bright-field signal light and the dark-field signal light and carries out bright-field imaging and dark-field imaging. Through a bright and dark field common-path sub-view-field design, simultaneous imaging detection of bright and dark fields is realized; in addition, by arranging the illumination modulation assembly, the reflection phenomenon of illumination light on the periphery of the exit pupil plane of the objective lens is inhibited, and interference of stray light on imaging is eliminated.

Disclosed herein are pupil expanders for pupil replication in near-eye display systems. In some examples, a pupil expander includes a waveguide and a variable reflectivity transflective mirror, where display light propagating in the waveguide is transmitted through a plurality of regions of the variable reflectivity transflective mirror to form a plurality of replicas of the pupil along one direction. Two such pupil expanders can be used to replicate the pupil in two directions. In some examples, a pupil expander includes a waveguide, an output coupler formed on or in the waveguide, and two or more transflective mirrors in the waveguide and parallel to a surface the waveguide for improving the pupil replication density and light intensity uniformity of the eyebox.

The invention provides a pupil center positioning method and device and electronic equipment, and relates to the technical field of image processing, and the method comprises the steps: obtaining a target pupil image; performing gradient calculation on the target pupil image according to a pre-configured gradient direction to obtain a gradient filtering image; taking the MASK image of the target pupil image as a mask to execute mask operation to obtain a pupil position candidate image, filtering each circular arc contour in the pupil position candidate image to obtain a candidate contour, fitting the circle center of the candidate contour to obtain a circle center-containing set, filtering the circle centers in the circle center set to obtain a target circle center, and obtaining the target circle center. And determining the target circle center as the pupil center. According to the pupil center positioning method and device and the electronic equipment, multiple filtering modes are adopted in the whole positioning process, the pupil center can be accurately obtained, and meanwhile high accuracy can still be achieved under the conditions of poor image contrast, shielding, deformation and the like.

The invention provides a wearable sight distance measurement method, and belongs to the field of visual depth extraction, the wearable sight distance measurement method comprises a pupil tracking algorithm and a sight distance measurement algorithm, the pupil tracking algorithm is used for tracking the pupil position state of a subject in real time, and performing preprocessing and Hough circle fitting on an eye image obtained by wearable eye movement video acquisition hardware; therefore, the pupil contour and the pupil center point of the subject are calibrated in real time; the sight distance measurement algorithm is based on data of a pupil tracking algorithm, the position of an eyeball center point is fitted through a center calibration algorithm, established data of an image sensor and eye parameters are combined to be imported into a visual depth model, so that sight distance measurement key information is obtained, and then the real-time visual depth of a subject is calculated through a distance measurement equation. According to the wearable sight distance measurement method, a wearable binocular sight distance detection algorithm system for multiple scenes is constructed, and accurate real-time data is provided for application scenes needing binocular sight distance.

The invention belongs to the technical field of optical design, and particularly relates to a free-form surface optical system design method based on double Zernike aberration. The method comprises the following steps: S1, rewriting an aberration contribution expression of a free-form surface optical system into a first double-Zernike polynomial based on a field-of-view Zernike polynomial and a pupil Zernike polynomial; s2, an offset vector is introduced into a view field vector of the rectangular Zernike polynomial; s3, carrying out the processing of the Zernike aberration of the full view field through employing a least square method, and carrying out the processing of the Zernike aberration of the full view field; and S4, constructing a performance evaluation model, analyzing and calculating the free-form surface component of the optical initial system by using the performance evaluation model, and substituting the free-form surface component into the optical initial system to complete the design of the free-form surface optical system. The free-form surface optical system obtained by the invention has relatively good imaging quality and relatively small free-form surface coefficient.

The invention relates to the technical field of medical diagnosis, in particular to an eye white image acquisition and disease auxiliary diagnosis method and device, and the method comprises the steps: obtaining a video frame collected by a camera in real time, obtaining eye socket detection frame information in the video frame through a target detection algorithm, and adjusting the three-axis displacement of a motor to be positioned to an eye socket based on the eye socket detection frame information. The method comprises the following steps: completing image acquisition of eye white area maps in five directions, automatically marking abnormal parts, establishing a dynamic coordinate system and a mapping area which take a pupil center as a pole, calculating polar radius and polar angle of polar coordinate parameters, calculating a spatial weight value of mapping abnormity through a distance attenuation function, calculating a comprehensive gain value of the mapping area, and normalizing the comprehensive gain value. Generating an eye white abnormity thermodynamic diagram and performing hierarchical display; according to the invention, eye sockets are automatically positioned, eye white area maps in five directions are adaptively acquired, hierarchical display of eye white abnormity thermodynamic diagrams is realized, batch acquisition of eye white images of patients is satisfied, diagnosis efficiency is improved, and doctors are assisted to complete disease diagnosis.

The invention discloses a cognitive impairment screening method and device based on a VR eye tracker and near-infrared brain imaging. The device comprises a virtual reality scene generation module, an eye tracker data acquisition module, a near-infrared brain imaging module, a data evaluation processing module and a cognitive impairment screening module. The eye tracker data acquisition module is used for acquiring an eye movement data information set of a user in a virtual reality scene in real time; the eye movement data information set comprises a fixation point information sequence, a pupil area information sequence and an eye hopping frequency information sequence; the near-infrared brain imaging module is used for acquiring a blood oxygen information set of cerebral cortex when a user completes a cognitive task; the blood oxygen information set of the cerebral cortex comprises a brain blood oxygen information sequence; the data evaluation processing module is used for carrying out evaluation processing on the collected eye movement data information set and the blood oxygen information set of cerebral cortex to obtain cognitive disorder information of the user; the cognitive impairment information comprises information about whether cognitive impairment exists or not and the degree of the cognitive impairment.

The invention provides an eye control interaction method, device and system based on eye movement tracking, and relates to the technical field of data processing. The method comprises the following steps: collecting eye movement data and user feature data of a testee; the user feature data comprises age, pupil color and eye disease type; extracting eye movement feature data according to the eye movement data and the user feature data; generating brain activity state information of the testee according to the eye movement feature data, and determining an eye control instruction of the testee according to the brain activity state information, the eye movement feature data and the user feature data; and performing eye control interaction based on the eye control instruction. According to the method, the characteristics of brain activity states, eye diseases and the like possibly existing in different types of users can be considered, the user feature data are collected, feature extraction is carried out in combination with the eye movement data, and the eye movement feature data accurately reflecting the real eye movement intention of the user is obtained, so that the obtained eye control instruction is adaptive to different users; while the eye control interaction accuracy is improved, smoother and more natural interaction experience is brought to the user.

The invention belongs to the technical field of optical lenses. The invention relates to a butterfly pupil escape compound eye bionic high-color-gamut nylon sunglass lens which comprises a lens body and a coating. Wherein the lenses are made of nylon resin; the coating is prepared from the following raw materials in parts by weight: 25 to 40 parts of tetraethoxysilane; 10 to 20 parts of phenyl trimethoxy silane; 4.0 to 8.0 parts of dimethyl dimethoxy silane; 2.0 to 4.0 parts of an MOF color enhancing agent; 20 to 30 parts of isopropanol; 11 to 22 parts of deionized water; and 1.0-3.0 parts of glacial acetic acid. A coating is prepared from a self-made MOF color enhancing agent through molecular design through formula optimization design, and the nylon resin lens is coated with the coating, so that the butterfly pupil escape compound eye bionic high-color-gamut nylon sunglasses lens is obtained. The butterfly pupil escape compound eye bionic high-color-gamut nylon sunglass lens effectively solves the problem that the color identification degree is low after the butterfly pupil escape compound eye bionic high-color-gamut nylon sunglass lens is blocked by 45-90% of light rays at present.

The utility model relates to the technical field of light feeding devices, in particular to an eye-closed three-dimensional light feeding LED device, which is characterized in that a pupil LED chip group comprises a red light chip and a near-infrared light chip with the wavelength range of 625nm to 960nm; a pupil LED chip set, an eyelash LED chip set and a meibomian gland LED chip set are fixedly installed on the pupil aluminum substrate, and forced eye closing distance control hair is arranged on the pupil aluminum substrate. A lens aluminum substrate and an eyebrow acupoint aluminum substrate are mounted on the lens seat; the system further comprises an integrated control circuit. By using the red light chip, the optical power density comparable to that of laser and the effective irradiation area larger than that of the laser can be obtained, and the alignment precision of a light source to acupuncture points is reduced; by utilizing the blood activating function of dark red and near-infrared light, myopia, eyebrow thickening and eyelash thickening can be prevented and controlled; health care can be carried out on meibomian glands and a suspension tough system, and light stimulation can be carried out on eye protection acupuncture points; all-directional three-dimensional light feeding can be realized anytime and anywhere; the safety values under various limit conditions refer to three kinds of sunlight.

The invention discloses a distance measurement system based on artificial intelligence, and the system can achieve the automatic grabbing of size parameters of glasses. According to the system, a camera is adopted to capture a glasses image, a gyroscope and an artificial intelligence algorithm are adopted to recognize the spatial position of glasses, spatial coordinates of feature points are obtained, the pixel scale # imgabs0 # of the image is obtained subsequently based on the physical geometrical relationship of the glasses and the real pupil distance of a user, and finally the size parameters of the glasses are obtained. The glasses parameters comprise a glasses width, a pupil distance, a front inclination angle, a surface bending angle and a glasses-eye distance; the camera is an apple panel built-in camera; the gyroscope can obtain the pitch angle # imgabs1 #, the deflection angle # imgabs2 # and the inclination angle # imgabs3 #, so that the head posture of a glasses wearer is obtained, and the size measurement precision of the glasses is greatly improved. According to the system, automatic measurement of glasses parameters is realized, the working intensity of manual glasses matching is greatly reduced, and digital upgrading of high-end customized glasses is realized.

The invention provides a measuring method of a non-contact intraocular pressure instrument and the non-contact intraocular pressure instrument. The measuring method of the non-contact intraocular pressure instrument comprises the following steps: acquiring a first human eye image in the XY direction and a second human eye image in the Z direction of an examined eye; identifying the first human eye image according to a pupil identification method and a positioning light spot detection method to determine the pupil of the detected eye and the mass center of the pupil contour; identifying a cornea bright line of the second human eye image according to a cornea bright line detection method so as to determine a cornea vertex of the detected eye; performing XY-direction positioning adjustment based on the pupil and the center of mass of the pupil contour, and performing Z-direction positioning adjustment based on the cornea vertex and the calibration point in the Z direction; in response to the completion of the XY-direction positioning adjustment and the Z-direction positioning adjustment, blowing air to the examined eye to obtain a cornea deformation image shot by the high-speed camera sensor; and determining the intraocular pressure value of the examined eye based on the cornea thickness and the cornea curvature determined by the cornea deformation image and the pressure change curve of the blowing air cavity.

The invention discloses an emotion analysis method and system based on multi-mode electroencephalogram eye movement fusion. An emotional induction stimulation sequence is alternately or synchronously displayed through a stimulation presentation module according to preset time sequences such as 5-second vision and 3-second auditory sense, a 64 conductive electrode cap (10-20 system layout, the sampling rate is larger than or equal to 1000 Hz) is triggered to collect electroencephalogram data of a prefrontal lobe, a temporal lobe and the like, and meanwhile eye movement data are obtained through an infrared pupil tracking technology (the sampling frequency is larger than or equal to 120 Hz). 0.5-70 Hz band-pass filtering and ICA artifact removal processing are carried out on the electroencephalogram data, smooth interpolation and Kalman filtering optimization are carried out on the eye movement data, and then electroencephalogram alpha / beta / gamma wave power spectrums, eye movement pupil change rates and other characteristics are extracted respectively. A Transform model based on an attention mechanism is adopted, deep fusion of electroencephalogram eye movement features is realized through feature embedding and multi-head self-attention calculation, and emotion recognition accuracy greater than or equal to 85% is achieved through confusion matrix optimization and five-fold cross validation in combination with an SVM or DNN classifier.

Methods and systems for performing operations to control brightness in an AR device are disclosed. The operation comprises: displaying an image on an eye wearable device worn by a user; detecting a gazing direction of pupils of the user; identifying a first region of the image corresponding to a gaze direction of the pupil; and modifying a luminance level or luminance value of pixels in the image based on the gaze direction such that pixels in a first region of the image are set to a first luminance value and pixels in a second region of the image are set to a second luminance value lower than the first luminance value.

The invention relates to the technical field of large model cheating detection, in particular to an online interview large model cheating detection system and method based on eye movement tracking, and the detection method comprises the steps: S1, system initialization and environment adaptation; s2, eye movement tracking calibration and baseline establishment; s3, collecting and preprocessing real-time eye movement data; s4, executing an anomaly detection algorithm; and S5, carrying out risk assessment and outputting a result. According to the scheme, based on the WebGazer.js technology, the mapping relation between the fixation point and the screen coordinates is established through nine-point initialization calibration, and the personalized coefficient k is generated in combination with the pupil diameter and the facial features of the candidate, so that the eye movement tracking error is greatly reduced, and the large model cheating detection precision requirement can be met without special hardware. The design not only reduces the deployment cost, but also breaks through the hardware limitation, so that the technology can adapt to mainstream notebook equipment, is convenient for large-scale popularization and application, and solves the contradiction that high precision and low cost cannot be achieved at the same time in the traditional scheme.