1200 results about "Pupil" patented technology

The invention relates to the field of electronic photo frames, and discloses an electronic photo frame intelligent interaction control method and system based on eye movement tracking, and the method comprises the steps: carrying out the real-time tracking of an eyeball position based on the eye image data of a user, and obtaining an eye movement track sequence according to the pupil center coordinate change and the eyelid opening and closing state change; calculating a fixation point coordinate, a fixation time length and an eye hopping frequency based on the eye movement track sequence; the current eye movement behavior type of the user is obtained through a personalized recognition model; matching with a preset eye movement pattern library based on the current eye movement behavior type of the user to obtain a candidate instruction set; and executing photo frame function operation according to the control instruction. The method has the following effect that the convenience and accuracy of man-machine interaction are improved based on non-contact intelligent control of eye movement.

The invention discloses an eye movement tracking method, an eye movement tracking device, eye movement tracking equipment, computer equipment and a storage medium. The method comprises the following steps: calculating calibration gaze information and a calibration pupil position according to first event data collected by an event camera; determining a region of interest based on the calibrated pupil position; processing second event data collected by the event camera according to the region of interest to generate region of interest data, the collection time of the second event data being later than the collection time of the first event data; according to the region-of-interest data, calculating a current fixation position offset; according to the calibration gaze information and the current gaze position offset, the current gaze information is determined, the calibrated pupil position is updated based on the current gaze position offset, the gaze direction, the moving direction and the moving distance of the pupil are accurately captured in real time by utilizing the characteristics of high time resolution and the like of the event camera, and the eye movement tracking effect is effectively improved.

The invention relates to a self-adaptive visual training method based on eye features, and belongs to the technical field of visual health and artificial intelligence. In order to solve the problems that traditional visual training equipment is heavy in structure, single in training mode and lack of personalized regulation and control and concentration state monitoring, the visual training equipment obtains eye images of a user in real time through an image acquisition module, adopts visual intelligent analysis, extracts double features of eye contours and pupil positions, calculates the visual concentration degree, and improves the visual training efficiency. And a concentration state is judged by combining a dynamic self-adaptive threshold value. When the concentration degree is insufficient, the control module triggers intervention mechanisms such as prompt or training pause and the like, and the remote interaction module uploads data to the cloud platform to generate a personalized training scheme. Intelligent and personalized regulation and control of the training process are achieved, the training effect and compliance are improved, the system is compact in structure and suitable for various scenes, and an efficient solution is provided for vision health.

The present application provides an iris recognition method and apparatus, an electronic device, and a storage medium. The method comprises: obtaining an iris image group acquired for an object to be recognized, wherein the iris image group comprises at least two iris images acquired at different acquisition angles for a same eye region of said object; performing stereo matching on the at least two iris images to obtain a disparity map between the at least two iris images, wherein the disparity map comprises disparity elements, and each disparity element represents a displacement amount in a specified direction between two pixel points corresponding to a same eye region element in the at least two iris images; in one iris image among the at least two iris images, determining a pupil edge on the basis of the displacement amounts; determining an iris region in the iris image on the basis of the pupil edge, and performing feature extraction on the iris region to obtain an iris feature; and performing identity recognition on said object on the basis of the iris feature.

The invention relates to the technical field of image processing, and discloses an image correction method and system for binocular diffraction AR intelligent glasses. The method comprises the following steps: calculating a dispersion response parameter of a diffractive optical element in the AR glasses in a visible light wave band; respectively carrying out dispersion distortion detection on the left eye image and the right eye image in the AR glasses to obtain a left eye dispersion distortion feature and a right eye dispersion distortion feature; interpupillary distance change data of a user is obtained, effective aperture offset calculation is carried out on the diffractive optical element, and interpupillary distance compensation parameters are obtained; performing coupling calculation on the left eye dispersion distortion feature, the right eye dispersion distortion feature and the interpupillary distance compensation parameter to obtain a binocular dispersion correction matrix; and performing dispersion compensation on the left eye image and the right eye image to obtain a dispersion correction image, and outputting the dispersion correction image to a display module of the AR glasses. The method can respond to the pupil distance change of the user in real time, automatically adjust dispersion correction parameters, realize accurate and comprehensive dispersion correction, and ensure the stability of dispersion correction performance.

Disclosed herein are pupil expanders for pupil replication in near-eye display systems. In some examples, a pupil expander includes a waveguide and a variable reflectivity transflective mirror, where display light propagating in the waveguide is transmitted through a plurality of regions of the variable reflectivity transflective mirror to form a plurality of replicas of the pupil along one direction. Two such pupil expanders can be used to replicate the pupil in two directions. In some examples, a pupil expander includes a waveguide, an output coupler formed on or in the waveguide, and two or more transflective mirrors in the waveguide and parallel to a surface the waveguide for improving the pupil replication density and light intensity uniformity of the eyebox.

The invention relates to the technical field of medical diagnosis, in particular to an eye white image acquisition and disease auxiliary diagnosis method and device, and the method comprises the steps: obtaining a video frame collected by a camera in real time, obtaining eye socket detection frame information in the video frame through a target detection algorithm, and adjusting the three-axis displacement of a motor to be positioned to an eye socket based on the eye socket detection frame information. The method comprises the following steps: completing image acquisition of eye white area maps in five directions, automatically marking abnormal parts, establishing a dynamic coordinate system and a mapping area which take a pupil center as a pole, calculating polar radius and polar angle of polar coordinate parameters, calculating a spatial weight value of mapping abnormity through a distance attenuation function, calculating a comprehensive gain value of the mapping area, and normalizing the comprehensive gain value. Generating an eye white abnormity thermodynamic diagram and performing hierarchical display; according to the invention, eye sockets are automatically positioned, eye white area maps in five directions are adaptively acquired, hierarchical display of eye white abnormity thermodynamic diagrams is realized, batch acquisition of eye white images of patients is satisfied, diagnosis efficiency is improved, and doctors are assisted to complete disease diagnosis.

The invention belongs to the technical field of optical lenses. The invention relates to a butterfly pupil escape compound eye bionic high-color-gamut nylon sunglass lens which comprises a lens body and a coating. Wherein the lenses are made of nylon resin; the coating is prepared from the following raw materials in parts by weight: 25 to 40 parts of tetraethoxysilane; 10 to 20 parts of phenyl trimethoxy silane; 4.0 to 8.0 parts of dimethyl dimethoxy silane; 2.0 to 4.0 parts of an MOF color enhancing agent; 20 to 30 parts of isopropanol; 11 to 22 parts of deionized water; and 1.0-3.0 parts of glacial acetic acid. A coating is prepared from a self-made MOF color enhancing agent through molecular design through formula optimization design, and the nylon resin lens is coated with the coating, so that the butterfly pupil escape compound eye bionic high-color-gamut nylon sunglasses lens is obtained. The butterfly pupil escape compound eye bionic high-color-gamut nylon sunglass lens effectively solves the problem that the color identification degree is low after the butterfly pupil escape compound eye bionic high-color-gamut nylon sunglass lens is blocked by 45-90% of light rays at present.

The invention discloses a distance measurement system based on artificial intelligence, and the system can achieve the automatic grabbing of size parameters of glasses. According to the system, a camera is adopted to capture a glasses image, a gyroscope and an artificial intelligence algorithm are adopted to recognize the spatial position of glasses, spatial coordinates of feature points are obtained, the pixel scale # imgabs0 # of the image is obtained subsequently based on the physical geometrical relationship of the glasses and the real pupil distance of a user, and finally the size parameters of the glasses are obtained. The glasses parameters comprise a glasses width, a pupil distance, a front inclination angle, a surface bending angle and a glasses-eye distance; the camera is an apple panel built-in camera; the gyroscope can obtain the pitch angle # imgabs1 #, the deflection angle # imgabs2 # and the inclination angle # imgabs3 #, so that the head posture of a glasses wearer is obtained, and the size measurement precision of the glasses is greatly improved. According to the system, automatic measurement of glasses parameters is realized, the working intensity of manual glasses matching is greatly reduced, and digital upgrading of high-end customized glasses is realized.

The invention discloses an emotion analysis method and system based on multi-mode electroencephalogram eye movement fusion. An emotional induction stimulation sequence is alternately or synchronously displayed through a stimulation presentation module according to preset time sequences such as 5-second vision and 3-second auditory sense, a 64 conductive electrode cap (10-20 system layout, the sampling rate is larger than or equal to 1000 Hz) is triggered to collect electroencephalogram data of a prefrontal lobe, a temporal lobe and the like, and meanwhile eye movement data are obtained through an infrared pupil tracking technology (the sampling frequency is larger than or equal to 120 Hz). 0.5-70 Hz band-pass filtering and ICA artifact removal processing are carried out on the electroencephalogram data, smooth interpolation and Kalman filtering optimization are carried out on the eye movement data, and then electroencephalogram alpha / beta / gamma wave power spectrums, eye movement pupil change rates and other characteristics are extracted respectively. A Transform model based on an attention mechanism is adopted, deep fusion of electroencephalogram eye movement features is realized through feature embedding and multi-head self-attention calculation, and emotion recognition accuracy greater than or equal to 85% is achieved through confusion matrix optimization and five-fold cross validation in combination with an SVM or DNN classifier.

The invention relates to the technical field of large model cheating detection, in particular to an online interview large model cheating detection system and method based on eye movement tracking, and the detection method comprises the steps: S1, system initialization and environment adaptation; s2, eye movement tracking calibration and baseline establishment; s3, collecting and preprocessing real-time eye movement data; s4, executing an anomaly detection algorithm; and S5, carrying out risk assessment and outputting a result. According to the scheme, based on the WebGazer.js technology, the mapping relation between the fixation point and the screen coordinates is established through nine-point initialization calibration, and the personalized coefficient k is generated in combination with the pupil diameter and the facial features of the candidate, so that the eye movement tracking error is greatly reduced, and the large model cheating detection precision requirement can be met without special hardware. The design not only reduces the deployment cost, but also breaks through the hardware limitation, so that the technology can adapt to mainstream notebook equipment, is convenient for large-scale popularization and application, and solves the contradiction that high precision and low cost cannot be achieved at the same time in the traditional scheme.

The invention discloses an attention monitoring method, device and equipment based on multi-modal sensing and a medium, and relates to the technical field of attention monitoring. The method comprises the following steps: collecting eye movement image data of eyeballs of a user; extracting fixation point stability features, eye movement track features, blink mode features and pupil dynamic features based on the eye movement image data; determining a concentration score of the user based on the fixation point stability feature, the blink mode feature, the pupil dynamic feature and the eye movement track feature; and if the concentration score is lower than a preset threshold value, sending reminding information to a user through the wearable device. The attention distraction behavior of the user in a continuous high attention demand scene can be accurately identified and prompted in time.

The invention relates to the technical field of visual health management, in particular to a ciliary muscle adjustment training system and method based on eye movement tracking, and the method comprises the steps: collecting eye movement data of a fixation point track, an adjustment amplitude change rate and pupil response time in real time, and combining personalized parameters such as the age of a user, diopter and a training target; inputting a ciliary muscle training dynamic planning algorithm module, dynamically generating a stage scheme containing a training action type, a single-group duration, a stimulation interval and a focal length adjustment strategy, and adaptively adjusting the strategy according to real-time adjustment stability and a historical ability curve; through multi-dimensional matching analysis of a pre-stored standard eye movement template, a training specification score is calculated from the track goodness of fit, speed uniformity, amplitude standard-reaching rate and binocular coordination, visual fatigue parameters are obtained based on continuous training duration, pupil fluctuation and retina reflex change, a scoring result is dynamically corrected, and a visual fatigue evaluation result is obtained. Personalized, self-adaptive and quantitative safety control of the training process is realized.

The invention relates to the technical field of pupil boundary detection, in particular to a multi-algorithm fusion pupil boundary detection method and system, and the method comprises the following steps: obtaining an eye image through an infrared camera, converting the eye image into a grey-scale map, optimizing the grey-scale map, carrying out the median filtering noise reduction, maintaining the edge information, and determining the pupil boundary through a Sobel operator and Hough transform. And the pupil center displacement is analyzed, the motion consistency is evaluated, the pupil position is corrected, and the pupil positioning accuracy is optimized. According to the method, the image preprocessing process is optimized by applying infrared camera shooting and image processing algorithms, accurate detection, median filtering and local contrast enhancement of pupil boundaries are achieved through multi-algorithm fusion, and particularly noise and edge information in the images are optimized; according to the method, the edge detection precision and the image definition are effectively improved, the pupil boundary is accurately mapped through combined use of the Sobel operator and Hough transform, and the misjudgment rate is greatly reduced.

The invention discloses a three-dimensional eyeball model reconstruction method and system based on multi-modal fusion, and the method comprises the following steps: S1, feature extraction: respectively extracting features of an original infrared eye diagram and a generated event diagram, carrying out the calculation of channel attention, and fusing the features of two modals in a spatial dimension; s2, time sequence feature fusion: compressing spatial dimensions through global average pooling, taking an ordered sequence of eye features and an ordered sequence of event graph features after spatial multi-modal fusion, and outputting corresponding eye parameters; s3, three-dimensional eyeball model reconstruction: defining an eyeball as a sphere with an eyeball center Oe and an eyeball radius re; generating discrete point clouds from pupils and irises of the 3D eye model; and S4, carrying out weak supervision on few samples. According to the method, the model can better learn a deformable eyeball model, and a robust and high-precision sight line estimation task can be carried out under the condition of a small number of samples.

Systems and methods for eye image segmentation and image quality estimation are disclosed. In one aspect, after receiving an eye image, a device such as an augmented reality device can process the eye image using a convolutional neural network with a merged architecture to generate both a segmented eye image and a quality estimation of the eye image. The segmented eye image can include a background region, a sclera region, an iris region, or a pupil region. In another aspect, a convolutional neural network with a merged architecture can be trained for eye image segmentation and image quality estimation. In yet another aspect, the device can use the segmented eye image to determine eye contours such as a pupil contour and an iris contour. The device can use the eye contours to create a polar image of the iris region for computing an iris code or biometric authentication.

An ophthalmic apparatus includes an objective optical system, an illumination optical system, a photographic optical system, a photographing unit, a movement mechanism, and a three-dimensional position identifying unit. The objective optical system is configured to optically relay a measurement position where a pupil of an eye of an examinee can be disposed. The illumination optical system is configured to irradiate illumination light onto the eye through the objective optical system. The photographic optical system is configured to receive returning light of the illumination light from the eye through the objective optical system. The photographing unit includes two or more cameras disposed so as to include a position, that is substantially conjugate optically to the measurement position relayed by the objective optical system, within a field of vision. The movement mechanism is configured to relatively move the objective optical system, the illumination optical system, the photographic optical system, and the photographing unit relative to the eye. The three-dimensional position identifying unit is configured to identify a three-dimensional position of the eye based on two or more photographic images of the eye acquired by the photographing unit.

A holographic near-eye display device with multi-angle simultaneous illumination comprises a light source module, a spatial light modulator, a beam splitter, an eyepiece, and a master controller. The light source module emits parallel light at different angles and simultaneously illuminates and covers effective working area of spatial light modulator which, loaded with a hologram, modulates incident parallel light at different angles to form diffracted parallel light at different angles, that is, virtual images at different viewing angles. Parallel light at different angles illuminates spatial light modulator. After modulated and diffracted by calculated hologram on spatial light modulator, the diffracted image light is converged by second lens to form different viewpoints for human eye to view. In multi-angle simultaneous illumination, additional time-sharing control of illumination unit is not needed. When size and position of human eye pupil change, clear virtual image is always seen, achieving expanding the eyebox.

The invention relates to the technical field of optometry, and discloses a self-service optometry method and system for a self-service optometry unit, and the method comprises the steps: obtaining a facial image of a user, carrying out key point detection, recognizing images of two eyes, and determining the center of a pupil; setting the position of a light spot emission point according to the pupil center; when the light spot image is emitted into the pupil of the user, adjusting the brightness of the light spot image according to a preset brightness step length, obtaining the pupil area of the user corresponding to each brightness, determining the pupil area change rate corresponding to each brightness, determining the optimal brightness according to the pupil area change rate, and emitting the light spot image to the user based on the optimal brightness; the method comprises the following steps: acquiring a reflected light spot image in a pupil of a user, performing feature extraction on the reflected light spot image to obtain light spot feature information, comparing the light spot feature information with preset standard light spot feature information, determining a refraction state of the user according to a comparison result, and generating an optometry result. According to the invention, the initial accuracy of optometry is improved.

The invention discloses a center positioning system and method for a femtosecond laser ophthalmic corneal refraction operation, and relates to the technical field of image processing. The method comprises the following steps of S1, performing multi-source data synchronous acquisition on eyeballs of a patient before an operation; s2, fusing and preprocessing the collected multi-source data; s3, establishing an eyeball dynamics method, outputting six-degree-of-freedom position data in real time, and predicting the position of a laser action point; s4, dynamically adjusting the dual coordinate system according to the cornea; s5, constructing a real-time feedback system, and realizing closed-loop control, safety boundary control and a fault-tolerant mechanism; and S6, generating parameters of an operation process, constructing a four-dimensional cutting model, and performing path planning of the laser model. According to the method, the OCT, the Placido ring and the iris vein composite features are combined, the positioning precision is improved, Kalman filtering and neural network prediction compensation are utilized, eyeball movement is tracked in real time, and the accuracy of operation pupil positioning is improved.

A gaze tracking system comprising a pupil detection unit operable to detect the location of a pupil in one or more images captured of one or both a user's eyes, a confidence value determination unit operable to determine a confidence value in dependence upon the identified pupil position, the confidence value indicating an expected reliability of the detection of the pupil location, and a processing unit operable to generate, in dependence upon the determined confidence value, one or more outputs to cause the user to modify their pupil location to a location with a higher determined confidence value.

The eyepiece waveguide stack includes a first eyepiece waveguide including a first incoupling diffractive optical element and a first compound pupil dilator, and a second eyepiece waveguide including a second incoupling diffractive optical element and a second compound pupil dilator, the second incoupling diffractive optical element being laterally offset from the first incoupling diffractive optical element.

The present invention belongs to the technical field of eye movement tracking, and discloses a near-eye fixation point tracking method, device and medium based on an event sensor, including: an infrared light source provides infrared illumination for the eye and the surrounding area of the eye, and the event sensor collects information on the eye and the surrounding area of the eye to obtain a series of event stream information generated by the change in light caused by movement; the time window clustering event set T is sent to the ROI and pupil calculation module to output pupil ellipse information; the event stream information is sent to the vector calculation module, and in combination with the pupil ellipse information, the movement vector of the pupil center is calculated; in combination with the movement vector, the pupil ellipse information is updated; in combination with the dynamic filtering method, the pupil ellipse information is smoothed; the filtered pupil ellipse information is sent to the line-of-sight regression and compensation model, and in combination with the deep learning method, the fixation point coordinates are calculated. The present invention introduces an event sensor and can more accurately identify moving targets in a dynamic scene.

The invention provides a fitting method of a 3D eye model and electronic equipment, and aims to improve the accuracy of the eye model. Comprising the following steps: in response to an eye model fitting instruction, obtaining eye images obtained when eyes of a user watch fixation points at different positions; obtaining eyeball parameters of the user by using the image position coordinates of the pupil center of the user in each eye image and the standard visual axis vector corresponding to each eye image; obtaining a current eyeball rotation angle based on the eyeball parameters of the user and the image position coordinates of the pupil center in the current eye image every specified duration; according to the current eyeball rotation angle and the eyeball parameters, current eyeball model parameters are obtained, and the eyeball model parameters comprise the position vector of the eyeball center, the position vector of the pupil center, the position vector of the curvature center and the visual axis vector; and updating a preset initial eye model by using the current eyeball model parameters of the user to obtain a current 3D eye model of the user.

Embodiments of the present disclosure generally relate to an optical system having a lens system configured to have a wide field of view and high resolution. The optical system includes three or more lens groups with ability to combat optical aberrations and produce a pupil outside of the lens group. The lens system as an image projection system projects a pattern or image rendered on a flat reticle or display of finite distance to the infinity. In an imaging system, the lens system collects light from infinity and forms an image of that object on a sensor.

A two-dimensional pupil-expanding waveguide optical module relates to the field of optical waveguides and comprises an image source, a waveguide element, a coupling-in element, a turning element and a coupling-out element. The turning element comprises a top grating and a bottom grating; the top grating is arranged on the upper surface of the waveguide element, and the bottom grating, the coupling-in element and the coupling-out element are arranged on the lower surface of the waveguide element; light emitted by the image source is subjected to total reflection in the waveguide element after being diffracted by the coupling-in element; after at least two times of total reflection in the waveguide, the light is diffracted by the top grating and is vertically emitted to the bottom grating, so that expansion in the first direction is realized; the light emitted from the top layer grating is emitted to the other direction after vertically emitting to the bottom layer grating, so that the turning of the light is realized; and the light emitted by the bottom grating is reflected totally at least once in the waveguide element, is diffracted by the coupling-out element and then is emitted to human eyes, so that expansion in a second direction is realized. According to the utility model, the two-dimensional pupil expansion of the image light is realized, the volumes of the coupling element and the projection light machine are reduced, and the manufacturing difficulty of the waveguide element is simplified.

The invention discloses an iris pupil real-time segmentation method based on deformable convolution and ellipse prior constraint, and relates to the technical field of computer vision and biological feature recognition. The method comprises the following steps: acquiring an original iris image, and preprocessing the original iris image by adopting dynamic shielding enhancement; constructing a lightweight encoder-decoder network, wherein the lightweight encoder-decoder network comprises an encoder, a decoder and a post-processing module; the encoder adopts a cascaded deformable convolution module and an elliptical attention mechanism module to perform feature extraction; training and optimizing the lightweight encoder-decoder network; carrying out multi-task loss calculation, introducing an elliptical parameter regression constraint design loss function on the basis of segmentation loss, and optimizing a segmentation result; and ellipse parameter refinement is carried out through a post-processing module, and ellipse fitting optimization is carried out on a segmentation result. Compared with the prior art, the iris pupil real-time segmentation method has the advantages that the precision is improved, the speed is optimized, and the robustness is high.

The invention discloses a peripheral retina data-based microstructure lens and a design method, and the lens comprises a mother lens which is provided with a first surface facing the retina of a human eye; the first surface comprises a central luminosity area, a luminosity modulation area and a luminosity compensation area which are arranged in sequence; the central luminosity area, the luminosity modulation area and the luminosity compensation area are respectively arranged around the optical center in a concentric circle mode; the luminosity modulation area is provided with a plurality of first areas which are divided into equal areas, the luminosity compensation area is provided with a plurality of second areas which are divided into equal areas, and the first areas and the second areas are adjacent in the first direction and jointly matched so as to be used for intervening the imaging quality of the retina within the pupil range. Peripheral retina data is adopted to carry out design compensation on spectacle lenses, so that a more accurate and more personalized correction mode is realized, and an optimal management method for inhibiting ametropia can be selected according to the actual condition of a wearer.

A method and system for determining a pupil profile for imaging a pattern on a substrate in a lithographic process is disclosed. Data indicative of a relationship between a lithographic performance change and a source change throughout the pupil plane is obtained, based on which the first pupil profile is optimized to generate a second pupil profile. The second pupil profile is a discrete pupil profile corresponding to a desired free-form pupil profile that can be used to print a pattern on a substrate using a lithographic apparatus. An illumination system (e.g., a field facet mirror) may be configured based on the second pupil profile to print a pattern on the substrate.

An apparatus for obtaining an image of a retina is described herein. The apparatus includes an optical relay that defines an optical path and is configured to relay an image of the iris along the optical path to a pupil, a shutter is disposed at the pupil and configured to define at least a first shutter aperture for control of light transmission through the pupil position, a tube lens disposed to direct light from the shutter aperture to an image sensor, and a prismatic input port disposed between the shutter and the tube lens and configured to combine, onto the optical path, light from the relay with light conveyed along a second light path that is orthogonal to the optical path.