108 results about "Pupil diameter" patented technology

The invention discloses a pupil image recognition and disease change evaluation system based on image recognition, and relates to the technical field of monitoring analysis, and the system comprises the steps: obtaining the identity information and historical pupil data of a patient, and building a pupil dynamic database corresponding to the patient; alternately irradiating the eyes of the patient, and collecting a dynamic image sequence corresponding to a pupil light reflex area of the patient; performing spatial-temporal characteristic analysis on the dynamic image sequence, establishing a pupil diameter dynamic change curve, and generating a light reflection sensitivity index of the pupil of the patient according to the pupil diameter dynamic change curve; constructing a pupil dynamic evaluation model according to the pupil diameter dynamic change curve and the light reflex sensitivity index of the patient pupil, and outputting a pupil grade evaluation result based on the pupil dynamic evaluation model; comprehensive analysis is conducted on pupil grade evaluation results, analysis results are uploaded to an intensive care central system, and a grading early warning mechanism is triggered. The application has the effect of reducing the occurrence of illness state delay.

The invention discloses a naked-eye 3D display optimization method based on real-time eyeball tracking, and particularly relates to the technical field of naked-eye 3D display, and the method comprises the steps: capturing eyeball movement data in real time through a visual angle tracking sensor, and collecting illumination information in combination with an ambient light sensor; depth perception parameters are calculated based on pupil diameter variation and frequency, and a time sequence prediction type dynamic compensation coefficient is generated in combination with eyeball movement acceleration; acquiring an initial fixation point coordinate by using an improved spherical projection mapping model, and performing compensation coefficient correction to obtain a real-time coordinate; and finally, according to the real-time coordinates, dynamically adjusting the refractive index distribution of the nanostructure layer, the rotation angle of the polarizer, the focal length of the optical lens and other optical modulation parameters. The real-time distance is calculated through the binocular parallax algorithm, the depth mapping value is generated by combining the focal length of the camera and the baseline distance, the method can adapt to the illumination change and the user view angle, and the 3D display effect is optimized.

The invention relates to the technical field of optical elements, and discloses a fog display point diffusion optical system and a preparation method thereof, and the preparation method comprises the steps: obtaining user visual parameters, and building a visual behavior probability density model through kernel density estimation; designing the front surface of the lens based on the model, and generating an asymmetric defocus system coupled with a gazing habit; the rear surface of the lens is designed, and the distribution density of a fog display point diffusion unit is cooperatively modulated by the front surface defocusing amount, the fixation probability and the pupil diameter; and finally integrating front and rear surface design to form an optical lens body. According to the method, the asymmetric defocus field on the front surface and the fog display point diffusion field on the rear surface are subjected to collaborative design, and the defocus intensity and the contrast modulation intensity are accurately applied to the effective retina area of the user through the visual behavior probability density model; the technical problem that a traditional out-of-focus lens is fixed in signal and cannot adapt to individual staring habits and physiological parameter changes is solved.

The invention discloses an intelligent eye-protection illumination control system, and relates to the technical field of intelligent illumination control, and the system comprises a physiological analysis module which is used for calculating the pupil diameter physiological index of a user through a Daugman algorithm based on the preprocessed multi-source data, marking fatigue early warning, obtaining the fatigue state of the user, and obtaining the fatigue state of the user according to the long-time fixed region of the sight line of the user; performing sight line drop point processing and region division through a space coordinate mapping and clustering algorithm to generate a concentration region coordinate; the instruction generation module is used for fusing the scene initial light strategy and the focus area coordinate through a weighted fusion method, forming a light parameter in combination with a user vision parameter, and analyzing through an NSGA-II algorithm to obtain an illumination control instruction; the execution module is used for transmitting and executing based on the illumination control instruction through a wireless communication method, and monitoring visual physiological reaction of the user in real time to obtain feedback data; according to the invention, the environment change is predicted through the Markov model, the illumination is prevented from lagging behind the environment change, and the illumination foresight and adaptability are improved.

The invention relates to the field of intelligent perception, and mainly relates to a user interaction intention perception method and system based on intelligent glasses, and the method comprises the steps: obtaining the abnormal degree of an eye jump drop point according to the main eye jump and the subsequent correction eye jump times after detecting that the current eye jump drop point of a user enters an interaction region of an interactive object; acquiring a pupil diameter change sequence after the main eye jump, and acquiring a pupil transient response score based on the pupil diameter change sequence; after a certain time from the falling point time of the main eye jump, acquiring a real-time double-variable contour ellipse area based on information of a plurality of latest fixation points, and acquiring a fixation stability score based on the real-time double-variable contour ellipse area; obtaining a real-time gaze residence time according to the falling point time of the main eye jump, and obtaining a residence time evaluation score based on the real-time gaze residence time; fusing the abnormal degree, the pupil instantaneous response score, the stability score and the evaluation score to obtain a dynamic interaction intention score of the user, and determining the interaction intention of the user based on the intention score. The perception accuracy of the user interaction intention is improved.

The invention relates to the technical field of video communication, in particular to an intelligent AI glasses video call auxiliary system which comprises a visual adjustment module, a voice interaction module, a communication scheduling module, a posture recognition module and a feedback prompt module. According to the invention, by acquiring the eye movement track and the pupil diameter change, adjusting the image brightness and the color contrast in combination with the ambient light, relieving visual fatigue, enhancing the call comfort, analyzing the voice frequency band and matching the keywords, the accurate recognition of the operation intention is realized, the call response efficiency is improved, and the mistaken touch and delay are avoided; the call priority is judged according to the action state, the acceleration trend and the contact person weight, the task access accuracy is improved, the user intention is judged according to the head posture and the sight line trend, misoperation and repeated confirmation are avoided, interaction convenience is enhanced, meanwhile, the audio intensity and image prompt are regulated and controlled according to the task type and the prompt level, the multi-environment prompt requirement is met, and the user experience is improved. Information omission is reduced, and call experience is optimized.

An interpupillary distance estimation method is implementable by an electronic computer and includes the operations of acquiring at least one 2D image of a user's face, locating on the 2D image two reference points corresponding to the pupils of the user, and measuring the distance in pixels between the two reference points. The method further includes measuring the diameter in pixels of the user's iris, and calculating the pixel-to-millimetre conversion ratio between a predetermined iris diameter expressed in metric units and the iris diameter measured in pixels. The predetermined pupil diameter is set equal to the value of the iris diameter most widespread in the world population according to data contained in an anthropometric database. A first estimation of the interpupillary distance is determined by multiplying the distance in pixels between the two reference points corresponding to the user's pupils by the pixel-to-millimetre ratio calculated previously.

The invention discloses a perioperative cognitive impairment predicting and monitoring device, relates to the technical field of medical instruments, and aims to solve the problem of low accuracy of perioperative cognitive impairment predicting and monitoring for children in the prior art. An electroencephalogram signal acquisition module, an eye movement tracking module, a behavior interaction module, a physiological parameter monitoring module and a data processing and analyzing module are integrated in the head-mounted VR glasses; the electroencephalogram signal acquisition module is used for acquiring an electroencephalogram signal of a child, processing the electroencephalogram signal and then transmitting the electroencephalogram signal to the data processing and analyzing module; the eye movement tracking module is used for capturing motion images of eyeballs of children, obtaining fixation points, eye jump frequencies and pupil diameter change parameters of the eyeballs and transmitting the parameters to the data processing and analyzing module. The method has the advantage that the accuracy of predicting and monitoring the cognitive impairment in the perioperative period of children is improved.

The invention belongs to the technical field of AR glasses control, and particularly relates to an intelligent AR glasses control method, which comprises the following steps of: continuously sensing extreme environmental parameters before and during operation by acquiring high-voltage electromagnetic field frequency spectrum, ambient light and wind speed data of an electric power inspection area in real time; the problem that existing AR glasses do not consider environmental confrontation and have extreme scene function failure is solved. Meanwhile, electromagnetic field dominant frequency features are extracted through fast Fourier transform, AR glasses setting is adjusted in combination with ambient light statistics, jitter compensation is activated when the wind speed exceeds the standard, and therefore the glasses can effectively avoid signal interference and guarantee the stability of basic functions in electric power inspection scenes such as a high-intensity magnetic field and complex illumination. Meanwhile, by synchronously monitoring the pupil diameter change rate and the eyelid shielding proportion, the eye movement state is verified in real time in the whole routing inspection process, the accurate iris fixation track is generated after dynamic judgment and calibration triggering, and the accuracy of eye movement interaction under the complex operation posture can be ensured.

The embodiment of the invention provides an emotion detection method based on a multi-mode electroencephalogram eye movement signal. According to the method, a dual-path electroencephalogram modal encoder is used for determining time sequence characteristics of an electroencephalogram in a time domain path, determining frequency domain characteristics of an amplitude spectrum of the electroencephalogram in a frequency domain path, and obtaining dual-path time domain and frequency domain fused electroencephalogram characteristics based on the time sequence characteristics and the frequency domain characteristics; the dual-path eye movement modal encoder is used for determining pupil features of the eye movement data in the pupil diameter path, determining eye movement fixation features of the eye movement data in the fixation point path, and obtaining fused eye movement features based on the pupil features and the eye movement fixation features; and the multi-modal expert mixing module is used for dynamically performing modal calling on the multi-modal mixed characteristics which are subjected to modal alignment and are fused with the electroencephalogram characteristics and the eye movement characteristics, performing emotion detection by utilizing an expert with a modal corresponding to the multi-modal mixed characteristics, and outputting an emotion classification result. According to the embodiment of the invention, alignment is realized through multi-task pre-training, and the depressive emotion is accurately recognized.

The invention relates to the technical field of illumination control, in particular to a shop illumination control system with an automatic adjustment function and a control method thereof, and the method comprises the following steps: 1, data collection: collecting the illumination value E of the environment inside and outside a shop in real time through an ambient light sensor, obtaining customer flow distribution and pupil diameter D through a camera or an infrared sensor; the main control chip calculates the environment illumination deviation e and the deviation change rate delta e according to the environment illumination value and a preset scene illumination threshold value, and through fusion of environment light, the visitor flow rate and customer pupil diameter data, a PSO optimized fuzzy self-adaptive PID control and dynamic mode switching mechanism is adopted, so that the environment illumination deviation e and the deviation change rate delta e are calculated; dual optimization of shop illumination energy saving and display effect is realized, and the total energy consumption is reduced by 19% while the commodity exposure is ensured; color temperature and illumination are adjusted in real time in combination with pupil biological characteristic feedback, so that the visual fatigue index of customers is reduced by 28%, and the staying time is prolonged by 15 minutes.

The invention provides an interface display parameter adjustment method and device, electronic equipment, a computer readable storage medium and a computer program product, and relates to the technical field of artificial intelligence such as neural networks, visualization and automatic driving. The method comprises the following steps: determining a pupil diameter change rate according to an eye image obtained by shooting a riding object; according to the focal length of the camera shooting the eye image and the pupil diameter change rate, the eyeball focal length of the riding object is determined; determining a target visual range of the riding object on the display screen based on the eyeball focal length; and adjusting display parameters of interface contents presented by the display screen based on the target visual range. By applying the scheme, high-precision adjustment of the display parameters can be realized and personalized visual experience can be provided under the condition that manual operation or voice instruction issuing is not needed in the whole process, the efficiency and the convenience degree of obtaining information from the display screen in the riding process are improved, and the riding safety is improved.

The invention provides AR glasses supporting emotion monitoring, and relates to the technical field of augmented reality, the AR glasses supporting emotion monitoring comprise a glasses body, a two-way eye camera, an emotion recognition module and an image processing unit, and the image processing unit comprises an emotion recognition algorithm and an image processing unit. The emotion recognition accuracy is 95.8% (angry) and 92.3% (anxiety), and compared with a traditional single-mode scheme (only facial expression), the emotion recognition accuracy is improved by 22% (angry) and 41% (anxiety). The blink frequency detection precision reaches + / -0.5 Hz through dynamic frame rate adjustment of the two cameras, and the feature point detection rate in a rapid blink scene is 98% (only 85% of a traditional monocular). By combining HRV physiological features extracted by PPG signals, the system can recognize the coupling relation between pupil diameter changes and blinking frequency, and physiological blinking and emotional blinking are successfully distinguished.

The invention discloses a vehicle-mounted augmented reality head-up display (AR-HUD) self-adaptive display adjusting system and method based on retina perception. The system comprises a retina perception parameter extraction module, a driving instruction response analysis module, a display light environment acquisition analysis module and a dynamic adaptive display optimization module. The method comprises the following steps: acquiring a retina perception threshold value of a user through a contrast sensitivity test before driving, extracting objective physiological parameters such as pupil diameter, blinking rate and fixation stability in a preset time window during driving, and calculating a comprehensive fatigue index F; a display area brightness distribution model is established in combination with vehicle-mounted light sensor data, F-based adaptive adjustment and safe amplitude limiting are performed on the brightness and contrast of an AR-HUD image, it is ensured that key information reaches the lowest recognizable contrast threshold, and an over-bright area is restrained. Compared with a fixed display adjusting scheme, the information readability can be improved in different light environments, the subjective fatigue score can be reduced, and the vehicle-mounted augmented reality head-up display adaptability and watching comfort can be improved.

The invention discloses a peripheral defocus principle-based progressive multi-focus optical correction method, which belongs to the technical field of vision correction and comprises the following steps of S1, collecting eye data of teenagers; s2, eye biological parameters are extracted; s3, calculating the change relation between the center defocusing amount and the peripheral defocusing amount under the dynamic change of different field angles and different pupil diameters; s4, presetting a target center defocusing amount and a peripheral defocusing amount of the progressive multi-focus lens under different field angles and different pupil diameter dynamic changes, and calculating a difference value between the target center defocusing amount and the peripheral defocusing amount under different field angles and different pupil diameter dynamic changes of eyes as a to-be-adjusted defocusing amount; s5, calculating parameters of the progressive multi-focus lens; s6, constructing a progressive multi-focus lens model; s7, optimizing the progressive multi-focus lens model; s8, performing optical correction by using the optimized progressive multi-focus lens model; the traditional Chinese medicine composition has a treatment effect and a prevention and control effect at the same time.

The invention relates to the technical field of light atmosphere, and discloses a light atmosphere effect generation method, which comprises the following steps: generating an initial wave function according to an intensity field, deducing on the basis of a potential energy field to obtain a first wave function, performing intensity calculation and phase extraction from the first wave function to obtain a second wave function, updating the direction field based on the second wave function to obtain an updated direction field and an enhanced optical flow field; three core advantages of light atmosphere generation are realized, firstly, deep coupling of quantum optics and neurocognition is realized, real response of human eyes is simulated through a phase-sensitive light response model, and light atmosphere distribution is enabled to conform to quantum propagation rules and human visual cognition characteristics in combination with a cognition attention focusing mechanism of a DQN model; and 2, a dynamic self-adaptive mechanism runs through the whole process, and a light current coefficient and object motion data are adjusted in real time through the pupil diameter to feed back a new light flow field so as to ensure that the environment change can be quickly responded.

The invention belongs to the technical field of screen display, and particularly relates to a large-screen display system based on machine learning, which comprises an environment sensing module, a user sensing module, a calculation module, a compensation module and a display control module, the compensation module calculates the distance and the visual angle according to the positioning coordinate parameters, and when the distance and the visual angle exceed a preset distance threshold value and a preset visual angle threshold value, the initial brightness adjustment coefficient is compensated according to the distance, the visual angle and the pupil diameter parameters to generate a corrected brightness adjustment coefficient; according to the correction brightness adjustment coefficient, the distance between the viewer and the large screen and the viewing angle are considered, so that the large-screen display system can dynamically adjust the screen brightness more accurately according to the visual comfort level of the viewer and the influence of ambient light.

The present invention is applicable to the field of pilot training technology and provides a ground-based vision training device for pilots that takes environmental and physiological factors into account. The device uses a computer system to rapidly simulate human visual characteristics, including: establishing a light source and brightness detector; obtaining a two-dimensional distributed brightness matrix of the scene; obtaining ambient brightness information of the external scene as perceived by the human eye, which affects optical aberrations by affecting pupil diameter; establishing an optical model of the human eye and obtaining a modulation transfer function; simulating the observation effect of the external scene after passing through the model in the frequency domain, using a GPU for accelerated processing; using an eye tracker to determine the coordinates of the pilot's gaze point, simulating the blur and depth of field characteristics of the peripheral vision; and finally performing image fusion to obtain a simulated image of the external scene after passing through the human eye. The present invention can improve the effectiveness of flight training or the accuracy of new aircraft cockpit evaluations, and provide pilots with a more realistic and intuitive flight visual experience during ground training.

The application discloses a pupil data fatigue detection method, system and device based on infrared camera, and relates to the technical field of target detection. Eye infrared image data of a testee is acquired; an image processing algorithm is used to process the eye infrared image data to obtain position data and edge data of a pupil; according to the position data and the edge data of the pupil, a pupil diameter position change data set and a pupil center position change data set in a T time period are obtained; the pupil diameter position change data set and the pupil center position change data set in the T time period are compared with a visual analogue scale of fatigue severity to obtain a pupil data fatigue detection result. The application improves the detection accuracy of the visual fatigue degree of the testee.

The present invention relates to a novel refractive intraocular lens (IOL) having a continuous range of view, extended depth of field (EDOF), capable of providing a continuous clear field of view for cataract patients when objects from far to near while minimizing halo and glare phenomena. The novel refractive EDOF continuous visual range artificial lens provided by the invention has the advantage that the extended focal depth can be provided, so that a patient can obtain continuous vision from a far position to a near position (35-40cm). The spherical aberration of each area on the front surface of the artificial lens is optimized, halo and glare are reduced to the maximum extent, the 60-degree refraction section of the fourth area is used for providing balanced energy distribution when the pupil diameter is large, the pupil is irrelevant to magnification distribution, and the lens magnification and the extension focal depth are not affected by the pupil size or light conditions. The partition modification of the intraocular lens can be used as a controllable switch, and the focal depth can be adjusted according to requirements, namely, the focal depth is adjusted from a far vision field to a near vision field or from the far vision field to a middle vision field.

The invention discloses a perception brightness characterization method and system based on display brightness and chromaticity distribution, and belongs to the technical field of information display. The method comprises the following steps: in a darkroom environment, recording perceived brightness rating and pupil diameter of a display picture by an observer through an eye tracker, and collecting brightness and chromaticity data of each pixel point of a screen at the same time; defining the equivalent brightness of the color stimulation as the gray brightness for generating the same pupil diameter by taking the white field gray stimulation as the reference; calculating a cornea flux density value based on a preset chromaticity-equivalent brightness mapping table in combination with the asymmetric space weighting model; establishing a function relationship between the density value and the perceived brightness, and further associating visual comfort rating; in practical application, the brightness is dynamically adjusted to a human eye comfort interval through real-time screen data analysis. According to the invention, the problem that the traditional method neglects the picture content difference is solved, and an adaptive brightness optimization strategy conforming to visual health is provided for the display equipment.

The present invention relates to a method and system for evaluating mental workload in a real environment based on eye movement data. The method comprises the following steps: respectively collecting eye movement data under different mental workload states, and preprocessing the eye movement data to construct an eye movement feature set; the eye movement feature set includes eye movement type statistical features, saccade speed statistical features, pupil diameter statistical features, and eye movement type transition features; establishing a mental workload evaluation model, training the mental workload evaluation model based on the eye movement feature set to obtain a trained mental workload evaluation model; collecting eye movement data of a user to be evaluated, preprocessing the eye movement data to construct an eye movement feature set of the user to be evaluated, and inputting the eye movement feature set into the trained mental workload evaluation model to obtain a mental workload evaluation result of the user to be evaluated.

The invention relates to the technical field of refraction correction, in particular to a myopia control lens design method based on a heterogeneous scattering unit array, which comprises the following steps of: acquiring an eye axis length, a corneal curvature and a pupil diameter, calculating an incidence characteristic and a visual axis reference value, dividing functional areas according to an arrangement relationship between the incidence characteristic and a micro lens, and calculating a myopia control lens array; the method comprises the steps of building a coordinate index, analyzing structure parameter differences, reading parameters, calculating regulation and control characteristic values, and mapping array coordinates to generate a manufacturing instruction sequence. According to the structure arrangement and main visual axis relation, dividing functional sections, improving the matching degree of the area visual function, introducing a structure difference recognition and fine adjustment mechanism, improving the structure adjustment precision, and improving the manufacturing accuracy. The optical path control capability is enhanced, parameters are mapped into manufacturing instructions, the structure execution accuracy is ensured, the processing consistency is improved, closed-loop optimization from parameter acquisition, structure regulation and control to manufacturing instruction generation is integrally realized, the coupling of a visual intervention structure and functions is enhanced, and the stability and continuity of a correction effect are improved.

A wide-angle lens, wherein the wide-angle lens includes a lens group and an aperture, the multiple lenses in the lens group are arranged in sequence from the object side in a manner of sandwiching the aperture, when the maximum half field angle of the wide-angle lens as a whole is set to ω, the following relationship is satisfied: 98°<ω<120°, when the focal length of the wide-angle lens as a whole is set to f and the incident pupil diameter of the wide-angle lens as a whole is set to HEP, the following relationship is satisfied: f / HEP<2.3, the lens group includes a first lens, the first lens is arranged at the position closest to the object side, and the first lens is a negative lens with a concave surface facing the image side, when the effective radius of the image-side lens surface of the first lens is set to sd12 and the curvature radius of the image-side lens surface of the first lens is set to R12, the following relationship is satisfied: 0.890<sd12 / R12<0.970.

To provide an extended depth of focus (EDOF) that provides a cataract patient with continuous vision from distance to near with minimal halo and glare, and an intraocular lens (IOL) that achieves continuous vision.SOLUTION: To obtain continuous vision from a long distance to a short distance near 40-35cm by providing the extension of a focal depth. The spherical aberration of each zone of the anterior surface of the intraocular lens is optimized to minimize halo and glare. The fourth zone 60 degree segment design of the present invention provides a balanced energy distribution at large pupil diameters and makes the lens pupil independent of power distribution. The lens power and its extended depth of focus are independent of pupil size and lighting conditions. Furthermore, the change of zone of the intraocular lens can be used as a controllable switch to change the depth of focus according to the demand from far vision to near vision or from far vision to intermediate vision.SELECTED DRAWING: Figure 1

This invention belongs to the field of AR glasses control technology, specifically disclosing a smart AR glasses control method. This method continuously senses extreme environmental parameters before and during power inspection by real-time acquisition of high-voltage electromagnetic field spectrum, ambient light, and wind speed data in the power inspection area, solving the problems of existing AR glasses not considering environmental resistance and functional failure in extreme scenarios. Simultaneously, it utilizes Fast Fourier Transform to extract the dominant frequency characteristics of the electromagnetic field, combines this with ambient light statistics to adjust the AR glasses settings, and activates jitter compensation when wind speed exceeds limits, enabling the glasses to effectively avoid signal interference and ensure basic functional stability in power inspection scenarios such as strong magnetic fields and complex lighting. Furthermore, by synchronously monitoring the pupil diameter change rate and eyelid occlusion ratio, it verifies eye movement status in real-time throughout the inspection process and generates a precise iris gaze trajectory after dynamic judgment and calibration, ensuring the accuracy of eye-tracking interaction under complex working postures.

The invention discloses a pupil diameter automatic detection method based on infrared imaging. The pupil diameter automatic detection method comprises the steps that an eye image is collected; acquiring a grayscale image of the eye of the eye-closed patient by using infrared imaging equipment; preprocessing the image; performing size unification and normalization processing on the acquired infrared eye image to obtain a standardized input image; pupil segmentation; inputting the preprocessed image into an image segmentation network based on deep learning, and outputting a binary mask image of the pupil region by the network; acquiring a mask pixel area of the binarized mask image, and converting the mask pixel area into an equivalent diameter of a pupil region; and carrying out visual output on equivalent diameter data and other related image features of the pupil region in the adopted period. The method is high in speed and uniform in measurement standard, and human differences are reduced.

Provided are an estimation device and the like that make it possible to highly accurately estimate the auditory attention of a subject in real time, even when biological information for a neutral state cannot be acquired. An estimation device according to the present invention includes a storage unit that stores biological information that is time-series information for pupil diameter acquired while a subject is presented with an image that has different luminances, a region information acquisition unit that acquires region information that is index values for the brightness of regions of the image presented to the subject, an analysis unit that calculates a statistical trend for the time-series change in the pupil diameter from the biological information for the subject, and an estimation unit that uses the region information and the statistical trend for the time-series change in the pupil diameter to estimate the direction in which the attention of the subject is directed.

Device for improving night vision of vehicle drivers comprising a controlled reduction of the driver's pupil diameter and the maintenance of said reduction over time in order to improve the visual capability of the vehicle driver, all of this, moreover, adapted to the pupil dynamics of the vehicle driver. It comprises a vehicle interior part comprising a carrier, a lighting device configured to emit pulsed light according to a sinusoidal wave emission varying in regular periods between 10 s and 30 s and a control means; a switching means and a user profile adjusting means.

The invention discloses a multi-mode drug taking detection method and device, a storage medium and equipment, and belongs to the field of biological feature recognition. The method comprises the following steps: acquiring an eye image sequence of a detected person, which is acquired according to a time sequence; and according to the color iris information, the infrared iris information, the pupil diameter change information and the pupil shape information contained in the eye image sequence, whether the detected person takes the drug or not is judged. Wherein the eye image sequences comprise a first infrared eye image sequence, a visible light eye image sequence and a second group of infrared eye image sequences which are arranged according to a time sequence; during collection of the eye image sequences, the eyes of a detected person are subjected to continuous photostimulation for a set time through visible light in a dark environment, a first infrared eye image sequence is collected before photostimulation, a visible light eye image sequence is collected in the photostimulation process, and a second infrared eye image sequence is collected after photostimulation. According to the invention, the screening accuracy of the drug addicts is improved.