48 results about "Pupil movement" patented technology

Virtually fraud-proof authentication for wireless mobile financial transactions. A mobile telephone, genius card or dongle may capture multiple biometrics, such as fingerprint, voiceprint, retinal recognition data, facial biometric data, ear biometric data and bio print, iris scanning data, pupil movement recognition data, and send segments of each of them to a server computer that re-constitutes them and stores them for matching during an attempted financial transaction. A purchasing individual has multiple biometrics read by separate readers integrated into a single hand-held device. An automatic process of the server computer has previously sent a command packet to the hand-held device defining percentage and portion of each biometric to select and the sequence and channel of transmission for matching along with other out of band security data. During the charging phase, the hand-held device may utilize a slidable antenna for swiping a magnetic strip of a charge card reader or may display credit card data for a limited amount of time.

The image-based system is used to observe and document eye responses which can be used to implement the procedures defined in the Standardized Field Sobriety Test as well as the Drug Recognition Expert Program. These eye responses include pupil movement, as well as pupil size and responses, for either one or both eyes simultaneously. The system includes a headset against which the subject places their face. The faceplate has an opening through which illumination devices transmit beams of infrared light to illuminate the subject's eyes. A reflective protractor, having a scale imprinted thereon, is mounted on the headset above the eye opening and facing the test administrator to provide an image of the stimulus target that is used by the test administrator. Two imaging devices are mounted on the headset opposite the eye opening to generate images of the subject's illuminated eyes. The generated images are transmitted to an image recording device for storage and an image display device for display to a test administrator.

A method of 3D morphing driven by facial tracking is provided. First, a 3D model is loaded. After that, facial feature control points and boundary control points are picked up respectively. A configure file “A.config” including the facial feature control points and boundary control points data that are picked up corresponding to the 3D avatar is saved. Facial tracking algorithm is started, and then “A.config” is loaded. After that, controlled morphing of a 3D avatar by facial tracking based on “A.config” is performed in real time by a deformation method having control points. Meanwhile, teeth and tongue tracking of the real-time face image, and scaling, translation and rotation of the real-time 3D avatar image is also provided. In addition, a control point reassignment and reconfiguration method, and a pupil movement detection method is also provided in the method of 3D morphing driven by facial tracking.

The impairment determination system automatically determines impairment of a subject based on pupil movement, as well as pupil responses to illumination and target tracking for either eye or both eyes simultaneously. The impairment determination system automatically processes a series of digital image frames, taken during the execution of a predetermined test protocol, to determine pupil location, size, and responsiveness to changes in illumination, which data are used by the impairment determination system to determine impairment of the subject. The present impairment determination system uses a method for quickly and accurately localizing the subject's pupils, as well as their boundaries, area, and center coordinates, which data is used as part of the impairment determination process.

The invention relates to a retina optical coherence chromatography detection-display system. The retina optical coherence chromatography detection-display system comprises a first light path channel for displaying image information, a second light path channel for tracking retina information, a third light path channel formed by an external natural light channel and a fourth light path channel for detecting pupils. In combination with the optical waveguide display technology and the Michelson interference technology, the retina optical coherence chromatography detection-display system overcomes the defects of an original retina optical coherence chromatography detection system, can detect the structure of the retina, can be used for studying the relations between pupil movement, dilation and miosis and structural features of the retina by changing displayed images, also has fluoroscopy and display functions and can be applied to medical research, pathologic analysis, lie detection and other aspects.

The image-based system is used to observe and document eye responses which can be used to implement the procedures defined in the Standardized Field Sobriety Test as well as the Drug Recognition Expert Program. These eye responses include pupil movement, as well as pupil size and responses, for either one or both eyes simultaneously. The system includes a headset against which the subject places their face. The faceplate has an opening through which illumination devices transmit beams of infrared light to illuminate the subject's eyes. A reflective protractor, having a scale imprinted thereon, is mounted on the headset above the eye opening and facing the test administrator to provide an image of the stimulus target that is used by the test administrator. Two imaging devices are mounted on the headset opposite the eye opening to generate images of the subject's illuminated eyes. The generated images are transmitted to an image recording device for storage and an image display device for display to a test administrator.

The impairment determination system automatically determines impairment of a subject based on pupil movement, as well as pupil responses to illumination and target tracking for either eye or both eyes simultaneously. The impairment determination system automatically processes a series of digital image frames, taken during the execution of a predetermined test protocol, to determine pupil location, size, and responsiveness to changes in illumination, which data are used by the impairment determination system to determine impairment of the subject. The present impairment determination system uses a method for quickly and accurately localizing the subject's pupils, as well as their boundaries, area, and center coordinates, which data is used as part of the impairment determination process.

The invention provides a smart wheelchair based on an eyeball control screen, which aims to widen the eye control scope. The smart wheel chair comprises an electrically propelled wheelchair, an information acquisition device fixed on the electrically propelled wheelchair, an information processing device, an information display device and a first bracket and a second bracket for fixing the three devices. The information acquisition device is used for shooting a user's face image; the information processing device is used for extracting the information of the eyes and judging the eyes' open orclose and pupil movement state. The judged eye movement state is converted into a command for controlling the cursor to move and clicking the displayed content of the electronic display screen while being converted into a command for controlling the movement of the electrically propelled wheelchair, and the user controls the starting, braking and left-right rotation of the electrically propelled wheelchair through effective blinking and pupil rotation, when the electrically propelled wheelchair is stationary, the user controls the mouse to click and move on the electronic display screen through the effective blinking and pupil rotation, so that the user can communicate with the outside through the eyes.

The invention discloses a terminal and a remote control method thereof. The method comprises the steps as follows: at least two frames of images of a user in a set area are acquired, and face positioning of the images is performed; according to double-eye reference positions which are established in advance, pupil positioning of the face images is performed, and the movement conditions of pupils are determined according to positions of the pupils; remote control instructions corresponding to the movement conditions of the pupils are looked up and executed from operation strategies, so that corresponding operation functions are realized; and a process for establishing the double-eye reference positions is as follows: a double-eye opening image and a double-eye closing image of the user in the set area are acquired, and the double-eye reference positions are established according to the difference of vertical gray-level projection histograms of the double-eye opening image and the double-eye closing image. Compared with a conventional pupil tracking technology, the terminal and the method improve the pupil positioning accuracy; the problem that in a process that the terminal is controlled remotely through the pupil movement, the pupils are not positioned accurately, so that the terminal identifies the pupil movement mistakenly is solved; and misoperation, caused by identification errors, of the terminal is reduced; and an experience effect of the user is improved.

The invention discloses a vehicle-mounted device integrating eyeball tracking and gesture control. The vehicle-mounted device comprises a head-up display and a 3D depth sensing module, wherein the 3Ddepth sensing module is arranged on an automobile central control platform, is connected with the head-up display, can emit infrared diffracted speckles, project to the eyeball position of a driver and receive the infrared speckles reflected by the eyeballs; a reflection vector formed by the non-repetitive speckle falling in the eyeball and the pupil is utilized to define the eyeball position, thesight line drop point is tracked and corrected according to the change of the reflection vector caused by pupil movement at the position; compensation calculation is carried out through a sight linemapping function, the sight line drop point position is calculated, when the sight line drop point position is located on the front windshield of the automobile, feedback display of the head-up display is controlled, and when the sight line drop point position is located on a control interface, gesture recognition calculation is started, and gesture control over the system in the automobile is carried out.

The invention relates to a visual field detection method and system based on head-mounted detection equipment and a detection device. The method comprises steps as follows: the detection device located in an electronic device sends a starting notification used for starting monitoring of movement loci of the pupil of a current to-be-detected eye to an eye movement tracking system after receiving a test starting instruction sent by a controller; the detection device receives pupil movement state information sent by the eye movement tracking system; the detection device determines the pupil movement loci according to the movement state information, wherein the controller is a part which is associated with the head-mounted detection equipment and in communication connection with the detection device of the electronic device. With the adoption of the method, the detection complexity can be reduced, and the detection accuracy and comfort can be improved.

The image-based system is used to observe and document eye responses which can be used to implement the procedures defined in the Standardized Field Sobriety Test as well as the Drug Recognition Expert Program These eye responses include pupil movement as well as pupil size and responses, for either one or both eyes simultaneously. The system includes a headset against which the subject places their face. The faceplate has two eye openings through which illumination devices transmit beams of infrared light to illuminate the subject's eyes. Two imaging devices are mounted on the headset opposite the eye openings to generate images of the subject's illuminated eyes. The generated images are transmitted to an image recording device for storage and an image display device for display to a test administrator.

A method of 3D morphing driven by facial tracking is provided. First, a 3D model is loaded. After that, facial feature control points and boundary control points are picked up respectively. A configure file “A.config” including the facial feature control points and boundary control points data that are picked up corresponding to the 3D avatar is saved. Facial tracking algorithm is started, and then “A.config” is loaded. After that, controlled morphing of a 3D avatar by facial tracking based on “A.config” is performed in real time by a deformation method having control points. Meanwhile, teeth and tongue tracking of the real-time face image, and scaling, translation and rotation of the real-time 3D avatar image is also provided. In addition, a control point reassignment and reconfiguration method, and a pupil movement detection method is also provided in the method of 3D morphing driven by facial tracking.

A system and method for improving social and presentation skills of persons with a social communication disorder such as Autism. Social anxiety or a lack of confidence, the method including: rendering and displaying on a display device a presentation script for an oral presentation to be made by a user; monitoring eye movement of the user during the oral presentation to measure a user's pupil movement and / or a user's gaze direction; displaying an indicia on a separate display screen and / or an upper portion of the display device; periodically displaying within the presentation script a visual prompt to cue the user to look at the indicia; measuring eye movement using eye tracking software and / or an eye tracking device, at occurrence of the visual prompt; and evaluating whether the user made eye contact with the indicia when prompted.

The embodiments disclose an apparatus including an eyewear pupilometer for detecting, measuring and processing a wearer's pupil movement and size, for detecting and processing retinal images, for detecting and processing a wearer's field of view, for broadcasting alerts, for pre-diagnostic screening, for overriding vehicle operation and for measuring, recording and transmitting circadian responses, at least one eyewear pupilometer module including a lens fiber optic camera module, an image processor module, a retinal image infrared detector module, an outward camera module, at least one alert module, an alert light and message projector, a WI-FI module, an automated pullover module, an automated steering module, fiber optic & data cables, a contact lens pupilometer image, sensor and processor module, and at least one eyewear pupilometer module coupled to and / or embedded into eyewear frames and lenses, contact lenses, a vehicle wind shield and protective covers for hand held devices and laptop computers.

A method and a device for helping a hearing-impaired person to understand an auditory sensory message by transforming the auditory message into a visual message and projecting this message on a support in the field of vision of the hearing-impaired person. This device comprises a support (11) carrying a sensor in the form of microphones (16, 17) to pick up the message, recording and memorizing module (19) for recording and memorizing / storing in real time the auditory message, and transforming the message into a visual message. A screen (18) is placed in the field of vision of the user, and at least one projector (20, 21) projects the visual message on the screen. A sensor detects pupil movement of the user and mechanism converts pupil movement of the user into a display command for the visual message, and carrying out the command by projecting the visual message.

The invention provides a hobby discrimination method based on eye fixation. The method comprises the following steps: capturing an eye gaze image of a user in real time when the user acquires currently played content through a camera shooting unit to track pupil feature data of the user in the eye gaze image, wherein the pupil feature data comprises pupil movement data, pupil zooming data and blinking frequency data for tracking pupils of the user; judging that the numerical value assignment is zero, and if the pupil movement data exceeds a threshold value, judgingthat the numerical value is accumulated; if the pupil zoom data is lower than the threshold value, judging that the numerical values are accumulated; if the blinking frequency data is lower than the threshold value, judging that the numerical values are accumulated; if the judgment value is not higher than 1, judging that the preference degree of the user is high; otherwise, judging that the preference degree of the user islow; and generating primary determination results. The invention further provides a preference judgment system based on eye fixation.

The invention provides a method and device for controlling an automobile electronic rearview mirror. The method for controlling an automobile electronic rearview mirror includes the steps that displayscreens are correspondingly installed on the left side and the right side of the front part inside an automobile; a driver head feature recognition camera is installed on a front windshield inside ofthe automobile; a master MCU collects the driver head feature through the driver head feature recognition camera firstly, judges the driver pupil movement and the driver head deflection at the same time after video is processed; when the master MCU judges that the driver pupil moves to the left, the road condition information on the left side of an automobile body is displayed on the left displayscreen; and when the MCU judges that the driver pupil moves to the right, the road condition information on the right side of the automobile body is displayed on the right display screen. Rear-view image display screens are correspondingly installed on the left side and the right side of the front part inside the automobile, and the display and non-display are controlled according to the driver pupil and head rotation, so that using by drivers is more convenient, and driving is safer.

A system and method for improving social and presentation skills of persons with a social communication disorder such as Autism. Social anxiety or a lack of confidence, the method including: rendering and displaying on a display device a presentation script for an oral presentation to be made by a user; monitoring eye movement of the user during the oral presentation to measure a user's pupil movement and / or a user's gaze direction; displaying an indicia on a separate display screen and / or an upper portion of the display device; periodically displaying within the presentation script a visual prompt to cue the user to look at the indicia; measuring eye movement using eye tracking software and / or an eye tracking device, at occurrence of the visual prompt; and evaluating whether the user made eye contact with the indicia when prompted.

According to various embodiments of the disclosure, an electronic device includes: a frame; a glass module comprising a glass supported by the frame; a support rotatably connected to the frame; a display module comprising display circuitry configured to project an image to the glass module; a front camera disposed in at least one of the frame or the support configured to photograph the front of the frame; a light emitting unit comprising light-emitting circuitry configured to radiate light toward the rear of the frame; and an eye tracking camera disposed in the frame configured to photograph the rear of the frame and including a lens assembly including at least one lens, wherein the eye tracking camera is configured to form a field of view (FOV) to include both a left eye and a right eye of a user based on an object distance, which is a distance between the lens assembly and an object, being a first distance corresponding to a distance between the lens assembly and the left eye and / or the right eye of the user wearing the electronic device, wherein an absolute value of a distortion value of the lens assembly is equal to or less than a threshold value capable of tracking a pupil movement of the left eye and the right eye with respect to light incident from a region of interest (ROI) within a certain range from an outermost portion to the inside among regions corresponding to the FOV.

A Virtual Reality (VR) computer system and method including a VR headset to be worn by at least one user; one or more pupil sensors located in the VR headset configured and operative to capture and track pupil movement of the at least one user wearing the VR headset; and at least one camera device operative to capture video image of at least one user wearing the VR headset. A computer processor is instructed to generate a two-dimensional (2D) image of the least one user such that an image of the VR headset is virtually removed from the image of the at least one user wearing the VR headset.

A Virtual Reality (VR) computer system and method including a VR headset to be worn by at least one user; one or more pupil sensors located in the VR headset configured and operative to capture and track pupil movement of the at least one user wearing the VR headset; and at least one camera device operative to capture video image of at least one user wearing the VR headset. A computer processor is instructed to generate a two-dimensional (2D) image of the least one user such that an image of the VR headset is virtually removed from the image of the at least one user wearing the VR headset.

A method for processing pupil tracking images, comprising the steps of: 1) acquiring eye images multiple times; 2) processing each acquired eye image, and determining whether a pupil can be positioned in the acquired image; and 3) determining that pupil tracking is completed when the pupil can be positioned in consecutive n pieces of eye images. Image processing efficiency is improved by searching a potential bright spot area and carrying out Blob analysis smearing images caused by pupil movement can be eliminated, the pupil edge is accurately positioned by adopting a line drawing method in collaboration with a support vector machine when determining the pupil edge, and finally a weighted least square method is adopted to fit a circle / ellipse (pupil). Therefore, real-time tracking and analysis of the pupil under a complex background are realized, and reliable data are provided for subsequent steps to obtain the refractive parameters of the eye.

The invention discloses a driving suitability detecting device and a detecting method. An integrated sealed-type spectacle structure is adopted, and the outer layer of the spectacle structure is applied with a black light-absorbing material, so that light leaking and pupil change caused by visual attention of human eye pupils can be effectively prevented; by applying a flexible silica gel materialto a part where spectacles fit to a face, the face can fit to the spectacles, and fatigue can be directly detected, so that the precision of fatigue detection can be improved; by stimulating pupils with a rectangular surface light source, the pupils can be stimulated by the light source uniformly; by irradiating the pupils with an infrared surface light source, interference of the infrared pointlight source to pupil image acquisition can be avoided, so that pupil imaging is more uniform and cannot get interfered easily; motion videos of the pupils are analyzed through a three-dimensional long-term deep convolutional learning network, and driver's task suitability is objectively classified and judged, so as to deeply understand the motion states of the pupils; therefore, end-to-end detection is achieved, and detection accuracy and driving suitability detecting efficiency are improved; and the device is simple in structure and is convenient and rapid to use.

The invention provides a data processing device and method, a monitoring system, an awakening system and a recording medium, which are capable of accurately calculating the sleepiness even in the situation that is not suitable for calculating the sleepiness based on the vestibulo-ocular reflex movement (VOR). The data processing device that performs data processing of monitoring a person, the dataprocessing device includes: a calculator configured to calculate pupil movement and head movement of the person; an evaluator configured to evaluate a suitability degree of a situation in calculatingthe VOR; a provision unit configured to provide the suitability degree evaluated by the evaluator to data calculated by the calculator; a selector configured to select a first technique of calculating the sleepiness based on the VOR of the person or a second technique different from the first technique based on the suitability degree provided to the data; a first sleepiness calculator configuredto calculate the sleepiness based on the first technique when the selector selects the first technique; and a second sleepiness calculator configured to calculate the sleepiness based on the second technique when the selector selects the second technique.

Provided are a method and system for detecting information of brain-heart connectivity, the method comprising: obtaining moving images of a pupil and an electrocardiogram (ECG) signal from a subject; acquiring a pupil size variation (PSV) from the moving images by separating the moving images at a predetermined time range after R-peak of the ECG signal; extracting signals of a first period and a second period from the PSV; calculating alpha powers of the signals of the first and second periods at predetermined frequencies respectively.

The invention discloses a probe control method and a probe control device. The method includes the following steps: collecting movement information of the monitored part of the operator; based on a preset correspondence between the movement range of the monitored part and the screen display range, determining the corresponding movement information on the screen the target object; based on the third preset corresponding relationship between the detection range of the probe and the screen display range, control data or a control instruction carrying the control data is generated, and the control data or the control instruction is used to control the Probe action. Through the present invention, the operator can precisely control the content displayed on the screen only through his own pupil movement and head movement, without the assistance of a third person, which improves the efficiency and accuracy of probe control.

The invention discloses a pupil tracking image processing method, which comprises the following steps: 1) collecting eye images multiple times; 2) processing the eye images collected each time, and determining whether the collected images can locate the pupil; 3) continuously The pupil can be located in n eye images, and the pupil tracking is determined to be completed. The present invention greatly improves the image processing time by looking for potential bright spot areas and analyzing the blob shape, and can eliminate trailing images caused by pupil movement, and then use When finding the pupil edge, the drawing line method is used with the svm support vector machine to accurately locate the pupil edge, and finally the weighted least square method is used to fit the circle / ellipse (pupil), thus realizing the real-time tracking and analysis of the pupil in a complex background, It provides reliable basic data for subsequent calculation of eye refractive parameters.

A device unlocking method. The method shows challenging icons in challenging rounds and traces user pupils. The method requires a right user to have his pupil movement conform to a challenging icon through the challenging rounds. A device unlocks when a combined moving vector representing the pupil movement passes the challenging rounds and matches an unlocking condition.