288 results about "Eyeball movements" patented technology

The present invention provides an eye-controlled password input apparatus, which comprises a display device to display a password menu, an image capturing device to capture an user's eye region image, a memory unit to store at least one preset password and a corresponding account number, a control unit to generate the password menu according to the preset password, and an image processing unit. The image processing unit obtains a plurality of reference objects from the eye image so as to recognize the eye movement direction and to confirm password input. After input a character of the password, the display device generates another password selection menu for the user to input another password character until the password input program is completed.

Methods for assessing cognitive and linguistic abilities by tracking and recording the eye movements of a patient in response to predetermined verbal and visual stimuli. The methods incorporate conventional eye-tracking technology to acquire eye-fixation location and duration measures for testing linguistic comprehension, working memory, attention allocation, and the effect of semantic associative priming. Visual stimuli presented in the methods are carefully designed to reduce visually distracting features. Verbal stimuli are carefully designed to control for numerous linguistic features.

A method, apparatus, and system of selective advertising includes a gaming server to receive a request to play a game of chance from a gaming device, transmit gaming data to the gaming device, the gaming data associated with the requested game of chance, and receive player data, the player data associated with the player's eye movement, gestures, or change in state. The server may also be configured to analyze the player data, determine a context associated with the player data; and initiate an action based on the determined context.

The OculoKinetic Device is used to test an individual to evaluate brain functions and to identify the presence of a traumatic brain injury or disease which manifests itself through abnormal ocular responses to stimuli by using the high-speed tracking of an individual's eye movements, pupil size and reactivity, eye lid position and blink parameters and optionally along with other ocular elements, i.e., eyeball pressure, temperature, blood flow, etc. The eye movement stimulus protocol uses a target that moves in any direction of the two-dimensional plane and may use a color display or geometric shapes. In addition, the stimuli can be used in conjunction with cognitive testing, balance assessment, and other non-eye tests.

An image is displayed by determining a relative position and orientation of a display in relation to a viewer's head, and rendering an image based on the relative position and orientation. The viewer's eye movement relative to the rendered image is tracked, with at least one area of interest in the image to the viewer being determined based on the viewer's eye movement, and an imaging property of the at least one area of interest is adjusted. Computer-generated data is obtained for display based on the at least one area of interest. At least one imaging property of the computer-generated data is adjusted according to the at least one imaging property that was adjusted for the at least one area of interest and the computer-generated data is displayed in the at least one area of interest along with a section of the image displayed in the at least one area of interest.

For optical coherence tomography engines a method for eliminating the effects of the movement of the eye on the optical coherence tomography scan calculates the motion of the eye from an image from an auxiliary scanning system and compares a reference region to a corresponding region in the image associated with the next frame, with the change in position sensing the motion of the eye. This is followed by utilizing this sensed motion to generate accurate offsets for the scanning mirror patterns of the OCT engine. Additionally, scan skipping is utilized to obviate the effects of rapid eye movement that occur at rates faster than the image acquisition rate.

The invention relates to a head-mounted wireless video eye tracker which is independently designed. Information is exchanged through analysis software of a wireless router and a computer without any peripheral cable connection. Multiple technologies such as an embedded system, image compression and a wireless local area network are comprehensively applied for the head-mounted wireless video eye tracker, eye movement video information is obtained by applying camera with an infrared LED illumination, image compression is completed through a digital signal processor (DSP) chip after the eye movement video information is decoded, then the decoded eye movement video information is transmitted to the computer by the wireless router through the wireless transmission module, a control signal sent by the analysis software of the computer, a corresponding visual stimulation dynamic image is generated, and is displayed through video eyeglasses arranged on a helmet to guide a subject for generating eye tracking information. The analysis software running on the computer also realizes image decompression and pupil location to obtain eyeball movement locus, so that multiple test items are tested.

The invention discloses a method and a device for operating a browser based on eye-movement tracking. The method comprises the steps of shooting a facial image of a user through a camera at every set time and describing the facial image to a Canvas, describing eyeball images to the Canvas after the eyeball images are extracted from the facial image, and acquiring the pixel data of the eyeball images from the Canvas; acquiring the eyeball data shot every time according to the pixel data and a set eyeball catching algorithm, and determining the user to be focused on a special content in a browser page when the difference valve of every adjacent two-time eyeball positions is less than a preset threshold valve and the retention time of eyeballs is more than the set time of the eyeballs; if the semi-diameters of pupils are detected to be amplified, looking for corresponding focal coordinates of the pupils in a webpage, and determining dom element label objects corresponding to the focal coordinates; and executing corresponding browsing operation according to relative relations between the preset dom element label subjects and performed actions. The execution of the browsing relative operation can be realized based on the eyeball movement by using the method.

The invention is applied to the technical field of intelligent terminals, and provides as screen brightness regulation method and a screen brightness regulation device. The method comprises the following steps of acquiring the eyeball movement information of a user; acquiring a focus area of eyeballs of the user on a screen of an intelligent terminal according to the eyeball movement information; regulating the brightness of the focus area on the screen to be first display brightness, and regulating the brightness of the other area on the screen to be second display brightness, wherein the other area is the area, except the focus area, on the screen. According to the method and the device, the brightness of different areas on the screen can be regulated according to the focus information of the eyeballs of the user, so that the power consumption of a display screen or a touch screen is effectively reduced, and the user favorably concentrates on an attentively watched screen area.

The invention provides a commodity browse method and a system based on eyeball tracking. The method comprises the steps that eyeball movement of a user is positioned and tracked by image acquisition equipment with an eyeball tracking function, a front camera of the image acquisition equipment acquires eye information of the user, a rear camera of the image acquisition equipment acquires a commodity image, and a user can quickly acquire commodity information from the commodity image and select a needed commodity by positioning gazing coordinates of eyeballs of the user on the commodity image and zooming in the commodity image according to the positioned gazing coordinates.

The present invention relates to a dual-mode emotion identification method and system based on a facial expression and an eyeball movement. The method comprises a step of performing acquisition, a step of extracting a facial expression feature vector, a step of extracting an eyeball movement feature vector, a step of performing qualitative analysis on an emotional state, a step of performing matching-by-time and storage, a step of performing fusion and classification and a step of comparing emotional information. According to the method and system provided by the present invention, facial expression information of a to-be-tested object can be dynamically and accurately extracted and analyzed, and a correlation between the facial expression and the emotion is established; rich eye movement information can be accurately and efficiently acquired by means of tracking of an eye tracker, and the emotional state of the to-be-tested object is analyzed from the angle of the eyeball movement; and the facial expression feature vector and the eyeball movement feature vector are processed by using an SVR, so that the emotional state of the to-be-tested object can be obtained more accurately, and thus accuracy and reliability of emotion identification are improved.

A sleepiness sign detection apparatus, includes: a head movement detection unit configured to detect a head movement to generate a head movement data; an eye movement detection unit configured to detect an eye movement to generate an eye movement data; an ideal eye movement angular velocity calculation unit configured to calculate an ideal eye movement angular velocity based on the head movement data generated by the head movement detection unit; an eye-rotation angular velocity calculation unit configured to calculate an eye-rotation angular velocity based on the eye movement data generated by the eye movement detection unit; and a sleepiness sign detection unit configured to detect vestibule-ocular reflex (VOR) from the ideal eye movement angular velocity and the eye-rotation angular velocity, and determine a sign of sleepiness based on the vestibule-ocular reflex.

The invention discloses an eyeball movement identification method based on face identification. The eyeball movement identification method based on the face identification includes: detecting an eyeball, performing edge detection on multiple images of a face, positioning an initialization feature point of the eyeball, and calculating a position and a ratio of the eyeball relative to the face according to the initialization feature point so as to obtain a face dimension angle normalization ratio; identifying the eyeball, obtaining a face image to be detected, and calculating positions of the eyeball in the face images according to the face dimension angle normalization ratio; identifying eyeball movements, identifying the positions of the eyeball in more than two face images, and identifying the eyeball movements according to position changes. The eyeball movement identification method based on the face identification can accurately position the eyeball on the face, and not only support eyeball identification on the static face, but also can support the eyeball identification on the face in dynamic video.

An image selected to be printed is rendered for display, prior to printing, based on the relative position and orientation of a display in relation to a user's head, where the displayed rendered image is a representation of what the rendered image will look like when printed. The user's eye movement relative to the rendered image is tracked, with at least one area of interest in the image to the viewer being determined based on the viewer's eye movement, an imaging property of the at least one area of interest is adjusted, the image to be printed is rendered based on adjusting the imaging property, and the image is printed.

The invention relates to an immersive three-dimensional rendering projection system and method for a moving view point on a curved screen. The method is based on an immersive three-dimensional rendering projection system for a moving view point on a curved screen. The method comprises the following steps: acquiring user information: tracking user's head position and posture information, and estimating user's binocular positions and sight direction; setting three-dimensional rendering parameters: according to the estimated user's binocular positions and sight direction, adjusting a three-dimensional camera in real time to perform three-dimensional rendering of the moving view point on the parameters; performing dynamic parallax adjustment: performing post processing on the parallax of the rendered three-dimensional image according to the relative position relation between the user and the screen and the geometric shape information of the projection screen, so that the user views comfortable and correct three-dimensional images at his position; optimizing user perception: for user's head posture and eyeball movement, further optimizing the image respectively after the dynamic parallax adjustment; and projecting a three-dimensional scene: watching a virtual roaming three-dimensional scene by the user wearing a pair of three-dimensional glasses.

A faceguard is configured for measuring a human eye muscle movement response. The faceguard is configured for protecting at least one part of a human face and has an aperture for human vision through the faceguard. The faceguard comprises an eye sensor, a head orientation sensor, and an electronic circuit. The eye sensor comprises a video camera and is configured for measuring eyeball movement, pupil size, and / or eyelid movement. The head orientation sensor senses pitch and / or yaw of a person's head. The electronic circuit is responsive to the eye sensor and the head orientation sensor.

A transfer assist apparatus includes an anxiety measurement unit that detects a physical change linked to a sense of anxiety in the care-receiver and measures a degree of anxiety in the care-receiver, and a control unit that control the drive unit correspondingly to a trajectory inputted by the operation unit and performs feedback control so as to reduce the degree of anxiety measured by the anxiety measurement unit. The anxiety measurement unit detects at least one of a heart rate, an amount of perspiration, a breathing rate, an eyeball movement, an electric resistance of skin, and a skin temperature as the physical change linked to a sense of anxiety in the care-receiver. The control unit sets a speed limit of the drive unit correspondingly to the degree of anxiety measured by the anxiety measurement unit and restricts the drive speed of the drive unit not to exceed the speed limit.

The invention discloses an automatic shooting method and system of a wearable device. The system comprises an eyeball movement detection module, a calculation module, a shooting module and a storage module. The eyeball movement detection module is used for detecting eyeball movement and outputting eyeball movement data; the calculation module is used for identifying eyeball pauses according to the eyeball movement data and outputting the line-of-sight direction formed during eyeball pausing and a shooting instruction; after receiving the shooting instruction, the shooting module conducts focusing according to the line-of-sight direction formed during eyeball pausing and then starts to shoot, and a picture is output; the storage module is used for storing the picture. When a person sees a thing with eyes, a picture can be seen clearly after the eyes are turned to fixed positions first, pause and then are focused. The method and system simulate the process, pauses in eye movement are detected, the line-of-sight direction formed during eyeball pausing is identified, automatic focusing is carried out, automatic shooting is conducted for recording, the real view field of a user can be recorded more truly and efficiently, and pictures seen by human eyes can be restored in real time.

The invention discloses an on-vehicle head-up terminal and a method for controlling display brightness of the same. The on-vehicle head-up display terminal comprises a controller, a display device which is connected with the controller, and an eyeball tracking device. The eyeball tracking device is connected with the controller and is used for monitoring movement of eyeballs in real time and transmitting captured image information to the controller. The controller is used for determining a visual line focusing point of the eyeballs according to an eyeball tracking algorithm and controlling the operation state of the display device according to determining result. According to the technical solution of the invention, the eyeball movement of a driver is monitored in real time through adding the eyeball tracking device; furthermore whether the visual line focusing point is on the display device is determined; and the operation state of the display device is controlled according to the determining result, thereby ensuring a fact that attention of the driver is not interfered by the display content and brightness, reducing negative effect of the on-vehicle head-up display terminal in a using process and furthermore greatly reducing power consumption of equipment.

The invention discloses an eye movement detection tracking method and device, and an application of the eye movement detection tracking method. The eye movement detection tracking method comprises that a continuous image sequence which can include an eyeball is captured; a target rectangle of a candidate eyeball is detected and positioned in imaging pictures of the image sequence; non eyeball positioning is removed, and the tracked eyeball target rectangle is obtained; a hash code calculating step is carried out, during one frame of the image sequence, the whole image is scanned, and the hash code of each scanning window is calculated; a comparison step is carried out, the Hamming distances of each calculated hash code and the hash code of the tracked eyeball target rectangle are compared, and the eyeball target is on the scanning window having the minimum Hamming distance in the current frame; the eyeball target rectangle to be tracked in the next frame is updated through the eyeball target rectangle in the current frame, the hash code calculating step and the comparison step are repeated until an eyeball target rectangle coordinate sequence of N frames is obtained; and the eyeball moving angle is calculated according to the coordinate sequence. According to the invention, eyeball movement can be detected and tracked accurately.

The invention discloses a vision rehabilitation training method and system. The vision rehabilitation training system is composed of an eyeball tracking module, an intelligent terminal, a virtual reality head-mounted display and a vision rehabilitation training module. According to the vision rehabilitation training method, the process of movement of an object according to a preset movement trackis tracked and viewed through eyeballs; through eyeball movement, ciliary muscles are trained, the spasm fatigue condition of the ciliary muscles is improved, the adjusting capacity of the ciliary muscles is enhanced, elasticity is recovered, and crystalline lenses of the eyes are stretched; and thus, a vision condition is improved, and vision rehabilitation effect is achieved without an operation.

The invention provides a visual attention detection method based on eyeball movement and a system thereof. The method comprises the steps that visual attention test content is displayed through firstdisplay equipment; acquiring a plurality of face images when a testee reads the plurality of E-shaped marks, identifying eye images corresponding to the face images according to the plurality of faceimages, and determining pupil position data of the eye images according to the plurality of eye images, based on the pupil position data, determining fixation point position information of the visualattention test content of the testee on the first display equipment, and determining the visual attention level of the visual attention testee according to the fixation point position information andthe visual attention test content. According to the technical scheme, the visual attention of the visual attention testee can be evaluated automatically, so that the evaluation is more objective, andthe defects of an existing clinical visual attention detection technology are overcome.

The invention provides a vehicle terminal eyeball identification control method and a vehicle terminal eyeball identification control system. The method comprises the following steps: projecting infrared rays to an eyeball when eye identification operation is activated; tracking the movement of the eyeball after infrared projection and collecting an eyeball iris image; processing the collected eyeball iris image to obtain eyeball movement information; sending a corresponding control instruction to a control system of a vehicle terminal to control the vehicle terminal according to a control instruction preset for the eyeball movement information; identifying the movement of the eyeball with the center point of a tracking and collecting module for tracking the movement of the eyeball and collecting the eyeball iris image as the point of origin; and installing an activation button on the steering wheel to activate eye identification operation. A car driver can control a HUD, an in-car entertainment system, and even the car radio, music, air conditioning temperature and other applications only through subtle movement of the eyes, there is no need for the hands of the driver to leave the steering wheel, and therefore, the security risk is reduced.

Provided are an image processing device and an image processing method for acquiring a consciousness level at which a driver recognizes a surrounding environment on the basis of an image of the driver picked up by an in-vehicle camera.An image of an eyelips is picked up by an in-vehicle camera 100 at low resolution and eye positions grasped in the image analysis are corrected for each frame while being subjected to local high-speed processing in parallel, whereby the tracking of the saccade among eyeball movement is realized. That is, active local high-speed eye tracking is performed only on a capture frame 102 in an image picked up by the in-vehicle camera 100, whereby it becomes possible to monitor the saccade of the eye movement without causing an attachment load.

Various aspects of the subject technology relate to prediction of eye movements of a user of a head-mountable display device. Predictive foveated display systems and methods, using the predicted eye movements are also disclosed. Predictive variable focus display systems and methods using the predicted eye movements are also disclosed. Predicting eye movements may include predicting a future gaze location and / or predicting a future vergence plane for the user's eyes, based on the current motion of one or both of the user's eyes. The predicted gaze location may be used to pre-render a foveated display image frame with a high-resolution region at the predicted gaze location. The predicted vergence plane may be used to modify an image plane of a display assembly to mitigate or avoid a vergence / accommodation conflict for the user.

A visual-eye movement reflex examination method by utilizing a virtual visual target comprises the following steps: 1) a virtual visual target image for visual stimulation is displayed by a virtual visual target optical display system; 2) an eyeball movement image of a detected person caused by the virtual visual target image is photographed by an eyeball movement image collection system; 3) the eyeball movement image is processed by an image processing module, thus forming a curve of the position of a pupil which is changing with the time; the visual-eye movement reflex examination method by utilizing the virtual visual target of the invention can facilitate the vestibular detection.