81 results about "Point of gaze" patented technology

Methods, systems, and computer programs for interfacing a user with a Graphical User Interface (GUI) are provided. One method includes an operation for identifying the point of gaze (POG) of the user. The initiation of a physical action by the user, to move a position of a cursor on a display, is detected, where the cursor defines a focus area associated with a computer program executing the GUI. Further, the method includes an operation for determining if the distance between the current position of the cursor and the POG is greater than a threshold distance. The cursor is moved from the current position to a region proximate to the POG in response to the determination of the POG and to the detection of the initiation of the physical action.

A system and method for eye gaze tracking in human or animal subjects without calibration of cameras, specific measurements of eye geometries or the tracking of a cursor image on a screen by the subject through a known trajectory. The preferred embodiment includes one uncalibrated camera for acquiring video images of the subject's eye(s) and optionally having an on-axis illuminator, and a surface, object, or visual scene with embedded off-axis illuminator markers. The off-axis markers are reflected on the corneal surface of the subject's eyes as glints. The glints indicate the distance between the point of gaze in the surface, object, or visual scene and the corresponding marker on the surface, object, or visual scene. The marker that causes a glint to appear in the center of the subject's pupil is determined to be located on the line of regard of the subject's eye, and to intersect with the point of gaze. Point of gaze on the surface, object, or visual scene is calculated as follows. First, by determining which marker glints, as provided by the corneal reflections of the markers, are closest to the center of the pupil in either or both of the subject's eyes. This subset of glints forms a region of interest (ROI). Second, by determining the gaze vector (relative angular or Cartesian distance to the pupil center) for each of the glints in the ROI. Third, by relating each glint in the ROI to the location or identification (ID) of a corresponding marker on the surface, object, or visual scene observed by the eyes. Fourth, by interpolating the known locations of each these markers on the surface, object, or visual scene, according to the relative angular distance of their corresponding glints to the pupil center.

A system and method for eye gaze tracking in human or animal subjects without calibration of cameras, specific measurements of eye geometries or the tracking of a cursor image on a screen by the subject through a known trajectory. The preferred embodiment includes one uncalibrated camera for acquiring video images of the subject's eye(s) and optionally having an on-axis illuminator, and a surface, object, or visual scene with embedded off-axis illuminator markers. The off-axis markers are reflected on the corneal surface of the subject's eyes as glints. The glints indicate the distance between the point of gaze in the surface, object, or visual scene and the corresponding marker on the surface, object, or visual scene. The marker that causes a glint to appear in the center of the subject's pupil is determined to be located on the line of regard of the subject's eye, and to intersect with the point of gaze. Point of gaze on the surface, object, or visual scene is calculated as follows. First, by determining which marker glints, as provided by the corneal reflections of the markers, are closest to the center of the pupil in either or both of the subject's eyes. This subset of glints forms a region of interest (ROI). Second, by determining the gaze vector (relative angular or cartesian distance to the pupil center) for each of the glints in the ROI. Third, by relating each glint in the ROI to the location or identification (ID) of a corresponding marker on the surface, object, or visual scene observed by the eyes. Fourth, by interpolating the known locations of each these markers on the surface, object, or visual scene, according to the relative angular distance of their corresponding glints to the pupil center.

A system for automatic mapping of eye-gaze data to hypermedia content utilizes high-level content-of-interest tags to identify regions of content-of-interest in hypermedia pages. User's computers are equipped with eye-gaze tracker equipment that is capable of determining the user's point-of-gaze on a displayed hypermedia page. A content tracker identifies the location of the content using the content-of-interest tags and a point-of-gaze to content-of-interest linker directly maps the user's point-of-gaze to the displayed content-of-interest. A visible-browser-identifier determines which browser window is being displayed and identifies which portions of the page are being displayed. Test data from plural users viewing test pages is collected, analyzed and reported.

Apparatus and method for eye gaze tracking in human or animal subjects without calibration of cameras, specific measurements of eye geometries or the tracking of a cursor image on a screen by the subject through a known trajectory. One embodiment includes one uncalibrated camera for acquiring video images of the subject's eye(s) and optionally having an on-axis illuminator, and a surface, object, or visual scene with embedded off-axis illuminator markers. The off-axis markers are reflected on the corneal surface of the subject's eyes as glints. The glints indicate the distance between the point of gaze in the surface, object, or visual scene and the corresponding marker on the surface, object, or visual scene.

Methods, systems, and computer programs for interfacing a user with a Graphical User Interface (GUI) are provided. One method includes an operation for identifying the point of gaze (POG) of the user. The initiation of a physical action by the user, to move a position of a cursor on a display, is detected, where the cursor defines a focus area associated with a computer program executing the GUI. Further, the method includes an operation for determining if the distance between the current position of the cursor and the POG is greater than a threshold distance. The cursor is moved from the current position to a region proximate to the POG in response to the determination of the POG and to the detection of the initiation of the physical action.

A display system that presents three-dimensional content to a viewer is described herein. The display system includes a screen assembly having one or more adaptable display characteristics relating to the presentation of three-dimensional content, first circuitry that at least assists in producing reference information corresponding to at least one aspect of a viewing reference of the viewer, and second circuitry that causes modification of at least one of the one or more adaptable display characteristics, the modification corresponding at least in part to the reference information. The viewing reference of the viewer may comprise one or more of a location of the viewer relative to the screen assembly, a head orientation (tilt and / or rotation) of the viewer, and a point of gaze of the viewer. The first circuitry may comprise, for example, viewer-located circuitry and / or other circuitry that is communicatively connected to the second circuitry for providing the referencing information thereto.

A system for tracking the point of gaze of an observer observing an object comprises a camera for recording an image of an eye of the observer, comprises a means for providing a luminous marker, and means for analyzing the image of the eye to determine the reflection of the marker on the eye and the centre of the pupil. The relative positions of the corneal reflection of the marker and the pupil centre are measured. The marker is repositioned, in dependence on the determined relative positions, to improve correspondence between the corneal reflection of the marker and the pupil centre.

An apparatus, system, and method for a mobile, low-cost headset for 3D point of gaze estimation. A point of gaze apparatus may include an eye tracking camera configured to track the movements of a user's eye and a scene camera configured to create a three-dimensional image and a two-dimensional image in the direction of the user's gaze. The point of gaze apparatus may include an image processing module configured to identify a point of gaze of the user and identify an object located at the user's point of gaze by using information from the eye tracking camera and the scene camera.

A mobile phone has a display etc. and detects an eye-gaze input based on a point of gaze of a user. The mobile phone performs predetermined processing relevant to an object if the eye-gaze input to the object displayed on the display is detected. If the point of gaze of the user is included to an area that displays a text of a digital book when a digital book application is performed, for example, a detection precision of the eye-gaze input is set in a low precision mode. On the other hand, when the point of gaze of the user is included to another area that does not display the text, the detection precision of the eye-gaze input is set in a high precision mode. Then, after the detection precision of the eye-gaze input is thus set, an eye-gaze of the user is detected.

A method and system for displaying an image, includes steps and means for: storing image data in a manner that enables retrieval of different spatial regions of an image at different fidelities; determining an viewer's point of gaze on a display; retrieving image data for each spatial region of an image at a fidelity that is a decreasing function of the distance of the regions from the point of gaze; and displaying the retrieved image data on the display.

Methods, systems, and computer programs for interfacing a user with a Graphical User Interface (GUI) are provided. One method includes operations for identifying a point of gaze (POG) of a user, and for detecting initiation of an action by the user to move a position of a selector for selecting objects presented on a graphical user interface (GUI). In addition, the method includes an operation for determining the distance between the current position of the selector and the POG. The displacement speed of the selector is adjusted based on the distance between the current position of the selector and the POG, where the displacement speed is reduced as the distance between the current position of the selector and the POG becomes smaller.

A method and system for displaying an image, includes steps and means for: storing image data in a manner that enables retrieval of different spatial regions of an image at different fidelities; determining an viewer's point of gaze on a display; retrieving image data for each spatial region of an image at a fidelity that is a decreasing function of the distance of the regions from the point of gaze; and displaying the retrieved image data on the display.

A game apparatus includes an LCD and a touch panel is provided on the LCD. On the LCD is displayed a game screen on which objects of different types are disposed so as to be aligned in a reticular pattern. By a player touching a desired object, a three-dimensional location of the object is set as a point of gaze of a virtual camera. Then, by the player moving a touch location, the location of the virtual camera (viewpoint) is changed according to the movement. In a virtual space, different layers are provided for the different types of objects. The objects are disposed so as not to overlap with each other between the different layers. When the viewpoint is fixed and a plurality of objects of different types intersecting a line of sight or a line parallel to the line of sight satisfy a predetermined condition, the objects are deleted.

The present invention provides an information display device including: an image input section 1 that inputs an image corresponding to a user's field of vision; a line-of-sight detection section 2 that detects a point of gaze indicative of a position of a line of sight in the user's field of vision; an object recognition section 3 that extracts as a first region a region in the image of an object including the point of gaze from the image; a display position determination section 5 that determines as a display position a position on which a user's line of sight does not fall in the field of vision based on information on the first region; and an information display section 6 that displays information to be presented to a user at the display position.

A system for delivering learning programmes comprising optical sensors for capturing a subject's facial expression, eye movements, point-of-gaze, and head pose during a learning session; a data repository comprising task data 5 entities; a module for estimating the subject's affective and cognitive states using the captured sensory data; and a module for selecting a task data entity for presentment to the subject after each completion of a task data entity based on a probability of the subject's understanding of the associated knowledge; wherein the probability of the subject's understanding is computed using the subject's 10 estimated affective cognitive states. The system can also be applied in neurocognitive disorder diagnosis tests. The subject's affective and cognitive states estimation based on the captured sensory data during a diagnosis test is feedback to the system to drive the course of the test, adaptively change the test materials, and influence the subject's emotions.

Resolution of perspective in three dimensions is necessary for intermeshing real players into simulated environments during virtual training exercises. With the advent of high resolution image sensors the ability to sense position and orientation using image capture devices is possible. The combination of small sized sensors and image recognition tracking algorithms allows the tracking element to be placed directly on the device whose perspective is desired. This provides a solution to determining perspective as it provides a direct measurement from the center axis of the observer. This invention employs a perspective tracking device to determine a point-of-gaze or a point-of-aim in a three-dimensional space to a high degree of accuracy. Point-of-gaze may be used to determine views for head mounted displays and aim-points for weapons. The invention may operate in an unconstrained space allowing simulation participants to operate in a larger, open environment. Areas of interest in the environment are bounded by area of interest markers which identify the region and its physical constraints.

A system for tracking the point of gaze of an observer observing an object comprises a camera for recording an image of an eye of the observer, comprises a means for providing a luminous marker, and means for analyzing the image of the eye to determine the reflection of the marker on the eye and the centre of the pupil. The relative positions of the corneal reflection of the marker and the pupil centre are measured. The marker is repositioned, in dependence on the determined relative positions, to improve correspondence between the corneal reflection of the marker and the pupil center.

To accurately input a point-of-gaze of a user in a game engine expressing a three-dimensional space. A point-of-gaze calculation algorithm is configured such that data of lines of view of both eyes of a user is calculated using data from a camera (10) capturing an image of the eyes of the user, and a three-dimensional coordinate position within a three-dimensional space at which the user gazes is calculated on the basis of the gaze data of the user and three-dimensional data included in a system managed by the game engine.

A method of compressing image data from one or more images forming part of digital reality content, the method including obtaining pixel data from the image data, the pixel data representing an array of pixels within the one or more images; determining a position of the array of pixels within the one or more images relative to a defined position, the defined position being at least partially indicative of a point of gaze of the user; and compressing the pixel data at least partially in accordance the determined position so that a degree of compression depends on the determined position of the array of pixels.

An image processing apparatus and an image processing method are provided which are capable of changing display from a virtual space image to a real space image or vice versa, or combining them based on the movement speed of the user's point of gaze while the user is moving in a virtual space. An image processing program and a medium recording the same are also provided. In the image processing apparatus, when the movement of a head mounted display (HMD) in the virtual space is detected (Step S111), the movement speed is calculated (Step S112) and it is determined whether the movement speed is equal to or greater than akm / h. When the movement speed is slower than akm / h, an updated virtual space image reflecting the movement of the HMD is created for display (Steps S114 and S118). When the movement speed is equal to or greater than akm / h, the real image then being taken is displayed as it is (Steps S115 and S118).

The invention discloses a method and a system of combining three-dimensional line-of-sight tracking and brain-computer interface technology to control a manipulator to grasp an object. A process thereof includes: collecting line-of-sight signals of a user by an eye tracker, sending data to a controller, calculating three-dimensional coordinates of a gaze point by the controller, and sending the same to the manipulator; and at the same time, collecting human-brain electroencephalogram signal changes by an electroencephalogram helmet, sending the same to the controller, decoding user motion imagination and relaxation status by the controller, and thus triggering grasping and releasing action of the manipulator on the gaze object. According to the method and the system, the dual advantages ofhuman line-of-sight and mind control are exerted, the deficiency that existing 2D line-of-sight tracking technology must rely on a displayer is overcome at the same time, intuitive human-robot interaction can be carried out in a real scene, assisting or rehabilitating manipulators can be provided for paraplegic / hemiplegic patients, movement-inconvenient elderly persons and the like by applying the system of the invention, and autonomy thereof is improved or rehabilitation is helped in everyday life.

Resolution of perspective in three dimensions is necessary for intermeshing real players into simulated environments during virtual training exercises. A combination of small sized sensors and image recognition tracking algorithms allows the tracking element to be placed directly on the device whose perspective is desired. This provides a solution to determining perspective as it provides a direct measurement from the center axis of the observer. This invention employs a perspective tracking device to determine a point-of-gaze or a point-of-aim in a three-dimensional space to a high degree of accuracy. Point-of-gaze may be used to determine views for head mounted displays and aim-points for weapons. The invention may operate in an unconstrained space allowing simulation participants to operate in a larger, open environment. Areas of interest in the environment are bounded by emitters which identify the region and its physical constraints.

A method of determining a point or object on a digital display that is being gazed at by a viewer by capturing an image of the viewer's iris and at least one other feature of the viewer's face, calculating an imaginary line from the objet being viewed, to the iris and continuing to an imaginary center of the viewer's eye, then calculating a position of the center of the eye relative to the other feature of the viewer's face. Upon a change in the position of the eye and the iris, a calculation can be made of a position of the iris in a second image. An imaginary line can be extended out from the center of the eye, through the new position of the iris onto the digital display to determine the point of gaze of the viewer.

A line-of-sight input device includes a detection means that detects a point of gaze or an eyeball rotational movement of the user, a movement control means that moves the input element; and an input determining means that determine an input of the input element near a predetermined position when a predetermined condition is satisfied; wherein the movement control means increases a movement speed of the input element as the point of gaze is farther from the predetermined position or a rotation angle of the eyeball rotational movement is larger, and makes the movement speed closer to zero as the point of gaze becomes nearer to the predetermined position or a rotation angle of the eyeball rotational movement becomes smaller.

A method of compressing image data from one or more images forming part of digital reality content, the method including obtaining pixel data from the image data, the pixel data representing an array of pixels within the one or more images; determining a position of the array of pixels within the one or more images relative to a defined position, the defined position being at least partially indicative of a point of gaze of the user; and compressing the pixel data at least partially in accordance the determined position so that a degree of compression depends on the determined position of the array of pixels.

A visual data processing method applied to a visual data processing system. The visual data processing method comprises: (a) detecting a gazing point position of a user on a display; and (b) performing at least one process operation to visual data according to at least one distance between at least one display location for the visual data on the display and the gazing point position.

In order to provide an information display device capable of displaying information to be presented to a user without obstructing what the user is looking at, the present invention is provided with: an image input unit (1) that inputs an image corresponding to the field of view of the user; a line of sight detection unit (2) that detects a point of gaze representing the position of the line of sight in the field of view of the user; an object recognition unit (3) that extracts, from the image inputted from the image input unit (1), a region in an image of an object, which includes the point of gaze detected by the line of sight detection unit (2), as a first region; a display position determination unit (5) that determines, on the basis of information regarding the first region extracted by the object recognition unit (3), a position where the line of sight of the user does not strike in the field of view as a display position; and an information display unit (6) that displays information to be presented to the user at the display position determined by the display position determination unit (5).

According to the invention, techniques for refining a ballistic prediction are described. In an example, an eye tracking system may record images over time of content presented on a display. Saccade data may be received and used as a trigger to retrieve particular ones of the recoded images. The eye tracking system may compare the images to identify a change in the content. The location of this change may correspond to a sub-area of the display. The output of the ballistic prediction may include a landing point that represents an anticipated gaze point. This landing point may be adjusted such that a gaze point is now predicted to fall within the sub-area when the change is significant.

The embodiment of the invention discloses an interface element appearance evaluation method and system based on real vehicle in-the-loop simulation, and relates to the technical field of man-machine interaction interface testing. The method comprises the following steps: in a real vehicle in-the-loop simulation test process, the processor analyzes a driver eye movement signal collected by the eye tracker in response to an operation of a driver on a human-computer interaction interface, so as to obtain a gaze point thermal area of the driver; if the gaze point thermal area is only located on the display screen and the driving is safe, the processor passes the evaluation of the human-computer interaction interface in the driving scene; and if the gaze point thermodynamic area is only located on the human-computer interaction interface, evaluating according to whether the gaze point thermodynamic area on the human-computer interaction interface is concentrated or not, the concentrated element type and whether the driving is safe or not. According to the embodiment, element appearances on the human-computer interaction interface are evaluated through a real vehicle in-the-loop simulation method, and the evaluation is more accurate.