80 results about "Point of gaze" patented technology

Methods, systems, and computer programs for interfacing a user with a Graphical User Interface (GUI) are provided. One method includes an operation for identifying the point of gaze (POG) of the user. The initiation of a physical action by the user, to move a position of a cursor on a display, is detected, where the cursor defines a focus area associated with a computer program executing the GUI. Further, the method includes an operation for determining if the distance between the current position of the cursor and the POG is greater than a threshold distance. The cursor is moved from the current position to a region proximate to the POG in response to the determination of the POG and to the detection of the initiation of the physical action.

A system and method for eye gaze tracking in human or animal subjects without calibration of cameras, specific measurements of eye geometries or the tracking of a cursor image on a screen by the subject through a known trajectory. The preferred embodiment includes one uncalibrated camera for acquiring video images of the subject's eye(s) and optionally having an on-axis illuminator, and a surface, object, or visual scene with embedded off-axis illuminator markers. The off-axis markers are reflected on the corneal surface of the subject's eyes as glints. The glints indicate the distance between the point of gaze in the surface, object, or visual scene and the corresponding marker on the surface, object, or visual scene. The marker that causes a glint to appear in the center of the subject's pupil is determined to be located on the line of regard of the subject's eye, and to intersect with the point of gaze. Point of gaze on the surface, object, or visual scene is calculated as follows. First, by determining which marker glints, as provided by the corneal reflections of the markers, are closest to the center of the pupil in either or both of the subject's eyes. This subset of glints forms a region of interest (ROI). Second, by determining the gaze vector (relative angular or Cartesian distance to the pupil center) for each of the glints in the ROI. Third, by relating each glint in the ROI to the location or identification (ID) of a corresponding marker on the surface, object, or visual scene observed by the eyes. Fourth, by interpolating the known locations of each these markers on the surface, object, or visual scene, according to the relative angular distance of their corresponding glints to the pupil center.

A display system that presents three-dimensional content to a viewer is described herein. The display system includes a screen assembly having one or more adaptable display characteristics relating to the presentation of three-dimensional content, first circuitry that at least assists in producing reference information corresponding to at least one aspect of a viewing reference of the viewer, and second circuitry that causes modification of at least one of the one or more adaptable display characteristics, the modification corresponding at least in part to the reference information. The viewing reference of the viewer may comprise one or more of a location of the viewer relative to the screen assembly, a head orientation (tilt and/or rotation) of the viewer, and a point of gaze of the viewer. The first circuitry may comprise, for example, viewer-located circuitry and/or other circuitry that is communicatively connected to the second circuitry for providing the referencing information thereto.

A system for tracking the point of gaze of an observer observing an object comprises a camera for recording an image of an eye of the observer, comprises a means for providing a luminous marker, and means for analyzing the image of the eye to determine the reflection of the marker on the eye and the centre of the pupil. The relative positions of the corneal reflection of the marker and the pupil centre are measured. The marker is repositioned, in dependence on the determined relative positions, to improve correspondence between the corneal reflection of the marker and the pupil centre.

An apparatus, system, and method for a mobile, low-cost headset for 3D point of gaze estimation. A point of gaze apparatus may include an eye tracking camera configured to track the movements of a user's eye and a scene camera configured to create a three-dimensional image and a two-dimensional image in the direction of the user's gaze. The point of gaze apparatus may include an image processing module configured to identify a point of gaze of the user and identify an object located at the user's point of gaze by using information from the eye tracking camera and the scene camera.

A mobile phone has a display etc. and detects an eye-gaze input based on a point of gaze of a user. The mobile phone performs predetermined processing relevant to an object if the eye-gaze input to the object displayed on the display is detected. If the point of gaze of the user is included to an area that displays a text of a digital book when a digital book application is performed, for example, a detection precision of the eye-gaze input is set in a low precision mode. On the other hand, when the point of gaze of the user is included to another area that does not display the text, the detection precision of the eye-gaze input is set in a high precision mode. Then, after the detection precision of the eye-gaze input is thus set, an eye-gaze of the user is detected.

A method and system for displaying an image, includes steps and means for: storing image data in a manner that enables retrieval of different spatial regions of an image at different fidelities; determining an viewer's point of gaze on a display; retrieving image data for each spatial region of an image at a fidelity that is a decreasing function of the distance of the regions from the point of gaze; and displaying the retrieved image data on the display.

A game apparatus includes an LCD and a touch panel is provided on the LCD. On the LCD is displayed a game screen on which objects of different types are disposed so as to be aligned in a reticular pattern. By a player touching a desired object, a three-dimensional location of the object is set as a point of gaze of a virtual camera. Then, by the player moving a touch location, the location of the virtual camera (viewpoint) is changed according to the movement. In a virtual space, different layers are provided for the different types of objects. The objects are disposed so as not to overlap with each other between the different layers. When the viewpoint is fixed and a plurality of objects of different types intersecting a line of sight or a line parallel to the line of sight satisfy a predetermined condition, the objects are deleted.

The present invention provides an information display device including: an image input section 1 that inputs an image corresponding to a user's field of vision; a line-of-sight detection section 2 that detects a point of gaze indicative of a position of a line of sight in the user's field of vision; an object recognition section 3 that extracts as a first region a region in the image of an object including the point of gaze from the image; a display position determination section 5 that determines as a display position a position on which a user's line of sight does not fall in the field of vision based on information on the first region; and an information display section 6 that displays information to be presented to a user at the display position.

Resolution of perspective in three dimensions is necessary for intermeshing real players into simulated environments during virtual training exercises. With the advent of high resolution image sensors the ability to sense position and orientation using image capture devices is possible. The combination of small sized sensors and image recognition tracking algorithms allows the tracking element to be placed directly on the device whose perspective is desired. This provides a solution to determining perspective as it provides a direct measurement from the center axis of the observer. This invention employs a perspective tracking device to determine a point-of-gaze or a point-of-aim in a three-dimensional space to a high degree of accuracy. Point-of-gaze may be used to determine views for head mounted displays and aim-points for weapons. The invention may operate in an unconstrained space allowing simulation participants to operate in a larger, open environment. Areas of interest in the environment are bounded by area of interest markers which identify the region and its physical constraints.

To accurately input a point-of-gaze of a user in a game engine expressing a three-dimensional space. A point-of-gaze calculation algorithm is configured such that data of lines of view of both eyes of a user is calculated using data from a camera (10) capturing an image of the eyes of the user, and a three-dimensional coordinate position within a three-dimensional space at which the user gazes is calculated on the basis of the gaze data of the user and three-dimensional data included in a system managed by the game engine.

A method of compressing image data from one or more images forming part of digital reality content, the method including obtaining pixel data from the image data, the pixel data representing an array of pixels within the one or more images; determining a position of the array of pixels within the one or more images relative to a defined position, the defined position being at least partially indicative of a point of gaze of the user; and compressing the pixel data at least partially in accordance the determined position so that a degree of compression depends on the determined position of the array of pixels.

The invention discloses a method and a system of combining three-dimensional line-of-sight tracking and brain-computer interface technology to control a manipulator to grasp an object. A process thereof includes: collecting line-of-sight signals of a user by an eye tracker, sending data to a controller, calculating three-dimensional coordinates of a gaze point by the controller, and sending the same to the manipulator; and at the same time, collecting human-brain electroencephalogram signal changes by an electroencephalogram helmet, sending the same to the controller, decoding user motion imagination and relaxation status by the controller, and thus triggering grasping and releasing action of the manipulator on the gaze object. According to the method and the system, the dual advantages ofhuman line-of-sight and mind control are exerted, the deficiency that existing 2D line-of-sight tracking technology must rely on a displayer is overcome at the same time, intuitive human-robot interaction can be carried out in a real scene, assisting or rehabilitating manipulators can be provided for paraplegic/hemiplegic patients, movement-inconvenient elderly persons and the like by applying the system of the invention, and autonomy thereof is improved or rehabilitation is helped in everyday life.

A method of determining a point or object on a digital display that is being gazed at by a viewer by capturing an image of the viewer's iris and at least one other feature of the viewer's face, calculating an imaginary line from the objet being viewed, to the iris and continuing to an imaginary center of the viewer's eye, then calculating a position of the center of the eye relative to the other feature of the viewer's face. Upon a change in the position of the eye and the iris, a calculation can be made of a position of the iris in a second image. An imaginary line can be extended out from the center of the eye, through the new position of the iris onto the digital display to determine the point of gaze of the viewer.

A visual data processing method applied to a visual data processing system. The visual data processing method comprises: (a) detecting a gazing point position of a user on a display; and (b) performing at least one process operation to visual data according to at least one distance between at least one display location for the visual data on the display and the gazing point position.

The embodiment of the invention discloses an interface element appearance evaluation method and system based on real vehicle in-the-loop simulation, and relates to the technical field of man-machine interaction interface testing. The method comprises the following steps: in a real vehicle in-the-loop simulation test process, the processor analyzes a driver eye movement signal collected by the eye tracker in response to an operation of a driver on a human-computer interaction interface, so as to obtain a gaze point thermal area of the driver; if the gaze point thermal area is only located on the display screen and the driving is safe, the processor passes the evaluation of the human-computer interaction interface in the driving scene; and if the gaze point thermodynamic area is only located on the human-computer interaction interface, evaluating according to whether the gaze point thermodynamic area on the human-computer interaction interface is concentrated or not, the concentrated element type and whether the driving is safe or not. According to the embodiment, element appearances on the human-computer interaction interface are evaluated through a real vehicle in-the-loop simulation method, and the evaluation is more accurate.