The invention discloses a
pupil and reflected
light spot adaptive tracking method and
system fusing multiple sensors, and belongs to the field of
eye movement tracking
signal processing. The
eye movement tracking device generates
cornea reflection light spots and collects images and events of the eyes; respectively obtaining a
light spot template, a
light spot coordinate
list and a
pupil fitting
ellipse according to the image; in the
eye movement tracking stage, events are screened according to the
pupil fitting
ellipse and the light spot template, and pupil events and light spot events are obtained; according to the pupil event, sequentially obtaining a pupil moving
direction angle and a light spot event template at the current moment, and further obtaining a light spot candidate position; screening the light spot candidate positions according to the light spot coordinate
list at the previous moment so as to update the light spot coordinate
list and the light spot template; and finally, comparing pupil fitting
ellipse axis length changes at two moments before and after, and judging whether eye
movement tracking is ended or not. According to the invention, by fusing the frame image and the
event stream, pupil and light spot tracking with high precision and high
time resolution is realized.