The invention discloses a view line tracking method and an assistant system for the handicapped by using the method. The method comprises the steps of image pretreatment, the orientation of a human eye area by utilizing Harr features, blinking recognition, the inspection and judgment of LED reflecting lightspot in pupils, the accurate position of pupil centre, the calculation of view line direction and so on. The system comprises an embedded-like platform, a camera, a display screen and four LED and wheelchair running control modules which are installed at the four corners of the display screen and arranged into a rectangular. The system is an embedded-type system, which carries out blinking inspection, the inspection of the reflecting lightspots against infrared light sources on corneas, the accurate position of the pupil centers and the judgment of view line directions by the camera and a processor, tracks the view line of human eyes and, meanwhile, carries out the recognition of the status of the human eyes by judging the view line directions of the human eyes when gazing on the screen, thus realizing the functions of wheelchair control, music play control, text reading and webpage rolling. The invention is convenient for use and has high accuracy, thereby being capable of bringing great convenience for the lives of the handicapped.