Vehicle-mounted device integrating eyeball tracking and gesture control

Abstract

The invention discloses a vehicle-mounted device integrating eyeball tracking and gesture control. The vehicle-mounted device comprises a head-up display and a 3D depth sensing module, wherein the 3Ddepth sensing module is arranged on an automobile central control platform, is connected with the head-up display, can emit infrared diffracted speckles, project to the eyeball position of a driver and receive the infrared speckles reflected by the eyeballs; a reflection vector formed by the non-repetitive speckle falling in the eyeball and the pupil is utilized to define the eyeball position, thesight line drop point is tracked and corrected according to the change of the reflection vector caused by pupil movement at the position; compensation calculation is carried out through a sight linemapping function, the sight line drop point position is calculated, when the sight line drop point position is located on the front windshield of the automobile, feedback display of the head-up display is controlled, and when the sight line drop point position is located on a control interface, gesture recognition calculation is started, and gesture control over the system in the automobile is carried out.

Description

technical field [0001] The present invention is a car design that integrates eye tracking and gesture control, especially a kind of feedback display of the head-up display by tracking the gaze position of the eyeballs. At the same time, when the head-up display is not used, gesture recognition can also be used to feedback the interior of the car. control. Background technique [0002] Press, with the development of intelligent technology in automobiles, in-vehicle systems are becoming more and more complex, and traditional human-computer interaction interfaces (such as knobs, touch screens, etc.) can no longer satisfy users' experience. [0003] However, the current emerging vehicle-mounted human-computer interaction solutions, such as gesture recognition and head-up display, still have some shortcomings: 1. Gesture recognition can only support a single operation command, and if it is too complicated, it will easily distract the driver; (camera) Capture gestures, it is diff...

AI Technical Summary

Problems solved by technology

[0002] Press, with the development of intelligent technology in automobiles, the on-board systems are becoming more and more complex, and traditional human-computer interaction interfaces (such as knobs, touch screens, etc.) can no longer satisfy the user experience

[0003] However, the current emerging vehicle-mounted human-computer interaction solutions, such as gesture recognition and head-up display, still have some shortcomings: 1. Gesture recognition can only support a single operation command, and if it is too complicated, it will easily distract the driver; (camera) Capture gestures, it is difficult to reflect the depth of control commands, recognition errors and operation delays; 3, head-up display, follow the logic of the original screen display, too little information leads to insufficient experience, too much information leads to driving distraction

However, it is easy to be limited by the fixed position of the light source 13, resulting in a limited detection range

[0005] It can be seen that there are still many deficiencies in the above-mentioned commonly used items, which are not really good designers and need to be improved urgently.

Images