Eye movement auxiliary voice interaction method and system based on car-borne Head Up Display (HUD)

A technology of voice interaction and in-vehicle voice, applied in the field of in-vehicle human interaction system, can solve problems such as inconvenient operation and achieve the effect of avoiding the risk of accidents

Inactive Publication Date: 2017-11-03
WUHAN UNIV OF TECH
View PDF6 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

So many functions require different buttons to operate separately, making it inconvenient for users to operate

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Eye movement auxiliary voice interaction method and system based on car-borne Head Up Display (HUD)
  • Eye movement auxiliary voice interaction method and system based on car-borne Head Up Display (HUD)

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] The present invention will be further described below in conjunction with specific examples and accompanying drawings.

[0022] The present invention provides a method for eye-movement-assisted voice interaction based on a vehicle-mounted HUD, comprising the following steps:

[0023] Initial state: HUD is off;

[0024] The on-board voice recognition system converts the HUD opening instruction voice obtained through the microphone into the HUD opening instruction;

[0025] The HUD starts after receiving the HUD opening command from the on-board voice recognition system, and projects the functional area of ​​the HUD interface onto the front windshield; corrects the eye tracking system;

[0026] When the eye tracking system recognizes that the driver's line of sight enters the functional area of ​​the HUD interface, and within a certain period of time (3-6 seconds), the vehicle-mounted voice recognition system will obtain voice control commands through the microphone, and...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an eye movement auxiliary voice interaction method based on a car-borne Head Up Display (HUD). The eye movement auxiliary voice interaction method comprises the following steps that in an original state, the HUD is in a closed state; a car-borne voice recognition system transforms HUD open command voice obtained through a microphone into an HUD open command; after the HUD receives the HUD open command of the car-borne voice recognition system, the HUD is started, and a HUD interface functional zone is projected to front windshield; an eye movement tracking system is corrected; when the eye movement tracking system recognizes that the sight line of a driver enters the HUD interface functional zone, the car-borne voice recognition system obtains a voice control command through the microphone within a certain time, and corresponding operation is carried out according to content corresponding to the voice control command; otherwise, the HUD is stopped and returns the original state. According to the eye movement auxiliary voice interaction method, by collecting eye movement of the driver to control a vehicle based on the HUD and voice auxiliary, hands do not need to leave a steering wheel in the interactive process, the sight line does not need to leave the visual field of a driving road, and accident risks brought when the driver pays attention to key operation are avoided.

Description

technical field [0001] The invention belongs to a vehicle-mounted human interaction system, in particular to an eye-movement-assisted voice interaction method and system based on a vehicle-mounted HUD. Background technique [0002] With the continuous development of the modern automobile industry, people have higher and higher requirements for the comfort and operation convenience of automobiles. The application of a large number of electronic devices in automobiles has greatly improved the comfort of vehicles. The increase in electronic equipment also means that there will be more buttons on the dashboard of the car to control audio, air conditioning, GPS, cruise control, navigation, etc. At the same time, the display screens of automobiles are also getting bigger and bigger, and more and more vehicle information is displayed while playing multimedia images and videos. So many functions require different keys to be operated separately, making it inconvenient for the user ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): B60R1/00B60R16/023G02B27/01G06F3/01G10L15/22G10L15/26
CPCB60R1/00B60R16/023G02B27/01G06F3/011G10L15/22G10L15/26G10L2015/223
Inventor 付翔贺子宸刘道远王静邢爱娟刘会康
Owner WUHAN UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap