Man-machine interactive method and apparatus
A technology of human-computer interaction and computer, which is applied in the direction of instruments, electrical digital data processing, and input/output process of data processing, etc. It can solve problems such as the influence of speech recognition accuracy, restrictions on the popularization and application of speech channels, and unnatural interaction processes. To achieve the effect of overcoming unnaturalness and unreliability
Inactive Publication Date: 2005-02-23
SHANGHAI UNIV
View PDF0 Cites 14 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
However, during the working process of the Erica system, the user's eyes are required to watch a certain dialog box on the screen for 2 seconds, and then the user is prompted to perform the task corresponding to the dialog box by staring at it for another 2 seconds. Different users have different response abilities, so a fixed interaction time is set. make the interaction process unnatural
Speech is also one of the most commonly used interactive channels. For example, speech recognition technologies such as IBM ViaVoice of IBM and Microsoft speech SDK of Microsoft can perform continuous speech recognition and speech synthesis, and their recognition accuracy for simple sentences or vocabulary is relatively high. High, but the dialects, pronunciation clarity, and noise interference in the surrounding environment of different users have a certain impact on the accuracy of speech recognition. In addition, homophones or homonymous words in Chinese are also an influence on speech recognition. factors, so that the popular application of a separate voice channel is subject to certain restrictions
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0015] A preferred embodiment of the present invention is as follows: see figure 1 and figure 2 , the computer interaction method is:
[0016] 1. Input of interactive information: (1) Place a near-infrared light source and a CCD camera at a fixed position in front of the user. The near-infrared light source forms high-brightness reflection points on the cornea of the user's eyes, that is, Purchin's spots. The CCD camera captures the face image, and the position coordinates of the two eyes' Purchin's spots are determined through image processing. When the eyes look at the dialog boxes in different directions on the display screen , the eyeball rotates, binarize the image of the eye part to determine the offset of the pupil position relative to the Purchin spot, determine the line of sight direction of the eye according to the offset, and activate the dialog box corresponding to the staring direction of the eye to realize Information input of the visual channel; (2) The voi...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
A man-machine interaction method is that the user utilizes interactive channel formed by visual, voice and command button to carry out interchange with computer. A device for realize the method consists of computer display, CCD camera image collection card, sound card, microphone, loudspeaker, auxiliary light source, PLC, operational button and domestic appliance.
Description
[0001] Field: [0002] The invention relates to a human-computer interaction method and device, which are used to communicate with a computer. Background technique: [0003] The traditional way of human-computer interaction is to input information to the computer through the mouse, keyboard, etc., and the computer outputs information to the user through the graphical user interface of the monitor. Such an interaction channel requires users to learn and actively adapt to the machine. In addition, for some special users, such as the handicapped, the elderly, and users with a relatively low cultural level, it is difficult for interactive channels such as keyboards and mice to meet their needs. In many cases, users don't need to do complicated work, they just want to realize some functions through natural and convenient operations, such as surfing the Internet and watching movies. The Erica system launched by the University of Virginia in 1989 (published in the journal: IEEE Tra...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/00
Inventor 赵其杰屠大维高达明王仁三
Owner SHANGHAI UNIV