System for performing non-contact type human-machine interaction by vision

Abstract

The invention relates to a system for non-contact man-machine interaction by vision, and belongs to the field of man-machine interaction Non-contact interaction between human and a robot is achieved through a mode of information circulation on a vision channel. The system comprises a machine vision unit for acquiring a face image of a user under specific illumination conditions; an information processing analytic unit which is used for processing the face image, and calculating the vision direction of the user, analyzing the information containing intention extracted in an eye movement state of the user and identifying interactive information fed back by an intention information decision robot; and an interactive information displaying unit which is used for providing feedback informationof the robot by a mode of generating visual stimulus for the user and used as a most direct platform for interaction of the robot and the user. The system makes full use of the vision channel to acquire and express nature, directness and convenience of information, has more convenient, quicker and easier operations for the man-machine interaction process, and has lower requirement on bandwidth ofan information channel.

Description

technical field The invention relates to a non-contact human-computer interaction system, belonging to the field of human-computer interaction, in particular to a non-contact human-computer interaction system using vision, which is used to realize natural and harmonious communication between humans and robots. Background technique With the development of robot technology, it is moving towards a more intelligent and anthropomorphic direction, and people expect robots to truly integrate into daily life and become people's life partners in all aspects. Human-computer interaction technology, as an interface technology for information exchange between humans and machines (robots), is a bridge for information communication between humans and robots; it is the key to making robots better integrate into people's lives. Therefore, people have devoted more than half a century of efforts and poured a lot of energy into researching and developing more natural and harmonious human-compu...

AI Technical Summary

Problems solved by technology

With the method he proposed at the time, as long as the line of sight falls on a certain button, the command will be triggered. The machine cannot effectively distinguish between the intentional eye movement command and the unintentional eye movement command, which makes each eye movement of the operator trigger a command. And sometimes people just want to browse at random without triggering commands unintentionally, which will bring some troubles to the operator and hinder the wide application of this interactive method

Images