Unlock instant, AI-driven research and patent intelligence for your innovation.

A gaze recognition and interaction method and device

An electronic device and recognition module technology, applied in neural learning methods, character and pattern recognition, instruments, etc., can solve problems such as failure to respond, failure to reflect the effect of human-human interaction, etc.

Active Publication Date: 2020-11-10
VIA TECH INC
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, the actions or responses of these interactive devices must be pre-defined, and in the process of interacting with the user, they can only respond to specific instructions (such as pressing a button or making a sound), and cannot rely on The user's facial expressions or body language respond appropriately, failing to reflect the effect of human interaction in a real scene

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A gaze recognition and interaction method and device
  • A gaze recognition and interaction method and device
  • A gaze recognition and interaction method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0014] This application integrates technologies such as voice recognition, face detection, and eye-to-eye recognition into intelligent robots or other intelligent devices that can interact with people. When receiving the voice of the user, the robot will turn to the direction of the voice, so that the camera configured on the robot can obtain the video frame of the user. And when the user looks at the robot, the robot can detect the human face from the video frame, and use the pre-trained classifier to identify whether the detected human face is looking at the robot, and then turn the robot's head to the center of the human face (representing the use of Eyes of the person), thereby simulating the eye-to-eye communication effect when people talk to each other in real situations.

[0015] figure 1 It is a block diagram of a gaze recognition and interaction device according to an embodiment of the present application. Please refer to figure 1 , The gaze recognition and interac...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A method and an apparatus for gaze recognition and interaction are provided. The method is adapted for an electronic apparatus having a camera and a steering gear configured to change a direction of the camera. The method includes following steps: capturing multiple video frames; detecting at least one face in a current video frame of the captured video frames and a rotated video frame that is generated by rotating the current video frame relative to a direction axis; recognizing each of the detected faces to determine whether there is a face gazing the camera by using a previously trained classifier; and if it is confirmed that there is a face gazing the camera, controlling the steering gear to turn the camera toward the face being recognized as gazing the camera according to a position of the face in the current video frame or a position of the face mapped from the rotated video frame to the current video frame.

Description

technical field [0001] The present application relates to an interaction method and device, and in particular to a gaze recognition and interaction method and device. Background technique [0002] Existing interactive devices (such as electronic dolls, electronic pets or intelligent robots) can interact with users through body movements or sound and light effects, so as to achieve entertainment effects. For example, the electronic pet can detect the user's voice, and change its expression or respond accordingly. The effect of interacting with users can be achieved through immediate response actions. [0003] However, the actions or responses of these interactive devices must be pre-defined, and in the process of interacting with the user, they can only respond to specific instructions (such as pressing a button or making a sound), and cannot rely on The user's facial expressions or body language respond appropriately, failing to reflect the effect of human interaction in a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00G06K9/62G06N3/08
Inventor 蒋静
Owner VIA TECH INC