Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Far-near distance man-machine interactive system based on 3D sight estimation and far-near distance man-machine interactive method based on 3D sight estimation

A technology of line of sight estimation and human-computer interaction, which is applied in the field of human-computer interaction systems at far and near distances, and can solve different problems.

Inactive Publication Date: 2016-07-13
UNIV OF ELECTRONICS SCI & TECH OF CHINA
View PDF5 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, in the existing human-computer interaction systems, most of them cannot use different human-computer interaction methods to control the robot according to the actual distance between the human and the robot.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Far-near distance man-machine interactive system based on 3D sight estimation and far-near distance man-machine interactive method based on 3D sight estimation
  • Far-near distance man-machine interactive system based on 3D sight estimation and far-near distance man-machine interactive method based on 3D sight estimation
  • Far-near distance man-machine interactive system based on 3D sight estimation and far-near distance man-machine interactive method based on 3D sight estimation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0102] The technical solution of the present invention will be further described in detail below in conjunction with the accompanying drawings, but the protection scope of the present invention is not limited to the following description.

[0103] like figure 1 As shown, a far-short distance human-computer interaction system based on 3D line-of-sight estimation, including a user selection module, a mode judgment module, a line-of-sight estimation module, a head orientation estimation module and a robot action control module;

[0104] The user selection module is used to select the user closest to the robot as an interaction object;

[0105] The mode judging module is used to judge the interactive mode according to the distance between the interactive object and the robot: when the distance between the interactive object and the robot is not greater than 1, it is a close-range interactive mode; when the distance between the interactive object and the robot is greater than When...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a far-near distance man-machine interactive system based on 3D sight estimation and a far-near distance man-machine interactive method based on 3D sight estimation. The system comprises a depth sensor, a user selection module, a mode judgment module, a sight estimation module, a head orientation estimation module and a robot action control module. The method comprises the following steps: (S1) interaction object selection; (S2) interaction mode judgment; (S3) 3D sight estimation; (S4) head orientation estimation; and (S5) robot action control. According to the system and the method, the man-machine interaction is divided into a far distance mode and a near distance mode according to the actual distance between people and a robot, and the action of the robot is controlled by virtue of the two modes, so that the validity and stability of the man-machine interaction are improved.

Description

technical field [0001] The invention relates to a long-short distance human-computer interaction system and method based on 3D line of sight estimation. Background technique [0002] Human-Robot Interaction (HRI) refers to the process of information exchange between humans and robots using a certain dialogue language in a certain interactive way to complete certain tasks; The new human-computer interaction technology is gradually emerging. At present, most of the interactions between humans and robots require many auxiliary tools. Realize the interaction between users and robots; with the development of machine learning and computer vision and other related fields, robots can recognize the user's posture, gestures, sight, etc.; sight is the most important means for people to understand the world, its convenient and natural characteristics It also makes it one of the most potential interactive technologies for human-computer interaction. [0003] However, most of the existi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F3/01
CPCG06F3/012G06F3/013G06V40/193G06V10/25G06V10/30
Inventor 姬艳丽谢非程洪
Owner UNIV OF ELECTRONICS SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products