A tour guide robot face device with a human eye concentration identification function and control

A tour guide robot and focus technology, applied in computer parts, program-controlled manipulators, instruments, etc., can solve the problems of adjusting the robot's facial expressions, low intelligence, and poor robot interaction.

Inactive Publication Date: 2019-06-14
HARBIN UNIV OF SCI & TECH
View PDF5 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The present invention is applied to the field of tour guide services in museums. In the prior art, the tour guide robot used in museums can realize the conventional tour guide introduction function, but it cannot judge whether the tourist is interested in the tour guide introduction according to the concentration of the tourist, so that the introduction cannot be made. The content is adjusted in real time, and the degree of intelligence is low. In addition, in the prior art, the facial expression changes of the guide robot facial device are randomly adjusted, and the facial expression of the robot itself cannot be adjusted in real time according to the expressions of the tourists, or even to please the tourists. These bots are less interactive and cannot contribute to enhancing the visitor experience

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A tour guide robot face device with a human eye concentration identification function and control
  • A tour guide robot face device with a human eye concentration identification function and control
  • A tour guide robot face device with a human eye concentration identification function and control

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment approach 1

[0066] A tour guide robot face device with the function of human eye concentration recognition, such as figure 1 , figure 2 As shown, it includes a robot face 1, an eye mechanism 2, a mouth mechanism 3 and a control system 4; the robot face 1 is a plate-shaped structure, and the eye mechanism 2 and mouth mechanism 3 are arranged on the robot face 1 surface;

[0067] The robot face 1 includes a vision module 1-1, a voice module 1-2 and a face support 1-3;

[0068] The eye mechanism 2 includes an eye structure 2-1 and an eyebrow structure 2-2;

[0069] The mouth mechanism 3 includes a mouth action mechanism 3-1 and a lip structure 3-2;

[0070] The control system 4 mainly includes a first chip and a second chip, the first chip is connected to the vision module 1-1, the second chip is connected to the eye mechanism 2 and the mouth mechanism 3, and the first chip is connected to the vision module 1-1. The chip communicates with the second chip through the UART0 serial port. ...

specific Embodiment approach 2

[0071] Such as figure 2 , image 3 , Figure 4 As shown, on the basis of Embodiment 1, the face support 1-3 includes a face frame 1-3A, a first support 1-3B and a second support 1-3C, and the face frame 1-3A The position of the human nose on the front surface is processed with a circular through hole, which is used for the positioning and installation of the camera probe in the vision module 1-1; the voice module 1-2 is arranged on the upper surface of the first support 1-3B, so The voice module 1-2 includes a speaker 1-2A, a speaker bracket 1-2B and a power amplifier module, and the speaker 1-2A is arranged perpendicular to the first support 1-3B and the second support 1-3C, and is arranged on the The rear position between the first support 1-3B and the second support 1-3C.

[0072] In this embodiment, the visual module 1-1 is the prior art, and the manufacturer is Guangdong Jiaxin Microelectronics franchise store, and the model is OV7670.

[0073] In this embodiment, th...

specific Embodiment approach 3

[0083] Such as Figure 10 , Figure 11 As shown, a control method based on the face device of the guide robot with the function of human eye concentration recognition includes the following steps:

[0084] Step S1, the vision module adopts the VideoCapture method of Opencv to collect the environmental information in front of the face device;

[0085] Step S2, processing image recognition face information;

[0086] Step S3, inputting the face information into the pre-trained RBF neural network human eye concentration prediction model;

[0087] Step S4, outputting Labels concentration information after prediction and classification;

[0088] Step S5, converting the above information into ASCII codes and transmitting them to the second chip through serial port communication;

[0089] Step S6, the second chip controls the corresponding steering gear to complete the corresponding facial expression according to the ASCII code received by the serial port, and at the same time, th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a tour guide robot face device with a human eye concentration identification function and control, and belongs to the field of intelligent service robots. The problem that in the prior art, a tour guide robot is low in man-machine interaction intelligent degree is solved. The robot comprises a robot face and eye mechanism, a mouth mechanism and a control system. The robot face is of a plate-shaped structure, and the eye mechanisms and the mouth mechanisms are arranged on the surface of the robot face. The robot face comprises a visual module, a voice module and a face support. The eye mechanism comprises an eye structure and an eyebrow structure; the mouth mechanism comprises a mouth action mechanism and a lip structure. According to the control system, an improvedRBF neural network learning algorithm is adopted, a human eye concentration prediction model is established, and higher classification accuracy is achieved; the robot can achieve the basic tour guideintroduction function, can detect the micro-expression change of the eye concentration degree of a tourist in real time, adjusts the tour guide introduction content, and meanwhile changes the facial expression of the robot to improve the man-machine interaction performance.

Description

technical field [0001] The invention belongs to the field of intelligent service robots, and in particular relates to a face device and control of a tour guide robot with the function of recognizing human eye concentration. Background technique [0002] With the continuous development of science and technology, automation level and computer technology are more and more widely used in daily life, and the development of robot technology has entered a new era. With the continuous improvement of science and technology, robots are used in scientific exploration, public service, industry Manufacturing, home entertainment and other aspects have begun to emerge, and it will also become the most powerful helper and closest partner of human beings in the future. [0003] The present invention is applied to the field of tour guide services in museums. In the prior art, the tour guide robot used in museums can realize the conventional tour guide introduction function, but it cannot judg...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62G06N3/02B25J9/00B25J11/00B25J19/02B25J9/16
Inventor 王鹏罗鹏刘然宋春宵黎晓强张元张鹏
Owner HARBIN UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap