Deaf-mute sign language identification interaction system based on robot

Abstract

The invention provides a deaf-mute sign language identification interaction system based on a robot and relates to the technical field of intelligent service robots and applications thereof. The deaf-mute sign language identification interaction system based on the robot comprises a sign language identification subsystem, a robot body and a text and voice input and output subsystem. The sign language identification subsystem is mainly composed of a sign language identification module and a sign language translation module, and the sign language identification module is installed on the robot body. The text and voice input and output subsystem can output and display texts or voice in the sign language identification module of the sign language identification subsystem, and convert languages or texts of people into language signals understood by a robot system. The system provided by the invention provides better service to improve the life, learning and working conditions of deaf people, the quality of interaction and interactive experience of conversation between the deaf and ordinary people is improved with the help of the robot platform, and integration of the latest sign language identification, voice identification and robots and other technologies is achieved, so that deaf people can also be treated equally by the community, to accept better education.

Description

technical field [0001] The invention relates to the technical field of intelligent service robots and their applications, in particular to a robot-based sign language recognition interaction system for deaf-mute people. Background technique [0002] With the rapid development of science and technology, high performance, high intelligence and high practicability are generally considered to be the main direction of the current development of computing science. How to use the rapid development of science and technology to transform into practical application results to benefit mankind has become the current scientific development. main theme. It is understood that there are more than 20 million people with hearing and language disabilities in my country, and the number is increasing at a rate of 20,000-30,000 every year. Research on the most important means of communication for people such as "sign language" will not only help to improve and improve the living, learning and wo...

AI Technical Summary

Problems solved by technology

The sign language recognition system based on data gloves uses data gloves and position trackers to measure the trajectory and timing information of gestures in space. The equipment is relatively expensive; in another sign language recognition system based on vision (image), the person to be recognized stands in front of the camera sensor, uses the camera sensor to collect three-dimensional sign language data, and converts the collected data into text or voice information, but This mode of human-computer interaction experience is poor

Images