Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Auxiliary tool for deaf-mute based on gesture recognition and VR display, and implementation method for auxiliary tool

A gesture recognition and auxiliary tool technology, applied in teaching aids, educational aids, instruments, etc., can solve the problems of inability to achieve daily communication for deaf people, not understanding sign language, and inability to complete work.

Pending Publication Date: 2018-11-23
王钦
View PDF6 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Problems encountered by deaf-mute people, 1. Life problems: lack of perception of the outside world
2. Work problems: Due to physiological reasons, there will be many restrictions, and many types of work cannot be completed
Most people don’t understand sign language, so it’s difficult to communicate. Currently, the implementation of auxiliary equipment for deaf-mute people on the market is mainly solved by wearing hearing aids, but not all deaf people can hear the sound by wearing hearing aids. Patients with severe disabilities cannot gain hearing by wearing hearing aids, and the existing hearing aids cannot realize the daily communication between deaf-mute and normal people

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Auxiliary tool for deaf-mute based on gesture recognition and VR display, and implementation method for auxiliary tool
  • Auxiliary tool for deaf-mute based on gesture recognition and VR display, and implementation method for auxiliary tool

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] combined with Figure 1~2 , a deaf-mute auxiliary tool based on gesture recognition and VR display, including a wearable virtual display 1, a Leap Motion gesture tracking sensor 2 and a terminal computer 3, and the wearable virtual display 1 is connected to the terminal computer 3 through a USB port and an HDMI port To realize data transmission and data analysis, the Leap Motion gesture tracking sensor 2 is horizontally fixed on the front of the wearable virtual display 1 so that the built-in infrared grayscale camera 2.1 in the Leap Motion gesture tracking sensor 2 is set facing forward, and the Leap Motion gesture tracking sensor The sensor 2 and the terminal computer 3 are connected so that the gestures collected by the infrared grayscale camera 2.1 in the LeapMotion gesture tracking sensor 2 can be displayed on the wearable virtual display 1 through the terminal computer 3 .

[0030] As a preferred implementation of this embodiment, a speaker 4 and a microphone 5 ar...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an auxiliary tool for the deaf-mute based on gesture recognition and VR display, and an implementation method for the auxiliary tool. The auxiliary tool comprises a wearable virtual display, a Leap Motion gesture tracking sensor and a terminal computer. The wearable virtual display is connected with the terminal computer through a USB port and an HDMI port to achieve data transmission and data analysis. The Leap Motion gesture tracking sensor is laterally fixed at the front part of the wearable virtual display, so that an infrared gray scale camera built in the Leap Motion gesture tracking sensor is set to face forwards. The Leap Motion gesture tracking sensor is connected with the terminal computer, so that a gesture action collected by the infrared gray scale camera in the Leap Motion gesture tracking sensor can be displayed on the wearable virtual display. Through the combination of the Leap Motion gesture tracking sensor and the wearable virtual display, thetool solves a hearing problem of language expression ability of the deaf-mute while solving also solves a hearing problem of the deaf-mute.

Description

technical field [0001] The present invention relates to the technical field of assistive tools for the deaf-mute, in particular to an assistive tool for the deaf-mute based on gesture recognition and VR display and its implementation method. Background technique [0002] According to the latest statistics, hearing and speech disabilities in my country rank first among the five major disabilities including visual disabilities, physical disabilities, and intellectual disabilities, accounting for 20.57 million people, accounting for 1.67% of the total population of China, including about 800,000 children under the age of 7. According to statistics, the incidence rate of deaf-mute in my country is about 2‰! Calculated based on the average annual birth rate, together with infants aged 2 to 3 after birth, the total population reaches 57 million each year, and the incidence of hearing impairment is about 170,000. There are 20 million newborns born in my country every year, and abo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G09B21/00
CPCG09B21/009
Inventor 王钦
Owner 王钦
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com