Intelligent prosthetic hand based on voice control and vision recognition and system and method thereof

An intelligent prosthetic and prosthetic hand technology, applied in the field of prosthetic hands, can solve the problems of inability to complete complex gesture operations, single function of the voice control system, and large interference of electromyographic signals, so as to improve the recognition effect and interactive experience, and overcome the low recognition efficiency. , reduce the effect of the charging interface

Active Publication Date: 2019-01-11
HUAZHONG UNIV OF SCI & TECH
View PDF11 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] In view of the above defects or improvement needs of the prior art, the present invention provides an intelligent prosthetic hand based on voice control and visual recognition and its system and method. hand, and the three-level operation control system and implementation method of the prosthetic hand based on the Internet of Things, thereby solving the problem that the existing mainstream prosthetic hand only relies on myoelectric control and traction control, which has low control efficiency, large interference of myoelectric signals, and complicated operation training. problems, as well as the technical problems of the existing prosthetic hand voice control system with single function, inability to complete complex gesture operations, and low intelligence

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Intelligent prosthetic hand based on voice control and vision recognition and system and method thereof
  • Intelligent prosthetic hand based on voice control and vision recognition and system and method thereof
  • Intelligent prosthetic hand based on voice control and vision recognition and system and method thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0063] Such as figure 1 with figure 2 As shown, the intelligent prosthetic hand adopts the three-freedom prosthetic hand as the intelligent prosthetic hand body, which includes finger parts, palm parts, residual arm parts, power supply and memory modules for power supply, wherein each finger in the finger parts is at each joint And the wrist place that connects palm part and residual arm part is all provided with motor, is used for driving each joint of each finger and the rotation of wrist place.

[0064] On the above-mentioned three-freedom prosthetic hand body, there are also a voice interaction module 1, a depth camera module 2, an LED touch screen 5, a wireless communication module 6, a wireless charging module 7, a core processing module 8, a power supply 9, and a myoelectric signal sensor 10 and memory module 11, wherein,

[0065] The voice interaction module 1 is used to realize the voice interaction function. By collecting voice information and performing prelimina...

Embodiment 2

[0086] Such as Figure 4 As shown, the Internet of Things intelligent prosthetic hand system based on voice control and visual recognition is composed of a cloud server, a secondary operation terminal, and an intelligent prosthetic hand that are connected wirelessly.

[0087] The intelligent prosthetic hand adopts the intelligent prosthetic hand in Embodiment 1.

[0088] The secondary operation terminal includes a client installed on a smartphone or computer for controlling an intelligent prosthetic hand, and / or a motion capture glove, wherein,

[0089] The client can establish a wireless connection with the cloud server and the intelligent prosthetic hand; the client has a built-in 3D model of the prosthetic hand, and the user can input data to accurately adjust and determine the gesture, which is converted into a machine control code by the client; the client can be connected to a motion capture glove to obtain Motion model, analyze the motion information of the motion mode...

Embodiment 3

[0103] This embodiment provides a method for realizing gesture actions based on the Internet of Things intelligent prosthetic hand system of Embodiment 2, including the following steps:

[0104] Step 1: Take pictures of two-dimensional scenes and objects through the depth camera component of the intelligent prosthetic hand, and upload them to the cloud server;

[0105] Step 2: Call the image recognition interface of Baidu AI Open Platform through the cloud server to perform recognition, and send the recognized corresponding objects and scenes to the core processing module of the intelligent prosthetic hand;

[0106] Step 3: The core processing module combines the identification information of the cloud server and compares the usage of each gesture in the past to infer the gesture that is most likely to be used;

[0107] Step 4: Send the inferred gesture action to the LED touch screen for the user to choose;

[0108] Step 5: Feedback the data selected by the user to the core p...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an intelligent prosthetic hand based on voice control and visual recognition, a system and a method thereof, belonging to the technical field of prosthetic hands. The intelligent prosthetic hand adopts a three-degree-of-freedom prosthetic hand body, and further comprises a depth camera module, a voice interaction module, an LED touch screen, a core processing module and a wireless charging module, wherein, the depth camera module is used for acquiring image data; the voice interaction module is used for voice interaction with the user; the LED touch screen is used for user to input operation instruction and display data; and the core processing module implements the overall task scheduling and data processing. The invention also discloses an intelligent prosthetic hand system and a gesture movement realizing method on the Internet of Things. The intelligent prosthetic hand based on voice control and visual recognition solves the technical problems that the existing mainstream prosthetic hand only relies on myoelectric control and traction control, so that control efficiency is low, and myoelectric signal interference is large, and operation and training arecomplex, and solves the technical problems that the voice control function is single and complex gesture operation cannot be completed, and intelligence is low.

Description

technical field [0001] The invention belongs to the technical field of prosthetic hands, and more particularly relates to an intelligent prosthetic hand based on voice control and visual recognition, a system and a method thereof. Background technique [0002] The smart prosthetic hand can complete the compensatory function of the prosthesis by driving the opening and closing of the prosthetic hand and the movement of the wrist and elbow joints through a DC micro-motor, which can provide convenience for the daily life of disabled patients with missing upper limbs and improve the quality of life. It is of great value in research in the field of rehabilitation engineering. Existing prosthetic hand products are divided into forearm myoelectric prosthesis with single degree of freedom and two degrees of freedom and upper arm myoelectric prosthesis with two degrees of freedom and three degrees of freedom. The first two degrees of freedom are low, and many scenarios are not appli...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): A61F2/68
CPCA61F2/68A61F2002/6809A61F2002/6881A61F2002/704
Inventor 汪志远罗婧怡高子誉
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap