Aphasia patient auxiliary rehabilitation training system and method based on fusion gesture recognition

Abstract

The invention provides an aphasia patient auxiliary rehabilitation training system based on fusion gesture recognition. The aphasia patient auxiliary rehabilitation training system comprises an embedded computing platform which comprises an object detection and gesture recognition unit, a rehabilitation training and user interaction unit and a training result evaluation unit; a scene camera; a user monitoring camera; a display screen used for displaying a front-end interaction interface and interacting with a user; a voice module used for synthesizing and playing training instruction voice; anexternal power supply used for supplying power to the whole training system. The embedded computing platform is connected with the scene camera, the user monitoring camera, the voice module, a display device and the external power supply. The invention further provides an aphasia patient auxiliary rehabilitation training method based on fusion gesture recognition, the training system and method have the good ability to be close to the real life of the patient and the good convenience of deployment, the increasing aphasia rehabilitation training requirement is greatly met, and the rehabilitation training effect of aphasia patient crowds is improved.

Description

technical field [0001] The present invention relates to the technical field of computer vision and rehabilitation medicine, and more specifically, to an auxiliary rehabilitation training system and method for aphasia patients based on fusion gesture recognition. Background technique [0002] In recent years, with the development of computer science and technology, under the huge impetus of deep learning, a new intelligent technology method, various technologies of artificial intelligence, such as speech recognition technology, image recognition technology, data mining technology, etc., have made substantial progress. Developed and successfully applied in many products. Deep learning is the current focus and hotspot in the field of computer vision research, and it is also one of the commonly used methods to solve complex environmental problems. As a milestone in the history of human science and technology development, computer vision plays a pivotal role in the development o...

AI Technical Summary

Problems solved by technology

[0003]Currently, the computer-aided rehabilitation training system for aphasia patients on the market mainly makes the content of traditional training items into a training question bank, and the doctor assists the patient in answering the questions and Rehabilitation training is completed in the form of scoring, and the training topics are boring and single, which makes many patients not interested in rehabilitation training; in addition, there is no home auxiliary training system on the market, and the training process needs to be carried out in a specialized rehabilitation treatment department and is led by doctors , quite inconvenient for many patients who need rehabilitation training

[0004]Currently, the intelligent system that uses computer vision technology to help aphasia patients to carry out rehabilitation training is not yet mature. One of the main reasons is the computer vision currently used in aphasia rehabilitation medicine There are very few technologies, and no one has explored the application of the combination of the two; secondly, due to the limitation of computing power, it is difficult to apply the object detection technology based on deep learning in real life, and it is more dependent on cloud computing support; At present, some micro-target detection networks have achieved similar accuracy and precision to common target detection networks, but the required computing resources have been greatly reduced, which makes it possible to deploy deep in low-power and cheap embedded computing devices. Neural Networks Made Possible

Images