Kinect-based interactive imaging device for autistic children and method thereof

Abstract

The invention relates to a Kinect-based interactive imaging device for autistic children and method thereof, the Kinect somatosensory camera is arranged on a bracket and is connected with a computer through a data line, the Kinect somatosensory camera is controlled by a computer to collect depth data and transmit speech signals, and the received depth data is calculated through skeleton capture functions of the Kinect somatosensory camera to obtain skeleton coordinate data of sick children, which is sent to a game engine, so that an action formed by the skeleton coordinate data is converted into an event defined by the game engine, and auxiliary game software can be incorporated into the interactive training of children; the computer is connected with a display, a training system and the auxiliary game software are displayed on the display, so that the children can stand in front of the display and independently complete the whole interactive training through gestures and body movements; the computer is connected with two speakers which are arranged on the left and right, a carpet which is suitable for children activities is arranged in front of the display, and isolation pillars are arranged around the carpet.

Description

technical field [0001] The invention relates to an interactive image device, in particular to an interactive image device for children with autism. Background technique [0002] Autism (autism) is also called autism. In 2013, the American Psychiatric Association released the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders (the Diagnostic and Statistical Manual of Mental Disorders, DSM-V), which formally proposed the concept of autistic spectrum disorders (ASD). The main obstacles of children with autism are abnormalities in communication, interest and behavior with others. The symptoms of autism will continue until adulthood, making people unable to take care of themselves. The best time for treatment and recovery is between 2 and 7 years old. Early treatment can effectively prevent the formation of autism symptoms. The etiology of autism is unknown, and the efficacy of drugs is not obvious. Therefore, the commonly used treatment methods are: app...

AI Technical Summary

Problems solved by technology

Using multiple devices including touch screen, computer, camera, and microphone, and designing multiple modules including visual signal processing, voice signal processing, physical interaction interface, multi-modal fusion, intelligent console, and real scene simulation, The equipment is very complex, the integration level is not high, each basic module independently realizes its own function, and the cost is high, so it is not suitable for large-scale promotion

Images