Human-machine interaction multi-mode early intervention system for improving social interaction capacity of autistic children

A human-computer interaction, multi-modal technology, applied in the direction of mechanical mode conversion, user/computer interaction input/output, computer components, etc., can solve problems such as the establishment of a multi-modal human-computer interaction system, and achieve The effect of improving social interaction ability

Active Publication Date: 2012-02-15
HUAZHONG NORMAL UNIV
View PDF2 Cites 61 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Relevant research abroad mainly uses various virtual reality technologies to assist children with autism in learning, creating a safe and controllable learning environment for children, but has

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Human-machine interaction multi-mode early intervention system for improving social interaction capacity of autistic children
  • Human-machine interaction multi-mode early intervention system for improving social interaction capacity of autistic children
  • Human-machine interaction multi-mode early intervention system for improving social interaction capacity of autistic children

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0018] The embodiments are described in detail below with reference to the accompanying drawings. A human-computer interaction multimodal early intervention system for improving the social interaction ability of children with autism of the present invention includes a multi-touch screen 1, a first camera 2-1, a second camera 2-2, and a third camera 2 -3, Computer 3, the 1st camera, the 3rd camera and the 2nd camera are respectively installed on the left, right and upper middle of the multi-touch screen, and the 3 cameras with microphones are connected to the computer through the USB interface (see figure 1 ), the system is equipped with six basic modules of visual signal processing, voice signal processing, physical interaction interface, multi-modal fusion, intelligent console and real scene simulation. The camera transmits the acquired video and audio signals of children to the computer, and the computer passes Visual signal processing to detect children's attention and expr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a human-machine interaction multi-mode early intervention system for improving the social interaction capacity of autistic children. The system comprises a multi-point touch screen, a computer and three cameras respectively mounted at the left and right sides of the touch screen and above the middle part of the touch screen, wherein each camera is provided with a microphone and connected with the computer through a USB (Universal Serial Bus) interface; and the system is provided with six basic modules, namely a visual signal processing module, a voice signal processing module, a physical interactive interface module, a multi-mode fusion module, an intelligent control console module and a real scene simulation module, wherein the modules are combined with computer vision, voice recognition, behavior identification, intelligent agent and virtual reality technologies so as to support and improve the social interaction capacity of the autistic children. Development and change of several children in the learning environment are tracked for half year, wherein the social interaction capacity of most children is improved obviously, and other children also make some progress in the aspect of interaction capacity.

Description

technical field [0001] The invention relates to a human-computer interaction multimodal intelligent learning system of computer science, cognitive science and pedagogy, in particular to a human-computer interaction multimodal early intervention system for improving the social interaction ability of children with autism. Background technique [0002] Childhood autism, also known as autism, is a developmental disorder that occurs in early childhood due to neurological disorders, and its symptoms include abnormal social skills, communication skills, interests and behavior patterns. Although autism was discovered in 1943, the research and treatment of autism did not receive real attention until the 1980s. For a long time, the cause of autism in children has remained a mystery. Many researchers suspect that autism is controlled by genes and then controlled by genes. Triggered by environmental factors, there is currently no effective drug for treatment, and only long-term educatio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F19/00G06F3/01
Inventor 陈靓影陈丹杨宗凯
Owner HUAZHONG NORMAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap