Autism auxiliary diagnosis system, device and medium based on multimodal information

A technology for auxiliary diagnosis and autism, applied in the direction of diagnosis, diagnosis recording/measurement, character and pattern recognition, etc., can solve problems such as the influence of evaluation results, misleading targeted intervention plans, delaying the effective recovery of patients, etc., and achieve fine diagnosis results effect

Active Publication Date: 2019-04-16
SHANDONG UNIV
View PDF6 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The subjective tendency of the person filling out the scale and the patient's on-site psychological state will have a serious impact on the evaluation results, mislead the formulation of targeted intervention plans, and delay the effective recovery of patients
[0006] In the process of realizing the present invention, the inventor found that the autism diagnosis system lacked in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Autism auxiliary diagnosis system, device and medium based on multimodal information
  • Autism auxiliary diagnosis system, device and medium based on multimodal information
  • Autism auxiliary diagnosis system, device and medium based on multimodal information

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0067] Embodiment one: if figure 1 As shown, the auxiliary diagnosis system for autism based on multimodal information includes:

[0068] The autism recognition module inputs the fused features to be tested into the trained BP neural network, and outputs the emotional label of the person to be tested in the current virtual reality scene; if in the same virtual reality scene, the BP neural network outputs If the number of emotional labels inconsistent with the real emotional labels of the current virtual reality scene exceeds the set threshold, it means that the person to be tested is an autistic patient, and the number of inconsistent emotional labels output by the BP neural network with the real emotional labels of the current virtual reality scene accounts for the total The ratio of the number of labels is used as the degree of illness of the autistic patient; if the emotional label output by the BP neural network is consistent with the real emotional label of the current vi...

Embodiment 2

[0120] Embodiment 2: An electronic device is provided, including: a memory, a processor, and computer instructions stored in the memory and run on the processor. When the computer instructions are executed by the processor, the following steps are completed:

[0121] Input the fused features to be tested into the trained BP neural network, and output the emotional label of the person to be tested in the current virtual reality scene; if in the same virtual reality scene, the emotional label output by the BP neural network is the same as the current virtual reality If the number of inconsistent real emotion labels in the real scene exceeds the set threshold, it means that the person to be tested is an autistic patient. The ratio of the number of inconsistencies between the emotional labels output by the BP neural network and the real emotional labels of the current virtual reality scene to the total number of labels will be This ratio is used as the degree of illness of the auti...

Embodiment 3

[0122] Embodiment three provides a computer-readable storage medium on which computer instructions are run, and when the computer instructions are run by a processor, the following steps are completed: input the fused features to be tested into the trained BP neural network , output the emotional label of the person to be tested in the current virtual reality scene; if in the same virtual reality scene, the number of inconsistent emotional labels output by the BP neural network and the real emotional label of the current virtual reality scene exceeds the set threshold, it means that The tester is an autistic patient, and the ratio of the number of inconsistent emotional labels output by the BP neural network to the total number of labels in the current virtual reality scene is used as the degree of illness of the autistic patient; if the BP neural network If the output emotional label is consistent with the real emotional label of the current virtual reality scene, it means that ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an autism auxiliary diagnosis system, device and medium based on multimodal information. The system includes an autism recognition module for inputting merged features to be tested into a trained BP neural network and outputting emotional labels of a person to be tested in the current virtual reality scenario; if the number of the emotional labels output by the BP neural network inconsistent with a real emotional label of the current virtual reality scenario exceeds a set threshold, it indicates that the person to be tested is an autistic patient, the ratio of the emotional labels output by the BP neural network inconsistent with the real emotional label of the current virtual reality scenario in the total number of labels shows the disease degree of the autistic patient; if the emotional labels output by the BP neural network are consistent with the real emotional labels of the current virtual reality scenario, it indicates that the person to be tested is not the autistic patient.

Description

technical field [0001] The present disclosure relates to an auxiliary diagnosis system, equipment and medium for autism based on multimodal information. Background technique [0002] The statements in this section merely enhance the background related to the present disclosure and may not necessarily constitute prior art. [0003] Children's autism is a subtype of pervasive developmental disorder, which is more common in males and starts in infancy. [0004] Autism seriously affects the normal living conditions and physical development of patients. Some patients show slow sensory responses, and severe cases will have self-injury and self-mutilation behaviors, resulting in mental disabilities and loss of social functions. According to a survey by the American Psychiatric Association, at present, a child is diagnosed with autism every 20 minutes, with an incidence rate of 1%-4%, and about 35 million people worldwide suffer from autism. More and more examples show that for th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): A61B5/0205A61B5/16G06K9/62A61B5/0476A61B5/0488
CPCA61B5/0205A61B5/165A61B5/4088A61B5/7264A61B5/7267A61B5/0816A61B2503/06A61B5/389A61B5/369G06F18/24G06F18/253G06F18/214
Inventor 刘治姚佳朱耀文王成
Owner SHANDONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products