Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

43 results about "Autistic child" patented technology

Autistic Children. When a child is autistic, it means that he or she has autism, a brain disorder that can result in impaired thinking, feeling, and social functioning. In many cases, children with this disorder will have difficulties with social interaction and have problems with verbal and nonverbal communication.

Multi-modal data integrated analysis system for screening children with autism

The invention relates to the technical field of medical information processing, in particular to a multi-modal data integrated analysis system for screening children with autism, which comprises a data acquisition module, a data processing module, a feature extraction module, a feature fusion module, a data screening module, a data analysis module and a data output module, according to the system, behavior data, brain function data and brain structure data of autism children are collected, and after preprocessing and feature extraction are carried out, fusion processing is carried out by a feature fusion module. The feature fusion module comprises a multi-scale topological feature representation sub-module, a heterogeneous feature integration sub-module and a self-adaptive weight adjustment sub-module which are respectively used for realizing multi-scale representation, heterogeneous feature integration and dynamic weight adjustment of features; the feature fusion technology solves the problems of feature scale inconsistency, inter-modal semantic gap, feature importance dynamic change and the like in multi-modal data fusion, improves the autism screening accuracy and early recognition capability, and supports personalized screening and accurate intervention.
Owner:THE SEVENTH MEDICAL CENTER OF PLA GENERAL HOSPITAL

Method and system for training dialogue intervention large model for children with autism

The invention discloses a method and a system for training a dialogue intervention large model for children with autism, and the system comprises a data processing module which is used for converting original dialogue data from theme dialogue intervention records of children with autism and doctors into a high-quality multi-round dialogue data set; the model training module is used for finely adjusting an existing large language model on the basis of the high-quality multi-round dialogue data set so as to learn dialogue styles and intervention strategies in the high-quality multi-round dialogue data set, and an intervention large model which can follow an ABA application behavior analysis principle to perform theme dialogues with autistic children is obtained; and the model evaluation module is used for comprehensively evaluating the intervention effect of the intervention large model from the sentence dimension and the dialogue dimension so as to feed back the model fine adjustment process. According to the method, the large model following the ABA application behavior analysis principle can be trained to perform dialogue intervention with the autism children, the intervention effect is effectively improved, and accessible, efficient and low-cost social communication rehabilitation support is provided for the autism children.
Owner:NANHU BRAIN COMPUTER CROSS RES INST

Facial expression recognition method for autistic children based on deep learning

The invention relates to the crossing field of target detection and emotion recognition, in particular to an autistic child facial expression recognition method based on deep learning. Comprising the following steps of: embedding three-dimensional attention (Tri-attention) behind a C3k2 module of a YOLOv11 backbone network so as to model an interactive relationship among three dimensions of height, width and channel in parallel and enhance response to key expression areas such as eyes, mouth corners and the like; three-dimensional attention (Tri-attention) is introduced into the multi-scale feature output end of the neck network again, and effective positioning and background noise suppression of a small-scale face under a complex background are achieved; respectively training and verifying the YOLOv11-TA model by using the public data set and a self-built autistic child data set, and outputting a detection frame of each face and an expression category thereof; by comparing various indexes of the original YOLOv11 and YOLOv11-TA on various data sets, the accuracy and robustness of expression recognition of the autistic children are remarkably improved by the method according to actual verification.
Owner:UNIV OF JINAN

Smart speaker (for children with autism)

ActiveCN309976185SAutistic childEmotional regulation
1. Name of the product in this design: Smart Speaker (for children with autism). 2. Purpose of this design: This design provides structured interaction for children with autism, assists in communication training and emotional regulation, and acts as a controllable social partner in repetitive learning scenarios. 3. The key design feature of this product is its shape. 4. The image or photograph that best illustrates the design's key points: 3D view 1.
Owner:刘玉翠

Severe game intervention fused electroencephalogram collection cap for children with autism and signal processing method

The invention discloses an autistic child electroencephalogram collection cap fusing severe game intervention and a signal processing method.The autistic child electroencephalogram collection cap comprises a structure module, an electroencephalogram collection module, a wireless communication module, a power module, a signal processing module and a game and report module, and the electroencephalogram collection module collects electroencephalogram signals through five electrodes and two ear patch type electrodes; the wireless communication module is used for communication between the electroencephalogram cap and user terminal equipment, the power supply module is used for storing electric energy and supplying power to other modules, and the signal processing module is used for processing and analyzing electroencephalogram signals in the severe game intervention process, including filtering, slicing and normalization processing, and outputting standardized electroencephalogram data. And then the data is analyzed through an MCNN network model, and the condition of the children is diagnosed, so that an effective tool is provided for brain function research and diagnosis while the adaptability of the children with autism is improved.
Owner:ZHANGJIAGANG GUANGWU INTELLIGENT TECH CO LTD

Early diagnosis and intervention curative effect evaluation method for children with autism

The invention discloses an early diagnosis and intervention curative effect evaluation method for children with autism, and belongs to the technical field of medical diagnosis. The method specifically comprises the following steps: S1, obtaining historical case big data: collecting the historical case big data of an autistic truly diagnosed child and a normally developed child and corresponding diagnosis results and intervention diagnosis and treatment records, and associating to form a historical database; s2, historical data preprocessing: performing cleaning, standardization and missing value processing on historical case big data, and associating and integrating the historical case big data into a structured sample set; by collecting behavior, physiology, environment and family multi-dimensional data, mining an internal mode of the data in combination with depth features, and then utilizing a multi-modal fusion diagnosis model for analysis, dependence on subjective experience of doctors and a single scale is reduced; the classification accuracy of the model is optimized through cross validation, a diagnosis report contains core abnormal features and a judgment basis, manual recheck is supported, and the risks of missed diagnosis and misdiagnosis are further reduced.
Owner:GUANGDONG HUASHENG FORESTRY TECHNOLOGY CO LTD

Method, device and machine-assisted system for autism children behavior recognition and motion prediction

The application discloses a method, device and diagnosis and treatment machine auxiliary system for autism child behavior recognition and motion prediction, the method comprises the following steps: (1) acquiring original skeleton video data of the child from different angles; (2) inputting the acquired original skeleton video data into a view adaptive conversion unit to adaptively convert to a consistent coordinate system to obtain the optimal representation of the human skeleton; (3) inputting the optimal representation of the human skeleton into a multi-scale feature extraction unit to extract high-performance spatiotemporal features of the human skeleton; (4) inputting the high-performance spatiotemporal features into a multi-task learning unit to perform behavior recognition and motion prediction on the human body, and obtaining behavior classification results and motion prediction results. The application can predict and intervene the future motion while recognizing the behavior.
Owner:ZHEJIANG UNIV BINJIANG RES INST

An interactive autism child training system, method, electronic device, readable storage medium

The application discloses an interactive autistic child training system, method, electronic device and readable storage medium. The interactive autistic child training system comprises a training configuration module, a TOF radar, a multi-modal sensor fusion camera group, a gesture exercise recognition module, an entity interaction behavior recognition module and a prompt module. The training configuration module is used for configuring training actions / training elements corresponding to autistic life self-care skills. The TOF radar is used for collecting gesture exercise data of palms and knuckles. The gesture exercise recognition module is used for judging the gesture exercise data. The multi-modal sensor fusion camera group is used for collecting entity interaction behavior data of a trainee. The entity interaction behavior recognition module is used for judging the entity interaction behavior data. The prompt module is used for outputting an object according to a personalized ability model of the trainee. The application is used to improve the scientificity and systematicness of training.
Owner:GUANGZHOU61LEARN INFORMATION TECH CO LTD

A control method and system of a robot for autism children diagnosis and treatment

The application relates to a medical engineering technology, in particular to a control method and system of a diagnosis and treatment robot for autistic children. The control method comprises the following steps: analyzing a human face video by using a deep learning model; generating a next-step intervention action recommendation list by using an LSTM state prediction model and a CPT action decision model; selecting or modifying one of the recommendation items and executing; retraining and updating the LSTM state prediction model and the CPT action decision model by using new interaction data. The control system comprises an execution module, a perception module, a memory module, an evolution module and a decision module. By introducing the quantification calculation of the concentration of the children and the valence and arousal of the facial expression, and by using the LSTM to predict the future state, the strategy can be adjusted in advance when it is predicted that the children will lose interest, so that the children's boredom or escape behavior is not easily caused, and meanwhile, the model is retrained and updated, so that the self-learning and adaptation capability is high, and the auxiliary diagnosis and treatment capability is relatively high.
Owner:XIAMEN UNIV

Pre-school autism sleep personalized intervention system based on AI behavior analysis

PendingCN121528443AHealth-index calculationMedical automated diagnosisSleep managementBehavioral risk
The invention belongs to the technical field of medical health monitoring and behavior intervention, and discloses a pre-school autism sleep personalized intervention system based on AI behavior analysis, which comprises a behavior acquisition unit, an environment monitoring unit, a living habit management unit, a fusion analysis unit, an intervention execution unit, a self-adaptive optimization unit and a family interaction unit, according to the system, body movement, heart rate, skin electricity and sleeping posture information of children and environment parameters such as illumination, noise and temperature and humidity of a bedroom are synchronously collected, diet and exercise balance indexes are combined for fusion analysis, and behavior risk indexes are generated; a personalized intervention scheme is automatically generated according to the risk level, and intervention is implemented through light, sound and visual guidance modes. The system dynamically adjusts analysis parameters according to an intervention result, realizes closed-loop correlation analysis and continuous regulation and control of sleep behaviors, environment changes and parent feedback, and is suitable for individualized sleep management of children with autism.
Owner:JIANGNAN UNIV

Social training system and method for children with autism based on multi-mode music interaction

The invention discloses a social training system and method for children with autism based on multi-mode music interaction, and relates to the technical field of social training for children with autism. Visual, audio and behavior data are cooperatively integrated through the multi-modal data acquisition unit, facial micro-expressions, voice and intonation changes and body movement details of children in social interaction are comprehensively covered, and subtle emotion signals or behavior clues possibly missed by a single sensor are effectively avoided; multi-source information is weighted and integrated in real time by using an attention mechanism of a feature fusion module, a unified high-dimensional representation vector is constructed, and the recognition precision of social intent and emotional state is improved; music parameters are dynamically adjusted based on an analysis result, and children are guided to naturally practice target behaviors in the simulated social scene; music changes and story branches are seamlessly linked through the plot driving module, social rule embedding is enhanced, and it is ensured that the children gradually internalize social skills in the immersive environment.
Owner:ZHEJIANG NORMAL UNIV

A deep learning-based facial expression recognition method for autistic children

The present application relates to the cross field of target detection and emotion recognition, and particularly relates to a facial expression recognition method for autistic children based on deep learning. The method comprises the following steps: embedding a three-dimensional attention (Tri-Attention) after a C3k2 module of a YOLOv11 backbone network to model the interaction relationship among height, width and channel dimensions in parallel, and enhancing the response to key expression regions such as eyes and corners of the mouth; introducing the three-dimensional attention (Tri-Attention) again at the multi-scale feature output end of the neck network to realize effective positioning of small-scale faces in a complex background and suppression of background noise; training and verifying the YOLOv11-TA model by using a public data set and a self-built autistic children data set respectively, and outputting the detection frame and expression category of each face; and comparing various indexes of the original YOLOv11 and the YOLOv11-TA on multiple data sets, and actually verifying that the method significantly improves the accuracy and robustness of the expression recognition of autistic children.
Owner:UNIV OF JINAN

Video image analysis method for social interaction behavior of autistic children and system thereof

PendingCN122348054AHuman bodyVideo image
The application discloses an autism child social interaction behavior video image analysis method and system, belongs to the technical field of computer vision and medical image analysis, and comprises the following steps: a video acquisition step, wherein video images of a child and an assessor performing a structured social interaction task are acquired through a multi-angle camera; a human body posture estimation step, wherein two-person skeleton key point detection is performed and posture parameter sequences are calculated; a social signal detection step, wherein key social behavior events such as eye contact, social smile, directional gesture and body orientation response are identified; an interaction synchronism analysis step, wherein the time coupling degree of posture changes of both parties is calculated through cross-correlation analysis; and an evaluation report generation step, wherein a social interaction ability evaluation report is generated in the form of a radar chart by comprehensively considering multi-dimensional features. The application realizes objective quantitative evaluation of the social interaction ability of an autism child and improves the consistency and repeatability of evaluation.
Owner:THE SEVENTH MEDICAL CENTER OF PLA GENERAL HOSPITAL

Autism child risk assessment early warning system and method

The application discloses a system and method for autism risk assessment and early warning, and relates to the field of computer and electroencephalogram signal processing. The system comprises an electroencephalogram data acquisition module, a feature extraction module, a risk assessment module and a risk early warning module. The preset task state covers resting state, local motion state and social motion state. In the resting state, the user observes low-speed target objects in the display picture for a preset time length. In the local motion state, the user observes the first type of target person completing local limb motion. In the social motion state, the user observes the second type of target person waving hands to say hello. By collecting electroencephalogram data in each task state and extracting features, the autism risk probability and the corresponding risk level are determined, and the early warning is triggered according to the preset logic rules. The system does not need frequent language interaction with children, is suitable for young children, significantly reduces the screening manpower and time cost, and is convenient for popularization in areas with scarce medical resources.
Owner:JILI INNOVATION (SHANGHAI) INTELLIGENT TECHNOLOGY CO LTD

Targeted acupuncture treatment method for autistic children

A targeted acupuncture treatment method for children with autism belongs to the field of medical care, and comprises a sound induction ear acupuncture method, a long-acting eye stimulation opposite pressing acupuncture method and a liver-spleen-kidney simultaneous acupuncture method. The system can improve the core symptoms of the autistic children (3-12 years old), such as not listening to instructions, eye contact parallax, inattention, diet singleness, emotion awareness, hyperactivity and the like, realizes targeted intervention through multi-module collaborative acupuncture, and is suitable for pediatrics of medical institutions, children rehabilitation centers and professional acupuncture clinics.
Owner:LINYI BAOZHILIN HEALTH MANAGEMENT SERVICE CO LTD

A method and system for analyzing classroom behavior of autistic children

The application provides a kind of autism children classroom behavior analysis method and analysis system, and the system will multi-view collection, stable key point detection, high-precision multi-view three-dimensional reconstruction and deep behavior analysis mode, through the construction of projection matrix, weighted calculation, filtering abnormal points, algorithm optimization and error elimination etc. Link realizes organic integration, forms a complete and efficient system, greatly improves the accuracy of autism children classroom behavior analysis, provides solid and scientific basis for individualized education intervention, and brings more valuable analysis results.
Owner:ZHEJIANG NORMAL UNIV

A complex nutrient composition and its use in intervention of autism and mental retardation

The application discloses a kind of composite nutrient composition and its application in intervention autism and mental retardation, the composite nutrient composition is composed of composite vitamin, mineral, enterobacterium, apple fruit powder and the substance for improving taste;Wherein, the procyanidin B1 content in the apple fruit powder is more than 30mg / kg, the composite nutrient composition of the application can effectively improve the repetitive stereotyped behavior of autistic children, the degree of anxiety, the degree of cognition, and social skills, and effectively improve the intestinal flora imbalance phenomenon of autistic children.It can also effectively improve the cognitive ability of children with mental retardation.
Owner:XUZHOU MEDICAL UNIVERSITY

Interesting rehabilitation training device for autistic children

The interesting rehabilitation training device comprises a bottom plate, vertical plates are fixedly mounted on the left side and the right side of the top of the bottom plate correspondingly, connecting frames are fixedly mounted on the left side and the right side of the top of the bottom plate and located on the inner sides of the vertical plates correspondingly, and a turnover mechanism is arranged at the top of the bottom plate; the turnover mechanism comprises a double-shaft motor, an output shaft, a transmission wheel, a transmission belt, a driven wheel and a sliding sleeve, through the arrangement of the turnover mechanism, richer and more personalized training experience can be provided for autistic children, the children are helped to make contact with various different toy teaching aids on one device, the game experience of the children is enriched, and the interestingness of the children is improved. And secondly, the all-in-one design can promote the sensory and cognitive development of the children, so that the children can understand and accept different types of stimulation more easily, and the development of social skills of the children is also facilitated because the children can be used together with other children to play interactive games.
Owner:YOUDAO SPEECH CORRECTION CENT (SHAANXI) CO LTD

Image recognition method and system for stereotyped repetitive behavior of autistic children

PendingCN122474320AHuman bodyEvaluated interventions
The application discloses an autism child stereotyped repetitive behavior image recognition method and system, and belongs to the technical field of artificial intelligence and image recognition. The method comprises the following steps: acquiring whole body movement video image data of an autism child, and extracting a movement trajectory sequence through a human body skeleton key point detection network; detecting a periodic repetition mode in the movement trajectory through a time sequence analysis algorithm, and recognizing five stereotyped behavior types, i.e., hand slapping, body shaking, rotating behavior, arranging articles and repeatedly opening and closing a door; establishing a stereotyped behavior feature library, and extracting quantitative parameters of a movement period, a movement amplitude, a continuous time length and a triggering situation; calculating a stereotyped behavior comprehensive score, supporting multi-period comparison and analysis to evaluate intervention effects; and generating an analysis report to assist clinical diagnosis and rehabilitation training scheme formulation.
Owner:THE SEVENTH MEDICAL CENTER OF PLA GENERAL HOSPITAL

Children infantile autism rehabilitation training strategy generation method and system

The invention discloses a children infantile autism rehabilitation training strategy generation method and system, and relates to the technical field of intelligent rehabilitation. The three core defects of high data subjectivity, strategy templating and adjustment lagging in traditional rehabilitation training are overcome. The key points of the technical scheme are as follows: a time sequence convolutional network and a gating cross-modal attention mechanism are fused to realize accurate association of symptom inducements; performing multi-step reasoning based on the dynamic knowledge graph, and identifying hidden risks; neural development logic sorting and dynamic feasibility verification are realized through a multi-level fusion algorithm; and driving continuous optimization of the knowledge graph by using the feedback data. The full-process intelligent effect from objective evaluation and precise intervention to continuous optimization is achieved, high-accuracy, high-perspectiveness, scientific and effective rehabilitation training support is provided for the autistic children, and the pertinence, predictability and long-term effectiveness of rehabilitation training are remarkably improved.
Owner:THE SECOND AFFILIATED HOSPITAL ARMY MEDICAL UNIV

Multi-role real scene picture book generation method for autistic children

In order to solve the problem that a picture book generated by an existing image generation technology is difficult to adapt to reading characteristics of autistic children, the invention discloses a multi-role real scene picture book generation method for autistic children, which specifically comprises the following steps: S1, constructing a multi-role picture book data set, s2, constructing a diffusion generation model fused with a physical information neural network, S3, carrying out role identity constraint modeling, and extracting key identity features of roles, S4, constructing a spatial consistency regular term between the roles, S5, introducing a time consistency boundary and an attention guidance mechanism, S6, constructing a multi-objective loss function and carrying out joint training, and S5, carrying out target identification. And a multi-role picture book image sequence with high consistency and definition in time sequence, structure and role recognition is output, so that autistic children can read and understand conveniently.
Owner:ZHEJIANG NORMAL UNIV

Intelligent language trainer for autism

The utility model discloses an intelligent language trainer for autism, and relates to the technical field of language trainer, the key point of the technical scheme is that the intelligent language trainer for autism comprises a base, a support frame and an attraction assembly arranged on the support frame, the attraction assembly comprises a storage frame, the storage frame is installed on the support frame, a servo motor is installed on the storage frame, and the servo motor is connected with the base. A supporting rod is inserted into the output end of the servo motor, and the end, away from the servo motor, of the supporting rod extends into the storage frame, so that the problem that the attention of autism children on the intelligent language training device for autism changes as time goes on in the prior art is solved; if the intelligent language trainer for autism does not change or is a device helpful for improving the attention of children with autism, the attention of the children with autism is not concentrated, and the children are not interested in training.
Owner:NOBEL (WUXI) MEDICAL RESEARCH CO LTD

Method and system for collecting daily behavior data of autistic children

The invention relates to the technical field of autism child behavior analysis, and provides an autism child daily behavior data acquisition method and system, and the method comprises the steps: collecting the three-axis acceleration and three-axis angular velocity of an inertial measurement unit in real time, and taking the three-axis acceleration and three-axis angular velocity as original data; extracting feature data of the original data; according to the feature data, judging the physical consistency of the original data, and distinguishing a real limb movement signal and a sensor relative movement signal; decomposing the original data into a first information stream and a second information stream; based on the first information flow, identifying a behavior pattern of limb movement of the autism child; extracting features of the second information flow to obtain second information features; the second information feature is used for representing the intensity of the relative motion of the sensor corresponding to the relative motion signal of the sensor; calculating a behavior intensity index according to the second information feature; and outputting the behavior pattern and the behavior intensity index. The method has the effect of improving the accuracy of collecting the daily behavior data of the autism children.
Owner:WENZHOU XUFEN TECHNOLOGY DEVELOPMENT CO LTD +1

Social training method for autistic children based on social cognition

The invention relates to the technical field of children rehabilitation treatment, and discloses a social cognition-based social training method for autistic children, which comprises a social cognition ability evaluation and layering module, a cognition foundation building training module, a scenarized social migration training module, a family cooperative training module and a dynamic evaluation and training optimization module. The social cognitive competence assessment and layering module comprises a children rehabilitation department special assessment terminal, a multi-modal assessment toolkit and an assessment data center; the cognitive foundation building training module comprises a social cognitive teaching subsystem, a sensory integration auxiliary prop and an intensifier management unit; the scenarized social migration training module comprises an immersive social scene cabin, a scene task card and a real-time behavior capture camera; the family cooperative training module comprises a parent end training APP, a family and mechanism data synchronization interface and a parent feedback terminal; the invention aims to solve the problem that children's social cognition development hierarchical design is not combined.
Owner:AFFILIATED HOSPITAL OF JINING MEDICAL UNIV

Oral health intelligent monitoring and intervention method for autistic children

The invention relates to the technical field of big data processing and analysis, in particular to an intelligent oral health monitoring and intervention method for autistic children. The method comprises the following steps: acquiring oral clinical index data of a patient, daily oral hygiene behavior record data and microorganism sequencing data obtained after sequencing an oral microorganism sample; the processed data are stored in an associated mode, and an individualized oral health file of each patient is formed; carrying out fusion analysis through a machine learning model based on data in the individualized health record, and outputting a current oral health state score, a risk level and a key risk factor of the patient; and a personalized oral health intervention scheme is matched and generated from a preset intervention strategy knowledge base. According to the method, whether the core factor causing the risk is flora imbalance or insufficient behavior can be identified, the accuracy of disease cause diagnosis is improved, and intervention measures can be adaptively adjusted along with the change of the oral health state of the child.
Owner:HOSPITAL OF STOMATOLOGY SUN YAT SEN UNIV

Method and system for collecting daily behavior data of autistic children

The invention relates to the technical field of autism child behavior analysis, and provides an autism child daily behavior data acquisition method and system, and the method comprises the steps: collecting the three-axis acceleration and three-axis angular velocity of an inertial measurement unit in real time, and taking the three-axis acceleration and three-axis angular velocity as original data; extracting feature data of the original data; according to the feature data, judging the physical consistency of the original data, and distinguishing a real limb movement signal and a sensor relative movement signal; decomposing the original data into a first information stream and a second information stream; based on the first information flow, identifying a behavior pattern of limb movement of the autism child; extracting features of the second information flow to obtain second information features; the second information feature is used for representing the intensity of the relative motion of the sensor corresponding to the relative motion signal of the sensor; calculating a behavior intensity index according to the second information feature; and outputting the behavior pattern and the behavior intensity index. The method has the effect of improving the accuracy of collecting the daily behavior data of the autism children.
Owner:WENZHOU XUFEN TECHNOLOGY DEVELOPMENT CO LTD +1

AI interaction system and interaction method for nursing and social contact of autistic children

The invention relates to an AI interaction system and interaction method for nursing and social contact of autistic children, the system comprises a robot terminal, a cloud AI platform and a parent / therapist terminal which are connected in sequence through a communication module, and the robot terminal is used for collecting multi-modal data of the autistic children and sending the multi-modal data to the cloud AI platform. The data are uploaded to a cloud AI platform after being subjected to multi-modal data processing; the parent / therapist terminal is used for receiving the interactive abstract and the key data and configuring personalized parameters to carry out personalized adjustment and optimization on an AI model in the cloud AI platform; and the cloud AI platform is used for analyzing the processed multi-modal data by adopting the personalized and optimized AI model, generating an interaction abstract and key data, generating an interaction script, transmitting the interaction abstract and the key data to the parent / therapist terminal, transmitting the interaction script to the robot terminal, converting the interaction script into voice through the robot terminal, and outputting the voice. Compared with the prior art, the method has the advantages of individuation, interaction diversity and the like.
Owner:SHANGHAI UNIV OF ENG SCI

Autistic child behavior recognition method based on micro-expression and motion behavior analysis

The invention discloses an autistic child behavior recognition method based on micro-expression and motion behavior analysis, and the method comprises the steps: collecting a free activity video of a child through a camera, and carrying out the size transformation and pixel normalization of a video frame; extracting spatial-temporal characteristics of skeleton points of the whole body by adopting a cascaded differential convolution long-short-term memory unit, and generating skeleton point coordinates through a full connection layer; performing time sorting, space normalization and interpolation expansion on the skeleton point queue to enhance data continuity; and fusing expression and attitude features based on a lightweight ResNet18 network, and outputting a classification result and confidence in combination with a Softmax layer. According to the method, the subjective defect of a traditional method is overcome through a skeleton point detection technology, the objectivity, accuracy and real-time performance of autism behavior recognition are remarkably improved by combining spatial-temporal feature extraction and an efficient classification model, and the method is suitable for early screening and auxiliary diagnosis.
Owner:WUHAN UNIV