System for assisting children autism spectrum disorder rehabilitation based on VR interaction technology

Abstract

The invention relates to the technical field of child psychotherapy, and provides a system for assisting child autism spectrum disorder rehabilitation based on a VR interaction technology, and the system comprises a psychotherapy simulation role generation module which is used for generating an autism treatment virtual object of a child, and the virtual object employs a cartoon 3D image; and the preference detection module is used for testing and screening a closer virtual image of a treatment object in a heart rate detection and through hole sight tracking mode, stimulating the interaction desire of the treatment object so as to better carry out treatment work and outputting a preference scheme list. According to the embodiment of the invention, the personalized virtual treatment object and scene can be generated according to the response of each child, and the personalized treatment scheme can better attract the attention and interaction desire of the child through the easier close image, so that the child as the treatment object can better develop the heart, and the treatment effect is improved. The rehabilitation treatment is promoted; and the treatment effectiveness is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of child psychotherapy, and in particular to a system for assisting the rehabilitation of children with autism spectrum disorders based on VR interaction technology. Background Art

[0002] Autism spectrum disorder (ASD) in children is a neurodevelopmental disorder characterized by social communication disorders, narrow interests or activities, and repetitive stereotyped behaviors. VR technology can integrate the real world and the virtual world, replicate various scenes, create an immersive experience, and conduct human-computer interaction through controllers. It has the characteristics of immersion, interactivity, and imagination. This immersive experience can help children with autism better immerse themselves in the training environment and improve the effectiveness of intervention.

[0003] The current VR interactive technology cannot meet the specific needs of each patient, and more personalized adjustments and customized content are needed to achieve the best results. Therefore, a rehabilitation system for children with autism spectrum disorders is needed based on VR interactive technology. Summary of the invention

[0004] In view of the shortcomings of the existing technology, the present invention provides a system for assisting the rehabilitation of children with autism spectrum disorders based on VR interaction technology, which solves the problem that the current VR interaction technology cannot meet the specific needs of each patient and requires more personalized adjustments and customized content to achieve the best effect.

[0005] To achieve the above objectives, the present invention is implemented through the following technical solutions:

[0006] The VR interactive technology-assisted rehabilitation system for children with autism spectrum disorders includes:

[0007] The psychotherapy simulation role generation module is used to generate a virtual object for autism treatment as a child. The virtual object adopts a cartoon 3D image.

[0008] The preference detection module uses heart rate detection and through-hole eye tracking to test and select virtual images that are more familiar to the treatment object, stimulate the treatment object's desire for interaction, so as to better carry out treatment work, and output a list of preference plans;

[0009] A scenario generation module generates scenarios that are more friendly to the treatment subject by combining the preference scenario list output by the preference detection module;

[0010] The role interaction module triggers the actions and voices of the autism treatment virtual object through the actions and voices of the treatment object, so as to interact with the treatment object and achieve the purpose of alleviating the symptoms of autism treatment.

[0011] Preferably, the psychotherapy simulation role generation module includes a role model library, a role color matching scheme unit and a role voice scheme unit which are electrically connected to each other.

[0012] Preferably, the preference detection module includes a heart rate detection unit, a pupil sight tracking unit, a preference object screening unit and a solution output unit which are electrically connected to each other.

[0013] Preferably, the scene generation module includes a solution importing unit, a scene storage unit and a background music playing unit which are electrically connected to each other.

[0014] Preferably, the role interaction module includes a dialogue language AI unit, a voice collection feedback unit, an action synchronization feedback unit and a treatment plan storage unit which are electrically connected to each other.

[0015] The method for assisting children with autism spectrum disorder rehabilitation based on VR interactive technology includes the following steps:

[0016] Step 1: The child to be treated wears a VR helmet and matching interactive accessories and starts the system;

[0017] Step 2: The psychotherapy simulation character generation module preferentially generates a plurality of cartoon 3D images of virtual objects for autism treatment, projects them into the screen of the VR helmet, and performs affinity screening through the preference detection module;

[0018] Step 3: After the affinity screening is completed, the cartoon 3D image of the autism treatment virtual object that has been screened is exported, and a list of preference plans with the cartoon image element numbers is output. If the affinity screening fails, repeat step 2;

[0019] Step 4: Import the preferred solution list into the scene generation module to generate a simulated scene environment similar to the selected cartoon elements;

[0020] Step 5: Perform therapeutic interaction through the role interaction module to treat the children who are the treatment targets and alleviate the symptoms of autism.

[0021] Preferably, the specific steps of generating the cartoon 3D image of the autism treatment virtual object in step 2 are:

[0022] S1. Randomly match the module materials in the character model library, each of which has independent art elements, to form multiple white models;

[0023] S2, randomly coloring the plurality of white films uniformly using an orange color matching scheme;

[0024] S3, using the character voice solution unit to load voice on the model;

[0025] S4. Record the art element number and color matching number of each model;

[0026] S5. Output the generated complex model.

[0027] Preferably, the affinity screening work in step 2 specifically comprises the following steps:

[0028] S1, the plural generated models are displayed in turn in the temporarily generated screen;

[0029] S2, using the pupil tracking unit to track the pupil gaze direction of the treatment object, and using the heart rate detection unit to detect the heart rate;

[0030] S3. When the treatment subject stares at one of the characters for a long time and a heart rate fluctuation is detected, the character is exported and the action skeleton is bound.

[0031] Preferably, the specific steps of generating the simulated scene environment in step 4 are:

[0032] S1, using the program importing unit to import the favorite program list into the scene storage unit and the background music playing unit;

[0033] S2, filtering materials in the scene storage unit and the background music playback unit by referring to the numbers in the preferred scheme list;

[0034] S3. Use the selected materials to construct a virtual scene, and cooperate with the autism treatment virtual object to create a scene that makes the treatment object feel at ease and comfortable.

[0035] Preferably, the specific steps of performing the treatment interaction work in step 5 are:

[0036] S1. Download the treatment plan to the dialogue language AI unit through the treatment plan storage unit to respond to the interaction of the treatment object and make corresponding feedback;

[0037] S2, collecting the actions and voices of the treatment subject during the treatment process through the voice collection unit and the action synchronization feedback unit;

[0038] S3. The language AI unit gives corresponding feedback based on the received actions and voices, and uses the downloaded treatment plan to further derive the next autonomous feedback action.

[0039] The present invention provides a system for assisting children with autism spectrum disorder rehabilitation based on VR interactive technology. It has the following beneficial effects:

[0040] 1. The present invention can generate personalized virtual treatment objects and scenes according to the reactions of each child. Through images that are more approachable, the personalized treatment plan can better attract the children's attention and desire for interaction, so that the children who are the treatment objects can better open their hearts, promote the progress of rehabilitation treatment and improve the effectiveness of treatment.

[0041] 2. The present invention can respond to children's movements and voices in real time, provide instant feedback and interaction through AI, promote the development of children's social skills and communication abilities, and greatly improve the flexibility of the system by combining treatment plans with intelligent AI interactions. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1 is a system diagram of the present invention;

[0043] Figure 2 A schematic diagram of a psychotherapy simulation role generation module system of the present invention;

[0044] Figure 3 A schematic diagram of a preference detection module system of the present invention;

[0045] Figure 4 A schematic diagram of a scene generation module system of the present invention;

[0046] Figure 5 Schematic diagram of the role interaction module system of the present invention. DETAILED DESCRIPTION

[0047] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0048] Example:

[0049] As one aspect of this application, please see the attached Figure 1 -Attached Figure 5 The embodiment of the present invention provides a system for assisting children with autism spectrum disorder rehabilitation based on VR interaction technology, including:

[0050] A psychotherapy simulation role generation module, which is composed of a role model library, a role color matching scheme unit and a role voice scheme unit which are electrically connected to each other, and is used to generate a virtual object for autism treatment as a child, and the virtual object adopts a cartoon 3D image;

[0051] The preference detection module is composed of a heart rate detection unit, a pupil sight tracking unit, a preference object screening unit and a plan output unit which are electrically connected to each other. The preference detection module tests and screens a virtual image that is closer to the treatment object through heart rate detection and pupil sight tracking, stimulates the treatment object's desire for interaction, so as to better carry out treatment work, and outputs a list of preference plans;

[0052] A scene generation module, which is composed of a solution import unit, a scene storage unit and a background music playing unit which are electrically connected to each other, and generates a scene that is more friendly to the treatment object by combining the preference solution list output by the preference detection module;

[0053] The role interaction module is composed of a dialogue language AI unit, a voice collection and feedback unit, a motion synchronization feedback unit and a treatment plan storage unit which are electrically connected to each other. The module triggers the motion and voice of the autism treatment virtual object through the motion and voice of the treatment object to interact with the treatment object, so as to achieve the purpose of alleviating the symptoms of autism treatment.

[0054] Based on the above-mentioned VR interactive technology-assisted rehabilitation system for children with autism spectrum disorders, as another aspect of the present application, a method for assisting rehabilitation of children with autism spectrum disorders based on VR interactive technology includes the following steps:

[0055] Step 1: The child to be treated wears a VR helmet and matching interactive accessories and starts the system;

[0056] Step 2: The psychotherapy simulation character generation module preferentially generates multiple cartoon 3D images of virtual objects for autism treatment, and projects them into the screen of the VR helmet. The affinity screening is performed through the preference detection module. The specific steps for generating cartoon 3D images of virtual objects for autism treatment are as follows:

[0057] S1. Randomly match the module materials in the character model library, each of which has independent art elements, to form multiple white models;

[0058] S2, randomly coloring the plurality of white films uniformly using an orange color matching scheme;

[0059] S3, using the character voice solution unit to load voice on the model;

[0060] S4. Record the art element number and color matching number of each model;

[0061] S5. Output the generated complex model.

[0062] Step 3: After the affinity screening is completed, the cartoon 3D image of the autism treatment virtual object that has been screened is exported, and a list of preference plans with the cartoon image element numbers is output. If the affinity screening fails, repeat step 2. The specific steps of the affinity screening are as follows:

[0063] S1, the plural generated models are displayed in turn in the temporarily generated screen;

[0064] S2, using the pupil tracking unit to track the pupil gaze direction of the treatment object, and using the heart rate detection unit to detect the heart rate;

[0065] S3. When the treatment subject stares at one of the characters for a long time and a heart rate fluctuation is detected, the character is exported and the action skeleton is bound.

[0066] Step 4: Import the preferred solution list into the scene generation module to generate a simulated scene environment similar to the selected cartoon elements. The specific steps of generating the simulated scene environment are as follows:

[0067] S1, using the program importing unit to import the favorite program list into the scene storage unit and the background music playing unit;

[0068] S2, filtering materials in the scene storage unit and the background music playback unit by referring to the numbers in the preferred scheme list;

[0069] S3. Use the selected materials to construct a virtual scene, and cooperate with the autism treatment virtual object to create a scene that makes the treatment object feel at ease and comfortable.

[0070] Step 5: Perform therapeutic interaction through the role interaction module to treat the child as the treatment object and alleviate the symptoms of autism. The specific steps for therapeutic interaction are:

[0071] S1. Download the treatment plan to the dialogue language AI unit through the treatment plan storage unit to respond to the interaction of the treatment object and make corresponding feedback;

[0072] S2, collecting the actions and voices of the treatment subject during the treatment process through the voice collection unit and the action synchronization feedback unit;

[0073] S3. The language AI unit gives corresponding feedback based on the received actions and voices, and uses the downloaded treatment plan to further derive the next autonomous feedback action.

[0074] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A rehabilitation system for children with autism spectrum disorders based on VR interactive technology, characterized by: include: The psychotherapy simulation role generation module is used to generate a virtual object for autism treatment as a child. The virtual object adopts a cartoon 3D image. The preference detection module uses heart rate detection and through-hole eye tracking to test and select virtual images that are more familiar to the treatment object, stimulate the treatment object's desire for interaction, so as to better carry out treatment work, and output a list of preference plans; A scenario generation module generates scenarios that are more friendly to the treatment subject by combining the preference scenario list output by the preference detection module; The role interaction module triggers the actions and voices of the autism treatment virtual object through the actions and voices of the treatment object, so as to interact with the treatment object and achieve the purpose of alleviating the symptoms of autism treatment.

2. The VR interactive technology-assisted rehabilitation system for children with autism spectrum disorders according to claim 1 is characterized in that: The psychotherapy simulation role generation module includes a role model library, a role color matching scheme unit and a role voice scheme unit which are electrically connected to each other.

3. The VR interactive technology-assisted rehabilitation system for children with autism spectrum disorders according to claim 1 is characterized in that: The preference detection module includes a heart rate detection unit, a pupil sight tracking unit, a preference object screening unit and a solution output unit which are electrically connected to each other.

4. The VR interactive technology-assisted rehabilitation system for children with autism spectrum disorders according to claim 1 is characterized in that: The scene generation module includes a solution importing unit, a scene storage unit and a background music playing unit which are electrically connected to each other.

5. The VR interactive technology-assisted rehabilitation system for children with autism spectrum disorders according to claim 1 is characterized in that: The role interaction module includes a dialogue language AI unit, a voice collection feedback unit, an action synchronization feedback unit and a treatment plan storage unit which are electrically connected to each other.

6. A method for assisting children with autism spectrum disorders with VR interactive technology, using a system for assisting children with autism spectrum disorders with VR interactive technology as described in any one of claims 1 to 5, characterized in that: The following steps are involved: Step 1: The child to be treated wears a VR helmet and matching interactive accessories and starts the system; Step 2: The psychotherapy simulation character generation module preferentially generates a plurality of cartoon 3D images of virtual objects for autism treatment, projects them into the screen of the VR helmet, and performs affinity screening through the preference detection module; Step 3: After the affinity screening is completed, the cartoon 3D image of the autism treatment virtual object that has been screened is exported, and a list of preference plans with the cartoon image element numbers is output. If the affinity screening fails, repeat step 2; Step 4: Import the preferred solution list into the scene generation module to generate a simulated scene environment similar to the selected cartoon elements; Step 5: Perform therapeutic interaction through the role interaction module to treat the children who are the treatment targets and alleviate the symptoms of autism.

7. The method for assisting children with autism spectrum disorder rehabilitation based on VR interactive technology according to claim 6, characterized in that: The specific steps of generating the cartoon 3D image of the autism treatment virtual object in step 2 are: S1. Randomly match the module materials in the character model library, each of which has independent art elements, to form multiple white models; S2, randomly coloring the plurality of white films uniformly using an orange color matching scheme; S3, using the character voice solution unit to load voice on the model; S4. Record the art element number and color matching number of each model; S5. Output the generated complex model.

8. The method for assisting children with autism spectrum disorder rehabilitation based on VR interactive technology according to claim 6, characterized in that: The specific steps of affinity screening in step 2 are as follows: S1, the plural generated models are displayed in turn in the temporarily generated screen; S2, using the pupil tracking unit to track the pupil gaze direction of the treatment object, and using the heart rate detection unit to detect the heart rate; S3. When the treatment subject stares at one of the characters for a long time and a heart rate fluctuation is detected, the character is exported and the action skeleton is bound.

9. The method for assisting children with autism spectrum disorder rehabilitation based on VR interactive technology according to claim 6, characterized in that: The specific steps of generating the simulation scene environment in step 4 are as follows: S1, using the program importing unit to import the favorite program list into the scene storage unit and the background music playing unit; S2, filtering materials in the scene storage unit and the background music playback unit by referring to the numbers in the preferred scheme list; S3. Use the selected materials to construct a virtual scene, and cooperate with the autism treatment virtual object to create a scene that makes the treatment object feel at ease and comfortable.

10. The method for assisting children with autism spectrum disorder rehabilitation based on VR interactive technology according to claim 6, characterized in that: The specific steps of performing the treatment interaction work in step 5 are: S1. Download the treatment plan to the dialogue language AI unit through the treatment plan storage unit to respond to the interaction of the treatment object and make corresponding feedback; S2, collecting the actions and voices of the treatment subject during the treatment process through the voice collection unit and the action synchronization feedback unit; S3. The language AI unit gives corresponding feedback based on the received actions and voices, and uses the downloaded treatment plan to further derive the next autonomous feedback action.

Images