Mixed reality assessment intervention system and method for child developmental disorder

Abstract

The invention relates to the technical field of children developmental disorder intervention, in particular to a mixed reality assessment intervention system and method for children developmental disorder, and the system comprises an intervention scheme determination module, a data collection module and an intervention control center. The method comprises the steps of determining an adjustment intervention strategy, a short-term target or an intervention stage according to a plurality of second correct rates of execution of an intervention scheme by a child, determining a strategy improvement level or replacement of the intervention strategy based on a strategy level of a current intervention strategy, or determining an adjustment strategy for a current stage based on a first quantity, and under the condition of determining that the current intervention stage is not changed, the short-term target is replaced based on a first quantity proportion, or the short-term target is replaced or the intervention stage is improved based on a second quantity proportion, and the development trend of the qualified rate of a plurality of execution cycles is obtained to adjust the judgment criterion of the intervention level. According to the method, the timeliness of intervention decision adjustment and the individual suitability are improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of child development disorder intervention, and particularly relates to a mixed reality evaluation intervention system and method for child development disorder. BACKGROUND

[0002] In the field of child development disorder intervention, the traditional method generally has the problem of insufficient dynamic adaptability. For example, the evaluation system based on artificial observation is difficult to capture the behavior changes of children in real time, and the adjustment of intervention strategies depends on the subjective experience of therapists, resulting in limited decision-making lag and individual adaptability. In view of this pain point, the mixed reality (MR) technology and artificial intelligence algorithm construct a dynamic evaluation framework with real-time data acquisition and analysis capability, which can synchronously obtain the behavior performance (such as attention allocation, motion coordination) of children in virtual tasks, emotional state (such as anxiety level) and cognitive load, and dynamically analyze the development characteristics and intervention needs of children by using machine learning model. Based on this, the system generates adjustment schemes of task difficulty gradient, environmental complexity and feedback intensity in real time through preset decision tree logic and adaptive algorithm. Based on the data-driven closed-loop intervention mechanism, not only the millisecond-level response and precise adaptation of the intervention strategy are realized, but also the individual development trajectory atlas is generated through the visual tracking module, which provides quantitative evaluation basis for the rehabilitation therapist, and significantly improves the intelligent level and evidence-based practice efficiency of the intervention process.

[0003] Chinese Patent Publication No. CN118690330B discloses a neural development disorder behavior intervention system based on a large language model, which collects behavior time series data of a child patient, including language, social interaction and behavior performance mode, etc., and uses a large language model and artificial intelligence technology to extract semantic features and behavior time series aggregated semantics of each behavior data of the child patient, to automatically identify the behavior mode and dynamic change information of the child patient, and provide a scientific basis for the development and optimization of intervention strategies. In this way, individualized intervention schemes, including intervention targets, methods and steps, can be more intelligently provided based on the multi-dimensional behavior time series aggregated semantics of the child patient, thereby improving the pertinence of behavior intervention for children with neural development disorders, better meeting the needs of different children, and promoting their overall development.

[0004] The existing technology also has the following problems: when intervening in children with development disorders, the evaluation system based on artificial observation is difficult to capture the behavior changes of children in real time, and the adjustment of intervention strategies depends on the subjective experience of therapists, resulting in limited decision-making lag and individual adaptability. SUMMARY

[0005] To this end, the application provides a mixed reality evaluation intervention system and method for child development disorders to overcome the problem that the evaluation system of artificial observation in the prior art is difficult to capture the behavior changes of children in real time, resulting in insufficient adjustment and individual adaptation of intervention decision-making.

[0006] To achieve the above-mentioned purpose, in one aspect, the application provides a mixed reality evaluation intervention system for child development disorders, comprising:

[0007] a data acquisition module configured to acquire a plurality of first correct rates and facial behavior video data of a child performing an intervention scheme based on mixed reality;

[0008] an intervention control center connected to the data acquisition module, comprising,

[0009] an intervention scheme analysis module configured to correct the corresponding first correct rate to obtain a second correct rate based on the attention representation parameters of the facial behavior video data;

[0010] an intervention scheme execution module configured to determine an adjusted intervention strategy, a short-term goal or an intervention stage based on the second correct rate;

[0011] a strategy adjustment module configured to determine an improved strategy level or replace the intervention strategy based on the strategy level of the current intervention strategy;

[0012] a stage adjustment module configured to determine an evaluation method of a short-term goal based on the first number of the short-term goal belonging to the current intervention stage to determine an adjustment strategy for the current stage, and replace the short-term goal based on the first number of the completed short-term goal in the current intervention stage under the condition that the current intervention stage is determined to be unchanged;

[0013] a short-term goal adjustment module configured to determine to replace the short-term goal or improve the intervention stage based on the second number of the completed short-term goal in the current intervention project;

[0014] a calling module configured to call the strategy adjustment module in response to the condition of adjusting the intervention strategy, or call the stage adjustment module in response to the condition of adjusting the intervention stage, or call the short-term goal adjustment module in response to the condition of adjusting the short-term goal.

[0015] Further, the intervention scheme analysis module sets a plurality of correct rate correction coefficients based on the comparison result of the attention representation parameters and the preset attention representation parameters, to correct the first correct rate according to a plurality of correct rate correction coefficients.

[0016] Further, the intervention scheme execution module determines to adjust the intervention stage based on the comparison result that the number of times that the second correct rate is greater than or equal to a first preset correct rate is greater than or equal to a preset number of times.

[0017] The intervention scheme execution module determines to adjust the short-term target based on a comparison result that the second accuracy is greater than or equal to a first preset accuracy for less than the preset number of times;

[0018] The intervention scheme execution module determines to adjust the intervention strategy based on a comparison result that the second accuracy is less than a second preset accuracy;

[0019] The second preset accuracy is less than the first preset accuracy.

[0020] Further, the strategy adjustment module determines to replace the intervention strategy based on a determination result that a strategy level of the current intervention strategy is a highest level;

[0021] The strategy adjustment module determines to promote the strategy level of the intervention strategy based on a determination result that the strategy level of the current intervention strategy is a non-highest level;

[0022] The strategy level is promoted by switching to an intervention scene with a higher complexity than a real-time complexity of a current intervention scene.

[0023] Further, the stage adjustment module determines to evaluate the short-term targets that have been completed in the current intervention stage in a data summary manner based on a comparison result that a first number of the short-term targets belonging to a short-term target of the current stage is greater than or equal to a preset target number;

[0024] The stage adjustment module determines to evaluate the short-term targets that have been completed in the current intervention stage in a single data manner based on a comparison result that the first number of the short-term targets belonging to a short-term target of the current stage is less than the preset target number.

[0025] Further, the stage adjustment module, in a condition of determining to evaluate the short-term targets that have been completed in the current intervention stage in the data summary manner, determines the short-term targets to be cumulative targets based on a comparison result that the short-term targets that have been completed are of the same attribute, determines a cumulative value of the cumulative targets, and determines an adjustment manner for the current intervention stage to be promotion, rollback, or unchanged based on the cumulative value.

[0026] Further, the stage adjustment module, in a condition of determining that the current intervention stage is unchanged, determines to replace the short-term targets based on a determination result that a first number of the short-term targets that have been completed in the current intervention stage accounts for greater than or equal to a first preset proportion.

[0027] Further, the short-term target adjustment module determines to promote the current intervention stage based on a comparison result that a second number of the short-term targets that have been completed in the current intervention project accounts for greater than or equal to a second preset proportion.

[0028] The short-term target adjustment module determines to replace the short-term target based on a comparison result that the second quantity ratio is less than the second preset ratio.

[0029] Further, the intervention control center further comprises an intervention verification module configured to determine to adjust the first preset accuracy and the second preset accuracy based on a development trend of the qualified rate of a plurality of execution cycles.

[0030] In another aspect, the present application also provides a mixed reality evaluation intervention method for children with developmental disorders, comprising:

[0031] Collecting a plurality of first accuracies and expression behavior video data of the children performing an intervention scheme based on mixed reality, correcting the second accuracy based on the expression behavior video data of the corresponding first accuracy based on the focused representation parameter of the expression behavior video data, and determining to adjust the intervention strategy, the short-term target or the intervention stage based on the second accuracy;

[0032] In a condition of determining to adjust the intervention strategy, determining to improve the strategy level or replace the intervention strategy based on the strategy level of the current intervention strategy;

[0033] In a condition of determining to adjust the intervention stage, determining the evaluation method of the short-term target based on the first quantity of the short-term target belonging to the current intervention stage to determine the adjustment strategy for the current stage, and in a condition of determining that the current intervention stage is unchanged, determining to replace the short-term target based on the first quantity ratio of the completed short-term target in the current intervention stage;

[0034] In a condition of determining to adjust the short-term target, determining to replace the short-term target or improve the intervention stage based on the second quantity ratio of the completed short-term target in the current intervention project;

[0035] Obtaining a development trend of the qualified rate of a plurality of execution cycles to adjust the judgment criterion of the intervention level;

[0036] The intervention level comprises an intervention strategy, a short-term target or an intervention stage.

[0037] Compared with the prior art, the present application has the beneficial effects that the present application matches a number of intervention programs from the intervention program database for children with developmental disorders, provides personalized intervention programs for children with developmental disorders, and implements the customized intervention programs through the technical means of mixed reality, builds a five-sense coordinated immersive environment to better guide the patient children to execute the intervention programs; in the process of the patient children executing the intervention programs, the first correctness rate is monitored in real time, and the expression behavior video data of the patient children executing the intervention programs is obtained in real time, the first correctness rate is corrected to obtain the second correctness rate according to the attention characteristic parameters of the video data, whether the current intervention level is suitable for the patient children is determined according to the second correctness rate, and the adjustment of the intervention level that is not suitable is determined according to the second correctness rate and the continuous number of times; under the condition of determining the adjustment of the intervention strategy, the adjustment mode is determined according to the strategy level of the current intervention strategy, if it is the highest level, it means that the current intervention strategy is a skill that the patient children can master, other intervention strategies under the same short-term goal can be replaced, if it is not the highest level, the level of the intervention strategy is improved; under the condition of determining the adjustment of the intervention stage, firstly, the first number of the short-term goals completed by the patient children in the current intervention stage is determined, whether the completed short-term goals are evaluated in the form of data summary or in the form of single data is determined according to the first number, the evaluation of the performance of the patient children in the intervention program implementation process in the form of data summary is more objective and comprehensive, and the adjustment mode of the current intervention stage is further determined under the determined analysis mode; under the condition of determining the adjustment of the short-term goal, whether the short-term goal is replaced is determined according to the first number proportion of the element or the second number proportion of the short-term goal, so that the intervention decision is adjusted according to the performance of the patient children in the intervention process, so as to improve the timeliness and individual adaptability of the intervention decision adjustment.

[0038] Further, the present application determines whether the current intervention decision adjustment mode is suitable by periodically analyzing the correctness rate trend of a single child, and timely adjusts the judgment basis for the case that the intervention decision adjustment mode is not suitable to provide a more targeted intervention decision adjustment mode for the individual situation of the patient children, thereby further improving the timeliness and individual adaptability of the intervention decision adjustment. BRIEF DESCRIPTION OF DRAWINGS

[0039] Figure 1 The structural block diagram of the mixed reality evaluation intervention system for children with developmental disorders in the embodiment of the present application;

[0040] Figure 2 The flowchart for determining whether to replace the intervention strategy according to the strategy level of the current intervention strategy in the embodiment of the present application;

[0041] Figure 3A flow chart for determining whether to replace a short-term goal under the condition that a current intervention stage is unchanged for an embodiment of the present application;

[0042] Figure 4 A flow chart for a mixed reality assessment intervention method for a child development disorder for an embodiment of the present application. DETAILED DESCRIPTION

[0043] In order to make the objects and advantages of the present application clearer, the present application will be further described in conjunction with embodiments. It should be understood that the specific embodiments described herein merely serve the purpose of explanation and are not intended to limit the present application.

[0044] The preferred embodiments of the present application will be described below with reference to the drawings. It should be understood by those skilled in the art that the embodiments are merely used to explain the technical principles of the present application and are not intended to limit the protection scope of the present application.

[0045] It should be noted that, in the description of the present application, the terms of "upper", "lower", "left", "right", "inner", "outer" and the like indicating the direction or positional relationship are based on the direction or positional relationship shown in the drawings, which are merely for the convenience of description and are not intended to indicate or imply that the device or element must have a particular orientation, be constructed and operated in a particular orientation, and therefore cannot be understood as limiting the present application.

[0046] In addition, it should also be noted that, in the description of the present application, unless otherwise explicitly specified and limited, the terms of "mounting", "connecting", "connection" should be understood in a broad sense, for example, can be fixed connection, can also be detachable connection, or integrally connected; can be mechanical connection, can also be electrical connection; can be directly connected, can also be indirectly connected through an intermediate medium, can be the communication inside two elements. For those skilled in the art, the specific meaning of the above terms in the present application can be understood according to the specific circumstances.

[0047] Please refer to Figures 1-3 as shown, Figure 1 A structural block diagram of a mixed reality assessment intervention system for a child development disorder for an embodiment of the present application; Figure 2 A flow chart for determining whether to replace an intervention strategy based on a strategy level of a current intervention strategy for an embodiment of the present application; Figure 3 A flow chart for determining whether to replace a short-term goal under the condition that a current intervention stage is unchanged for an embodiment of the present application.

[0048] The mixed reality assessment intervention system for a child development disorder of the embodiment of the present application comprises:

[0049] An intervention scheme determination module is used to determine an intervention scheme for the child based on the assessment data of the child;

[0050] a data collection module configured to collect a plurality of first accuracies and facial expression video data of a child performing an intervention program based on mixed reality;

[0051] an intervention control center connected to the data collection module, comprising,

[0052] an intervention program analysis module configured to correct a second accuracy based on a first accuracy and a focused representation parameter of the facial expression video data;

[0053] an intervention program execution module configured to determine an adjustment intervention strategy, a short-term goal or an intervention stage based on the second accuracy;

[0054] a strategy adjustment module configured to determine an improved strategy level or a replacement intervention strategy based on a strategy level of a current intervention strategy;

[0055] a stage adjustment module configured to determine an evaluation method of a short-term goal based on a first number of the short-term goal belonging to a current intervention stage to determine an adjustment strategy for the current stage, and to replace the short-term goal based on a first number ratio of the short-term goal completed under the current intervention stage when it is determined that the current intervention stage is unchanged;

[0056] a short-term goal adjustment module configured to determine a replacement short-term goal or an improved intervention stage based on a second number ratio of the short-term goal completed under a current intervention project;

[0057] a calling module configured to call the strategy adjustment module in response to a condition of adjusting the intervention strategy, or to call the stage adjustment module in response to a condition of adjusting the intervention stage, or to call the short-term goal adjustment module in response to a condition of adjusting the short-term goal;

[0058] an intervention verification module configured to determine an adjustment of a judgment benchmark of an intervention level based on a development trend of a qualified rate of a plurality of execution cycles.

[0059] Specifically, the evaluation data of the child in the embodiment of the present application includes: standardized scale evaluation data such as screening scale, diagnostic scale or special ability scale, neuropsychological evaluation and physiological and medical detection such as imaging examination or gene detection, which are not specifically limited.

[0060] It can be understood that, in the embodiment of the present application, the evaluation data of the child and the data in the database are matched, the intervention scheme is matched according to the result that the matching degree is higher than 90% of the preset matching degree, one intervention scheme includes several intervention projects, one intervention project includes several stage targets, one stage target includes several short-term targets, one short-term target includes several intervention strategies, one intervention strategy includes several rounds, each round corresponds to one intervention scene based on mixed reality, and several contents in each intervention level are numbered, and the implementation principle of intervention decision is to gradually transition from low level to high level, and specific examples are shown in the following table:

[0061]

[0062] Specifically, the intervention scheme analysis module sets a plurality of correction coefficients of accuracy based on the comparison result of the attention representation parameter and the preset attention representation parameter, so as to correct the first accuracy according to the plurality of correction coefficients of accuracy.

[0063] Specifically, the intervention scheme analysis module determines to increase the first accuracy by a first correction coefficient of accuracy based on the comparison result that the attention representation parameter is greater than the preset attention representation parameter.

[0064] Based on the comparison result that the attention representation parameter is equal to the preset attention representation parameter, it is determined that the first accuracy is not corrected.

[0065] Based on the comparison result that the attention representation parameter is less than the preset attention representation parameter, it is determined to decrease the first accuracy by a second correction coefficient of accuracy.

[0066] In the embodiment of the present application, the preset attention representation parameter is 0.9, but the above value is not limited thereto, and the person skilled in the art can also adjust the value according to actual needs.

[0067] In the implementation, the attention representation parameter is the ratio of the duration of the target area of the child's gaze to the total duration of the child's execution of the intervention scheme, which is extracted from the expression behavior video data obtained in real time during the execution of the intervention scheme by the child. The target area is predefined in the video picture according to the specific intervention scheme, for example, in a common object recognition training intervention scheme, the target area can be the area where the target common object appears based on the mixed reality technology. If the included angle between the child's gaze direction and the target area is less than 30°, it is determined that the child gazes at the target area.

[0068] It can be understood that, during the execution of the intervention program, if the child's line of sight frequently deviates from the target area (the attention representation parameter is low), it means that the child may not have seriously received the task information (such as not seeing the target object), and at this time, the "correct rate" may contain a large component of random guessing (such as guessing correctly), which cannot reflect the child's true cognitive or executive ability; on the contrary, if the child continuously gazes at the target area (the attention representation parameter is high), the "correct rate" is more likely to be based on the understanding and processing of the task, and can truly reflect the actual level. As the basis for evaluating the child's ability and adjusting the intervention program, the "authenticity" (i.e., whether it can represent the child's true ability) of the first correct rate is highly dependent on whether the child is in an attentive state when performing the task:

[0069] When the attention representation parameter is higher than the preset value, the child is in a highly attentive and effective participation state, and the correct rate at this time can more accurately reflect the true ability, and by increasing the correct rate through the first correction coefficient, the weight of this true performance can be strengthened, providing a more reliable basis for intervention evaluation;

[0070] When the attention representation parameter is lower than the preset value, the child's participation effectiveness is low, and the correct rate may contain more non-ability factors (such as luck), and by reducing the correct rate through the second correction coefficient, the interference of false results on evaluation can be reduced, and misjudgment of the child's ability due to "accidental correctness" can be avoided;

[0071] When the attention representation parameter is equal to the preset value, the attention degree is in a reasonable range, and the authenticity of the correct rate is moderate, and no correction is needed as an effective reference.

[0072] Specifically, the value range of the first correct rate correction coefficient is set to [1.01, 1.03], and the embodiment of the present application preferably 1.02; the value range of the second correct rate correction coefficient is set to [0.97, 0.99]. The embodiment of the present application preferably 0.985.

[0073] Specifically, the intervention program execution module determines to adjust the intervention stage based on the comparison result that the number of consecutive times that the second correct rate is greater than or equal to the first preset correct rate is greater than or equal to a preset number;

[0074] The intervention program execution module determines to adjust the short-term goal based on the comparison result that the number of consecutive times that the second correct rate is greater than or equal to the first preset correct rate is less than the preset number;

[0075] The intervention program execution module determines to adjust the intervention strategy based on the comparison result that the second correct rate is less than the second preset correct rate;

[0076] Wherein, the second preset correct rate is less than the first preset correct rate.

[0077] It can be understood that the accuracy rate is determined for a single intervention strategy, for example, the single intervention strategy includes 10 rounds, 7 of which are qualified, and the accuracy rate is 70%.

[0078] Specifically, the first preset accuracy rate, the second preset accuracy rate, and the preset number of times are determined according to the performance of the historical intervention process of a plurality of children, the value range of the first preset accuracy rate is set to [80%, 95%], and the embodiment of the present application preferably 85%, the value range of the second preset accuracy rate is set to [40%, 60%], and the embodiment of the present application preferably 50%, and the value range of the preset number of times is set to [4 times, 8 times], and the embodiment of the present application preferably 6 times.

[0079] It can be understood that the accuracy rate reflects the matching degree of the current ability level of the child and the difficulty of the intervention task, and the effectiveness of the child rehabilitation intervention depends on the "moderate challenge" principle: the task difficulty cannot be too low, which may lead to stagnation of ability, nor too high, which may lead to frustration and ineffective attempts, and a high accuracy rate indicates that the child has fully mastered the core ability of the current stage, and the goal of the current intervention stage is not challenging to it, and it is necessary to enter a higher level of intervention stage to promote ability migration and promotion; a low accuracy rate indicates that the current intervention strategy may not effectively stimulate the learning potential of the child, or the task difficulty exceeds its current ability range, and the strategy needs to be fundamentally adjusted to provide more appropriate support.

[0080] Specifically, the strategy adjustment module determines to replace the intervention strategy based on the determination result that the strategy level of the current intervention strategy is the highest level;

[0081] The strategy adjustment module determines to improve the strategy level of the intervention strategy based on the determination result that the strategy level of the current intervention strategy is not the highest level;

[0082] The strategy adjustment module determines to improve the strategy level of the intervention strategy based on the determination result that the strategy level of the current intervention strategy is not the highest level;

[0083] It can be understood that the determination manner of the complexity is determined according to the intervention scene, for example, taking the intervention strategy of identifying apples as an example, the determination manner of the complexity is determined according to the state and number of objects in the intervention scene, for intervention strategy 1, the complexity is the number of objects 2; for strategy 2, the complexity is the number of objects 3; for strategy 3, the complexity is the sum of the number of static objects and the number of dynamic objects multiplied by the weight coefficient of dynamic objects, and the weight coefficient of dynamic objects can be set to 2, that is, 2*2=4.

[0084] It can be understood that the manner in the embodiment of the present application is only used as an example, and the setting of the intervention scheme is not limited thereto, and those skilled in the art can also adjust the setting of the intervention scheme according to actual needs.

[0085] Specifically, the stage adjustment module determines to evaluate the completed short-term goals of the current intervention stage in a data summary manner based on a comparison result that the number of short-term goals to which the current stage belongs is greater than or equal to a preset number of goals.

[0086] The stage adjustment module determines to evaluate the completed short-term goals of the current intervention stage in a single data manner based on a comparison result that the number of short-term goals to which the current stage belongs is less than the preset number of goals.

[0087] Specifically, the preset number of goals is 2.

[0088] Specifically, the stage adjustment module determines the completed short-term goals to be cumulative goals based on a comparison result that the completed short-term goals are of the same attribute under the condition of determining to evaluate the completed short-term goals of the current intervention stage in a data summary manner, to determine a cumulative value of the cumulative goals.

[0089] The completed short-term goals are determined to be non-cumulative goals based on a comparison result that the completed short-term goals are not of the same attribute.

[0090] Specifically, whether or not the same attribute is determined according to the specific circumstances of the short-term goals, for example, the short-term goals are to identify apples, identify pears, identify red, and identify spoons, then the short-term goals of identifying apples and identifying pears are of the same fruit attribute, and the short-term goals of identifying red and identifying spoons are not of the same attribute, the short-term goals of the same attribute are determined to be cumulative goals, and the number of short-term goals is determined to be a cumulative value.

[0091] Specifically, the stage adjustment module determines the adjustment mode for the current intervention stage based on the cumulative value to be promotion, rollback, or unchanged.

[0092] The stage adjustment module determines the adjustment mode for the current intervention stage to be rollback or promotion based on a mean value of the accuracy rates of each intervention strategy to which the short-term goals belong under the condition of determining the short-term goals to be non-cumulative goals.

[0093] In a specific implementation, the stage adjustment module determines the adjustment mode for the current intervention stage based on the cumulative value, wherein,

[0094] The stage adjustment module determines a mode value of the accuracy rates of a plurality of the intervention strategies for a single cumulative goal under the condition that the cumulative value is greater than or equal to a preset cumulative value, to determine a mean value of mode values of a plurality of the cumulative goals based on the mode values of the accuracy rates.

[0095] The intervention stage is determined to be promoted based on a comparison result that the mean value of the mode values is greater than or equal to a first preset mean value.

[0096] determining that the intervention stage is not changed based on a comparison result that the mode mean value is less than the first preset mean value and greater than or equal to a second preset mean value;

[0097] determining to rollback the intervention stage based on a comparison result that the mode mean value is less than the second preset mean value.

[0098] In a specific implementation, the stage adjustment module determines an adjustment mode for the current intervention stage according to a mean value of the accuracy rates of the intervention strategies to which the short-term target belongs, on a condition that the short-term target is determined to be a non-accumulative target.

[0099] The stage adjustment module determines to promote the intervention stage of the child based on a comparison result that the mean value of the accuracy rates is greater than or equal to a third preset mean value.

[0100] The stage adjustment module determines to rollback the intervention stage based on a comparison result that the mean value of the accuracy rates is less than the third preset mean value.

[0101] It can be understood that, in the adjustment mode for the current intervention stage, rollback is to return to an adjacent level intervention stage with a lower stage level, no change is to keep the current intervention stage unchanged, and promotion is to promote to an adjacent level intervention stage with a higher stage level.

[0102] Specifically, the preset accumulation value is 2.

[0103] Specifically, the first preset mean value, the second preset mean value, and the third preset mean value are determined according to a historical intervention process, the first preset mean value is set to a range of [70%, 80%], and is preferably 75% in the embodiments of the present application, the second preset mean value is set to a range of [55%, 65%], and is preferably 60% in the embodiments of the present application, and the third preset mean value is set to a range of [75%, 85%], and is preferably 80% in the embodiments of the present application.

[0104] Specifically, when a plurality of determination results exist in the analysis of a single intervention stage, the adjustment mode for the intervention stage is determined according to the following table:

[0105] Lift Invar Backoff Lift Lift Lift Invar Backoff Invar Backoff Backoff

[0106] Specifically, the stage adjustment module determines to replace the short-term target based on a determination result that a first quantity proportion of the short-term targets completed under the current intervention stage is greater than or equal to a first preset proportion, on a condition that the current intervention stage is determined to be unchanged.

[0107] The stage adjustment module determines to continue the short-term target and replace the intervention strategy of the short-term target based on a determination result that the first quantity proportion is less than the first preset proportion.

[0108] Specifically, the first preset percentage is determined based on the historical intervention process, and the value range is set to [80%, 90%], with 90% being preferred in this embodiment of the invention.

[0109] Specifically, the short-term goal adjustment module determines to increase the current intervention stage based on a comparison result that the second quantity ratio of completed short-term goals under the current intervention project is greater than or equal to the second preset ratio.

[0110] The short-term target adjustment module determines to replace the short-term target based on the comparison result that the second quantity percentage is less than the second preset percentage.

[0111] Specifically, the second preset percentage is determined based on the historical intervention process, and the value range is set to [75%, 80%], with 78% being preferred in this embodiment of the invention.

[0112] Specifically, the intervention control center also includes an intervention verification module, which is used to determine the adjustment of the first preset accuracy rate and the second preset accuracy rate based on the development trend of the pass rate over several execution cycles.

[0113] Specifically, the specific division of the execution cycle can be determined based on time. For example, the execution cycle can be determined to be 1 month, but no specific limitation is made.

[0114] Specifically, the pass rate of an execution cycle is the ratio of the number of intervention strategies with a success rate greater than or equal to the first preset success rate among all intervention strategies included in a single execution cycle to the total number of intervention strategies.

[0115] Specifically, the intervention verification module establishes a pass rate curve for several execution cycles and determines the mean difference between the pass rates of two adjacent data points on the pass rate curve. Based on the comparison result that the mean difference is greater than the preset mean, it determines to reduce the first preset accuracy rate.

[0116] Based on the comparison result that the mean difference is equal to the preset mean, it is determined that the first preset accuracy rate and the second preset accuracy rate will not be adjusted.

[0117] Based on the comparison result that the mean difference is less than the preset mean, it is determined to increase the second preset accuracy adjustment.

[0118] Specifically, the intervention verification module reduces the first preset accuracy rate based on the first mean difference, wherein,

[0119] The intervention verification module subtracts the preset mean value from the difference mean value to obtain a first mean difference, determines to reduce the first preset accuracy rate by a first adjustment coefficient based on a comparison result that the first mean difference is greater than or equal to a preset mean difference, and determines to reduce the first preset accuracy rate by a second adjustment coefficient based on a comparison result that the first mean difference is less than the preset mean difference.

[0120] Specifically, the intervention verification module increases the second preset accuracy rate according to a second mean difference, wherein,

[0121] The intervention verification module subtracts the preset mean value from the difference mean value to obtain a second mean difference, determines to increase the second preset accuracy rate by a third adjustment coefficient based on a comparison result that the second mean difference is greater than or equal to a preset mean difference, and determines to increase the second preset accuracy rate by a fourth adjustment coefficient based on a comparison result that the second mean difference is less than the preset mean difference.

[0122] Specifically, the preset mean value is 0, the value of the preset mean difference is determined according to a historical intervention process, the value range is set to [0.2, 0.5], and the embodiment of the present application preferably 0.3; the value range of the first adjustment coefficient is set to [0.84, 0.88], and the embodiment of the present application preferably 0.85; the value range of the second adjustment coefficient is set to [0.89, 0.93], and the embodiment of the present application preferably 0.9; the value range of the third adjustment coefficient is set to [1.1, 1.19], and the embodiment of the present application preferably 1.15; and the value range of the second adjustment coefficient is set to [1.05, 1.09], and the embodiment of the present application preferably 1.05.

[0123] Referring to Figure 4 The figure is a flowchart of the mixed reality evaluation intervention method for child development disorders according to the embodiment of the present application.

[0124] The mixed reality evaluation intervention method for child development disorders according to the embodiment of the present application comprises:

[0125] Step S1, collecting a plurality of first accuracy rates and expression behavior video data of a child performing an intervention scheme based on mixed reality, to correct the corresponding first accuracy rate to obtain a second accuracy rate based on the expression behavior video data, and to determine an adjustment intervention strategy, a short-term goal or an intervention stage based on the second accuracy rate;

[0126] Step S2, under the condition of determining to adjust the intervention strategy, determining to promote the strategy level or replace the intervention strategy based on the strategy level of the current intervention strategy;

[0127] Step S3, in the condition of determining to adjust the intervention stage, determining the evaluation mode of the short-term target based on the first number of the short-term target to which the current intervention stage belongs to determine the adjustment strategy for the current stage, and in the condition of determining that the current intervention stage is unchanged, replacing the short-term target based on the first number of the short-term target that has been completed under the current intervention project;

[0128] Step S4, in the condition of determining to adjust the short-term target, determining to replace the short-term target or promote the intervention stage based on the second number of the short-term target that has been completed under the current intervention project;

[0129] Step S5, obtaining the development trend of the qualified rate of a plurality of execution cycles to adjust the judgment benchmark of the intervention level;

[0130] The intervention level includes an intervention strategy, a short-term target or an intervention stage.

[0131] The mixed reality evaluation intervention system for child development disorders in the embodiment of the application can be integrated in a chip, the chip is placed in a plush toy to achieve the purpose of evaluation intervention on children with development disorders, a miniature camera can be embedded in the eyes of the plush toy, each sensor can be sewn on the limbs, the chip is connected with the miniature camera and each sensor, the behavior and physiological data of the child are collected in real time, the chip drives a miniature projector or a transparent screen, such as a HoloLens principle, virtual elements, such as 3D fruit projection, are superimposed on the surface of the toy, the child is guided to complete virtual tasks, and a personalized training scheme is generated according to the real-time data of each sensor, at the same time, a parent terminal APP can push a training report, and a therapist can remotely adjust intervention parameters, such as adjusting the complexity of the virtual scene. The children with development disorders are interacted with the toy, the “laboratory effect” of traditional evaluation can be eliminated, the children are tested in a game without pressure, the data authenticity is improved, the natural behavior is recorded continuously, the evaluation is more comprehensive than clinical evaluation, and the chip integration scheme replaces high-priced MR equipment, so that family intervention becomes possible.

[0132] So far, the technical solutions of the application have been described in combination with the preferred embodiments shown in the drawings, but those skilled in the art can easily understand that the protection scope of the application is obviously not limited to these specific embodiments. Those skilled in the art can make equivalent changes or replacements to related technical features without departing from the principles of the application, and the technical solutions after the changes or replacements will fall within the protection scope of the application.

Claims

1. A mixed reality assessment and intervention system for developmental disorders in children, characterized in that, include: The data acquisition module is used to collect several first-time accuracy and facial expression behavior video data of children implementing intervention programs based on mixed reality; An intervention control center, connected to the data acquisition module, includes, The intervention program analysis module is used to correct the corresponding first accuracy rate based on the focus representation parameters of the facial expression behavior video data to obtain a second accuracy rate. An intervention program execution module is used to determine the adjustment intervention strategy, short-term goal, or intervention phase based on the second accuracy rate; The strategy adjustment module is used to determine whether to upgrade the strategy level or replace the intervention strategy based on the current strategy level. The phase adjustment module is used to determine the evaluation method of the short-term objectives based on the first quantity of the short-term objectives to which the current intervention phase belongs, to determine the adjustment strategy for the current phase, and to replace the short-term objectives based on the first quantity percentage of the short-term objectives that have been completed under the current intervention phase, while ensuring that the current intervention phase remains unchanged. The short-term goal adjustment module is used to determine whether to replace the short-term goal or upgrade the intervention stage based on the second quantity percentage of the short-term goals already completed under the current intervention project. The module invokes the strategy adjustment module in response to conditions for adjusting the intervention strategy, or the phase adjustment module in response to conditions for adjusting the intervention phase, or the short-term goal adjustment module in response to conditions for adjusting the short-term goal.

2. The mixed reality assessment and intervention system for developmental disorders in children according to claim 1, characterized in that, The intervention scheme analysis module sets several accuracy correction coefficients based on the comparison results between the focus representation parameters and the preset focus representation parameters, so as to correct the first accuracy according to the several accuracy correction coefficients.

3. The mixed reality assessment and intervention system for developmental disorders in children according to claim 2, characterized in that, The intervention program execution module determines to adjust the intervention stage based on the comparison result of the number of consecutive times that the second accuracy rate is greater than or equal to the first preset accuracy rate is greater than or equal to a preset number; The intervention plan execution module determines to adjust the short-term goal based on the comparison result that the number of consecutive times the second accuracy rate is greater than or equal to the first preset accuracy rate is less than the preset number; The intervention plan execution module determines to adjust the intervention strategy based on the comparison result that the second accuracy rate is less than the second preset accuracy rate; The second preset accuracy rate is less than the first preset accuracy rate.

4. The mixed reality assessment and intervention system for developmental disorders in children according to claim 3, characterized in that, The strategy adjustment module determines to change the intervention strategy based on the determination that the current intervention strategy has the highest level. The strategy adjustment module determines to raise the strategy level of the intervention strategy based on the determination that the current intervention strategy's strategy level is not the highest level. The method to upgrade the strategy level is to switch to an intervention scenario with a higher real-time complexity than the current intervention scenario.

5. The mixed reality assessment and intervention system for developmental disorders in children according to claim 4, characterized in that, The phase adjustment module determines the completed short-term objectives of the current intervention phase by summarizing data, based on the comparison result that the first number of the short-term objectives to which the current phase belongs is greater than or equal to the preset number of objectives. The phase adjustment module determines, based on a comparison result that the first number of short-term goals to which the current phase belongs is less than the preset number of goals, to evaluate the completed short-term goals to which the current intervention phase belongs in the form of individual data.

6. The mixed reality assessment and intervention system for developmental disorders in children according to claim 5, characterized in that, The phase adjustment module, under the condition that the completed short-term goals of the current intervention phase are evaluated by data aggregation, determines the short-term goals as cumulative goals based on the comparison results of the completed short-term goals having the same attribute, determines the cumulative value of the cumulative goals, and determines the adjustment method for the current intervention phase as improvement, regression, or no change based on the cumulative value.

7. The mixed reality assessment and intervention system for developmental disorders in children according to claim 6, characterized in that, Under the condition that the current intervention stage remains unchanged, the stage adjustment module determines to replace the short-term target based on the determination result that the first quantity percentage of the short-term targets completed under the current intervention stage is greater than or equal to the first preset percentage.

8. The mixed reality assessment and intervention system for developmental disorders in children according to claim 7, characterized in that, The short-term goal adjustment module determines to increase the current intervention stage based on a comparison result that the second quantity ratio of completed short-term goals under the current intervention project is greater than or equal to the second preset ratio; The short-term target adjustment module determines to replace the short-term target based on the comparison result that the second quantity percentage is less than the second preset percentage.

9. The mixed reality assessment and intervention system for developmental disorders in children according to claim 8, characterized in that, The intervention control center also includes an intervention verification module, which is used to determine the adjustment of the first preset accuracy rate and the second preset accuracy rate based on the development trend of the pass rate over several execution cycles.

10. A method for mixed reality assessment and intervention of developmental disorders in children using the mixed reality assessment and intervention system for developmental disorders according to any one of claims 1-9, characterized in that, include: Collect several first accuracy rates and facial expression and behavior video data of children implementing intervention programs based on mixed reality, correct the corresponding first accuracy rates with attention representation parameters based on the facial expression and behavior video data to obtain second accuracy rates, and determine the adjustment intervention strategy, short-term goals or intervention stages based on the second accuracy rates; If it is determined that the intervention strategy should be adjusted, then the strategy level should be increased or the intervention strategy should be changed based on the current strategy level. Under the condition of determining to adjust the intervention stage, the evaluation method of the short-term goals is determined based on the first number of short-term goals to which the current intervention stage belongs, and the adjustment strategy for the current stage is determined. Under the condition of determining that the current intervention stage remains unchanged, the short-term goals are replaced based on the first number of short-term goals completed under the current intervention stage. Under the condition of adjusting the short-term goal, the decision to replace the short-term goal or upgrade the intervention stage is made based on the second percentage of the short-term goals already completed under the current intervention project. To obtain the development trend of the pass rate over several execution cycles in order to adjust the judgment criteria for the intervention level; The intervention levels include intervention strategies, short-term goals, or intervention phases.

Images