Man-machine interaction system and method for visual attention range of developmental reading disorder

Abstract

The invention discloses a man-machine interaction system and method for visual attention breadth of developmental reading disorder. The man-machine interaction system comprises an information collection unit used for system login and user registration; the task description unit is connected with the information collection unit and is used for rule description; the parameter configuration unit is connected with the task description unit and is used for configuring man-machine interaction tasks with different difficulties; the task interaction unit is connected with the parameter configuration unit so as to perform man-machine interaction with a user based on man-machine interaction tasks with different difficulties; the difficulty adjusting unit is connected with the task interaction unit so as to dynamically adjust the task difficulty in the user interaction process; and a feedback unit. And the man-machine interaction unit is connected with the task interaction unit so as to obtain man-machine interaction data of the man-machine interaction task completed by the user and feed back an interaction result to the user.

Description

Technical Field

[0001] The invention relates to a human-computer interaction system for visual attention span of developmental dyslexia, and also relates to a corresponding human-computer interaction method, belonging to the technical field of human-computer interaction. Background Art

[0002] Developmental Dyslexia is a learning disability that affects an individual's performance in learning areas such as reading and spelling. Even with normal intelligence, an appropriate learning environment, and no other neurological or psychiatric disorders, approximately 5% to 15% of school-age children will still experience this disorder. These children have difficulty reaching a reading level commensurate with their intelligence and age. The development of reading ability begins with basic visual processing, which requires readers to be able to quickly and accurately recognize and decode multiple words. In recent years, researchers have paid more and more attention to the visual processing level, especially the role of visual attention span in dyslexia.

[0003] Visual attention span is a basic ability of visual processing. It refers to an individual's ability to process multiple visual stimuli at the same time, reflecting the speed and parallelism of processing visual elements. Children with developmental dyslexia often have defects in visual attention span, which causes them to have abnormal eye movements when reading text, thus hindering the rapid decoding of text and reducing reading efficiency. A 2007 study first proposed the hypothesis of visual attention span deficiency, believing that this is the core problem of developmental dyslexia. The results of the study showed that compared with normal readers of the same age, children with developmental dyslexia performed significantly worse in visual attention span tasks, and this defect still existed after excluding the influence of language factors, and may be aggravated with age.

[0004] Chinese patent application CN115273606A discloses a visual-motor integrated reading training system. The system improves reading skills by copying and drawing. The training includes three stages: pre-test, training and post-test. Users need to copy and draw graphics of gradually increasing complexity. The training effect is evaluated by a seven-point Likert scale. Although the existing intervention technologies represented by the above patent applications have achieved certain results, there are still some challenges. First, there is a scarcity of measurement and intervention technology products for visual attention span defects, and there is a lack of mature technical support. Secondly, many intervention programs require professional instruments, which limits their application in non-laboratory environments such as homes and schools. In addition, existing intervention measures usually require long-term training, which places high demands on children's patience and continuous participation, and children's attention and interest may be difficult to maintain for a long time. Finally, there are individual differences in the intervention effect, and the effect may be limited for some children, which requires the intervention program to be more personalized and flexible. Summary of the invention

[0005] The primary technical problem to be solved by the present invention is to provide a human-computer interaction system for visual attention span of developmental dyslexia.

[0006] Another technical problem to be solved by the present invention is to provide a human-computer interaction method for visual attention span of developmental dyslexia.

[0007] In order to achieve the above technical objectives, the present invention adopts the following technical solutions:

[0008] According to a first aspect of an embodiment of the present invention, a human-computer interaction system for visual attention span of developmental dyslexia is provided, comprising:

[0009] An information collection unit, used to obtain the user's personal information and store it in a user database;

[0010] A task description unit, connected to the information collection unit, for presenting tasks and describing rules for preset human-computer interaction tasks;

[0011] A parameter configuration unit, connected to the task description unit and having a preset element library and a preset rule library, for configuring human-computer interaction tasks of different difficulty levels for the user; wherein the preset element library at least includes a plurality of cards and a plurality of patterns; and the preset rule library at least includes a difficulty level, a number of cards, a card position, and a pattern randomly distributed on the card;

[0012] a task interaction unit connected to the parameter configuration unit to perform human-computer interaction with the user based on the human-computer interaction tasks of different difficulty levels; wherein the human-computer interaction task is configured to present a random number of cards at random positions of the observation interface, and a pattern is randomly distributed on each card, requiring the user to select all cards with a specific pattern; the specific pattern is one of the multiple patterns;

[0013] A difficulty adjustment unit, connected to the task interaction unit, for obtaining the user's behavioral response data of human-computer interaction and dynamically adjusting the task difficulty based on the behavioral response data;

[0014] A feedback unit is connected to the task interaction unit to obtain the human-computer interaction data of the user completing the human-computer interaction task and to feed back the interaction result to the user.

[0015] Preferably, the difficulty adjustment unit includes:

[0016] A first difficulty adjustment module is connected to the task interaction unit to dynamically adjust the task difficulty according to a first difficulty adjustment range based on the behavioral response data of the user performing human-computer interaction; wherein, in the first difficulty adjustment module, the user's change from difficulty reduction to difficulty increase is set as difficulty reversal;

[0017] A second difficulty adjustment module, connected to the first difficulty adjustment module, dynamically adjusts the task difficulty according to a second difficulty adjustment range based on the behavioral response data of the user performing human-computer interaction;

[0018] Among them, the first difficulty adjustment range is greater than the second difficulty adjustment range; at the beginning of human-computer interaction, the task difficulty is dynamically adjusted through the first difficulty adjustment module, and after two difficulty reversals, the task difficulty is dynamically adjusted through the second adjustment module.

[0019] Preferably, in the first difficulty adjustment module, if the user answers three questions correctly in a row, the task difficulty increases by two levels; if the user answers one question incorrectly, the task difficulty decreases by two levels;

[0020] In the second difficulty adjustment module, if the user answers three questions correctly in a row, the task difficulty increases by one level; if the user answers a question incorrectly, the task difficulty decreases by one level.

[0021] Preferably, a task trial of the human-computer interaction task is configured in the following manner:

[0022] Obtaining an initial difficulty of the task based on the personal information of the user;

[0023] Based on the initial difficulty of the task, randomly extracting a preset number of card positions from the preset rule library;

[0024] Extracting a corresponding number of cards from the preset element library to present each card at each card position;

[0025] A plurality of patterns are randomly selected from the preset element library, and a pattern is randomly distributed on each card, so that the user is required to select all cards with a specific pattern within a preset time.

[0026] Preferably, if the user is a new user, the parameter configuration unit configures the initial difficulty level n1 of the human-computer interaction task to be level 1;

[0027] If the user is a historical user, the parameter configuration unit determines the initial difficulty level n1 of this human-computer interaction based on the final difficulty n0 of the user's last interaction; wherein, if 1≤n0<a, then n1=n0; if a≤n0<b, then n1=n0-1; if b≤n0<c, then n1=n0-2, and a, b, and c represent three different preset difficulty levels.

[0028] Preferably, the card sizes, display times, and number of cards corresponding to human-computer interaction tasks of different difficulty levels are different;

[0029] Among them, the smaller the card, the higher the difficulty; the shorter the display time, the higher the difficulty; the more cards there are, the higher the difficulty.

[0030] Preferably, the plurality of patterns include at least letters, Chinese characters, numbers and graphics.

[0031] Preferably, the human-computer interaction system is an APP installed on an electronic device or an accessible website set on a browser.

[0032] According to a second aspect of an embodiment of the present invention, a human-computer interaction method for visual attention span of developmental dyslexia is provided, comprising the following steps:

[0033] Obtain user's personal information and store it in the user database;

[0034] Based on a preset human-computer interaction task, presenting tasks and explaining rules to the user;

[0035] Based on the personal information of the user, configuring a human-computer interaction task of initial difficulty for the user through a parameter configuration unit;

[0036] Pushing the human-computer interaction task of the initial difficulty to the user for human-computer interaction, so as to obtain the human-computer interaction result of the user;

[0037] During the process of the user performing human-computer interaction, obtaining the user's behavioral response data of the human-computer interaction, so as to dynamically adjust the task difficulty through the difficulty adjustment unit until a preset duration is reached;

[0038] Feedback the interaction result of this human-computer interaction to the user.

[0039] Preferably, when the human-computer interaction starts, the task difficulty is dynamically adjusted through the first difficulty adjustment module; wherein, in the first difficulty adjustment module, if the user answers three questions correctly in a row, the task difficulty increases by two levels; if the user answers one question incorrectly, the task difficulty decreases by two levels; and the user's change from difficulty decrease to difficulty increase is set as difficulty reversal;

[0040] After the user has experienced two difficulty reversals, the task difficulty is dynamically adjusted through the second difficulty adjustment module; wherein, in the second difficulty adjustment module, if the user answers three questions correctly in a row, the task difficulty increases by one level; if the user answers a question incorrectly, the task difficulty decreases by one level.

[0041] Compared with the prior art, the present invention has the following technical effects:

[0042] (1) Starting from the intervention of perceptual deficits in developmental dyslexia, focusing on the intervention of children's visual attention span related abilities, according to the classical psychology research paradigm, ensure that the designed visual attention span classification interaction system is effective and scientific.

[0043] (2) The human-computer interaction system can be presented in the form of an APP or website, and can be adapted to conventional electronic devices on the market, making the interaction easy to access. This not only facilitates parents and doctors to conduct remote real-time monitoring, but also allows children to interact anytime and anywhere without being restricted by time and place. As a result, the flexibility and efficiency of the interaction are significantly improved, providing great convenience for clinical intervention of dyslexia.

[0044] (3) Human-computer interaction tasks include both non-verbal symbols and verbal text materials, which is richer and more inclusive than those interaction methods that rely solely on text materials. In addition, the use of interesting and easy-to-use methods is easier for users to understand and operate, thus effectively improving children's acceptance of interaction.

[0045] (4) The interaction difficulty is automatically adjusted according to the user's performance parameters such as accuracy, and the first difficulty adjustment module and the second difficulty adjustment module respectively adjust the difficulty at different interaction stages. Thus, the human-computer interaction system can be applied to children with reading disabilities at different reading levels, thereby improving the practicality and adaptability of the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] Figure 1 A structural diagram of a human-computer interaction system for visual attention span of developmental dyslexia provided by the first embodiment of the present invention;

[0047] Figure 2 An overall flow chart of a human-computer interaction method for visual attention span of developmental dyslexia provided by the second embodiment of the present invention;

[0048] Figure 3 This is a detailed flow chart of a human-computer interaction method for visual attention span of developmental dyslexia provided in the second embodiment of the present invention. DETAILED DESCRIPTION

[0049] The technical content of the present invention is described in detail below with reference to the accompanying drawings and specific embodiments.

[0050] The technical concept of the embodiment of the present invention is to intervene in the visual attention span defect of children with developmental dyslexia based on the visual processing perspective in basic cognitive processing by combining verbal and non-linguistic materials. On this theoretical basis, the embodiment of the present invention designs a complete human-computer interaction system, which is derived from the classic local reporting method. After the screen presents stimulus materials of a specific duration (e.g., 1000ms or 800ms), the number of times the specified material appears is selected according to requirements, which is used to examine the visual attention span of an individual within a rapid fixation time range, and improve their visual processing ability, reading speed and fluency through continuous practice.

[0051] In addition, the human-computer interaction system provided by the embodiment of the present invention can provide users with a convenient and interesting interaction method using general electronic devices and computer software, allowing them to practice at any time and place, thereby simplifying the interaction process and enhancing the attractiveness of cognitive interaction to children. In addition, the difficulty of the interactive content can be dynamically adjusted by modifying the relevant parameter settings according to the individual differences of the users, which not only enhances the adaptability of the interaction, but also significantly improves its practicality.

[0052] First embodiment

[0053] like Figure 1 As shown, a human-computer interaction system for visual attention span of developmental dyslexia provided by the first embodiment of the present invention includes an information collection unit 1, a task description unit 2, a parameter configuration unit 3, a task interaction unit 4, a difficulty adjustment unit 5 and a feedback unit 6. Among them, the information collection unit 1 is used to collect user information. The task description unit 2 is connected to the information collection unit 1, and is used to present tasks and explain rules for preset human-computer interaction tasks. The parameter configuration unit 3 is connected to the task description unit 2 and has a preset element library and a preset rule library, which are used to configure human-computer interaction tasks of different difficulties for users. The task interaction unit 4 is connected to the parameter configuration unit 3 to perform human-computer interaction with users based on human-computer interaction tasks of different difficulties. The difficulty adjustment unit 5 is connected to the task interaction unit 4 to dynamically adjust the task difficulty during the user interaction process. The feedback unit 6 is connected to the task interaction unit 4 to obtain the human-computer interaction data of the user completing the human-computer interaction task, and feedback the interaction results to the user.

[0054] Below, each functional unit of the human-computer interaction system is described in detail:

[0055] 1. Information Collection Unit

[0056] In this embodiment, when a user logs into the system, the information collection unit 1 is used to collect basic information such as the user's age, gender, years of education, etc. and store them in the user database to form a unique user portrait for the user and use it for subsequent system logins. If the user has completed registration and information collection, the user can directly log in to the account.

[0057] 2. Mission Description Unit

[0058] In this embodiment, the task description unit 2 is used to present the task and describe the rules of the preset human-computer interaction task. The specific process is as follows:

[0059] The first step is to present the task homepage. The homepage introduces the task name "Instant Cards", the scientific principle and introduction of the task "Visual attention span task is one of the core tasks for training reading processing speed. Through continuous training, it will greatly improve children's reading ability and speed" and clinical evidence, etc. At the same time, the task picture and the "Start" button are displayed. Users can click the "Start" button to proceed to the next step.

[0060] The second step is to enter the task introduction page. The element diagram description rules are presented. The element diagram includes two elements, one element is the text description presented at the top of the screen, and the other element is the stimulus presentation diagram presented at the bottom of the screen. Specifically, it is divided into the following two steps:

[0061] (1) Present a number of cards with random positions and numbers, letters, Chinese characters, and numbers on them, and a text instruction: "Quickly observe the patterns on all the cards";

[0062] (2) Presenting task requirements and feedback images: The task requirement is “how many cards with numbers (or letters, or Chinese characters) are there?” and a number of cards appear below. The user selects the corresponding number on the card to answer the question.

[0063] At the same time, the "←", "→", "Start", and "Back" keys are always present in the interface. "←" means returning to the previous interface, "→" means entering the next interface, "Back" means returning to the task homepage, and "Start" means that the user has understood the rules and is ready to enter the task interaction unit 3 to start human-computer interaction.

[0064] In addition, in the information collection unit 1, if the user is a new user, after completing the information collection, the user enters the task description unit 2 for task description, until the user understands the rules and enters the task interaction unit 3 to start human-computer interaction. If the user is a historical user, after completing the information collection, the user skips the task description unit 2 and directly enters the task interaction unit 4 to start human-computer interaction. In addition, a "Help" button will be presented in the task interaction interface. The user can click the "Help" button to pause the task and return to the task description unit to continue learning the rules. At the same time, the "Start" button will be displayed as "Continue". When the user understands the rules, click the "Continue" button to enter the task interaction unit 3 again to start human-computer interaction.

[0065] 3. Parameter Configuration Unit

[0066] In this embodiment, the parameter configuration unit 3 has a preset element library and a preset rule library, which are used to configure human-computer interaction tasks of different difficulty levels for users. The preset element library includes at least multiple cards and multiple patterns; the preset rule library includes at least difficulty level, number of cards, card position, and a pattern randomly distributed on the card.

[0067] The following is a detailed description of the configuration process of a task trial of the human-computer interaction task:

[0068] ① Obtain the initial difficulty of the task based on the user’s personal information.

[0069] The card display radius, display time, and number of cards are set according to the difficulty configuration table. There are c difficulty levels in the difficulty configuration table, and the specific setting rules are as follows: (1) display time t; (2) card angle A; (3) display radius r; (4) number of cards m.

[0070] ②Based on the initial difficulty of the task, randomly select a preset number of card positions from the preset rule library.

[0071] ③ Draw a corresponding number of cards from the preset element library to present each card in each card position.

[0072] ④ Randomly select multiple patterns from the preset element library and randomly distribute a pattern on each card, requiring the user to select all cards with a specific pattern within the display time t.

[0073] In this embodiment, a human-computer interaction task includes multiple task trials (for example, 3, 4, 5 or more), and each task trial is configured through the above steps ①-④ to be configured into the final human-computer interaction task.

[0074] 4. Task Interaction Unit

[0075] In this embodiment, the task interaction unit 4 is connected to the parameter configuration unit 3 to perform human-computer interaction with the user based on human-computer interaction tasks of different difficulty levels. Among them, a task trial of the human-computer interaction task is configured to present a random number of cards at a random position of the observation interface, and a pattern is randomly distributed on each card, requiring the user to select all cards with a specific pattern. The specific pattern is one of multiple patterns.

[0076] Specifically, when the user enters the task interaction unit 4, the human-computer interaction is completed through the following steps:

[0077] The first step is to show the card. First, show the back of the card for t2 seconds, and then show the front of the card for t1 second.

[0078] Step 2: The user answers. After 3 seconds from the end of step 1, the user enters the answering page. After answering, the user provides feedback. The specific feedback rules are as follows: if the answer is correct, √ is displayed on the correct option, and a correct answer sound effect is played; if the answer is wrong, × is displayed on the wrong option, and a failed answer sound effect is played.

[0079] When the user completes a task trial, he / she proceeds to the next task trial for interaction until the entire human-computer interaction task is completed.

[0080] 5. Difficulty Adjustment Unit

[0081] In this embodiment, the difficulty adjustment unit 5 includes a first difficulty adjustment module 51 and a second difficulty adjustment module 52. The first difficulty adjustment module 51 is used to perform a first stage difficulty adjustment at the beginning of the task, and the second difficulty adjustment module 52 is used to perform a second stage difficulty adjustment after the task level is increased to a certain level.

[0082] Specifically, the first difficulty adjustment module 51 is connected to the task interaction unit 4 to dynamically adjust the task difficulty according to the first difficulty adjustment range based on the behavioral response data of the user performing human-computer interaction. In this embodiment, when the user starts human-computer interaction, the task difficulty is dynamically adjusted by the first difficulty adjustment module. Specifically, if the user answers 3 questions correctly in succession, the task difficulty increases by two levels; if the user answers one question incorrectly, the task difficulty decreases by two levels. In addition, the user's change from difficulty decrease to difficulty increase is set as difficulty reversal.

[0083] The second difficulty adjustment module 52 is connected to the first difficulty adjustment module 51 to dynamically adjust the task difficulty according to the second difficulty adjustment range based on the user's behavioral response data for human-computer interaction. In this embodiment, when the user undergoes two difficulty reversals during the human-computer interaction process, the task difficulty is dynamically adjusted by the second adjustment module. Specifically, if the user answers three questions correctly in a row, the task difficulty increases by one level; if the user answers one question incorrectly, the task difficulty decreases by one level.

[0084] It can be understood that in this embodiment, the first difficulty adjustment range is greater than the second difficulty adjustment range, thereby quickly determining the task difficulty level that the user can roughly cope with in the initial stage of interaction, and then dynamically adjusting the task difficulty based on the user's human-computer interaction data to adapt to the user's current ability level.

[0085] 6. Feedback Unit

[0086] In this embodiment, the difficulty level of the question and the remaining interaction time will be continuously displayed on the interface of the task interaction unit 4. After the interaction time countdown reaches 0, it enters the feedback unit 6, and the specific process of the feedback unit 6 is as follows:

[0087] The first step is to enter the interaction completion interface. The text "Complete" is displayed and the interaction end sound effect is played.

[0088] The second step is to enter the interactive settlement interface. The interface displays the score of this interaction and the user's highest score in history. The score is calculated by the average difficulty of the last eight questions in this interaction.

[0089] The third step is to record user data. The background records the user's general information, the highest score in the interaction history, the score of this interaction, the cumulative number of interactions, and the number of wrong answers and correct answers of each difficulty level in this interaction.

[0090] In the above embodiment, preferably, the human-computer interaction system is an APP installed on an electronic device or an accessible website set on a browser. Therefore, it can be adapted to conventional electronic devices on the market, and the availability of interaction is achieved, which not only facilitates parents and doctors to conduct remote real-time monitoring, but also allows children to conduct interactive exercises anytime and anywhere without being restricted by time and place.

[0091] Second embodiment

[0092] like Figure 2 and Figure 3 As shown, based on the above first embodiment, the second embodiment of the present invention provides a human-computer interaction method for visual attention span of developmental dyslexia, which specifically includes steps S1 to S6:

[0093] S1: System login.

[0094] Specifically, if the user is an initial user, a user-specific portrait is created for the user based on the user's personal information for system login, and the user information is stored in the user database.

[0095] If the user is a historical user, just log in to the system directly.

[0096] S2: Present tasks and explain rules to users based on preset human-computer interaction tasks.

[0097] Specifically, step S2 is an optional step. If the user logged in in step S1 is an initial user, then step S2 is performed to explain the rules to the user. Otherwise, if the user logged in in step S1 is a historical user, then step S2 is skipped and step S3 is performed directly to configure the task.

[0098] S3: Based on the user's personal information, the parameter configuration unit 3 configures a human-computer interaction task of initial difficulty for the user.

[0099] Specifically, in this embodiment, the parameter configuration unit 3 will retrieve the data in the user database, and then according to the data in the user database, the system will perform algorithm calculation and deployment and generate a human-computer interaction task suitable for the user level. The specific task configuration process refers to the description of the parameter configuration unit 3 in the first embodiment, which will not be repeated here.

[0100] When the algorithm is calculating, the system will determine whether the user is an initial user. If the user is an initial user, the system will retrieve the user's age, education level, and current cognitive assessment score to calculate the visual attention span ability, and then determine the initial task level based on the user's visual attention span ability.

[0101] If the user is a historical user, the above steps are omitted, and the initial difficulty level of the task of this interaction is determined based on the final difficulty at the end of the last interaction. Specifically, the initial difficulty level n1 of this human-computer interaction is determined based on the final difficulty level n0 of the user's last interaction; wherein, if 1≤n0<a, then n1=n0; if a≤n0<b, then n1=n0-1; if b≤n0<c, then n1=n0-2, a, b, c represent three different preset difficulty levels, c is the highest level, and the values ​​of a and b can be adaptively adjusted as needed.

[0102] S4: Pushing a human-computer interaction task of initial difficulty to the user for human-computer interaction to obtain the user's human-computer interaction result.

[0103] After completing the task configuration based on step S3, the user will enter the human-computer interaction unit 4 to perform human-computer interaction based on the human-computer interaction task. The specific human-computer interaction steps refer to the description of the human-computer interaction unit 4 in the first embodiment above, which will not be repeated here.

[0104] S5: During the process of human-computer interaction performed by the user, the behavioral response data of the user performing the human-computer interaction is obtained, so as to dynamically adjust the task difficulty through the difficulty adjustment unit until a preset duration is reached.

[0105] In this embodiment, during the human-computer interaction process, the difficulty adjustment unit 5 dynamically adjusts the task difficulty based on preset rules. Specifically, when the human-computer interaction begins, the task difficulty is dynamically adjusted through the first difficulty adjustment module; wherein, in the first difficulty adjustment module, if the user answers three questions correctly in a row, the task difficulty increases by two levels; if the user answers one question incorrectly, the task difficulty decreases by two levels; and the user's change from difficulty decrease to difficulty increase is set as difficulty reversal.

[0106] After the user has experienced two difficulty reversals, the task difficulty is dynamically adjusted through the second difficulty adjustment module; in the second difficulty adjustment module, if the user answers three questions correctly in a row, the task difficulty increases by one level; if the user answers a question incorrectly, the task difficulty decreases by one level.

[0107] S6: Feedback the interaction result of this human-computer interaction to the user.

[0108] Specifically, after the user completes the human-computer interaction task in the task interaction unit 4, the feedback unit 6 feeds back the interaction result of this human-computer interaction to the user, and the interaction result at least includes: the historical highest score of the interaction, the score of this interaction, the cumulative number of interactions, and the number of wrongly answered questions and the number of correctly answered questions of each difficulty level in this interaction.

[0109] In addition, the interaction result will be stored in the user database for subsequent data retrieval. When the user starts the next human-computer interaction, the final difficulty of the previous human-computer interaction is directly retrieved from the user database and adjusted as the initial difficulty of the next human-computer interaction.

[0110] In summary, the human-computer interaction system and method for visual attention span of developmental dyslexia provided by the embodiments of the present invention have the following beneficial effects:

[0111] (1) Starting from the intervention of perceptual deficits in developmental dyslexia, focusing on the intervention of children's visual attention span related abilities, according to the classical psychology research paradigm, ensure that the designed visual attention span classification interaction system is effective and scientific.

[0112] (2) The human-computer interaction system can be presented in the form of an APP or website, and can be adapted to conventional electronic devices on the market, making the interaction easy to access. This not only facilitates parents and doctors to conduct remote real-time monitoring, but also allows children to interact anytime and anywhere without being restricted by time and place. As a result, the flexibility and efficiency of the interaction are significantly improved, providing great convenience for clinical intervention of dyslexia.

[0113] (3) Human-computer interaction tasks include both non-verbal symbols and verbal text materials, which is richer and more inclusive than those interaction methods that rely solely on text materials. In addition, the use of interesting and easy-to-use methods is easier for users to understand and operate, thus effectively improving children's acceptance of interaction.

[0114] (4) The interaction difficulty is automatically adjusted according to the user's performance parameters such as accuracy, and the first difficulty adjustment module and the second difficulty adjustment module respectively adjust the difficulty at different interaction stages. Thus, the human-computer interaction system can be applied to children with reading disabilities at different reading levels, thereby improving the practicality and adaptability of the system.

[0115] It should be noted that the above embodiments are only examples, and the technical solutions of the various embodiments can be combined, all within the protection scope of the present invention.

[0116] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present invention, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0117] The above is a detailed description of the human-computer interaction system and method for visual attention span of developmental dyslexia provided by the present invention. For those skilled in the art, any obvious changes made to it without departing from the essence of the present invention will constitute an infringement of the patent right of the present invention and will bear the corresponding legal liability.

Claims

1. A human-computer interaction system for visual attention span of developmental dyslexia, characterized in that include: An information collection unit, used to obtain the user's personal information and store it in a user database; A task description unit, connected to the information collection unit, for presenting tasks and describing rules for preset human-computer interaction tasks; A parameter configuration unit, connected to the task description unit and having a preset element library and a preset rule library, for configuring human-computer interaction tasks of different difficulty levels for the user; wherein the preset element library at least includes a plurality of cards and a plurality of patterns; and the preset rule library at least includes a difficulty level, a number of cards, a card position, and a pattern randomly distributed on the card; a task interaction unit connected to the parameter configuration unit to perform human-computer interaction with the user based on the human-computer interaction tasks of different difficulty levels; wherein the human-computer interaction task is configured to present a random number of cards at random positions of the observation interface, and a pattern is randomly distributed on each card, requiring the user to select all cards with a specific pattern; the specific pattern is one of the multiple patterns; A difficulty adjustment unit, connected to the task interaction unit, for obtaining the user's behavioral response data of human-computer interaction and dynamically adjusting the task difficulty based on the behavioral response data; A feedback unit is connected to the task interaction unit to obtain the human-computer interaction data of the user completing the human-computer interaction task and to feed back the interaction result to the user.

2. The human-computer interaction system according to claim 1, characterized in that The difficulty adjustment unit comprises: A first difficulty adjustment module is connected to the task interaction unit to dynamically adjust the task difficulty according to a first difficulty adjustment range based on the behavioral response data of the user performing human-computer interaction; wherein, in the first difficulty adjustment module, the user's change from difficulty reduction to difficulty increase is set as difficulty reversal; A second difficulty adjustment module, connected to the first difficulty adjustment module, dynamically adjusts the task difficulty according to a second difficulty adjustment range based on the behavioral response data of the user performing human-computer interaction; Among them, the first difficulty adjustment range is greater than the second difficulty adjustment range; at the beginning of human-computer interaction, the task difficulty is dynamically adjusted through the first difficulty adjustment module, and after two difficulty reversals, the task difficulty is dynamically adjusted through the second adjustment module.

3. The human-computer interaction system according to claim 2, characterized in that: In the first difficulty adjustment module, if the user answers three questions correctly in a row, the task difficulty increases by two levels; if the user answers one question incorrectly, the task difficulty decreases by two levels; In the second difficulty adjustment module, if the user answers three questions correctly in a row, the task difficulty increases by one level; if the user answers a question incorrectly, the task difficulty decreases by one level.

4. The human-computer interaction system according to claim 1, characterized in that A task trial of the human-computer interaction task is configured in the following way: Obtaining an initial difficulty of the task based on the personal information of the user; Based on the initial difficulty of the task, randomly extracting a preset number of card positions from the preset rule library; Extracting a corresponding number of cards from the preset element library to present each card at each card position; A plurality of patterns are randomly selected from the preset element library, and a pattern is randomly distributed on each card, so that the user is required to select all cards with a specific pattern within a preset time.

5. The human-computer interaction system according to claim 1, characterized in that: If the user is a new user, the parameter configuration unit configures the initial difficulty level n1 of the human-computer interaction task to be level 1; If the user is a historical user, the parameter configuration unit determines the initial difficulty level n1 of this human-computer interaction based on the final difficulty n0 of the user's last interaction; wherein, if 1≤n0<a, then n1=n0; if a≤n0<b, then n1=n0-1; if b≤n0<c, then n1=n0-2, and a, b, and c represent three different preset difficulty levels.

6. The human-computer interaction system according to claim 1, characterized in that: The card sizes, display times, and number of cards corresponding to human-computer interaction tasks of different difficulty levels are different; Among them, the smaller the card, the higher the difficulty; the shorter the display time, the higher the difficulty; the more cards there are, the higher the difficulty.

7. The human-computer interaction system according to claim 1, characterized in that: The multiple patterns include at least letters, Chinese characters, numbers and graphics.

8. The human-computer interaction system according to claim 1, characterized in that: The human-computer interaction system is an APP installed on an electronic device or an accessible website set on a browser.

9. A human-computer interaction method for visual attention span of developmental dyslexia, based on the human-computer interaction system according to any one of claims 1 to 8, characterized in that include: Obtain user's personal information and store it in the user database; Based on a preset human-computer interaction task, presenting tasks and explaining rules to the user; Based on the personal information of the user, configuring a human-computer interaction task of initial difficulty for the user through a parameter configuration unit; Pushing the human-computer interaction task of the initial difficulty to the user for human-computer interaction, so as to obtain the human-computer interaction result of the user; During the process of the user performing human-computer interaction, obtaining the user's behavioral response data of the human-computer interaction, so as to dynamically adjust the task difficulty through the difficulty adjustment unit until a preset duration is reached; Feedback the interaction result of this human-computer interaction to the user.

10. The human-computer interaction method according to claim 9, characterized in that: When the human-computer interaction starts, the task difficulty is dynamically adjusted through the first difficulty adjustment module; wherein, in the first difficulty adjustment module, if the user answers three questions correctly in a row, the task difficulty increases by two levels; if the user answers one question incorrectly, the task difficulty decreases by two levels; and the user's change from difficulty decrease to difficulty increase is set as difficulty reversal; After the user has experienced two difficulty reversals, the task difficulty is dynamically adjusted through the second difficulty adjustment module; wherein, in the second difficulty adjustment module, if the user answers three questions correctly in a row, the task difficulty increases by one level; if the user answers a question incorrectly, the task difficulty decreases by one level.

Images