Work memory evaluation system and method based on visual induction

Abstract

The invention provides a work memory evaluation system and method based on visual induction, which can be applied to the technical field of neuroscience and the technical field of computer vision. The system comprises a control device which is configured to execute multiple rounds of display tasks, and the (i-1) th round of display tasks in the multiple rounds of display tasks controls a display device to display a memory array image, a gray level stimulation image and a test array image based on an (i-1) th task intensity parameter and an (i-1) th stimulation intensity parameter of the (i-1) th round of display tasks; the interaction device is configured to determine an (i-1) th feedback result in response to an (i-1) th feedback operation of the target object in an (i-1) th round display task execution process; and the evaluation device is configured to determine an (i-1) th working memory capacity evaluation result based on the (i-1) th feedback result, determine an ith task intensity parameter and an ith stimulation intensity parameter based on the (i-1) th feedback result and the (i-1) th working memory capacity evaluation result, and obtain an ith round of display task.

Description

Technical Field

[0001] The present disclosure relates to the fields of neuroscience technology and computer vision technology, and in particular to a working memory assessment system and method based on visual induction. Background Art

[0002] Working memory is a core cognitive ability that supports individuals' information storage and manipulation in complex tasks such as language comprehension, reasoning, and learning. Individuals' working memory abilities can be improved through relevant cognitive interventions and memory training. However, the inadequacy and lack of intervention methods in related technologies have resulted in a relatively single assessment of working memory abilities, which results in low assessment accuracy. Summary of the invention

[0003] In view of the above problems, the present disclosure provides a working memory assessment system and method based on visual induction.

[0004] According to a first aspect of the present disclosure, a visually induced working memory assessment system is provided, comprising: a control device configured to execute multiple rounds of display tasks, wherein the i-1th round of display tasks in the multiple rounds of display tasks is to control the display device to display a memory array image, a grayscale stimulation image, and a test array image based on the i-1th task intensity parameter and the i-1th stimulation intensity parameter of the i-1th round, wherein the task intensity parameter represents the number of color blocks in the memory array image, and the stimulation intensity parameter represents the display duration of the grayscale stimulation image introduced in the process of changing from the memory array image to the test array image, and i is a positive integer greater than 1; an interactive device configured to, during the execution of the i-1th round of display tasks, , in response to the i-1th feedback operation of the target object, determining the i-1th feedback result, wherein the feedback result represents that the target object believes that there are different color blocks between the memory array image and the test array image, or represents that the target object believes that the memory array image and the test array image are exactly the same; an evaluation device is configured to determine the i-1th working memory capacity evaluation result based on the i-1th feedback result, and to determine the i-th task intensity parameter and the i-th stimulation intensity parameter based on the i-1th feedback result and the i-1th working memory capacity evaluation result, to obtain the i-th round display task, wherein the evaluation device is further configured to determine the target working memory capacity evaluation result based on the working memory capacity evaluation results of multiple rounds of display tasks.

[0005] According to an embodiment of the present disclosure, a grayscale stimulation image is obtained based on the following operations: obtaining a color blocks from a database; removing color blocks having the same color as the color blocks in the memory array image from the a color blocks to obtain b target color blocks, where b is less than a, and a and b are both positive integers; based on a color mixing algorithm, performing color superposition processing on multiple target color blocks in the overlapping area of ​​the color blocks in the initial stimulation image to obtain a superimposed stimulation image, wherein the initial stimulation image is obtained by arranging the b target color blocks; performing grayscale conversion processing on the superimposed stimulation image to obtain a grayscale stimulation image.

[0006] According to an embodiment of the present disclosure, the i-1th round of display task includes M display subtasks, where M is a positive integer, the color distribution of color blocks in the memory array image and the test array image in the M display subtasks is determined based on the color block color change ratio parameter, the number and position of color blocks in the memory array image and the test array image in each display subtask are the same, and the i-1th feedback result includes subtask feedback results corresponding to each of the M display subtasks; determining the i-1th working memory capacity evaluation result based on the i-1th feedback result includes: determining the i-1th observation accuracy and the i-1th observation error rate corresponding to the i-1th round of display task according to the M subtask feedback results corresponding to the M display subtasks; determining the i-1th memory capacity evaluation result according to the i-1th task intensity parameter, the i-1th observation accuracy and the i-1th observation error rate.

[0007] According to an embodiment of the present disclosure, a display subtask is marked with a color block color change category label, and the color block color change category label represents whether the color blocks set at the same position in the memory array image and the test array image are the same or different; wherein, according to the M subtask feedback results corresponding to the M display subtasks, determining the i-1th observation accuracy and the i-1th observation error rate corresponding to the i-1th round display task includes: for the mth display subtask among the M display subtasks, when the color block color change category label of the mth display subtask matches the color change category represented by the subtask feedback result, determining the observation result of the mth display subtask is an observation correct result; when the color block color change category label of the mth display subtask does not match the color change category represented by the subtask feedback result, determining the observation result of the mth display subtask is an observation error result; determining the i-1th observation accuracy corresponding to the i-1th round display task according to the number of observation correct results and the number of display subtasks; determining the i-1th observation error rate corresponding to the i-1th round display task according to the number of observation error results and the number of display subtasks.

[0008] According to an embodiment of the present disclosure, a control device is configured to control a display device to display a first fixation point image, a memory array image, a second fixation point image, a clue prompt image, a third fixation point image, a grayscale stimulation image, a fourth fixation point image, and a test array image based on preset timing rules, wherein the first fixation point image is used to guide the target object to fixate on the center point of the display device, and the i-1th preset timing rule of the i-1th round of display task is determined based on the i-1th stimulation intensity parameter.

[0009] According to an embodiment of the present disclosure, when the i-1th observation accuracy corresponding to the i-1th round of display task is less than a preset accuracy threshold, or when the average color block observation reaction time corresponding to the i-1th round of display task is greater than the preset reaction threshold, the i-1th task intensity parameter is adjusted to obtain the i-1th round of display task, wherein the average color block observation reaction time is obtained based on a weighted average operation performed on the color block observation reaction times corresponding to each of the M display subtasks, and the color block observation reaction time represents the time from the start of displaying the test array image to responding to the feedback operation during the execution of the display subtask; when the i-1th observation accuracy corresponding to the i-1th round of display task is greater than or equal to the preset accuracy threshold and the average color block observation reaction time is less than or equal to the preset reaction threshold, the i-1th stimulation intensity parameter is adjusted according to the i-1th memory capacity evaluation result and the i-1th capacity threshold to obtain the i-1th round of display task, wherein the i-1th capacity threshold is determined based on the historical memory ability of the target object or the i-1th task intensity parameter.

[0010] According to an embodiment of the present disclosure, the evaluation device is configured as follows: when the i-1th memory capacity evaluation result is less than or equal to the i-1th capacity threshold, the i-1th stimulation intensity parameter is enhanced based on the adaptive adjustment mechanism to obtain the i-th stimulation intensity parameter; based on the i-th stimulation intensity parameter, the i-th round display task is determined.

[0011] According to a second aspect of the present disclosure, a method for evaluating working memory based on visual induction is provided, comprising: executing an i-1th round of display tasks, wherein the i-1th round of display tasks is to display a memory array image, a grayscale stimulation image, and a test array image to a target object based on an i-1th task intensity parameter and an i-1th stimulation intensity parameter of the i-1th round; determining an i-1th feedback result in response to an i-1th feedback operation of the target object; determining an i-1th working memory capacity evaluation result based on the i-1th feedback result; and determining an i-th task intensity parameter and an i-th stimulation intensity parameter based on the i-1th feedback result and the i-1th working memory capacity evaluation result to obtain an i-th round of display tasks.

[0012] A third aspect of the present disclosure provides an electronic device, comprising: one or more processors; and a memory for storing one or more computer programs, wherein the one or more processors execute the one or more computer programs to implement the steps of the above method.

[0013] The fourth aspect of the present disclosure further provides a computer-readable storage medium on which a computer program or instruction is stored, and the steps of the above method are implemented when the above computer program or instruction is executed by a processor.

[0014] According to the visually induced working memory assessment system and method provided by the present invention, multiple rounds of display tasks are designed to provide visual stimulation to the target object at different task intensity parameters, and the working memory capacity of the target object is quantitatively assessed based on the feedback results of the display tasks, so as to obtain relatively accurate working memory capacity assessment results, and the task intensity parameters and stimulation intensity parameters are adaptively adjusted according to the feedback results and the quantified results of the working memory capacity to design the next round of display tasks. The multi-display task design and dynamic adjustment of the task intensity parameters and stimulation intensity parameters overcome the limitations of the traditional single memory task assessment, and are conducive to a comprehensive and accurate assessment of the working memory performance of an individual to comprehensively assess the working memory capacity of the target object, effectively improve the working memory ability under high-load working conditions, and provide a new technical means for cognitive intervention. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] The above and other objects, features and advantages of the present disclosure will become more apparent through the following description of the embodiments of the present disclosure with reference to the accompanying drawings.

[0016] Figure 1 A schematic diagram of a working memory assessment system based on visual induction according to an embodiment of the present disclosure is shown.

[0017] Figure 2 A flowchart of a working memory assessment method based on visual induction according to an embodiment of the present disclosure is shown.

[0018] Figure 3A Schematic diagrams of Experiment 1-A and Experiment 1-B according to an embodiment of the present disclosure are shown.

[0019] Figure 3B Schematic diagrams of Experiment 2-A and Experiment 2-B according to an embodiment of the present disclosure are shown.

[0020] Figure 4 A block diagram of an electronic device suitable for implementing a working memory assessment method based on visual induction according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0021] Hereinafter, embodiments according to the present disclosure will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the present disclosure. In the following detailed description, for ease of explanation, many specific details are set forth to provide a comprehensive understanding of the embodiments of the present disclosure. However, it is apparent that one or more embodiments may also be implemented without these specific details. In addition, in the following description, descriptions of known structures and technologies are omitted to avoid unnecessary confusion of the concepts of the present disclosure.

[0022] The terms used herein are only for describing specific embodiments and are not intended to limit the present disclosure. The terms "comprise", "include", etc. used herein indicate the existence of features, steps, operations and / or components, but do not exclude the existence or addition of one or more other features, steps, operations or components.

[0023] All terms (including technical and scientific terms) used herein have the meanings commonly understood by those skilled in the art unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification and should not be interpreted in an idealized or overly rigid manner.

[0024] When using expressions such as "at least one of A, B, and C, etc.", they should generally be interpreted according to the meaning of the expression commonly understood by those skilled in the art (for example, "a system having at least one of A, B, and C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.).

[0025] In the process of implementing the present disclosure, it is found that working memory is a core cognitive ability that supports individuals in storing and manipulating information in complex tasks such as language comprehension, reasoning, and learning. The working memory ability of an individual can be improved through relevant cognitive intervention and memory training. However, the insufficiency and lack of intervention methods in related technologies result in a relatively single assessment of working memory ability, which leads to low assessment accuracy.

[0026] In view of this, according to an embodiment of the present disclosure, a system and method for evaluating working memory based on visual induction are provided. The system includes: a control device configured to perform multiple rounds of display tasks, wherein the i-1th round of display tasks in the multiple rounds of display tasks is to control the display device to display memory array images, grayscale stimulation images, and test array images based on the i-1th task intensity parameter and the i-1th stimulation intensity parameter of the i-1th round; an interactive device configured to determine the i-1th feedback result in response to the i-1th feedback operation of the target object during the execution of the i-1th round of display tasks; an evaluation device configured to determine the i-1th working memory capacity evaluation result based on the i-1th feedback result, and to determine the i-th task intensity parameter and the i-th stimulation intensity parameter based on the i-1th feedback result and the i-1th working memory capacity evaluation result, so as to obtain the i-th round of display tasks.

[0027] In the technical solution of the present disclosure, the user information (including but not limited to user personal information, user image information, user device information, such as location information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved are all information and data authorized by the user or fully authorized by all parties, and the collection, storage, use, processing, transmission, provision, disclosure and application of the relevant data comply with relevant laws, regulations and standards, take necessary confidentiality measures, do not violate public order and good morals, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0028] It should be noted that the sequence numbers of the operations in the following method are only used as representations of the operations for the purpose of description, and should not be regarded as representing the execution order of the operations. Unless explicitly stated, the method does not need to be executed completely in the order shown.

[0029] Figure 1 A schematic diagram of a working memory assessment system based on visual induction according to an embodiment of the present disclosure is shown.

[0030] like Figure 1As shown, the visually induced working memory assessment system 100 of this embodiment includes a control device 110, an interaction device 120 and an assessment device 130. The control device 110 is configured to perform multiple rounds of display tasks, wherein the i-1th round of display tasks in the multiple rounds of display tasks is to control the display device to display the memory array image, the grayscale stimulation image and the test array image based on the i-1th task intensity parameter and the i-1th stimulation intensity parameter of the i-1th round, wherein the task intensity parameter represents the number of color blocks in the memory array image, and the stimulation intensity parameter represents the display duration of the grayscale stimulation image introduced in the process of changing from the memory array image to the test array image, and i is a positive integer greater than 1; the interaction device 120 is configured to, in the process of executing the i-1th round of display tasks, respond to the i-1th feedback operation of the target object, Determine the i-1th feedback result, wherein the feedback result indicates that the target object believes that there are different color blocks between the memory array image and the test array image, or indicates that the target object believes that the memory array image and the test array image are exactly the same; the evaluation device 130 is configured to determine the i-1th working memory capacity evaluation result based on the i-1th feedback result, and to determine the i-th task intensity parameter and the i-th stimulation intensity parameter based on the i-1th feedback result and the i-1th working memory capacity evaluation result, to obtain the i-th round of display task, wherein the evaluation device 130 is further configured to determine the target working memory capacity evaluation result based on the working memory capacity evaluation results of multiple rounds of display tasks.

[0031] According to an embodiment of the present disclosure, the control device and the evaluation device are deployed on a central processing unit, the experimental program is encapsulated in the control device, and the display device can be a liquid crystal display with a memory of 24G2, a size of 23.8 inches, 1920×1080 pixels, and a refresh rate of 144Hz. During the execution of multiple rounds of display tasks, the control device controls the display device to display the memory array image, the grayscale stimulation image, and the test array image. The background of the grayscale stimulation image is a uniform light gray (red, green, and blue (RGB): 125, 125, 125). The interactive device 120 can be a button device that connects the evaluation device 110 and the display device.

[0032] According to an embodiment of the present disclosure, the distance between the target object and the center of the screen of the display device is 65 cm. The target object represents an object whose working memory capacity is to be evaluated in the display task.

[0033] According to an embodiment of the present disclosure, the i-1th task intensity parameter is the number of items that the target object needs to remember in the i-1th round of display task. For example, the i-1th task intensity parameter is 2, which means that the number of color blocks in the memory array image displayed by the display device during the execution of the i-1th round of display task is 2, and the position and number of color blocks in the memory array image and the test array image in the same display task are the same.

[0034] According to the embodiments of the present disclosure, the memory array image is a visual image that the target object observes for reference, and during the display of the memory array image, the target object is required to memorize the position, color, and number of color blocks in the memory array image; the test array image is a visual image that the target object observes for comparison, and during the display of the test array image, the target object is required to observe the position, color, and number of color blocks in the test array image, and judge whether the color of the color blocks changes between the memory array image and the test array image.

[0035] According to the embodiments of the present disclosure, a larger stimulus intensity parameter represents a longer duration of display of the grayscale stimulus image introduced during the change from the memory array image to the test array image. Introducing the grayscale stimulus image during the change from the memory array image to the test array image can activate the silent neural activity state of the target object, thereby optimizing the working memory ability of the target object under the display task of the high task intensity parameter.

[0036] According to an embodiment of the present disclosure, the feedback operation is a target object click operation. For example, if the target object believes that there are different color blocks between the memory array image and the test array image, then the target object clicks the "j" button, or if the target object believes that the memory array image and the test array image are exactly the same, then the target object clicks the "f" button.

[0037] According to the embodiments of the present disclosure, the i-1th feedback result can be processed using a quantitative analysis model or a dynamic adjustment algorithm to obtain the i-1th working memory capacity evaluation result. For example, the target object is already in a working state during the process of observing the displayed image, and the i-1th working memory capacity evaluation result can be the target object's memory ability for multiple color blocks under the array distribution in the i-1th round of display task, which can further reflect the target object's memory ability in other working states at the task level corresponding to the task intensity parameter and the stimulation level corresponding to the stimulation intensity parameter.

[0038] According to an embodiment of the present disclosure, a first task intensity parameter and a first stimulation intensity parameter are set in the first round display task design stage; during the execution of the first round display task, a first feedback result is determined in response to a first feedback operation of the target object; a first working memory capacity assessment result is determined based on the first feedback result, and a second task intensity parameter and a second stimulation intensity parameter are determined based on the first feedback result and the first working memory capacity assessment result, to obtain a second round display task.

[0039] For example, first, in the first round of display task design stage, the first task intensity parameter is set to 2 and the first stimulation intensity parameter is set to 100ms. During the execution of the first round of display tasks, in response to the first feedback operation of the target object, the first feedback result is determined, and the first working memory capacity assessment result is obtained by processing the first feedback result based on the dynamic adjustment algorithm. If the first feedback result does not meet the benchmark expected result, the first task intensity parameter can be increased and the second task intensity parameter can be determined to be 4. Then, in the second round of display task design stage, the second task intensity parameter is set to 4 and the second stimulation intensity parameter is set to 100ms.

[0040] For example, taking the above-mentioned second task intensity parameter of 4 and the second stimulation intensity parameter of 100ms as an example, during the execution of the second round of display task, in response to the second feedback operation of the target object, the second feedback result is determined, and the second feedback result is processed based on the dynamic adjustment algorithm to obtain the second working memory capacity assessment result. If the first feedback result meets the benchmark expected result, the task intensity parameter will no longer be adjusted. If the second working memory capacity assessment result does not meet the working memory performance condition, the second stimulation intensity parameter will be increased, and the third stimulation intensity parameter will be determined to be 120ms. Then, in the third round of display task design stage, the third task intensity parameter is set to 4 and the third stimulation intensity parameter is set to 120ms. If the second working memory capacity assessment result meets the working memory performance condition, the third round of display task will no longer be designed.

[0041] According to an embodiment of the present disclosure, based on the working memory capacity evaluation results of multiple rounds of display tasks, a target working memory capacity evaluation result is determined, and the target working memory capacity evaluation result can be the maximum working memory capacity evaluation result, reflecting the best working memory ability of the target object, such as a large number of memory color blocks, and accurate color block positions and colors. For example, in the above two rounds of display tasks, when the second working memory capacity evaluation result meets the working memory performance condition, the second working memory capacity evaluation result is determined as the target working memory capacity evaluation result.

[0042] According to an embodiment of the present disclosure, the working memory capacity change state of the target object can be evaluated based on the working memory capacity evaluation results of multiple rounds of display tasks, thereby comprehensively evaluating the working memory performance.

[0043] According to the embodiments of the present disclosure, since multiple rounds of display tasks are designed to provide visual stimulation to the target object at different task intensity parameters, and the working memory capacity of the target object is quantitatively evaluated based on the feedback results of the display tasks, a relatively accurate working memory capacity evaluation result is obtained, and the task intensity parameters and stimulation intensity parameters are adaptively adjusted according to the feedback results and the quantification results of the working memory capacity to design the next round of display tasks, the multi-display task design and dynamic adjustment of the task intensity parameters and stimulation intensity parameters overcome the limitations of the traditional single memory task evaluation, and are conducive to a comprehensive and accurate evaluation of the individual's working memory performance to comprehensively evaluate the working memory capacity of the target object, effectively improve the working memory ability under high-load working conditions, and provide a new technical means for cognitive intervention.

[0044] According to an embodiment of the present disclosure, a control device is configured to control a display device to display a first fixation point image, a memory array image, a second fixation point image, a clue prompt image, a third fixation point image, a grayscale stimulation image, a fourth fixation point image, and a test array image based on preset timing rules, wherein the first fixation point image is used to guide the target object to fixate on the center point of the display device, and the i-1th preset timing rule of the i-1th round of display task is determined based on the i-1th stimulation intensity parameter.

[0045] According to an embodiment of the present disclosure, the first gaze point image, the second gaze point image, the third gaze point image, and the fourth gaze point image are all gaze point images, and the midpoint of the gaze point image is marked with a central gaze point for guiding the target object to gaze at the center point of the display device.

[0046] According to an embodiment of the present disclosure, a clue indication symbol is marked in the clue prompt image, which is used to instruct the target object to make a judgment between the memory array image and the test array image.

[0047] According to an embodiment of the present disclosure, the preset timing rules include the order in which images appear and the display duration of each image. During the execution of each display task, the control device controls the display device to display in sequence based on the preset timing rules: the first fixation point image of 200ms, the memory array visual image of 100ms, the second fixation point image of 900ms, the clue prompt image of 200ms, the third fixation point image, the grayscale stimulation image, the fourth fixation point image, and the test array visual image of 2000ms. The total display duration of the third fixation point image, the grayscale stimulation image, and the fourth fixation point image is 1400ms.

[0048] According to an embodiment of the present disclosure, the duration of displaying the grayscale stimulation image is determined according to the stimulation intensity parameters set in the design phase of each round of display task, and the duration of displaying the third fixation point image and the fourth fixation point image is shortened accordingly.

[0049] For example, the i-1th stimulation intensity parameter is 100ms, and the third fixation point image of 900ms, the grayscale stimulation image of 100ms, and the fourth fixation point image of 400ms are set in the i-1th preset timing rule; the i-th stimulation intensity parameter is 120ms, and the third fixation point image of 890ms, the grayscale stimulation image of 120ms, and the fourth fixation point image of 390ms are set in the i-th preset timing rule.

[0050] According to an embodiment of the present disclosure, a grayscale stimulation image is obtained based on the following operations: obtaining a color blocks from a database; removing color blocks having the same color as the color blocks in the memory array image from the a color blocks to obtain b target color blocks, where b is less than a, and a and b are both positive integers; based on a color mixing algorithm, performing color superposition processing on multiple target color blocks in the overlapping area of ​​the color blocks in the initial stimulation image to obtain a superimposed stimulation image, wherein the initial stimulation image is obtained by arranging the b target color blocks; performing grayscale conversion processing on the superimposed stimulation image to obtain a grayscale stimulation image.

[0051] According to an embodiment of the present disclosure, the color block is in the shape of a 1°×1° square, the color of each square is randomly extracted from a preset multiple color database, and the extracted color is randomly rendered on the square to obtain a color blocks.

[0052] For example, the database may have magenta (RGB: 255,0,144), cyan (RGB: 0,255,255), red (RGB: 255,0,0), blue (RGB: 0,0,255), green (RGB: 0,255,0), violet (RGB: 238,130,238), yellow (RGB: 255,255,0), black (RGB: 0,0,0), white (RGB: 255,255,255), orange (RGB: 255,128,0), etc. The diversity of colors increases the complexity of the display task and the memory load.

[0053] For example, in the memory array image in the i-1th round of display task, the colors of the color blocks are yellow and red, then the yellow and red color blocks are removed from a color blocks to obtain b target color blocks.

[0054] According to an embodiment of the present disclosure, an initial stimulation image is obtained by randomly arranging b target color blocks, and a color mixing algorithm is used to perform color superposition processing on multiple target color blocks in the overlapping area of ​​the color blocks in the initial stimulation image to obtain a superimposed stimulation image.

[0055] For example, the color block overlap region includes a blue color block and a purple color block, and the color value of the blue color block and the color value of the purple color block are summed to obtain the color value of the color block overlap region. The pixel value of the superimposed stimulus image is the color value after the colors are superimposed.

[0056] According to an embodiment of the present disclosure, grayscale conversion is performed on the color value of the superimposed stimulation image to obtain a grayscale stimulation image. The grayscale stimulation image is a mosaic image, and the pixel value of the grayscale stimulation image is a grayscale value.

[0057] According to an embodiment of the present disclosure, the i-1th round of display task includes M display subtasks, where M is a positive integer, the color distribution of color blocks in the memory array image and the test array image in the M display subtasks is determined based on the color block color change ratio parameter, the number and position of color blocks in the memory array image and the test array image in each display subtask are the same, and the i-1th feedback result includes subtask feedback results corresponding to each of the M display subtasks; determining the i-1th working memory capacity evaluation result based on the i-1th feedback result includes: determining the i-1th observation accuracy and the i-1th observation error rate corresponding to the i-1th round of display task according to the M subtask feedback results corresponding to the M display subtasks; determining the i-1th memory capacity evaluation result according to the i-1th task intensity parameter, the i-1th observation accuracy and the i-1th observation error rate.

[0058] According to an embodiment of the present disclosure, M display subtasks are designed in the i-1th round of display task design phase, the task intensity parameters and stimulation intensity parameters of the M display subtasks are the same, and the task intensity parameter and stimulation intensity parameter of each display subtask are the i-1th task intensity parameter and the i-1th stimulation intensity parameter, respectively.

[0059] For example, if the color block color change ratio parameter is 50%, the color block colors of the corresponding position areas in the memory array image and the test array image in half of the display subtasks are set to be the same, and the color block colors of the corresponding position areas in the memory array image and the test array image in the remaining half of the display subtasks are set to be different.

[0060] According to an embodiment of the present disclosure, the number of color blocks in the memory array image is an even number, and a coordinate axis is established with the center of the memory array image as the base point. The area in the memory array image is divided into four quadrants, and half the number of color blocks are presented on the left and right sides of the y-axis respectively. The positions of the color blocks on each side are randomly arranged, with the center as the center of the circle, and the viewing angle range of the color blocks is 3° to 7.3°.

[0061] According to an embodiment of the present disclosure, a number of breaks is set in each round of display tasks to ensure a balance between the concentration of the target object and the continuity of the experiment.

[0062] For example, the i-1th round of display tasks includes 480 display subtasks, and the number of breaks is set to 6. Then, every 80 display subtasks are regarded as a batch, and a break time of about 1 minute is set between the execution of adjacent batches. The total execution time of the i-1th round of display tasks is controlled within 45 minutes.

[0063] According to an embodiment of the present disclosure, each display subtask corresponds to a subtask feedback result, and each subtask feedback result reflects the result of correct or incorrect observation of the target object in this display subtask. The M subtask feedback results are counted to determine the i-1th observation accuracy rate and i-1th observation error rate corresponding to the i-1th round of display task as a whole.

[0064] According to an embodiment of the present disclosure, the i-1th observation accuracy rate represents the probability of correctly observing the target object in the M display subtasks, and the i-1th observation error rate represents the probability of incorrectly observing the target object in the M display subtasks.

[0065] In one embodiment, the i-1th memory capacity evaluation result As shown in formula (1):

[0066] (1);

[0067] in, Characterizes the intensity parameter of the i-1th task, represents the accuracy of the i-1th observation, Characterizes the i-1th observation error rate.

[0068] According to an embodiment of the present disclosure, a display subtask is marked with a color block color change category label, and the color block color change category label represents whether the color blocks set at the same position in the memory array image and the test array image are the same or different; wherein, according to the M subtask feedback results corresponding to the M display subtasks, determining the i-1th observation accuracy and the i-1th observation error rate corresponding to the i-1th round display task includes: for the mth display subtask among the M display subtasks, when the color block color change category label of the mth display subtask matches the color change category represented by the subtask feedback result, determining the observation result of the mth display subtask is an observation correct result; when the color block color change category label of the mth display subtask does not match the color change category represented by the subtask feedback result, determining the observation result of the mth display subtask is an observation error result; determining the i-1th observation accuracy corresponding to the i-1th round display task according to the number of observation correct results and the number of display subtasks; determining the i-1th observation error rate corresponding to the i-1th round display task according to the number of observation error results and the number of display subtasks.

[0069] According to an embodiment of the present disclosure, a color block color change category label of 1 represents that the color blocks set at the same position in the memory array image in the display subtask and the test array image have the same color; a color block color change category label of 0 represents that the color blocks set at the same position in the memory array image in the display subtask and the test array image have different colors.

[0070] According to an embodiment of the present disclosure, a color change category represented by a subtask feedback result of 1 represents that the target object believes that the colors of the color blocks set at the same position in the memory array image in the display subtask and the test array image are the same; a color change category represented by a subtask feedback result of 0 represents that the target object believes that the colors of the color blocks set at the same position in the memory array image in the display subtask and the test array image are different.

[0071] According to an embodiment of the present disclosure, if the color block color change category label of the mth display subtask matches the color change category represented by the subtask feedback result, it means that the target object is observed correctly; if the color block color change category label of the mth display subtask does not match the color change category represented by the subtask feedback result, it means that the target object is observed incorrectly.

[0072] According to an embodiment of the present disclosure, in the i-1th display task, each display subtask corresponds to an observation result, and the i-1th observation accuracy is determined according to the proportion of the number of correct observation results to the M observation results; the i-1th observation error rate is determined according to the proportion of the number of incorrect observation results to the M observation results.

[0073] According to an embodiment of the present disclosure, the evaluation device is configured to: when the i-1th observation accuracy corresponding to the i-1th round of display task is less than a preset accuracy threshold, or when the average color block observation reaction time corresponding to the i-1th round of display task is greater than the preset reaction threshold, adjust the i-1th task intensity parameter to obtain the i-th round of display task, wherein the average color block observation reaction time is obtained based on a weighted average operation performed on the color block observation reaction times corresponding to each of the M display subtasks, and the color block observation reaction time represents the time from the start of displaying the test array image to responding to the feedback operation during the execution of the display subtask; when the i-1th observation accuracy corresponding to the i-1th round of display task is greater than or equal to the preset accuracy threshold and the average color block observation reaction time is less than or equal to the preset reaction threshold, adjust the i-1th stimulation intensity parameter according to the i-1th memory capacity evaluation result and the i-1th capacity threshold to obtain the i-th round of display task, wherein the i-1th capacity threshold is determined based on the historical memory ability of the target object or the i-1th task intensity parameter.

[0074] According to an embodiment of the present disclosure, a weighted average operation is performed on the color block observation reaction time corresponding to each of the M display subtasks to obtain an average color block observation reaction time corresponding to the (i-1)th round of display task.

[0075] For example, the preset accuracy threshold may be 80%, and the preset reaction threshold may be 1500ms.

[0076] According to an embodiment of the present disclosure, when the i-1th observation accuracy corresponding to the i-1th round of display task is less than the preset accuracy threshold, or when the average color block observation reaction time corresponding to the i-1th round of display task is greater than the preset reaction threshold, the task difficulty is automatically increased and the task intensity parameter is increased; when the i-1th observation accuracy corresponding to the i-1th round of display task is greater than or equal to the preset accuracy threshold and the average color block observation reaction time corresponding to the i-1th round of display task is less than or equal to the preset reaction threshold, the task intensity parameter remains unchanged and the stimulation intensity parameter is automatically increased.

[0077] For example, the i-1th observation accuracy corresponding to the i-1th round of display task is 75%, the i-1th task intensity parameter is 2, and the observation accuracy is less than the preset accuracy threshold. Therefore, it is necessary to continue to design the i-1th round of display task and adjust the i-1th task intensity parameter by 2 to obtain the i-1th task intensity parameter of 4.

[0078] For example, the i-1th round display task corresponds to an observation accuracy of 85%, an average color block observation reaction time of 1200ms, an i-1th task intensity parameter of 2, an i-1th stimulus intensity parameter of 140ms, and an observation accuracy greater than the preset accuracy threshold and an average color block observation reaction time less than the preset reaction threshold. Therefore, it is necessary to decide whether to adjust the i-1th stimulus intensity parameter based on the i-1th memory capacity evaluation result and the i-1th capacity threshold. If it is necessary to adjust the i-1th stimulus intensity parameter by 20ms, the i-th stimulus intensity parameter is 160ms, and the i-th task intensity parameter remains unchanged at 2, and the i-th round display task is obtained; if the i-1th memory capacity evaluation result reaches the optimal working memory capacity of the target object, there is no need to design the i-th round display task.

[0079] According to an embodiment of the present disclosure, the task intensity parameter is the working memory load intensity of the target object, and the i-1th memory capacity assessment result can be equal to the i-1th task intensity parameter at most. Therefore, the i-1th capacity threshold can be set according to the i-1th task intensity parameter; the working memory capacity of each individual object is different. If the i-1th memory capacity assessment result does not reach the i-1th task intensity parameter during the execution process of multiple display tasks, the i-1th capacity threshold can be set based on the historical memory capacity of the target object.

[0080] For example, based on the working memory ability of the target object, in a display task with a smaller task intensity parameter, the i-1th capacity threshold is set to the i-1th task intensity parameter; in a display task with a larger task intensity parameter, such as the i-1th task intensity parameter is 8, based on the target object's historical memory ability in previous rounds of display tasks, it is found that the target object's memory capacity evaluation result improves slowly after the task intensity parameter exceeds 6, then the i-1th capacity threshold can be set to 7.

[0081] According to the embodiments of the present disclosure, through multi-display task design and dynamic adjustment of task intensity parameters and stimulation intensity parameters, the limitations of traditional single memory task evaluation are overcome, which is conducive to comprehensive and accurate evaluation of individual working memory performance.

[0082] According to an embodiment of the present disclosure, the evaluation device is configured as follows: when the i-1th memory capacity evaluation result is less than or equal to the i-1th capacity threshold, the i-1th stimulation intensity parameter is enhanced based on the adaptive adjustment mechanism to obtain the i-th stimulation intensity parameter; based on the i-th stimulation intensity parameter, the i-th round display task is determined.

[0083] According to an embodiment of the present disclosure, after the i-1th round of display task is executed, the i-1th observation accuracy rate and the i-1th observation error rate are obtained, and then the i-1th memory capacity evaluation result is obtained based on the i-1th observation accuracy rate, the i-1th observation error rate and the i-1th task intensity parameter. When the i-1th memory capacity evaluation result is less than or equal to the i-1th capacity threshold, the i-1th stimulation intensity parameter can be enhanced by an adaptive adjustment mechanism.

[0084] According to an embodiment of the present disclosure, the adaptive adjustment mechanism is adjusted based on the change rate of the i-1th observation accuracy and the average color block observation reaction time corresponding to the i-1th round of display tasks. If the i-1th observation accuracy increases slower than the previous observation accuracy or the average color block observation reaction time corresponding to the i-1th round of display tasks decreases slower than the previous average color block observation reaction time, the i-1th stimulus intensity parameter is enhanced by a larger margin; otherwise, the i-1th stimulus intensity parameter is enhanced by a smaller margin.

[0085] For example, by increasing the i-1th stimulus intensity parameter by a relatively large amount, the i-1th stimulus intensity parameter can be increased by 40ms to obtain the i-th stimulus intensity parameter; by increasing the i-1th stimulus intensity parameter by a relatively small amount, the i-1th stimulus intensity parameter can be increased by 20ms to obtain the i-th stimulus intensity parameter.

[0086] According to an embodiment of the present disclosure, when the i-1th memory capacity assessment result is greater than the i-1th capacity threshold or the i-1th memory capacity assessment result is less than the previous memory capacity assessment result, it means that the memory capacity assessment result of the target object has reached the target memory capacity assessment result or the memory ability has decreased, and there is no need to design the i-th round of display tasks.

[0087] According to the embodiments of the present disclosure, an adaptive adjustment mechanism is set up in the process of designing a display task, which can dynamically optimize the enhancement amplitude of the stimulation intensity parameter according to the real-time reaction performance of the target object. The task intensity parameter is the working memory load intensity of the target object. Under the condition of high working memory load intensity, the adaptive increase of the stimulation intensity parameter caters to the memory rhythm of the target object, which is conducive to improving the working memory capacity.

[0088] Figure 2 A flowchart of a working memory assessment method based on visual induction according to an embodiment of the present disclosure is shown.

[0089] like Figure 2 As shown, the method 200 includes operations S210 to S240.

[0090] In operation S210, the i-1th round of display tasks is performed, wherein the i-1th round of display tasks is to display memory array images, grayscale stimulation images and test array images to the target object based on the i-1th task intensity parameter and the i-1th stimulation intensity parameter of the i-1th round.

[0091] In operation S220 , in response to the (i-1)th feedback operation of the target object, an (i-1)th feedback result is determined.

[0092] In operation S230 , an (i-1)th working memory capacity evaluation result is determined based on the (i-1)th feedback result.

[0093] In operation S240, an i-th task intensity parameter and an i-th stimulation intensity parameter are determined based on the i-1-th feedback result and the i-1-th working memory capacity assessment result to obtain an i-th round of display tasks.

[0094] According to an embodiment of the present disclosure, during the design stage of the i-1th round of display tasks, the i-1th task intensity parameters and the i-1th stimulation intensity parameters are set, and the i-1th round of display tasks is performed, and the target object observes the memory array image, the grayscale stimulation image, and the test array image in turn.

[0095] According to an embodiment of the present disclosure, the target object observes the change of the color block between the memory array image and the test array image, and performs the (i-1)th feedback operation.

[0096] According to an embodiment of the present disclosure, in response to the i-1th feedback operation of the target object, the i-1th feedback result is determined, and the i-1th feedback result is processed using a quantitative analysis model to obtain the i-1th working memory capacity assessment result.

[0097] According to an embodiment of the present disclosure, the gap between the i-1th feedback result and the expected result, the gap between the i-1th working memory capacity assessment result and the expected capacity result are evaluated, the i-1th task intensity parameter and the i-1th stimulation intensity parameter are adaptively adjusted, the i-th task intensity parameter and the i-th stimulation intensity parameter are determined, and the i-th round display task is obtained.

[0098] According to the embodiments of the present disclosure, an evaluation is performed in real time based on the feedback results of the previous round and the working memory capacity evaluation results, and the current display task is designed to further comprehensively evaluate the impact of the task intensity parameters and the stimulation intensity parameters on the memory ability of the target object and determine the target working memory capacity evaluation result of the target object.

[0099] According to an embodiment of the present disclosure, before designing multiple rounds of display tasks for target objects, reference comparison experiments including sample references for multiple rounds of display tasks are designed for multiple groups of sample objects.

[0100] According to an embodiment of the present disclosure, a grayscale stimulation image is obtained based on the following operations: obtaining a color blocks from a database; removing color blocks having the same color as the color blocks in the memory array image from the a color blocks to obtain b target color blocks, where b is less than a, and a and b are both positive integers; based on a color mixing algorithm, performing color superposition processing on multiple target color blocks in the overlapping area of ​​the color blocks in the initial stimulation image to obtain a superimposed stimulation image, wherein the initial stimulation image is obtained by arranging the b target color blocks; performing grayscale conversion processing on the superimposed stimulation image to obtain a grayscale stimulation image.

[0101] According to an embodiment of the present disclosure, the i-1th round of display task includes M display subtasks, where M is a positive integer, the color distribution of color blocks in the memory array image and the test array image in the M display subtasks is determined based on the color block color change ratio parameter, the number and position of color blocks in the memory array image and the test array image in each display subtask are the same, and the i-1th feedback result includes the subtask feedback results corresponding to each of the M display subtasks.

[0102] According to an embodiment of the present disclosure, the i-1th observation accuracy and the i-1th observation error rate corresponding to the i-1th round of display task are determined based on the M subtask feedback results corresponding to the M display subtasks; the i-1th memory capacity evaluation result is determined based on the i-1th task intensity parameter, the i-1th observation accuracy and the i-1th observation error rate.

[0103] According to an embodiment of the present disclosure, the display subtask is marked with a color block color change category label, and the color block color change category label indicates whether the color of the color block set at the same position in the memory array image and the test array image is the same or different.

[0104] According to an embodiment of the present disclosure, for the mth display subtask among M display subtasks, when the color block color change category label of the mth display subtask matches the color change category represented by the subtask feedback result, the observation result of the mth display subtask is determined to be a correct observation result; when the color block color change category label of the mth display subtask does not match the color change category represented by the subtask feedback result, the observation result of the mth display subtask is determined to be an incorrect observation result; based on the number of correct observation results and the number of display subtasks, the i-1th observation correct rate corresponding to the i-1th round of display task is determined; based on the number of incorrect observation results and the number of display subtasks, the i-1th observation error rate corresponding to the i-1th round of display task is determined.

[0105] According to an embodiment of the present disclosure, a first fixation point image, a memory array image, a second fixation point image, a clue prompt image, a third fixation point image, a grayscale stimulation image, a fourth fixation point image, and a test array image are displayed based on preset timing rules, wherein the first fixation point image is used to guide the target object to gaze at the center point of the display device, and the i-1th preset timing rule of the i-1th round of display task is determined based on the i-1th stimulation intensity parameter.

[0106] According to an embodiment of the present disclosure, when the i-1th observation accuracy corresponding to the i-1th round of display task is less than a preset accuracy threshold, or when the average color block observation reaction time corresponding to the i-1th round of display task is greater than the preset reaction threshold, the i-1th task intensity parameter is adjusted to obtain the i-1th round of display task, wherein the average color block observation reaction time is obtained based on a weighted average operation performed on the color block observation reaction times corresponding to each of the M display subtasks, and the color block observation reaction time represents the time from the start of displaying the test array image to responding to the feedback operation during the execution of the display subtask; when the i-1th observation accuracy corresponding to the i-1th round of display task is greater than or equal to the preset accuracy threshold and the average color block observation reaction time is less than or equal to the preset reaction threshold, the i-1th stimulation intensity parameter is adjusted according to the i-1th memory capacity evaluation result and the i-1th capacity threshold to obtain the i-1th round of display task, wherein the i-1th capacity threshold is determined based on the historical memory ability of the target object or the i-1th task intensity parameter.

[0107] According to an embodiment of the present disclosure, when the i-1th memory capacity evaluation result is less than or equal to the i-1th capacity threshold, the i-1th stimulation intensity parameter is enhanced based on the adaptive adjustment mechanism to obtain the i-th stimulation intensity parameter; based on the i-th stimulation intensity parameter, the i-th round display task is determined.

[0108] Figure 3A Schematic diagrams of Experiment 1-A and Experiment 1-B according to an embodiment of the present disclosure are shown.

[0109] like Figure 3A As shown, Experiment 1-A and Experiment 1-B are the same group of sample objects, one group of sample objects includes 30 first sample objects, Experiment 1-A is the reference experiment of Experiment 1-B, and Experiment 1-B adds a 100ms grayscale stimulus image compared to Experiment 1-A. A display task was set for Experiment 1-A, in which the task intensity parameter was set to 8 and the stimulation intensity parameter was set to 0. The control device controlled the display device to display in sequence based on a preset timing rule: the first fixation point image of 200 ms, the memory array visual image of 100 ms, the second fixation point image of 900 ms, the clue prompt image of 200 ms, the third fixation point image of 1300 ms, and the test array visual image of 2000 ms; a display task was set for Experiment 1-B, in which the task intensity parameter was set to 8 and the stimulation intensity parameter was set to 100 ms. The control device controlled the display device to display in sequence based on a preset timing rule: the first fixation point image of 200 ms, the memory array visual image of 100 ms, the second fixation point image of 900 ms, the clue prompt image of 200 ms, the third fixation point image of 900 ms, the grayscale stimulation image of 100 ms, the fourth fixation point image of 400 ms, and the test array visual image of 2000 ms.

[0110] Figure 3B Schematic diagrams of Experiment 2-A and Experiment 2-B according to an embodiment of the present disclosure are shown.

[0111] like Figure 3BAs shown, Experiment 2-A and Experiment 2-B are the same group of sample objects, one group of sample objects includes 30 second sample objects, Experiment 2-A is the reference experiment of Experiment 2-B, and Experiment 2-B adds a blank image of 100ms compared to Experiment 1-A. A display task was set for Experiment 2-A, in which the task intensity parameter was set to 8 and the stimulation intensity parameter was set to 0. The control device controlled the display device to display in sequence based on the preset timing rules: the first fixation point image of 200ms, the memory array visual image of 100ms, the second fixation point image of 900ms, the clue prompt image of 200ms, the third fixation point image of 1300ms, and the test array visual image of 2000ms; a display task was set for Experiment 2-B, in which the task intensity parameter was set to 8, the stimulation intensity parameter was set to 0ms, and the blank image display duration parameter was set to 100ms. The control device controlled the display device to display in sequence based on the preset timing rules: the first fixation point image of 200ms, the memory array visual image of 100ms, the second fixation point image of 900ms, the clue prompt image of 200ms, the third fixation point image of 900ms, the blank image of 100ms, the fourth fixation point image of 400ms, and the test array visual image of 2000ms.

[0112] According to an embodiment of the present disclosure, multiple display subtasks are designed for each display task. Based on the subtask feedback results of each of the multiple display subtasks, the observation accuracy and observation error rate corresponding to each display task are obtained, and then the working memory capacity evaluation results of each sample object in each display task are obtained.

[0113] According to the embodiments of the present disclosure, display tasks corresponding to task intensity parameters S=2, S=4, S=6, and S=8 were designed in Experiment 1-A, Experiment 1-B, Experiment 2-A, and Experiment 2-B, respectively, and other parameters remained unchanged, and statistical results of the working memory capacity evaluation results were obtained.

[0114] Table 1 shows a statistical table of working memory capacity evaluation results of Experiment 1-A according to an embodiment of the present disclosure.

[0115]

[0116] Table 2 shows a statistical table of working memory capacity evaluation results of Experiment 1-B according to an embodiment of the present disclosure.

[0117]

[0118] Table 3 shows a statistical table of working memory capacity evaluation results of Experiment 2-A according to an embodiment of the present disclosure.

[0119]

[0120] Table 4 shows a statistical table of working memory capacity evaluation results of Experiment 2-B according to an embodiment of the present disclosure.

[0121]

[0122] According to an embodiment of the present disclosure, in each experiment, a display task is designed for each level of task intensity parameters, and a working memory capacity evaluation result of each sample object is obtained for each display task. The average value of the working memory capacity evaluation results represents the average value of the working memory capacity evaluation results of the 30 sample objects after executing each display task; the standard deviation of the working memory capacity evaluation results represents the standard deviation of the working memory capacity evaluation results of the 30 sample objects after executing each display task.

[0123] According to the embodiments of the present disclosure, each display task in Experiment 1-B is set with a 100ms grayscale stimulation image compared to each display task in Experiment 1-A. According to the experimental results in Tables 1 and 2, it is found that under the low working memory load intensity state (S=2, S=4), the working memory capacity is generally high, and the stimulation intensity parameter has a poor effect on improving the working memory capacity; under the high working memory load intensity state (S=6, S=8), increasing the stimulation intensity parameter is beneficial to improving the working memory capacity.

[0124] According to an embodiment of the present disclosure, each display task in Experiment 2-B is set with a blank image of 100ms compared to each display task in Experiment 2-A. According to the experimental results of Tables 3 and 4, it is found that under the low working memory load intensity state or the high working memory load intensity state, adding blank image stimulation to the second sample objects does not significantly improve the working memory capacity.

[0125] According to the embodiments of the present disclosure, each display task in Experiment 2-A has the same parameters as each display task in Experiment 1-A, but different sample objects. According to the experimental results in Tables 1 and 3, it is found that the changing trends of the working memory capacity evaluation results of the first sample object and the second sample object are roughly the same, which means that the first sample object and the second sample object have small differences in age and cognitive ability and high homogeneity, thus overcoming the problem of differences in age and cognitive ability of different sample objects affecting the experimental results.

[0126] According to the embodiments of the present disclosure, based on the experimental results of Tables 1 and 3 and the experimental results of Tables 3 and 4, the comparison between Experiment 1-B and Experiment 2-B is convincing. A blank image of 100ms is set in each display task in Experiment 2-B, and a grayscale stimulation image of 100ms is set in each display task in Experiment 2-B. According to the experimental results of Tables 2 and 4, it is found that under the high working memory load intensity state (S=6, S=8), increasing the stimulation intensity parameters for different sample objects is beneficial to improving the working memory capacity, and the effect is good.

[0127] According to the embodiments of the present disclosure, experimental results show that under high working memory load intensity conditions, adaptively increasing the stimulation intensity parameters is beneficial to improving the working memory capacity. Therefore, based on the above experimental results, multiple rounds of display tasks are designed for the target objects to comprehensively evaluate and improve the working memory capacity of the target objects.

[0128] Figure 4 A block diagram of an electronic device suitable for implementing a working memory assessment method based on visual induction according to an embodiment of the present disclosure is shown.

[0129] like Figure 4 As shown, the electronic device 400 according to an embodiment of the present disclosure includes a processor 401, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 402 or a program loaded from a storage part 408 to a random access memory (RAM) 403. The processor 401 may include, for example, a general-purpose microprocessor (e.g., a CPU), an instruction set processor and / or a related chipset and / or a dedicated microprocessor (e.g., an application-specific integrated circuit (ASIC)), etc. The processor 401 may also include an onboard memory for caching purposes. The processor 401 may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present disclosure.

[0130] In RAM 403, various programs and data required for the operation of electronic device 400 are stored. Processor 401, ROM 402 and RAM 403 are connected to each other via bus 404. Processor 401 performs various operations of the method flow according to the embodiment of the present disclosure by executing the program in ROM 402 and / or RAM 403. It should be noted that the program can also be stored in one or more memories other than ROM 402 and RAM 403. Processor 401 can also perform various operations of the method flow according to the embodiment of the present disclosure by executing the program stored in one or more memories.

[0131] According to an embodiment of the present disclosure, the electronic device 400 may further include an input / output (I / O) interface 405, which is also connected to the bus 404. The electronic device 400 may further include one or more of the following components connected to the input / output (I / O) interface 405: an input portion 406 including a keyboard, a mouse, etc.; an output portion 407 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage portion 408 including a hard disk, etc.; and a communication portion 409 including a network interface card such as a LAN card, a modem, etc. The communication portion 409 performs communication processing via a network such as the Internet. A drive 410 is also connected to the input / output (I / O) interface 405 as needed. A removable medium 411, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 410 as needed, so that a computer program read therefrom is installed into the storage portion 408 as needed.

[0132] The present disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiment; or may exist independently without being assembled into the device / apparatus / system. The above computer-readable storage medium carries one or more programs, and when the above one or more programs are executed, the working memory assessment method according to the embodiment of the present disclosure is implemented.

[0133] According to an embodiment of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium, for example, it may include but is not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, an apparatus or a device. For example, according to an embodiment of the present disclosure, the computer-readable storage medium may include the ROM 402 and / or RAM 403 described above and / or one or more memories other than ROM 402 and RAM 403.

[0134] The embodiment of the present disclosure also includes a computer program product, which includes a computer program, and the computer program contains program code for executing the method shown in the flowchart. When the computer program product is run in a computer system, the program code is used to enable the computer system to implement the working memory assessment method provided by the embodiment of the present disclosure.

[0135] The above functions defined in the system / device of the embodiment of the present disclosure are performed when the computer program is executed by the processor 401. According to the embodiment of the present disclosure, the system, device, module, unit, etc. described above can be implemented by a computer program module.

[0136] In one embodiment, the computer program may rely on tangible storage media such as optical storage devices, magnetic storage devices, etc. In another embodiment, the computer program may also be transmitted and distributed in the form of signals on a network medium, and downloaded and installed through the communication part 409, and / or installed from the removable medium 411. The program code contained in the computer program may be transmitted using any appropriate network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0137] In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 409, and / or installed from the removable medium 411. When the computer program is executed by the processor 401, the above functions defined in the system of the embodiment of the present disclosure are performed. According to the embodiment of the present disclosure, the system, device, apparatus, module, unit, etc. described above can be implemented by a computer program module.

[0138] According to an embodiment of the present disclosure, the program code for executing the computer program provided by the embodiment of the present disclosure can be written in any combination of one or more programming languages. Specifically, these computing programs can be implemented using high-level process and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages ​​include, but are not limited to, Java, C++, python, "C" language or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, partially on the remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (for example, using an Internet service provider to connect through the Internet).

[0139] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram may represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box may also occur in an order different from that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart, can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions. It can be understood by those skilled in the art that the features recorded in the various embodiments of the present disclosure can be combined and / or combined in a variety of ways, even if such a combination or combination is not explicitly recorded in the present disclosure. In particular, without departing from the spirit and teaching of the present disclosure, the features described in the various embodiments of the present disclosure may be combined and / or combined in a variety of ways. All of these combinations and / or combinations fall within the scope of the present disclosure.

[0140] The embodiments according to the present disclosure are described above. However, these embodiments are only for the purpose of illustration, and are not intended to limit the scope of the present disclosure. Although the embodiments are described above, this does not mean that the measures in the various embodiments cannot be used in combination to advantage. Without departing from the scope of the present disclosure, those skilled in the art may make a variety of substitutions and modifications, which should all fall within the scope of the present disclosure.

Claims

1. A visually induced working memory assessment system, characterized in that: The system comprises: A control device configured to execute multiple rounds of display tasks, wherein the i-1th round of display tasks in the multiple rounds of display tasks is to control the display device to display a memory array image, a grayscale stimulation image, and a test array image based on the i-1th task intensity parameter and the i-1th stimulation intensity parameter of the i-1th round, wherein the task intensity parameter represents the number of color blocks in the memory array image, and the stimulation intensity parameter represents the display duration of the grayscale stimulation image introduced in the process of changing from the memory array image to the test array image, and i is a positive integer greater than 1; The interactive device is configured to determine an i-1th feedback result in response to an i-1th feedback operation of the target object during the execution of the i-1th round of display task, wherein the feedback result indicates that the target object believes that there are different color blocks between the memory array image and the test array image, or indicates that the target object believes that the memory array image and the test array image are exactly the same; An evaluation device is configured to determine an i-1th working memory capacity evaluation result based on an i-1th feedback result, and to determine an i-th task intensity parameter and an i-th stimulation intensity parameter based on the i-1th feedback result and the i-1th working memory capacity evaluation result, to obtain an i-th round of display tasks, wherein the evaluation device is further configured to determine a target working memory capacity evaluation result based on the working memory capacity evaluation results of multiple rounds of display tasks.

2. The working memory assessment system according to claim 1, characterized in that: The grayscale stimulus image is obtained based on the following operations: Get a color blocks from the database; Remove the color blocks with the same color as the color blocks in the memory array image from the a color blocks to obtain b target color blocks, where b is less than a, and both a and b are positive integers; Based on a color mixing algorithm, a color superposition process is performed on multiple target color blocks in the overlapping area of ​​the color blocks in the initial stimulus image to obtain a superimposed stimulus image, wherein the initial stimulus image is obtained by arranging b target color blocks; The superimposed stimulation image is subjected to grayscale conversion processing to obtain a grayscale stimulation image.

3. The working memory assessment system according to claim 1, characterized in that: The i-1th round of display task includes M display subtasks, where M is a positive integer, the color distribution of the color blocks in the memory array image and the test array image in the M display subtasks is determined based on the color block color change ratio parameter, the number and position of the color blocks in the memory array image and the test array image in each display subtask are the same, and the i-1th feedback result includes the subtask feedback results corresponding to each of the M display subtasks; The i-1 working memory capacity assessment results determined based on the i-1 feedback results include: Determine the i-1th observation accuracy and the i-1th observation error rate corresponding to the i-1th round of display task according to the M subtask feedback results corresponding to the M display subtasks; The i-1th memory capacity evaluation result is determined according to the i-1th task intensity parameter, the i-1th observation accuracy rate and the i-1th observation error rate.

4. The working memory assessment system according to claim 3, characterized in that: The display subtask is marked with a color block color change category label, and the color block color change category label indicates whether the color of the color block set at the same position in the memory array image and the test array image is the same or different; Wherein, determining the i-1th observation accuracy and the i-1th observation error rate corresponding to the i-1th round display task according to the M subtask feedback results corresponding to the M display subtasks includes: For an m-th display subtask among the M display subtasks, when the color block color change category label of the m-th display subtask matches the color change category represented by the subtask feedback result, determining that the observation result of the m-th display subtask is a correct observation result; In a case where the color block color change category label of the m-th display subtask does not match the color change category represented by the subtask feedback result, determining that the observation result of the m-th display subtask is an observation error result; Determining the i-1th observation accuracy rate corresponding to the i-1th round of display task according to the number of correct observation results and the number of display subtasks; The i-1th observation error rate corresponding to the i-1th round of display tasks is determined according to the number of the observation error results and the number of the display subtasks.

5. The working memory assessment system according to claim 1, characterized in that: The control device is configured to control the display device to display a first fixation point image, the memory array image, the second fixation point image, the clue prompt image, the third fixation point image, the grayscale stimulation image, the fourth fixation point image, and the test array image based on preset timing rules, wherein the first fixation point image is used to guide the target object to gaze at the center point of the display device, and the i-1th preset timing rule of the i-1th round display task is determined based on the i-1th stimulation intensity parameter.

6. The working memory assessment system according to claim 5, characterized in that: The evaluation device is configured as follows: In a case where the i-1th observation accuracy rate corresponding to the i-1th round display task is less than a preset accuracy rate threshold, or in a case where the average color block observation reaction time corresponding to the i-1th round display task is greater than a preset reaction threshold, adjusting the i-1th task intensity parameter to obtain the i-th round display task, wherein the average color block observation reaction time is obtained based on a weighted average operation performed on the color block observation reaction time corresponding to each of the M display subtasks, and the color block observation reaction time represents the time from the start of displaying the test array image to responding to the feedback operation during the execution of the display subtask; When the i-1th observation accuracy corresponding to the i-1th round of display task is greater than or equal to the preset accuracy threshold and the average color block observation reaction time is less than or equal to the preset reaction threshold, the i-1th stimulation intensity parameter is adjusted according to the i-1th memory capacity assessment result and the i-1th capacity threshold to obtain the i-1th round of display task, wherein the i-1th capacity threshold is determined based on the historical memory ability of the target object or the i-1th task intensity parameter.

7. The working memory assessment system according to claim 6, characterized in that: The evaluation device is configured as follows: When the i-1th memory capacity evaluation result is less than or equal to the i-1th capacity threshold, enhancing the i-1th stimulation intensity parameter based on the adaptive adjustment mechanism to obtain the i-th stimulation intensity parameter; Based on the i-th stimulation intensity parameter, the i-th round display task is determined.

8. A method for assessing working memory based on visual induction, characterized in that: The method comprises: Executing an i-1th round of display tasks, wherein the i-1th round of display tasks is to display a memory array image, a grayscale stimulation image, and a test array image to a target object based on an i-1th task intensity parameter and an i-1th stimulation intensity parameter of the i-1th round; In response to the (i-1)th feedback operation of the target object, determining an (i-1)th feedback result; Determining the i-1th working memory capacity assessment result based on the i-1th feedback result; and Based on the i-1th feedback result and the i-1th working memory capacity assessment result, the i-th task intensity parameter and the i-th stimulation intensity parameter are determined to obtain the i-th round display task.

9. An electronic device, comprising: one or more processors; a memory for storing one or more computer programs, It is characterized in that the one or more processors execute the one or more computer programs to implement the steps of the method according to claim 8.

10. A computer-readable storage medium having a computer program or instruction stored thereon, characterized in that: When the computer program or instructions are executed by a processor, the steps of the method according to claim 8 are implemented.

Images