System and method for assessing visual evoked working memory

Abstract

The disclosure provides a visual evoked working memory evaluation system and method, which can be applied to the fields of neuroscience technology and computer vision technology. The system comprises: a control device configured to execute multiple rounds of display tasks, wherein the (i-1)th round of display tasks is controlled to display a memory array image, a gray scale stimulus image and a test array image based on the (i-1)th task intensity parameter and the (i-1)th stimulus intensity parameter; an interaction device configured to determine the (i-1)th feedback result in response to the (i-1)th feedback operation of a target object during the execution of the (i-1)th round of display tasks; and an evaluation device configured to determine the (i-1)th working memory capacity evaluation result based on the (i-1)th feedback result, and determine the (i)th task intensity parameter and the (i)th stimulus intensity parameter based on the (i-1)th feedback result and the (i-1)th working memory capacity evaluation result to obtain the (i)th round of display tasks.

Description

Technical Field

[0001] The present disclosure relates to the fields of neuroscience technology and computer vision technology, and in particular to a working memory assessment system and method based on visual induction. Background Art

[0002] Working memory is a core cognitive ability that supports individuals' information storage and manipulation in complex tasks such as language comprehension, reasoning, and learning. Cognitive interventions and memory training can improve working memory. However, the inadequacy and lack of intervention methods in related technologies have led to limited assessments of working memory capacity, resulting in low accuracy. Summary of the Invention

[0003] In view of the above problems, the present disclosure provides a working memory assessment system and method based on visual induction.

[0004] According to a first aspect of the present disclosure, a working memory assessment system based on visual induction is provided, comprising: a control device configured to execute multiple rounds of display tasks, wherein the i-1th round of display tasks in the multiple rounds of display tasks is to control a display device to display a memory array image, a grayscale stimulation image, and a test array image based on the i-1th task intensity parameter and the i-1th stimulation intensity parameter of the i-1th round, wherein the task intensity parameter represents the number of color blocks in the memory array image, and the stimulation intensity parameter represents the duration of display of the grayscale stimulation image introduced during the change from the memory array image to the test array image, and i is a positive integer greater than 1; and an interactive device configured to, during the execution of the i-1th round of display tasks, , in response to the i-1th feedback operation of the target object, determining the i-1th feedback result, wherein the feedback result represents that the target object believes that there are different color blocks between the memory array image and the test array image, or represents that the target object believes that the memory array image and the test array image are exactly the same; an evaluation device is configured to determine the i-1th working memory capacity evaluation result based on the i-1th feedback result, and to determine the i-th task intensity parameter and the i-th stimulation intensity parameter based on the i-1th feedback result and the i-1th working memory capacity evaluation result to obtain the i-th round display task, wherein the evaluation device is further configured to determine the target working memory capacity evaluation result based on the working memory capacity evaluation results of multiple rounds of display tasks.

[0005] According to an embodiment of the present disclosure, a grayscale stimulation image is obtained based on the following operations: obtaining a color blocks from a database; removing color blocks with the same color as the color blocks in the memory array image from the a color blocks to obtain b target color blocks, where b is less than a, and a and b are both positive integers; based on a color mixing algorithm, performing color superposition processing on multiple target color blocks in the overlapping area of ​​the color blocks in the initial stimulation image to obtain a superimposed stimulation image, wherein the initial stimulation image is obtained by arranging the b target color blocks; performing grayscale conversion processing on the superimposed stimulation image to obtain a grayscale stimulation image.

[0006] According to an embodiment of the present disclosure, the i-1th round display task includes M display subtasks, where M is a positive integer, the color distribution of the color blocks in the memory array image and the test array image in the M display subtasks is determined based on the color block color change ratio parameter, the number and position of the color blocks in the memory array image and the test array image in each display subtask are the same, and the i-1th feedback result includes the subtask feedback results corresponding to each of the M display subtasks; determining the i-1th working memory capacity evaluation result based on the i-1th feedback result includes: determining the i-1th observation accuracy and the i-1th observation error rate corresponding to the i-1th round display task based on the M subtask feedback results corresponding to the M display subtasks; and determining the i-1th memory capacity evaluation result based on the i-1th task intensity parameter, the i-1th observation accuracy and the i-1th observation error rate.

[0007] According to an embodiment of the present disclosure, a display subtask is marked with a color block color change category label, and the color block color change category label represents whether the color of the color blocks set at the same position in the memory array image and the test array image is the same or different; wherein, determining the i-1th observation correct rate and the i-1th observation error rate corresponding to the i-1th round display task based on the M subtask feedback results corresponding to the M display subtasks includes: for the mth display subtask among the M display subtasks, when the color block color change category label of the mth display subtask matches the color change category represented by the subtask feedback result, determining the observation result of the mth display subtask as a correct observation result; when the color block color change category label of the mth display subtask does not match the color change category represented by the subtask feedback result, determining the observation result of the mth display subtask as an incorrect observation result; determining the i-1th observation correct rate corresponding to the i-1th round display task based on the number of correct observation results and the number of display subtasks; and determining the i-1th observation error rate corresponding to the i-1th round display task based on the number of incorrect observation results and the number of display subtasks.

[0008] According to an embodiment of the present disclosure, a control device is configured to control a display device to display a first fixation point image, a memory array image, a second fixation point image, a clue prompt image, a third fixation point image, a grayscale stimulation image, a fourth fixation point image, and a test array image based on preset timing rules, wherein the first fixation point image is used to guide the target object to gaze at the center point of the display device, and the i-1th preset timing rule of the i-1th round display task is determined based on the i-1th stimulation intensity parameter.

[0009] According to an embodiment of the present disclosure, when the i-1th observation accuracy corresponding to the i-1th round display task is less than a preset accuracy threshold, or when the average color block observation reaction time corresponding to the i-1th round display task is greater than the preset reaction threshold, the i-1th task intensity parameter is adjusted to obtain the i-1th round display task, wherein the average color block observation reaction time is obtained by performing a weighted average operation on the color block observation reaction times corresponding to each of the M display subtasks, and the color block observation reaction time represents the time from the start of displaying the test array image to responding to the feedback operation during the execution of the display subtask; when the i-1th observation accuracy corresponding to the i-1th round display task is greater than or equal to the preset accuracy threshold and the average color block observation reaction time is less than or equal to the preset reaction threshold, the i-1th stimulation intensity parameter is adjusted according to the i-1th memory capacity evaluation result and the i-1th capacity threshold to obtain the i-1th round display task, wherein the i-1th capacity threshold is determined based on the historical memory ability of the target object or the i-1th task intensity parameter.

[0010] According to an embodiment of the present disclosure, the evaluation device is configured to: when the i-1th memory capacity evaluation result is less than or equal to the i-1th capacity threshold, enhance the i-1th stimulation intensity parameter based on the adaptive adjustment mechanism to obtain the i-th stimulation intensity parameter; based on the i-th stimulation intensity parameter, determine the i-th round display task.

[0011] According to a second aspect of the present disclosure, a working memory assessment method based on visual induction is provided, comprising: executing an i-1th round of display task, wherein the i-1th round of display task is to display a memory array image, a grayscale stimulation image, and a test array image to a target object based on an i-1th task intensity parameter and an i-1th stimulation intensity parameter of the i-1th round; determining an i-1th feedback result in response to an i-1th feedback operation of the target object; determining an i-1th working memory capacity assessment result based on the i-1th feedback result; and determining an i-th task intensity parameter and an i-th stimulation intensity parameter based on the i-1th feedback result and the i-1th working memory capacity assessment result to obtain an i-th round of display task.

[0012] A third aspect of the present disclosure provides an electronic device, comprising: one or more processors; and a memory for storing one or more computer programs, wherein the one or more processors execute the one or more computer programs to implement the steps of the above method.

[0013] The fourth aspect of the present disclosure further provides a computer-readable storage medium having a computer program or instructions stored thereon, which implements the steps of the above method when the computer program or instructions are executed by a processor.

[0014] According to the visually induced working memory assessment system and method provided by the present disclosure, multiple rounds of display tasks are designed to provide visual stimulation to the target object under different task intensity parameters, and the working memory capacity of the target object is quantitatively assessed based on the feedback results of the display tasks, so as to obtain relatively accurate working memory capacity assessment results, and the task intensity parameters and stimulation intensity parameters are adaptively adjusted according to the feedback results and the quantified results of the working memory capacity to design the next round of display tasks. The multi-display task design and dynamic adjustment of the task intensity parameters and stimulation intensity parameters overcome the limitations of the traditional single memory task assessment, are conducive to the comprehensive and accurate assessment of the individual's working memory performance to comprehensively assess the working memory capacity of the target object, effectively improve the working memory ability under high-load working conditions, and provide a new technical means for cognitive intervention. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] The above and other objects, features and advantages of the present disclosure will become more apparent through the following description of the embodiments of the present disclosure with reference to the accompanying drawings.

[0016] Figure 1 A schematic diagram of a working memory assessment system based on visual induction according to an embodiment of the present disclosure is shown.

[0017] Figure 2 A flowchart of a working memory assessment method based on visual induction according to an embodiment of the present disclosure is shown.

[0018] Figure 3A Schematic diagrams of Experiment 1-A and Experiment 1-B according to an embodiment of the present disclosure are shown.

[0019] Figure 3B Schematic diagrams of Experiment 2-A and Experiment 2-B according to an embodiment of the present disclosure are shown.

[0020] Figure 4 A block diagram of an electronic device suitable for implementing a working memory assessment method based on visual induction according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0021] Hereinafter, embodiments according to the present disclosure will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are merely exemplary and are not intended to limit the scope of the present disclosure. In the detailed description below, for ease of explanation, many specific details are set forth to provide a comprehensive understanding of the embodiments of the present disclosure. However, it is apparent that one or more embodiments may also be implemented without these specific details. In addition, in the following description, descriptions of well-known structures and technologies are omitted to avoid unnecessary confusion of the concepts of the present disclosure.

[0022] The terms used herein are only for describing specific embodiments and are not intended to limit the present disclosure. The terms "comprise," "include," etc. used herein indicate the presence of features, steps, operations, and / or components, but do not exclude the presence or addition of one or more other features, steps, operations, or components.

[0023] All terms used herein (including technical and scientific terms) have the meanings commonly understood by those skilled in the art unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification and should not be interpreted in an idealized or overly rigid manner.

[0024] When expressions such as "at least one of A, B, and C, etc." are used, they should generally be interpreted in accordance with the meaning commonly understood by those skilled in the art (for example, "a system having at least one of A, B, and C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.).

[0025] During the implementation of the present disclosure, it was discovered that working memory is a core cognitive ability that supports individuals in storing and manipulating information in complex tasks such as language comprehension, reasoning, and learning. Working memory can be improved through relevant cognitive interventions and memory training. However, the inadequacy and lack of intervention methods in related technologies have resulted in a relatively limited assessment of working memory capacity, resulting in low assessment accuracy.

[0026] In view of this, according to an embodiment of the present disclosure, a working memory assessment system and method based on visual induction is provided. The system includes: a control device configured to execute multiple rounds of display tasks, wherein the i-1th round of display tasks in the multiple rounds of display tasks is to control the display device to display a memory array image, a grayscale stimulation image, and a test array image based on the i-1th task intensity parameter and the i-1th stimulation intensity parameter of the i-1th round; an interaction device configured to determine the i-1th feedback result in response to the i-1th feedback operation of the target object during the execution of the i-1th round of display tasks; an assessment device configured to determine the i-1th working memory capacity assessment result based on the i-1th feedback result, and to determine the i-th task intensity parameter and the i-th stimulation intensity parameter based on the i-1th feedback result and the i-1th working memory capacity assessment result, thereby obtaining the i-th round of display tasks.

[0027] In the technical solutions disclosed herein, the user information (including but not limited to user personal information, user image information, user device information, such as location information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved are all information and data authorized by the user or fully authorized by all parties, and the collection, storage, use, processing, transmission, provision, disclosure and application of the relevant data comply with relevant laws, regulations and standards, take necessary confidentiality measures, do not violate public order and good morals, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0028] It should be noted that the sequence numbers of the operations in the following method are only used to indicate the operation for the purpose of description, and should not be regarded as indicating the order in which the operations should be performed. Unless explicitly stated, the method does not need to be performed in the order shown.

[0029] Figure 1 A schematic diagram of a working memory assessment system based on visual induction according to an embodiment of the present disclosure is shown.

[0030] like Figure 1As shown, the visually induced working memory assessment system 100 of this embodiment includes a control device 110, an interaction device 120, and an assessment device 130. The control device 110 is configured to perform multiple rounds of display tasks, wherein the i-1th round of display tasks in the multiple rounds of display tasks is to control the display device to display the memory array image, the grayscale stimulation image, and the test array image based on the i-1th task intensity parameter and the i-1th stimulation intensity parameter of the i-1th round, wherein the task intensity parameter represents the number of color blocks in the memory array image, and the stimulation intensity parameter represents the display duration of the grayscale stimulation image introduced during the change from the memory array image to the test array image, and i is a positive integer greater than 1; the interaction device 120 is configured to, during the execution of the i-1th round of display tasks, respond to the i-1th feedback operation of the target object, Determine the i-1th feedback result, wherein the feedback result indicates that the target object believes that the memory array image and the test array image have different color blocks, or indicates that the target object believes that the memory array image and the test array image are exactly the same; the evaluation device 130 is configured to determine the i-1th working memory capacity evaluation result based on the i-1th feedback result, and determine the i-th task intensity parameter and the i-th stimulation intensity parameter based on the i-1th feedback result and the i-1th working memory capacity evaluation result, to obtain the i-th round display task, wherein the evaluation device 130 is further configured to determine the target working memory capacity evaluation result based on the working memory capacity evaluation results of multiple rounds of display tasks.

[0031] According to an embodiment of the present disclosure, the control device and evaluation device are deployed on a central processing unit, the experimental program is encapsulated in the control device, and the display device can be a liquid crystal display with 24GB of memory, a size of 23.8 inches, 1920×1080 pixels, and a refresh rate of 144Hz. During the execution of multiple rounds of display tasks, the control device controls the display device to display the memory array image, grayscale stimulation image, and test array image. The background of the grayscale stimulation image is a uniform light gray (red, green, and blue (RGB): 125, 125, 125). The interactive device 120 can be a button device connecting the evaluation device 110 and the display device.

[0032] According to an embodiment of the present disclosure, the distance between the target object and the center of the screen of the display device is 65 cm. The target object represents an object whose working memory capacity is to be evaluated in the display task.

[0033] According to an embodiment of the present disclosure, the i-1th task intensity parameter is the number of items that the target object needs to remember in the i-1th round of display task. For example, the i-1th task intensity parameter is 2, which means that the number of color blocks in the memory array image displayed by the display device during the execution of the i-1th round of display task is 2, and the position and number of color blocks in the memory array image and the test array image in the same display task are the same.

[0034] According to an embodiment of the present disclosure, the memory array image is a visual image that the target object observes for reference. During the display of the memory array image, the target object is required to memorize the position, color, and number of color blocks in the memory array image. The test array image is a visual image that the target object observes for comparison. During the display of the test array image, the target object is required to observe the position, color, and number of color blocks in the test array image, and determine whether the color of the color blocks changes between the memory array image and the test array image.

[0035] According to embodiments of the present disclosure, a greater stimulation intensity parameter indicates a longer duration of display of the grayscale stimulation image introduced during the transition from the memory array image to the test array image. Introducing the grayscale stimulation image during the transition from the memory array image to the test array image can activate the target subject's quiescent neural activity state, thereby optimizing the target subject's working memory ability under a display task with a high task intensity parameter.

[0036] According to an embodiment of the present disclosure, the feedback operation is a target object click operation. For example, if the target object believes that there are different color blocks between the memory array image and the test array image, the target object clicks the button "j" key, or if the target object believes that the memory array image and the test array image are exactly the same, the target object clicks the button "f" key.

[0037] According to embodiments of the present disclosure, a quantitative analysis model or a dynamic adjustment algorithm can be used to process the (i-1)th feedback result to obtain the (i-1)th working memory capacity assessment result. For example, if the target subject is already in a working state while observing the displayed image, the (i-1)th working memory capacity assessment result can be the target subject's memory capacity for the multiple color blocks in the array distribution during the (i-1)th round of the display task, and can further reflect the target subject's memory capacity in other working states at a task level corresponding to the task intensity parameter and a stimulation level corresponding to the stimulation intensity parameter.

[0038] According to an embodiment of the present disclosure, a first task intensity parameter and a first stimulation intensity parameter are set in the first round display task design stage; during the execution of the first round display task, a first feedback result is determined in response to the first feedback operation of the target object; a first working memory capacity assessment result is determined based on the first feedback result, and a second task intensity parameter and a second stimulation intensity parameter are determined based on the first feedback result and the first working memory capacity assessment result, to obtain a second round display task.

[0039] For example, first, in the first round of display task design stage, the first task intensity parameter is set to 2 and the first stimulation intensity parameter is set to 100ms. During the execution of the first round of display task, in response to the first feedback operation of the target object, the first feedback result is determined, and the first working memory capacity assessment result is obtained by processing the first feedback result based on the dynamic adjustment algorithm. If the first feedback result does not meet the baseline expected result, the first task intensity parameter can be increased and the second task intensity parameter can be determined to be 4. Then, in the second round of display task design stage, the second task intensity parameter is set to 4 and the second stimulation intensity parameter is set to 100ms.

[0040] For example, taking the above-mentioned second task intensity parameter of 4 and the second stimulation intensity parameter of 100ms as an example, during the execution of the second round of display task, in response to the second feedback operation of the target object, the second feedback result is determined, and the second feedback result is processed based on the dynamic adjustment algorithm to obtain the second working memory capacity evaluation result. If the first feedback result meets the benchmark expected result, the task intensity parameter will no longer be adjusted. If the second working memory capacity evaluation result does not meet the working memory performance condition, the second stimulation intensity parameter will be increased, and the third stimulation intensity parameter will be determined to be 120ms. Then, in the design stage of the third round of display task, the third task intensity parameter will be set to 4 and the third stimulation intensity parameter will be set to 120ms. If the second working memory capacity evaluation result meets the working memory performance condition, the third round of display task will no longer be designed.

[0041] According to an embodiment of the present disclosure, a target working memory capacity assessment result is determined based on the working memory capacity assessment results of multiple rounds of display tasks. The target working memory capacity assessment result can be the maximum working memory capacity assessment result, reflecting the target subject's optimal working memory ability, such as a large number of memorized color blocks and accurate color and position of the blocks. For example, in the two rounds of display tasks described above, if the second working memory capacity assessment result meets the working memory performance condition, the second working memory capacity assessment result is determined as the target working memory capacity assessment result.

[0042] According to an embodiment of the present disclosure, the working memory capacity change state of the target subject can be evaluated based on the working memory capacity evaluation results of multiple rounds of display tasks, thereby comprehensively evaluating the working memory performance.

[0043] According to the embodiments of the present disclosure, since multiple rounds of display tasks are designed to provide visual stimulation to the target object at different task intensity parameters, and the working memory capacity of the target object is quantitatively evaluated based on the feedback results of the display tasks, a relatively accurate working memory capacity evaluation result is obtained, and the task intensity parameters and stimulation intensity parameters are adaptively adjusted according to the feedback results and the quantification results of the working memory capacity to design the next round of display tasks, the multi-display task design and dynamic adjustment of the task intensity parameters and stimulation intensity parameters overcome the limitations of the traditional single memory task evaluation, and are conducive to a comprehensive and accurate evaluation of the individual's working memory performance to comprehensively evaluate the working memory capacity of the target object, effectively improve the working memory ability under high-load working conditions, and provide a new technical means for cognitive intervention.

[0044] According to an embodiment of the present disclosure, a control device is configured to control a display device to display a first fixation point image, a memory array image, a second fixation point image, a clue prompt image, a third fixation point image, a grayscale stimulation image, a fourth fixation point image, and a test array image based on preset timing rules, wherein the first fixation point image is used to guide the target object to gaze at the center point of the display device, and the i-1th preset timing rule of the i-1th round display task is determined based on the i-1th stimulation intensity parameter.

[0045] According to an embodiment of the present disclosure, the first gaze point image, the second gaze point image, the third gaze point image, and the fourth gaze point image are all gaze point images, and the midpoint of the gaze point image is marked with a central gaze point, which is used to guide the target object to gaze at the center point of the display device.

[0046] According to an embodiment of the present disclosure, a clue indication symbol is marked in the clue prompt image to instruct the target object to make a judgment between the memory array image and the test array image.

[0047] According to an embodiment of the present disclosure, the preset timing rules include the order in which images appear and the display duration of each image. During the execution of each display task, the control device controls the display device to display in sequence based on the preset timing rules: the first gaze point image of 200ms, the memory array visual image of 100ms, the second gaze point image of 900ms, the clue prompt image of 200ms, the third gaze point image, the grayscale stimulation image, the fourth gaze point image, and the test array visual image of 2000ms. The total display duration of the third gaze point image, the grayscale stimulation image, and the fourth gaze point image is 1400ms.

[0048] According to an embodiment of the present disclosure, the duration of displaying the grayscale stimulation image is determined based on the stimulation intensity parameters set in the design phase of each round of display task, and the duration of displaying the third and fourth fixation point images is shortened accordingly.

[0049] For example, the i-1 stimulation intensity parameter is 100ms, and the i-1 preset timing rule sets the third fixation point image of 900ms, the grayscale stimulation image of 100ms, and the fourth fixation point image of 400ms; the i-th stimulation intensity parameter is 120ms, and the i-th preset timing rule sets the third fixation point image of 890ms, the grayscale stimulation image of 120ms, and the fourth fixation point image of 390ms.

[0050] According to an embodiment of the present disclosure, a grayscale stimulation image is obtained based on the following operations: obtaining a color blocks from a database; removing color blocks with the same color as the color blocks in the memory array image from the a color blocks to obtain b target color blocks, where b is less than a, and a and b are both positive integers; based on a color mixing algorithm, performing color superposition processing on multiple target color blocks in the overlapping area of ​​the color blocks in the initial stimulation image to obtain a superimposed stimulation image, wherein the initial stimulation image is obtained by arranging the b target color blocks; performing grayscale conversion processing on the superimposed stimulation image to obtain a grayscale stimulation image.

[0051] According to an embodiment of the present disclosure, the color block is in the shape of a 1°×1° square, the color of each square is randomly extracted from a preset multiple color database, and the extracted color is randomly rendered on the square to obtain a color blocks.

[0052] For example, the database may include magenta (RGB: 255,0,144), cyan (RGB: 0,255,255), red (RGB: 255,0,0), blue (RGB: 0,0,255), green (RGB: 0,255,0), violet (RGB: 238,130,238), yellow (RGB: 255,255,0), black (RGB: 0,0,0), white (RGB: 255,255,255), orange (RGB: 255,128,0), etc. The diversity of colors increases the complexity of the display task and the memory load.

[0053] For example, in the i-1th round display task, the colors of the color blocks in the memory array image are yellow and red, then the yellow and red color blocks are removed from a color blocks to obtain b target color blocks.

[0054] According to an embodiment of the present disclosure, an initial stimulation image is obtained by randomly arranging b target color blocks, and a color mixing algorithm is used to perform color superposition processing on multiple target color blocks in the overlapping area of ​​the color blocks in the initial stimulation image to obtain a superimposed stimulation image.

[0055] For example, if the overlapping area of ​​the color blocks includes a blue block and a purple block, the color value of the blue block and the color value of the purple block are summed to obtain the color value of the overlapping area of ​​the color blocks. The pixel value of the superimposed stimulus image is the color value after the colors are superimposed.

[0056] According to an embodiment of the present disclosure, grayscale conversion is performed on the color values ​​of the superimposed stimulation image to obtain a grayscale stimulation image. The grayscale stimulation image is a mosaic image, and the pixel values ​​of the grayscale stimulation image are grayscale values.

[0057] According to an embodiment of the present disclosure, the i-1th round display task includes M display subtasks, where M is a positive integer, the color distribution of the color blocks in the memory array image and the test array image in the M display subtasks is determined based on the color block color change ratio parameter, the number and position of the color blocks in the memory array image and the test array image in each display subtask are the same, and the i-1th feedback result includes the subtask feedback results corresponding to each of the M display subtasks; determining the i-1th working memory capacity evaluation result based on the i-1th feedback result includes: determining the i-1th observation accuracy and the i-1th observation error rate corresponding to the i-1th round display task based on the M subtask feedback results corresponding to the M display subtasks; and determining the i-1th memory capacity evaluation result based on the i-1th task intensity parameter, the i-1th observation accuracy and the i-1th observation error rate.

[0058] According to an embodiment of the present disclosure, M display subtasks are designed in the i-1th round of display task design phase, and the task intensity parameters and stimulation intensity parameters of the M display subtasks are the same. The task intensity parameter and stimulation intensity parameter of each display subtask are the i-1th task intensity parameter and the i-1th stimulation intensity parameter, respectively.

[0059] For example, if the color block color change ratio parameter is 50%, the color block colors of the corresponding position areas in the memory array image and the test array image in half of the display subtasks are set to be the same, and the color block colors of the corresponding position areas in the memory array image and the test array image in the remaining half of the display subtasks are set to be different.

[0060] According to an embodiment of the present disclosure, the number of color blocks in the memory array image is an even number, and a coordinate axis is established with the center of the memory array image as the base point. The area in the memory array image is divided into four quadrants, and half the number of color blocks are presented on the left and right sides of the y-axis, respectively. The positions of the color blocks on each side are randomly arranged, with the center as the center of the circle, and the viewing angle range of the color blocks is 3° to 7.3°.

[0061] According to an embodiment of the present disclosure, a number of breaks is set in each round of display tasks to ensure a balance between the target subject's concentration and the continuity of the experiment.

[0062] For example, the i-1th round of display tasks includes 480 display subtasks. The number of breaks is set to 6. Each 80 display subtasks is regarded as a batch. A break of about 1 minute is set between the execution of adjacent batches. The total execution time of the i-1th round of display tasks is controlled within 45 minutes.

[0063] According to an embodiment of the present disclosure, each display subtask corresponds to a subtask feedback result, and each subtask feedback result reflects the correct or incorrect observation result of the target object in this display subtask. The M subtask feedback results are counted to determine the i-1th observation accuracy rate and i-1th observation error rate corresponding to the entire i-1th round of display task.

[0064] According to an embodiment of the present disclosure, the i-1th observation accuracy rate represents the probability of correctly observing the target object in the M display subtasks, and the i-1th observation error rate represents the probability of incorrectly observing the target object in the M display subtasks.

[0065] In one embodiment, the i-1th memory capacity evaluation result As shown in formula (1):

[0066] (1);

[0067] in, Characterize the intensity parameter of the i-1th task, Characterizes the accuracy of the i-1th observation, Characterizes the i-1th observation error rate.

[0068] According to an embodiment of the present disclosure, a display subtask is marked with a color block color change category label, and the color block color change category label represents whether the color of the color blocks set at the same position in the memory array image and the test array image is the same or different; wherein, determining the i-1th observation correct rate and the i-1th observation error rate corresponding to the i-1th round display task based on the M subtask feedback results corresponding to the M display subtasks includes: for the mth display subtask among the M display subtasks, when the color block color change category label of the mth display subtask matches the color change category represented by the subtask feedback result, determining the observation result of the mth display subtask as a correct observation result; when the color block color change category label of the mth display subtask does not match the color change category represented by the subtask feedback result, determining the observation result of the mth display subtask as an incorrect observation result; determining the i-1th observation correct rate corresponding to the i-1th round display task based on the number of correct observation results and the number of display subtasks; and determining the i-1th observation error rate corresponding to the i-1th round display task based on the number of incorrect observation results and the number of display subtasks.

[0069] According to an embodiment of the present disclosure, a color block color change category label of 1 represents that the color of the color block set at the same position in the memory array image in the display subtask and the test array image is the same; a color block color change category label of 0 represents that the color of the color block set at the same position in the memory array image in the display subtask and the test array image is different.

[0070] According to an embodiment of the present disclosure, a color change category represented by a subtask feedback result of 1 represents that the target object believes that the colors of the color blocks set at the same position in the memory array image in the display subtask and the test array image are the same; a color change category represented by a subtask feedback result of 0 represents that the target object believes that the colors of the color blocks set at the same position in the memory array image in the display subtask and the test array image are different.

[0071] According to an embodiment of the present disclosure, if the color change category label of the color block of the mth display subtask matches the color change category represented by the subtask feedback result, it means that the target object is observed correctly; if the color change category label of the color block of the mth display subtask does not match the color change category represented by the subtask feedback result, it means that the target object is observed incorrectly.

[0072] According to an embodiment of the present disclosure, in the i-1th display task, each display subtask corresponds to an observation result, and the i-1th observation accuracy is determined according to the proportion of the number of correct observation results to the M observation results; the i-1th observation error rate is determined according to the proportion of the number of incorrect observation results to the M observation results.

[0073] According to an embodiment of the present disclosure, the evaluation device is configured to: when the i-1th observation accuracy corresponding to the i-1th round display task is less than a preset accuracy threshold, or when the average color block observation reaction time corresponding to the i-1th round display task is greater than a preset reaction threshold, adjust the i-1th task intensity parameter to obtain the i-th round display task, wherein the average color block observation reaction time is obtained by performing a weighted average operation on the color block observation reaction times corresponding to each of the M display subtasks, and the color block observation reaction time represents the time from the start of displaying the test array image to responding to the feedback operation during the execution of the display subtask; when the i-1th observation accuracy corresponding to the i-1th round display task is greater than or equal to the preset accuracy threshold and the average color block observation reaction time is less than or equal to the preset reaction threshold, adjust the i-1th stimulation intensity parameter according to the i-1th memory capacity evaluation result and the i-1th capacity threshold to obtain the i-th round display task, wherein the i-1th capacity threshold is determined based on the historical memory ability of the target object or the i-1th task intensity parameter.

[0074] According to an embodiment of the present disclosure, a weighted average operation is performed on the color block observation reaction times corresponding to each of the M display subtasks to obtain an average color block observation reaction time corresponding to the (i-1)th round of display task.

[0075] For example, the preset accuracy threshold may be 80%, and the preset reaction threshold may be 1500ms.

[0076] According to an embodiment of the present disclosure, when the i-1th observation accuracy corresponding to the i-1th round of display task is less than the preset accuracy threshold, or when the average color block observation reaction time corresponding to the i-1th round of display task is greater than the preset reaction threshold, the task difficulty is automatically increased and the task intensity parameter is increased; when the i-1th observation accuracy corresponding to the i-1th round of display task is greater than or equal to the preset accuracy threshold and the average color block observation reaction time corresponding to the i-1th round of display task is less than or equal to the preset reaction threshold, the task intensity parameter remains unchanged and the stimulation intensity parameter is automatically increased.

[0077] For example, the i-1th observation accuracy corresponding to the i-1th round display task is 75%, the i-1th task intensity parameter is 2, and the observation accuracy is less than the preset accuracy threshold. Therefore, it is necessary to continue designing the i-1th round display task and adjust the i-1th task intensity parameter by 2, so that the i-1th task intensity parameter is 4.

[0078] For example, for the i-1th round of display task, the i-1th observation accuracy is 85%, the average color block observation reaction time is 1200ms, the i-1th task intensity parameter is 2, and the i-1th stimulus intensity parameter is 140ms. Since the observation accuracy is greater than the preset accuracy threshold and the average color block observation reaction time is less than the preset reaction threshold, it is necessary to determine whether to adjust the i-1th stimulus intensity parameter based on the i-1th memory capacity assessment result and the i-1th capacity threshold. If the i-1th stimulus intensity parameter needs to be increased by 20ms, the i-th stimulus intensity parameter is 160ms, and the i-th task intensity parameter remains unchanged at 2, resulting in the i-th round of display task. If the i-1th memory capacity assessment result meets the target subject's optimal working memory capacity, then there is no need to design the i-th round of display task.

[0079] According to an embodiment of the present disclosure, the task intensity parameter is the working memory load intensity of the target object, and the i-1th memory capacity assessment result can be equal to the i-1th task intensity parameter at most. Therefore, the i-1th capacity threshold can be set according to the i-1th task intensity parameter; the working memory capacity of each individual object is different. If the i-1th memory capacity assessment result does not reach the i-1th task intensity parameter during the execution process of multiple display tasks, the i-1th capacity threshold can be set based on the historical memory capacity of the target object.

[0080] For example, based on the working memory ability of the target object, in a display task with a smaller task intensity parameter, the i-1th capacity threshold is set to the i-1th task intensity parameter; in a display task with a larger task intensity parameter, such as if the i-1th task intensity parameter is 8, based on the historical memory ability of the target object in previous rounds of display tasks, it is found that the target object's memory capacity evaluation result improves slowly after the task intensity parameter exceeds 6, then the i-1th capacity threshold can be set to 7.

[0081] According to the embodiments of the present disclosure, through multi-display task design and dynamic adjustment of task intensity parameters and stimulation intensity parameters, the limitations of traditional single memory task evaluation are overcome, which is conducive to comprehensive and accurate evaluation of individual working memory performance.

[0082] According to an embodiment of the present disclosure, the evaluation device is configured to: when the i-1th memory capacity evaluation result is less than or equal to the i-1th capacity threshold, enhance the i-1th stimulation intensity parameter based on the adaptive adjustment mechanism to obtain the i-th stimulation intensity parameter; based on the i-th stimulation intensity parameter, determine the i-th round display task.

[0083] According to an embodiment of the present disclosure, after the i-1th round of display task is executed, the i-1th observation accuracy rate and the i-1th observation error rate are obtained, and then the i-1th memory capacity evaluation result is obtained based on the i-1th observation accuracy rate, the i-1th observation error rate and the i-1th task intensity parameter. When the i-1th memory capacity evaluation result is less than or equal to the i-1th capacity threshold, the i-1th stimulation intensity parameter can be enhanced by an adaptive adjustment mechanism.

[0084] According to an embodiment of the present disclosure, the adaptive adjustment mechanism is adjusted based on the rate of change of the i-1th observation accuracy and the average color block observation reaction time corresponding to the i-1th round of display tasks. If the i-1th observation accuracy rate increases more slowly than the previous observation accuracy rate or the average color block observation reaction time corresponding to the i-1th round of display tasks decreases more slowly than the previous average color block observation reaction time, the i-1th stimulation intensity parameter is increased by a larger amount; otherwise, the i-1th stimulation intensity parameter is increased by a smaller amount.

[0085] For example, by increasing the i-1th stimulus intensity parameter by a larger magnitude, the i-1th stimulus intensity parameter can be increased by 40ms to obtain the i-th stimulus intensity parameter; by increasing the i-1th stimulus intensity parameter by a smaller magnitude, the i-1th stimulus intensity parameter can be increased by 20ms to obtain the i-th stimulus intensity parameter.

[0086] According to an embodiment of the present disclosure, when the i-1th memory capacity evaluation result is greater than the i-1th capacity threshold or the i-1th memory capacity evaluation result is less than the previous memory capacity evaluation result, it means that the memory capacity evaluation result of the target object has reached the target memory capacity evaluation result or the memory ability has decreased, and there is no need to design the i-th round display task.

[0087] According to the embodiments of the present disclosure, an adaptive adjustment mechanism is set up in the process of designing a display task, which can dynamically optimize the enhancement amplitude of the stimulation intensity parameter according to the real-time reaction performance of the target object. The task intensity parameter is the working memory load intensity of the target object. Under the high working memory load intensity state, the adaptive increase of the stimulation intensity parameter caters to the memory rhythm of the target object, which is conducive to improving the working memory capacity.

[0088] Figure 2 A flowchart of a working memory assessment method based on visual induction according to an embodiment of the present disclosure is shown.

[0089] like Figure 2 As shown, the method 200 includes operations S210 to S240.

[0090] In operation S210, the i-1th round display task is performed, wherein the i-1th round display task is to display the memory array image, the grayscale stimulation image and the test array image to the target object based on the i-1th task intensity parameter and the i-1th stimulation intensity parameter of the i-1th round.

[0091] In operation S220 , in response to the (i-1)th feedback operation of the target object, an (i-1)th feedback result is determined.

[0092] In operation S230 , an (i-1)th working memory capacity evaluation result is determined based on the (i-1)th feedback result.

[0093] In operation S240 , an i-th task intensity parameter and an i-th stimulation intensity parameter are determined based on the i-1-th feedback result and the i-1-th working memory capacity assessment result to obtain an i-th round display task.

[0094] According to an embodiment of the present disclosure, in the design stage of the i-1th round of display tasks, the i-1th task intensity parameters and the i-1th stimulation intensity parameters are set, and the i-1th round of display tasks is performed, and the target object observes the memory array image, the grayscale stimulation image and the test array image in turn.

[0095] According to an embodiment of the present disclosure, the target object observes the changes in the color blocks between the memory array image and the test array image, and performs the (i-1)th feedback operation.

[0096] According to an embodiment of the present disclosure, in response to the i-1th feedback operation of the target object, an i-1th feedback result is determined, and the i-1th feedback result is processed using a quantitative analysis model to obtain an i-1th working memory capacity assessment result.

[0097] According to an embodiment of the present disclosure, the gap between the i-1th feedback result and the expected result, the gap between the i-1th working memory capacity evaluation result and the expected capacity result are evaluated, the i-1th task intensity parameter and the i-1th stimulation intensity parameter are adaptively adjusted, the i-th task intensity parameter and the i-th stimulation intensity parameter are determined, and the i-th round display task is obtained.

[0098] According to the embodiments of the present disclosure, an evaluation is performed in real time based on the feedback results of the previous round and the working memory capacity evaluation results, and the current display task is designed to further comprehensively evaluate the impact of the task intensity parameters and the stimulation intensity parameters on the memory ability of the target object and determine the target working memory capacity evaluation results of the target object.

[0099] According to an embodiment of the present disclosure, before designing multiple rounds of display tasks for target objects, a reference comparison experiment including sample references of the multiple rounds of display tasks is designed for multiple groups of sample objects.

[0100] According to an embodiment of the present disclosure, a grayscale stimulation image is obtained based on the following operations: obtaining a color blocks from a database; removing color blocks with the same color as the color blocks in the memory array image from the a color blocks to obtain b target color blocks, where b is less than a, and a and b are both positive integers; based on a color mixing algorithm, performing color superposition processing on multiple target color blocks in the overlapping area of ​​the color blocks in the initial stimulation image to obtain a superimposed stimulation image, wherein the initial stimulation image is obtained by arranging the b target color blocks; performing grayscale conversion processing on the superimposed stimulation image to obtain a grayscale stimulation image.

[0101] According to an embodiment of the present disclosure, the i-1th round of display task includes M display subtasks, where M is a positive integer. The color distribution of the color blocks in the memory array image and the test array image in the M display subtasks is determined based on the color block color change ratio parameter. The number and position of the color blocks in the memory array image and the test array image in each display subtask are the same. The i-1th feedback result includes the subtask feedback results corresponding to each of the M display subtasks.

[0102] According to an embodiment of the present disclosure, based on the M subtask feedback results corresponding to the M display subtasks, the i-1th observation accuracy and the i-1th observation error rate corresponding to the i-1th round display task are determined; based on the i-1th task intensity parameter, the i-1th observation accuracy and the i-1th observation error rate, the i-1th memory capacity evaluation result is determined.

[0103] According to an embodiment of the present disclosure, the display subtask is marked with a color block color change category label, which indicates whether the colors of the color blocks set at the same position in the memory array image and the test array image are the same or different.

[0104] According to an embodiment of the present disclosure, for the mth display subtask among M display subtasks, when the color block color change category label of the mth display subtask matches the color change category represented by the subtask feedback result, the observation result of the mth display subtask is determined to be a correct observation result; when the color block color change category label of the mth display subtask does not match the color change category represented by the subtask feedback result, the observation result of the mth display subtask is determined to be an incorrect observation result; based on the number of correct observation results and the number of display subtasks, the i-1th observation correct rate corresponding to the i-1th round display task is determined; based on the number of incorrect observation results and the number of display subtasks, the i-1th observation error rate corresponding to the i-1th round display task is determined.

[0105] According to an embodiment of the present disclosure, a first fixation point image, a memory array image, a second fixation point image, a clue prompt image, a third fixation point image, a grayscale stimulation image, a fourth fixation point image, and a test array image are displayed based on preset timing rules, wherein the first fixation point image is used to guide the target object to gaze at the center point of the display device, and the i-1th preset timing rule of the i-1th round display task is determined based on the i-1th stimulation intensity parameter.

[0106] According to an embodiment of the present disclosure, when the i-1th observation accuracy corresponding to the i-1th round display task is less than a preset accuracy threshold, or when the average color block observation reaction time corresponding to the i-1th round display task is greater than the preset reaction threshold, the i-1th task intensity parameter is adjusted to obtain the i-1th round display task, wherein the average color block observation reaction time is obtained by performing a weighted average operation on the color block observation reaction times corresponding to each of the M display subtasks, and the color block observation reaction time represents the time from the start of displaying the test array image to responding to the feedback operation during the execution of the display subtask; when the i-1th observation accuracy corresponding to the i-1th round display task is greater than or equal to the preset accuracy threshold and the average color block observation reaction time is less than or equal to the preset reaction threshold, the i-1th stimulation intensity parameter is adjusted according to the i-1th memory capacity evaluation result and the i-1th capacity threshold to obtain the i-1th round display task, wherein the i-1th capacity threshold is determined based on the historical memory ability of the target object or the i-1th task intensity parameter.

[0107] According to an embodiment of the present disclosure, when the i-1th memory capacity evaluation result is less than or equal to the i-1th capacity threshold, the i-1th stimulation intensity parameter is enhanced based on the adaptive adjustment mechanism to obtain the i-th stimulation intensity parameter; based on the i-th stimulation intensity parameter, the i-th round display task is determined.

[0108] Figure 3A Schematic diagrams of Experiment 1-A and Experiment 1-B according to an embodiment of the present disclosure are shown.

[0109] like Figure 3A As shown, Experiment 1-A and Experiment 1-B are the same group of sample objects, one group of sample objects includes 30 first sample objects, Experiment 1-A is the reference experiment of Experiment 1-B, and Experiment 1-B adds a 100ms grayscale stimulus image compared to Experiment 1-A. A display task was set for Experiment 1-A, in which the task intensity parameter was set to 8 and the stimulation intensity parameter was set to 0. The control device controlled the display device to display, based on a preset timing rule, the following sequence: a first fixation point image of 200 ms, a memory array visual image of 100 ms, a second fixation point image of 900 ms, a clue prompt image of 200 ms, a third fixation point image of 1300 ms, and a test array visual image of 2000 ms. A display task was set for Experiment 1-B, in which the task intensity parameter was set to 8 and the stimulation intensity parameter was set to 100 ms. The control device controlled the display device to display, based on a preset timing rule, the following sequence: a first fixation point image of 200 ms, a memory array visual image of 100 ms, a second fixation point image of 900 ms, a clue prompt image of 200 ms, a third fixation point image of 900 ms, a grayscale stimulation image of 100 ms, a fourth fixation point image of 400 ms, and a test array visual image of 2000 ms.

[0110] Figure 3B Schematic diagrams of Experiment 2-A and Experiment 2-B according to an embodiment of the present disclosure are shown.

[0111] like Figure 3BAs shown, Experiment 2-A and Experiment 2-B are the same group of sample objects, one group of sample objects includes 30 second sample objects, Experiment 2-A is the reference experiment of Experiment 2-B, and Experiment 2-B adds a 100ms blank image compared to Experiment 1-A. A display task was set for Experiment 2-A, in which the task intensity parameter was set to 8 and the stimulation intensity parameter was set to 0. The control device controlled the display device to display, based on a preset timing rule, the following sequence: a first fixation point image of 200 ms, a memory array visual image of 100 ms, a second fixation point image of 900 ms, a clue prompt image of 200 ms, a third fixation point image of 1300 ms, and a test array visual image of 2000 ms; a display task was set for Experiment 2-B, in which the task intensity parameter was set to 8, the stimulation intensity parameter was set to 0 ms, and a blank image display duration parameter of 100 ms. The control device controlled the display device to display, based on a preset timing rule, the following sequence: a first fixation point image of 200 ms, a memory array visual image of 100 ms, a second fixation point image of 900 ms, a clue prompt image of 200 ms, a third fixation point image of 900 ms, a blank image of 100 ms, a fourth fixation point image of 400 ms, and a test array visual image of 2000 ms.

[0112] According to an embodiment of the present disclosure, multiple display subtasks are designed for each display task. Based on the subtask feedback results of each of the multiple display subtasks, the observation accuracy and observation error rate corresponding to each display task are obtained, and then the working memory capacity evaluation results of each sample object evaluated in each display task are obtained.

[0113] According to the embodiments of the present disclosure, display tasks corresponding to task intensity parameters S=2, S=4, S=6, and S=8 were designed in Experiment 1-A, Experiment 1-B, Experiment 2-A, and Experiment 2-B, respectively, and other parameters remained unchanged to obtain statistical results of the working memory capacity evaluation results.

[0114] Table 1 shows a statistical table of working memory capacity evaluation results of Experiment 1-A according to an embodiment of the present disclosure.

[0115]

[0116] Table 2 shows a statistical table of working memory capacity evaluation results of Experiment 1-B according to an embodiment of the present disclosure.

[0117]

[0118] Table 3 shows a statistical table of working memory capacity evaluation results of Experiment 2-A according to an embodiment of the present disclosure.

[0119]

[0120] Table 4 shows a statistical table of working memory capacity evaluation results of Experiment 2-B according to an embodiment of the present disclosure.

[0121]

[0122] According to an embodiment of the present disclosure, in each experiment, a display task is designed for each level of task intensity parameters, and a working memory capacity evaluation result of each sample object is obtained for each display task. The average value of the working memory capacity evaluation results represents the average value of the working memory capacity evaluation results of the 30 sample objects after executing each display task; the standard deviation of the working memory capacity evaluation results represents the standard deviation of the working memory capacity evaluation results of the 30 sample objects after executing each display task.

[0123] According to the embodiments of the present disclosure, each display task in Experiment 1-B is set with a 100ms grayscale stimulation image compared to each display task in Experiment 1-A. According to the experimental results in Tables 1 and 2, it is found that under the low working memory load intensity state (S=2, S=4), the working memory capacity is generally high, and the stimulation intensity parameter has a poor effect on improving the working memory capacity; under the high working memory load intensity state (S=6, S=8), increasing the stimulation intensity parameter is beneficial to improving the working memory capacity.

[0124] According to an embodiment of the present disclosure, each display task in Experiment 2-B was set with a blank image of 100ms compared to each display task in Experiment 2-A. According to the experimental results in Tables 3 and 4, it was found that under the low working memory load intensity state or the high working memory load intensity state, adding blank image stimulation to the second sample subjects did not significantly improve the working memory capacity.

[0125] According to the embodiments of the present disclosure, each display task in Experiment 2-A has the same parameters as each display task in Experiment 1-A, but different sample objects. According to the experimental results in Tables 1 and 3, it is found that the changing trends of the working memory capacity evaluation results of the first sample object and the second sample object are roughly the same, which means that the age and cognitive ability differences between the first sample object and the second sample object are small, and the homogeneity is large, which overcomes the problem that the differences in age and cognitive ability of different sample objects affect the experimental results.

[0126] According to the embodiments of the present disclosure, based on the experimental results in Tables 1 and 3 and the experimental results in Tables 3 and 4, the comparison between Experiment 1-B and Experiment 2-B is convincing. A blank image of 100ms is set in each display task in Experiment 2-B, and a grayscale stimulation image of 100ms is set in each display task in Experiment 2-B. According to the experimental results in Tables 2 and 4, it is found that under the high working memory load intensity state (S=6, S=8), increasing the stimulation intensity parameters for different sample objects is beneficial to improving the working memory capacity, and the effect is good.

[0127] According to the embodiments of the present disclosure, experimental results show that under high working memory load intensity conditions, adaptively increasing the stimulation intensity parameters is beneficial to improving working memory capacity. Therefore, based on the above experimental results, multiple rounds of display tasks are designed for the target objects to comprehensively evaluate and improve the working memory capacity of the target objects.

[0128] Figure 4 A block diagram of an electronic device suitable for implementing a working memory assessment method based on visual induction according to an embodiment of the present disclosure is shown.

[0129] like Figure 4 As shown, the electronic device 400 according to an embodiment of the present disclosure includes a processor 401, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 402 or a program loaded from a storage portion 408 into a random access memory (RAM) 403. The processor 401 may include, for example, a general-purpose microprocessor (e.g., a CPU), an instruction set processor and / or a related chipset and / or a special-purpose microprocessor (e.g., an application-specific integrated circuit (ASIC)), etc. The processor 401 may also include onboard memory for caching purposes. The processor 401 may include a single processing unit or multiple processing units for performing different actions of the method flow according to the embodiment of the present disclosure.

[0130] Various programs and data required for the operation of the electronic device 400 are stored in the RAM 403. The processor 401, ROM 402, and RAM 403 are connected to each other via a bus 404. The processor 401 executes the programs in the ROM 402 and / or RAM 403 to perform various operations of the method flow according to the embodiment of the present disclosure. It should be noted that the programs may also be stored in one or more memories other than the ROM 402 and RAM 403. The processor 401 may also execute the programs stored in one or more memories to perform various operations of the method flow according to the embodiment of the present disclosure.

[0131] According to an embodiment of the present disclosure, electronic device 400 may further include an input / output (I / O) interface 405, which is also connected to bus 404. Electronic device 400 may also include one or more of the following components connected to I / O interface 405: an input section 406 including a keyboard, mouse, etc.; an output section 407 including devices such as a cathode ray tube (CRT), liquid crystal display (LCD), and speakers; a storage section 408 including a hard disk; and a communication section 409 including a network interface card such as a LAN card or modem. Communication section 409 performs communication processing via a network such as the Internet. A drive 410 is also connected to I / O interface 405 as needed. Removable media 411, such as a magnetic disk, optical disk, magneto-optical disk, semiconductor memory, etc., is installed in drive 410 as needed, so that computer programs read from the removable media can be installed into storage section 408 as needed.

[0132] The present disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments, or may exist independently and not be incorporated into the device / apparatus / system. The computer-readable storage medium carries one or more programs, which, when executed, implement the working memory assessment method according to the embodiments of the present disclosure.

[0133] According to an embodiment of the present disclosure, a computer-readable storage medium may be a non-volatile computer-readable storage medium, and may include, for example, but not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. For example, according to an embodiment of the present disclosure, a computer-readable storage medium may include the ROM 402 and / or RAM 403 described above, and / or one or more memories other than ROM 402 and RAM 403.

[0134] The present disclosure also includes a computer program product comprising a computer program containing program code for executing the method shown in the flowchart. When the computer program product is executed in a computer system, the program code is used to cause the computer system to implement the working memory assessment method provided by the present disclosure.

[0135] The computer program executes the above functions defined in the system / device of the embodiment of the present disclosure when the processor 401 executes the computer program. According to the embodiment of the present disclosure, the system, device, module, unit, etc. described above can be implemented by a computer program module.

[0136] In one embodiment, the computer program may be stored on a tangible storage medium such as an optical storage device or a magnetic storage device. In another embodiment, the computer program may be transmitted and distributed in the form of a signal on a network medium, downloaded and installed via the communication portion 409, and / or installed from a removable medium 411. The program code contained in the computer program may be transmitted using any appropriate network medium, including but not limited to wireless, wired, or any suitable combination thereof.

[0137] In such an embodiment, the computer program can be downloaded and installed from a network via the communication section 409, and / or installed from the removable medium 411. When the computer program is executed by the processor 401, the above-mentioned functions defined in the system of the embodiment of the present disclosure are performed. According to the embodiment of the present disclosure, the systems, devices, means, modules, units, etc. described above can be implemented by computer program modules.

[0138] According to an embodiment of the present disclosure, the program code for executing the computer program provided by the embodiment of the present disclosure can be written in any combination of one or more programming languages. Specifically, these computer programs can be implemented using high-level procedural and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages ​​include, but are not limited to, languages ​​such as Java, C++, Python, "C" or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device can be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (for example, using an Internet service provider to connect via the Internet).

[0139] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of the systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or part of the code, which contains one or more executable instructions for implementing the specified logical functions. It should also be noted that in some alternative implementations, the functions marked in the boxes can also occur in an order different from that marked in the accompanying drawings. For example, two boxes shown in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, as well as the combination of boxes in the block diagram or flowchart, can be implemented using a dedicated hardware-based system that performs the specified functions or operations, or can be implemented using a combination of dedicated hardware and computer instructions. It will be understood by those skilled in the art that the features described in the various embodiments of the present disclosure can be combined and / or combined in various ways, even if such combinations or combinations are not explicitly described in the present disclosure. In particular, without departing from the spirit and teachings of the present disclosure, the features described in the various embodiments of the present disclosure may be combined and / or coupled in various ways, and all of these combinations and / or couplings fall within the scope of the present disclosure.

[0140] The above describes embodiments according to the present disclosure. However, these embodiments are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Although each embodiment has been described separately above, this does not mean that the measures in each embodiment cannot be advantageously used in combination. Without departing from the scope of the present disclosure, those skilled in the art may make various substitutions and modifications, which should all fall within the scope of the present disclosure.

Claims

1. A working memory assessment system based on visual induction, characterized in that: The system comprises: A control device is configured to execute multiple rounds of display tasks, wherein the i-1th round of display tasks in the multiple rounds of display tasks is to control the display device to display a memory array image, a grayscale stimulation image, and a test array image based on the i-1th task intensity parameter and the i-1th stimulation intensity parameter of the i-1th round, wherein the task intensity parameter represents the number of color blocks in the memory array image, and the stimulation intensity parameter represents the display duration of the grayscale stimulation image introduced during the change from the memory array image to the test array image, i is a positive integer greater than 1, and the grayscale stimulation image is obtained based on the following operations: obtaining a color blocks from a database; removing color blocks having the same color as the color blocks in the memory array image from the a color blocks to obtain b target color blocks, where b is less than a, and both a and b are positive integers; performing color superposition processing on multiple target color blocks in the overlapping area of ​​the color blocks in the initial stimulation image based on a color mixing algorithm to obtain a superimposed stimulation image, wherein the initial stimulation image is obtained by arranging the b target color blocks; and performing grayscale conversion processing on the superimposed stimulation image to obtain a grayscale stimulation image. an interaction device configured to, in response to an i-1th feedback operation of a target subject during an i-1th round of display task execution, determine an i-1th feedback result, wherein the feedback result indicates that the target subject believes that there are different color blocks between the memory array image and the test array image, or indicates that the target subject believes that the memory array image and the test array image are identical; The evaluation device is configured to determine an i-1th working memory capacity evaluation result based on an i-1th feedback result, wherein the i-1th round display task includes M display subtasks, where M is a positive integer. The specific process includes: Determine the i-1th observation accuracy and the i-1th observation error rate corresponding to the i-1th round of display task based on the M subtask feedback results corresponding to the M display subtasks, wherein the i-1th feedback result includes the subtask feedback results corresponding to each of the M display subtasks; determine the i-1th memory capacity assessment result based on the i-1th task intensity parameter, the i-1th observation accuracy and the i-1th observation error rate, and Based on the i-1th feedback result and the i-1th working memory capacity evaluation result, the i-th task intensity parameter and the i-th stimulation intensity parameter are determined to obtain the i-th round display task, wherein the evaluation device is further configured to determine the target working memory capacity evaluation result based on the working memory capacity evaluation results of multiple rounds of display tasks.

2. The working memory assessment system according to claim 1, wherein: The color distribution of the color blocks in the memory array image and the test array image in the M display subtasks is determined based on a color block color change ratio parameter, and the number and position of the color blocks in the memory array image and the test array image in each display subtask are the same.

3. The working memory assessment system according to claim 2, wherein: The display subtask is marked with a color block color change category label, and the color block color change category label indicates whether the colors of the color blocks set at the same position in the memory array image and the test array image are the same or different; Wherein, determining the i-1th observation accuracy rate and the i-1th observation error rate corresponding to the i-1th round display task according to the M subtask feedback results corresponding to the M display subtasks includes: For an m-th display subtask among the M display subtasks, if the color change category label of the color block of the m-th display subtask matches the color change category represented by the subtask feedback result, determining that the observation result of the m-th display subtask is a correct observation result; In a case where the color change category label of the color block of the m-th display subtask does not match the color change category represented by the subtask feedback result, determining that the observation result of the m-th display subtask is an observation error result; Determining the (i-1)th observation accuracy rate corresponding to the (i-1)th round of display tasks according to the number of correct observation results and the number of display subtasks; The (i-1)th observation error rate corresponding to the (i-1)th round of display tasks is determined according to the number of the observation error results and the number of the display subtasks.

4. The working memory assessment system according to claim 1, wherein: The control device is configured to control the display device to display a first fixation point image, the memory array image, the second fixation point image, the clue prompt image, the third fixation point image, the grayscale stimulation image, the fourth fixation point image, and the test array image based on preset timing rules, wherein the first fixation point image is used to guide the target object to gaze at the center point of the display device, and the i-1th preset timing rule of the i-1th round display task is determined based on the i-1th stimulation intensity parameter.

5. The working memory assessment system according to claim 4, wherein: The evaluation device is configured as follows: When the i-1th observation accuracy corresponding to the i-1th round display task is less than a preset accuracy threshold, or when the average color block observation reaction time corresponding to the i-1th round display task is greater than a preset reaction threshold, adjusting the i-1th task intensity parameter to obtain the i-th round display task, wherein the average color block observation reaction time is obtained by performing a weighted average operation on the color block observation reaction times corresponding to each of the M display subtasks, and the color block observation reaction time represents the time from the start of displaying the test array image to the response to the feedback operation during the execution of the display subtask; When the i-1th observation accuracy corresponding to the i-1th round display task is greater than or equal to the preset accuracy threshold and the average color block observation reaction time is less than or equal to the preset reaction threshold, the i-1th stimulation intensity parameter is adjusted according to the i-1th memory capacity assessment result and the i-1th capacity threshold to obtain the i-1th round display task, wherein the i-1th capacity threshold is determined based on the historical memory ability of the target object or the i-1th task intensity parameter.

6. The working memory assessment system according to claim 5, wherein: The evaluation device is configured as follows: When the i-1th memory capacity evaluation result is less than or equal to the i-1th capacity threshold, enhancing the i-1th stimulation intensity parameter based on the adaptive adjustment mechanism to obtain an i-th stimulation intensity parameter; Based on the i-th stimulation intensity parameter, the i-th round display task is determined.

7. A method for assessing working memory based on visual induction, characterized in that: Applied to the working memory assessment system of claim 1, the method comprising: Performing an i-1th round of display tasks, wherein the i-1th round of display tasks is to display a memory array image, a grayscale stimulation image, and a test array image to the target subject based on an i-1th task intensity parameter and an i-1th stimulation intensity parameter of the i-1th round; In response to the (i-1)th feedback operation of the target object, determining an (i-1)th feedback result; Determining the (i-1)th working memory capacity assessment result based on the (i-1)th feedback result; and The i-th task intensity parameter and the i-th stimulation intensity parameter are determined based on the i-th feedback result and the i-th working memory capacity assessment result to obtain the i-th round display task.

8. An electronic device comprising: one or more processors; a memory for storing one or more computer programs, It is characterized in that the one or more processors execute the one or more computer programs to implement the steps of the method according to claim 7.

9. A computer-readable storage medium having a computer program or instruction stored thereon, characterized in that: When the computer program or instructions are executed by a processor, the steps of the method according to claim 7 are implemented.

Images