Methods, devices, equipment and media for training and assessing cognitive abilities

Abstract

This invention discloses a method, apparatus, device, and medium for training and evaluating cognitive abilities. The method includes: receiving a start command; obtaining a multimedia playback file corresponding to the start command from a preset multimedia set; sending the multimedia playback file to an interactive display screen for playback, and simultaneously acquiring eye movement trajectory information captured by an eye-tracking module; projecting the eye movement trajectory information onto a virtual scene corresponding to the multimedia playback file to obtain eye movement projection information; performing consistency analysis on the eye movement projection information based on the eye movement reference coordinates corresponding to the multimedia playback file to obtain a corresponding consistency analysis result; and evaluating the consistency analysis result according to a preset evaluation model to obtain a corresponding evaluation score. This cognitive ability training and evaluation method accurately obtains an individual's cognitive ability evaluation result by playing a multimedia playback file and analyzing the individual's eye movement trajectory information.

Description

Technical Field

[0001] This invention relates to the field of artificial intelligence technology, and in particular to a method, apparatus, device, and medium for training and evaluating cognitive abilities. Background Technology

[0002] To assess individual users' cognitive abilities, hospital rehabilitation departments currently mostly use traditional paper-based questionnaires. These questionnaires assess cognitive functions such as attention, memory, executive function, calculation ability, and thinking ability through questioning. Traditional training methods primarily involve active cognitive ability analysis and assessment under the guidance of therapists through questioning and testing.

[0003] However, during the training and evaluation process, the standardization of the scales, evaluation results, training type, and training parameters for individual users cannot accurately analyze and evaluate their attention performance and cognitive changes, thus reducing the reliability of cognitive assessment. Therefore, existing methods for assessing individual cognitive abilities suffer from poor assessment accuracy. Summary of the Invention

[0004] This invention provides a method, apparatus, device, and medium for training and assessing cognitive abilities, aiming to solve the problem of poor assessment accuracy in existing methods for assessing individual cognitive abilities.

[0005] In a first aspect, embodiments of the present invention provide a method for training and evaluating cognitive abilities, wherein the method is applied in a training and evaluation terminal, the training and evaluation terminal being communicatively connected to an interactive display screen and an eye-tracking module to transmit data information, and the method includes:

[0006] Receive a start command and retrieve the multimedia playback file corresponding to the start command from a preset multimedia set;

[0007] The multimedia playback file is sent to the interactive display screen for playback, and the eye movement trajectory information captured by the eye tracking module is acquired simultaneously.

[0008] The eye-tracking information is projected onto a virtual scene corresponding to the multimedia playback file to obtain eye-tracking projection information;

[0009] Based on the eye-tracking reference coordinates corresponding to the multimedia playback file, a consistency analysis of the eye-tracking projection information is performed to obtain the corresponding consistency analysis results.

[0010] The consistency analysis results are evaluated based on a pre-set evaluation model to obtain the corresponding evaluation score.

[0011] Secondly, embodiments of the present invention also provide a cognitive ability training and assessment device, wherein the device is configured in a training and assessment terminal, the training and assessment terminal being communicatively connected to an interactive display screen and an eye-tracking module to transmit data information, and the device is used to execute the cognitive ability training and assessment method as described in the first aspect above, the device comprising:

[0012] A multimedia playback file acquisition unit is used to receive a start command and acquire a multimedia playback file corresponding to the start command from a preset multimedia set;

[0013] An eye-tracking trajectory information acquisition unit is used to send the multimedia playback file to the interactive display screen for playback, and simultaneously acquire the eye-tracking trajectory information captured by the eye-tracking module;

[0014] An eye-tracking projection information acquisition unit is used to project the eye-tracking trajectory information onto a virtual scene corresponding to the multimedia playback file to obtain eye-tracking projection information;

[0015] The consistency analysis unit is used to perform consistency analysis on the eye movement projection information based on the eye movement reference coordinates corresponding to the multimedia playback file, and obtain the corresponding consistency analysis results.

[0016] The evaluation unit is used to evaluate the consistency analysis results according to a preset evaluation model and obtain the corresponding evaluation score.

[0017] In a third aspect, an embodiment of the present invention further provides a computer device, wherein the device includes a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus;

[0018] Memory, used to store computer programs;

[0019] When a processor executes a program stored in memory, it implements the steps of the cognitive ability training and evaluation method described in the first aspect above.

[0020] Fourthly, embodiments of the present invention also provide a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the steps of the cognitive ability training and evaluation method described in the first aspect above.

[0021] This invention provides a method, apparatus, device, and medium for training and evaluating cognitive abilities. The method includes: receiving a start command; obtaining a multimedia playback file corresponding to the start command from a preset multimedia set; sending the multimedia playback file to an interactive display screen for playback, and simultaneously acquiring eye movement trajectory information captured by an eye-tracking module; projecting the eye movement trajectory information onto a virtual scene corresponding to the multimedia playback file to obtain eye movement projection information; performing consistency analysis on the eye movement projection information based on the eye movement reference coordinates corresponding to the multimedia playback file to obtain a corresponding consistency analysis result; and evaluating the consistency analysis result according to a preset evaluation model to obtain a corresponding evaluation score. This cognitive ability training and evaluation method accurately obtains an individual's cognitive ability evaluation result by playing a multimedia playback file and analyzing the individual's eye movement trajectory information. Attached Figure Description

[0022] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the following description of the embodiments will be briefly introduced. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0023] Figure 1 A flowchart illustrating the cognitive ability training and assessment method provided in this embodiment of the invention;

[0024] Figure 2 A schematic diagram illustrating an application scenario of the cognitive ability training and assessment method provided in this embodiment of the invention;

[0025] Figure 3 A schematic diagram illustrating another application scenario of the cognitive ability training and assessment method provided in this embodiment of the invention;

[0026] Figure 4 A schematic block diagram of a cognitive ability training and assessment device provided in an embodiment of the present invention;

[0027] Figure 5 This is a schematic block diagram of a computer device provided in an embodiment of the present invention. Detailed Implementation

[0028] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0029] It should be understood that, when used in this specification and the appended claims, the terms "comprising" and "including" indicate the presence of the described features, integrals, steps, operations, elements and / or components, but do not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or collections thereof.

[0030] It should also be understood that the terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the invention. As used in this specification and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms unless the context clearly indicates otherwise.

[0031] It should also be further understood that the term "and / or" as used in this specification and the appended claims refers to any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.

[0032] The embodiments of this invention provide a method for training and evaluating cognitive abilities, such as... Figure 2 and Figure 3 As shown, this method is applied in a training and evaluation terminal 10, which is communicatively connected to an interactive display screen 20 and an eye-tracking module 30 to transmit data. The training and evaluation terminal 10 executes the stored software program to implement the aforementioned cognitive ability training and evaluation method. The training and evaluation terminal 10 can be a terminal device, such as an MCU chip, used by testers and individual users to train and evaluate cognitive abilities. The interactive display screen 20 and related auxiliary structures are as follows... Figure 3As shown, the interactive display screen 20 faces the individual user and can play multimedia files. The keyboard 50 is connected to the training and evaluation terminal 10 for inputting commands by the tester. The operation display screen 60 is communicatively connected to the training and evaluation terminal 10 and is used to input or adjust the training parameters corresponding to the individual user. By setting up two displays, the operation display screen 60 and the interactive display screen 20, the individual user can train through the interactive display screen 20, while the therapist can input and adjust training parameters through the operation display screen 60. The two displays do not interfere with each other, improving training efficiency. The operation display screen 60 is movably mounted on the device platform 70 via a screen support frame 61. The connection between the operation display screen 60 and the screen support frame 61 can be adjusted left and right, and up and down. The connection between the screen support frame 61 and the device platform 70 can also be adjusted left and right, and up and down, to facilitate use by therapists and individual users. Furthermore, for assessment scales and training plans that cannot be seen by the individual user, the operation display screen 60 can be rotated using its adjustment function to prevent the individual user from viewing the relevant content. The equipment platform 70, which is the other side of the placement slot 71, is connected to a chassis 73 via a lifting column 72. Several wheels 74 are mounted on the chassis 73. This design, by using the lifting column 72, allows for easy adjustment of the height of the equipment platform 70 to suit various training methods and individual users of different heights. The wheels 74 allow for adjustment of the position of the equipment platform 70 according to the training scenario during rehabilitation training, thereby improving training effectiveness.

[0033] like Figure 1 As shown, the method includes steps S110 to S150.

[0034] S110. Receive a startup command and retrieve the multimedia playback file corresponding to the startup command from a preset multimedia set.

[0035] The training and evaluation terminal is pre-configured with a multimedia collection containing a large number of multimedia files. These files include at least video content and may also contain both video and audio content. Upon receiving a start command, the terminal filters the multimedia files in the collection according to the command to obtain the multimedia playback file corresponding to the start command.

[0036] In a specific embodiment, step S110 includes the following sub-steps: filtering multimedia files in the multimedia set according to the age value in the startup instruction to obtain multimedia files that match the age value; filtering matching multimedia files according to the training type in the startup instruction to obtain multimedia files that match the training type as the multimedia playback file.

[0037] Specifically, the startup command includes an age value, which corresponds to the individual user undergoing the cognitive ability assessment. Each multimedia file in the multimedia collection corresponds to an age range and a file type. The multimedia files in the collection can be filtered using the age value in the startup command to obtain multimedia files whose age range matches that age value. Furthermore, the startup command can also configure a training type parameter, such as basic cognitive training, attention training, or cognitive response training. The command can match the training type with the file types of the corresponding multimedia files to obtain multimedia files whose file types match the training type, which will then be used as the multimedia playback files corresponding to the startup command.

[0038] If there is only one multimedia file that matches the training type, then that multimedia file will be played directly as the multimedia playback file; if there are multiple multimedia files that match the training type, then one of them will be randomly selected as the multimedia playback file.

[0039] S120. Send the multimedia playback file to the interactive display screen for playback, and simultaneously acquire the eye movement trajectory information captured by the eye tracking module.

[0040] Furthermore, the acquired multimedia playback file is sent to the interactive display screen, which can then play the file. Simultaneously, the eye movement of the individual user undergoing training and evaluation is captured by the eye-tracking module to obtain corresponding eye movement trajectory information. This eye movement trajectory information includes the user's gaze trajectory during the playback of the multimedia playback file.

[0041] S130. Project the eye-tracking trajectory information onto a virtual scene corresponding to the multimedia playback file to obtain eye-tracking projection information.

[0042] The eye-tracking information obtained in the above steps is projected onto the virtual scene corresponding to the multimedia playback file, thereby obtaining eye-tracking projection information.

[0043] In a specific embodiment, step S130 includes the following sub-steps: constructing a virtual scene corresponding to the multimedia playback file based on the eye socket position in the eye movement trajectory information; generating projection lines corresponding to each moment based on the pupil gaze orientation at each moment in the eye movement trajectory information; and obtaining the projection position corresponding to the projection line at each moment in the virtual scene as the eye movement projection information.

[0044] Specifically, the eye movement trajectory information includes the individual user's eye socket position, with the center point between the two eye socket positions as the center of gaze; the eye movement trajectory information includes eye images collected at different times (e.g., if an eye image is collected every 0.05 seconds, then the time difference between adjacent moments in the eye movement trajectory information is 0.05 seconds). In the eye images, the pupil is black, and other areas inside the eye socket are white or near white. Thus, the eye socket position and pupil gaze direction can be determined by analyzing the eye images at each moment of the eye movement trajectory information.

[0045] The relative position between the interactive display screen and the center of gaze can be obtained by analyzing the setting position of the interactive display screen, the setting position of the eye-tracking module, and the eye movement trajectory information obtained by the eye-tracking module. A virtual scene corresponding to the multimedia playback file can be constructed. In the virtual scene, the video screen of the multimedia playback file is used as the scene plane, and the center of gaze is used as the reference point.

[0046] Furthermore, using the center of the gaze as a reference, the pupil coordinates in the virtual scene are determined for the pupil gaze orientation at each moment in the eye movement trajectory information, and corresponding projection lines are generated based on the pupil gaze orientation at each moment in the eye movement trajectory information. The pupil gaze orientation includes the pupil's movement position within the eye socket and the pupil's rotation angle. Therefore, the pupil's movement position can be used as the starting point of the projection line, and the projection direction of the projection line can be determined by the pupil's rotation angle, thus generating the corresponding projection lines at each moment.

[0047] In the virtual scene, the projection positions corresponding to the projection lines at each moment are obtained, which means obtaining the intersection points of the projection lines of the two eyes with the scene plane in the virtual scene at each moment. The intersection points of the projection lines and the scene plane are the projection positions. If the user focuses their attention on viewing a certain information in a multimedia playback file, the deviation between the projection positions of the two eyes at the same moment will be small. In this case, it can be considered that the projection positions of the two eyes are projected simultaneously within a small field of vision.

[0048] S140. Perform consistency analysis on the eye-tracking projection information based on the eye-tracking reference coordinates corresponding to the multimedia playback file to obtain the corresponding consistency analysis results.

[0049] Consistency analysis of eye-tracking projection information can be performed based on the eye-tracking reference coordinates corresponding to the multimedia playback file. The eye-tracking reference coordinates are the positional coordinates of important information displayed on the screen during multimedia playback. If an individual user has strong cognitive abilities and is highly focused, their visual field will closely follow the eye-tracking reference coordinates; if their cognitive abilities are weak or their attention is insufficient, their visual field will usually deviate from the eye-tracking reference coordinates. Therefore, the consistency between the eye-tracking reference coordinates and the eye-tracking projection information can be analyzed to obtain the corresponding consistency analysis results.

[0050] In a specific embodiment, step S140 includes the following sub-steps: generating corresponding temporal coordinate lines based on the eye-tracking reference coordinates corresponding to the multimedia playback file; obtaining multiple eye-tracking projection lines corresponding to the eye-tracking projection information and a preset delay gradient time; calculating the coordinate consistency coefficient between the temporal coordinate lines and each eye-tracking projection line; obtaining the delay time corresponding to the eye-tracking projection line with the highest coordinate consistency coefficient; obtaining the crossover time ratio of the projection positions of both eyes in the eye-tracking projection information based on a preset positional connection threshold; and combining the crossover time ratio, the delay time, and the corresponding coordinate consistency coefficient as the consistency analysis result.

[0051] Specifically, the multimedia playback file contains a series of eye-tracking reference coordinates. These eye-tracking reference coordinates can be sequentially connected to generate a temporal coordinate connection on the scene plane. Furthermore, based on a preset delay gradient time, the eye-tracking projection information is sequentially connected to obtain multiple eye-tracking projection connections.

[0052] A time gradient is composed of multiple delay times, such as 0.05 seconds, 0.1 seconds, 0.15 seconds, 0.2 seconds, 0.25 seconds, 0.3 seconds, 0.35 seconds, 0.4 seconds, 0.45 seconds, and 0.5 seconds. When multimedia content displays information, users have different cognitive abilities and therefore different reaction times. If a user reacts quickly, they can adjust their field of vision to the vicinity of the corresponding eye-tracking reference coordinates within a shorter delay time; if a user reacts slowly, a longer delay time is required for visual field adjustment.

[0053] For example, if the delay time in the delay gradient time is 0.1 seconds, the projection center points of the projection positions of both eyes in the eye-tracking projection information are obtained. The time corresponding to each projection center point is then subtracted by the 0.1-second delay time to obtain the new time point. Lines are then sequentially connected according to the new time points of each projection center point to obtain the eye-tracking projection lines corresponding to the 0.1-second delay time. A set of eye-tracking projection lines can be obtained for each delay time in the delay gradient time.

[0054] The number of projection center points in the eye-tracking projection lines is no less than the number of eye-tracking reference coordinates. Place each eye-tracking projection line and the temporal coordinate line in the same time dimension, and calculate the geometric distance between the projection center point in the eye-tracking projection line and the eye-tracking reference coordinate at the same time point in the temporal coordinate line. Based on the geometric distance corresponding to each eye-tracking reference coordinate, the coordinate consistency coefficient can be further calculated. For example, the coordinate consistency coefficient can be obtained by formula (1).

[0055] (1);

[0056] Z is the calculated coordinate consistency coefficient, and N is the total number of eye-tracking reference coordinates in the temporal coordinate connection line. 1,i y 1,i (x) is the projection center point at the i-th time point in the eye-tracking projection line. 2,i y 2,i () represents the eye-tracking reference coordinates at the i-th time point in the temporal coordinate connection. L is the length of the interactive display screen, and W is the width of the interactive display screen.

[0057] If the delay time corresponding to the eye-tracking projection line with the highest coordinate consistency coefficient is obtained, then this set of delay times can accurately reflect the reaction speed of an individual user.

[0058] The crossover time ratio of the projection positions of both eyes in the eye-tracking projection information is obtained based on a pre-set positional connection threshold. Specifically, the geometric distance between the projection positions of both eyes at each moment in the eye-tracking projection information is calculated, and it is determined whether this geometric distance is not greater than the positional connection threshold. The number of time points where the geometric distance is not greater than the positional connection threshold is obtained and divided by the total number of eye images in the eye-tracking projection information to obtain the crossover time ratio. The crossover time ratio reflects the time proportion in which the projection positions of both eyes cross-connect.

[0059] By combining the obtained crossover time percentage, delay time, and coordinate consistency coefficient corresponding to the delay time (the largest coordinate consistency coefficient obtained is the coordinate consistency coefficient corresponding to the delay time), the corresponding consistency analysis results can be obtained.

[0060] S150. Evaluate the consistency analysis results according to the preset evaluation model to obtain the corresponding evaluation score.

[0061] Furthermore, the consistency analysis results can be evaluated based on a pre-set evaluation model to obtain a corresponding evaluation score, which can accurately reflect the cognitive ability of individual users.

[0062] In a specific embodiment, step S150 includes the following sub-steps: calculating the delay time in the consistency analysis result according to the reaction delay function in the evaluation model to obtain the corresponding delay coefficient; and comprehensively calculating the delay coefficient, the consistency coefficient, and the crossover time ratio in the consistency analysis result according to the comprehensive evaluation function in the evaluation model to obtain the corresponding evaluation score.

[0063] Specifically, the delay time in the consistency analysis results can be calculated based on the reaction delay function, which can be expressed by formula (2):

[0064] (2);

[0065] F is the calculated delay coefficient, t r This represents the delay time in the consistency analysis results.

[0066] Furthermore, based on the comprehensive evaluation function set in the evaluation model, the delay coefficient and the consistency coefficient and crossover time ratio in the consistency analysis results are comprehensively calculated, and the calculated value is used as the corresponding evaluation score. The comprehensive evaluation function can be expressed by formula (3):

[0067] (3);

[0068] y is the consistency coefficient in the consistency analysis results, e is the base of the natural logarithm, F is the lag coefficient, V is the crossover time percentage, and P is the calculated evaluation score.

[0069] The cognitive ability training and evaluation method disclosed in the above embodiments includes: receiving a start command; obtaining a multimedia playback file corresponding to the start command from a preset multimedia set; sending the multimedia playback file to an interactive display screen for playback, and simultaneously obtaining eye movement trajectory information captured by an eye-tracking module; projecting the eye movement trajectory information onto a virtual scene corresponding to the multimedia playback file to obtain eye movement projection information; performing consistency analysis on the eye movement projection information based on the eye movement reference coordinates corresponding to the multimedia playback file to obtain a corresponding consistency analysis result; and evaluating the consistency analysis result according to a preset evaluation model to obtain a corresponding evaluation score. The above cognitive ability training and evaluation method accurately obtains the individual's cognitive ability evaluation results by playing a multimedia playback file and analyzing the individual's eye movement trajectory information.

[0070] This invention also provides a cognitive ability training and assessment device, which can be configured in a training and assessment terminal 10. This device is used to execute any embodiment of the aforementioned cognitive ability training and assessment method. Specifically, please refer to... Figure 4 , Figure 4 A schematic block diagram of a cognitive ability training and assessment device provided in an embodiment of the present invention.

[0071] like Figure 4 As shown, the cognitive ability training and assessment device 100 includes a multimedia playback file acquisition unit 110, an eye movement trajectory information acquisition unit 120, an eye movement projection information acquisition unit 130, a consistency analysis unit 140, and an assessment unit 150.

[0072] The multimedia playback file acquisition unit 110 is used to receive a start command and acquire the multimedia playback file corresponding to the start command from a preset multimedia set.

[0073] In a more specific embodiment, the multimedia playback file acquisition unit 110 includes: a first filtering unit, configured to filter multimedia files in the multimedia set according to the age value in the startup instruction, so as to obtain multimedia files that match the age value; and a second filtering unit, configured to filter matching multimedia files according to the training type in the startup instruction, so as to obtain multimedia files that match the training type as the multimedia playback file.

[0074] The eye movement trajectory information acquisition unit 120 is used to send the multimedia playback file to the interactive display screen for playback, and simultaneously acquire the eye movement trajectory information captured by the eye tracking module.

[0075] The eye-tracking projection information acquisition unit 130 is used to project the eye-tracking trajectory information onto a virtual scene corresponding to the multimedia playback file to obtain eye-tracking projection information.

[0076] In a more specific embodiment, the eye-tracking projection information acquisition unit 130 includes: a virtual scene construction unit, used to construct a virtual scene corresponding to the multimedia playback file based on the eye socket position in the eye-tracking trajectory information; a projection line generation unit, used to generate projection lines corresponding to each moment based on the pupil fixation orientation at each moment in the eye-tracking trajectory information; and a projection position acquisition unit, used to acquire the projection position corresponding to the projection line at each moment in the virtual scene as the eye-tracking projection information.

[0077] The consistency analysis unit 140 is used to perform consistency analysis on the eye movement projection information based on the eye movement reference coordinates corresponding to the multimedia playback file, and obtain the corresponding consistency analysis result.

[0078] Evaluation unit 150 is used to evaluate the consistency analysis results according to a preset evaluation model and obtain the corresponding evaluation score.

[0079] The cognitive ability training and assessment device provided in this embodiment of the invention applies the above-described cognitive ability training and assessment method. It receives a start command, retrieves a multimedia playback file corresponding to the start command from a preset multimedia set, sends the multimedia playback file to an interactive display screen for playback, and simultaneously acquires eye movement trajectory information captured by an eye-tracking module. It projects the eye movement trajectory information onto a virtual scene corresponding to the multimedia playback file to obtain eye movement projection information. It performs consistency analysis on the eye movement projection information based on the eye movement reference coordinates corresponding to the multimedia playback file to obtain a corresponding consistency analysis result. Finally, it evaluates the consistency analysis result according to a preset assessment model to obtain a corresponding assessment score. This cognitive ability training and assessment method accurately obtains an individual's cognitive ability assessment result by playing a multimedia playback file and analyzing the individual's eye movement trajectory information.

[0080] The aforementioned cognitive ability training and assessment device can be implemented in the form of a computer program, which can, for example... Figure 5 It runs on the computer device shown.

[0081] See also Figure 5 , Figure 5 This is a schematic block diagram of a computer device provided in an embodiment of the present invention. The computer device may be a training and assessment terminal for executing a cognitive ability training and assessment method to train and assess the cognitive abilities of an individual user.

[0082] See Figure 5 The computer device 500 includes a processor 502, a memory, and a communication interface 505 connected via a communication bus 501. The memory may include a storage medium 503 and internal memory 504.

[0083] The storage medium 503 may store an operating system 5031 and a computer program 5032. When the computer program 5032 is executed, it enables the processor 502 to execute a cognitive ability training and evaluation method. The storage medium 503 may be a volatile storage medium or a non-volatile storage medium.

[0084] The processor 502 provides computing and control capabilities to support the operation of the entire computer device 500.

[0085] The internal memory 504 provides an environment for the operation of the computer program 5032 in the storage medium 503. When the computer program 5032 is executed by the processor 502, the processor 502 can perform a cognitive ability training and assessment method.

[0086] This communication interface 505 is used for network communication, such as providing data transmission. Those skilled in the art will understand that... Figure 5 The structure shown is merely a block diagram of a portion of the structure related to the present invention and does not constitute a limitation on the computer device 500 to which the present invention is applied. The specific computer device 500 may include more or fewer components than shown in the figure, or combine certain components, or have different component arrangements.

[0087] The processor 502 is used to run the computer program 5032 stored in the memory to implement the corresponding functions in the above-mentioned cognitive ability training and evaluation method.

[0088] Those skilled in the art will understand that Figure 5The embodiments of the computer device shown do not constitute a limitation on the specific configuration of the computer device. In other embodiments, the computer device may include more or fewer components than illustrated, or combine certain components, or have different component arrangements. For example, in some embodiments, the computer device may include only memory and a processor. In such embodiments, the structure and function of the memory and processor are different from those shown. Figure 5 The embodiments shown are consistent and will not be described again here.

[0089] It should be understood that, in this embodiment of the invention, the processor 502 may be a Central Processing Unit (CPU), or it may be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor.

[0090] In another embodiment of the invention, a computer-readable storage medium is provided. This computer-readable storage medium may be volatile or non-volatile. The computer-readable storage medium stores a computer program, wherein when executed by a processor, the computer program implements the steps included in the above-described cognitive ability training and assessment method.

[0091] Those skilled in the art will readily understand that, for the sake of convenience and brevity, the specific working processes of the devices, apparatuses, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here. Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this invention.

[0092] In the embodiments provided by this invention, it should be understood that the disclosed devices, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative. For instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. Units with the same function may be grouped into one unit. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. In addition, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interfaces, devices, or units, or it may be an electrical, mechanical, or other form of connection.

[0093] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of the embodiments of the present invention, depending on actual needs.

[0094] Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0095] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a computer-readable storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned computer-readable storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), magnetic disks, or optical disks.

[0096] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in the present invention, and these modifications or substitutions should all be covered within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

1. A method for training and assessing cognitive abilities, characterized in that, The method is applied in a training and evaluation terminal, which is communicatively connected to an interactive display screen and an eye-tracking module to transmit data information. The method includes: Receive a start command and retrieve the multimedia playback file corresponding to the start command from a preset multimedia set; The multimedia playback file is sent to the interactive display screen for playback, and the eye movement trajectory information captured by the eye tracking module is acquired simultaneously. The eye-tracking information is projected onto a virtual scene corresponding to the multimedia playback file to obtain eye-tracking projection information; Based on the eye-tracking reference coordinates corresponding to the multimedia playback file, a consistency analysis of the eye-tracking projection information is performed to obtain the corresponding consistency analysis results. The consistency analysis results are evaluated based on a pre-set evaluation model to obtain the corresponding evaluation score; The step of performing consistency analysis on the eye-tracking projection information based on the eye-tracking reference coordinates corresponding to the multimedia playback file, and obtaining the corresponding consistency analysis results, includes: Generate corresponding temporal coordinate connections based on the eye-tracking reference coordinates of the multimedia playback file; Obtain multiple eye-tracking projection lines corresponding to the eye-tracking projection information and the preset delay gradient time; Calculate the coordinate consistency coefficient between the temporal coordinate lines and each of the eye-tracking projection lines; Obtain the delay time corresponding to the eye-tracking projection line with the highest coordinate consistency coefficient; The crossover time ratio of the projection positions of both eyes in the eye-tracking projection information is obtained based on a preset position connection threshold. The crossover time ratio, the delay time, and the corresponding coordinate consistency coefficient are combined to form the consistency analysis result.

2. The cognitive ability training and assessment method according to claim 1, characterized in that, The step of retrieving the multimedia playback file corresponding to the start command from the preset multimedia set includes: The multimedia files in the multimedia collection are filtered according to the age value in the startup command to obtain multimedia files that match the age value; The multimedia files are filtered according to the training type in the startup command to obtain the multimedia files that match the training type as the multimedia playback files.

3. The cognitive ability training and assessment method according to claim 1, characterized in that, The step of projecting the eye-tracking information onto a virtual scene corresponding to the multimedia playback file to obtain eye-tracking projection information includes: A virtual scene corresponding to the multimedia playback file is constructed based on the eye orbit position in the eye movement trajectory information; Based on the pupil gaze orientation at each moment in the eye movement trajectory information, a projection line corresponding to each moment is generated; The projection position corresponding to the projection line at each moment in the virtual scene is obtained as the eye-tracking projection information.

4. The cognitive ability training and assessment method according to claim 1, characterized in that, The evaluation of the consistency analysis results based on a pre-set evaluation model to obtain a corresponding evaluation score includes: The delay time in the consistency analysis results is calculated based on the reaction delay function in the evaluation model to obtain the corresponding delay coefficient; The delay coefficient and the consistency coefficient and crossover time ratio in the consistency analysis results are comprehensively calculated based on the comprehensive evaluation function in the evaluation model to obtain the corresponding evaluation score.

5. A cognitive ability training and assessment device, characterized in that, The device is configured in a training and evaluation terminal, which is communicatively connected to an interactive display screen and an eye-tracking module to transmit data. The device is used to execute the cognitive ability training and evaluation method as described in any one of claims 1-4. The device comprises: A multimedia playback file acquisition unit is used to receive a start command and acquire a multimedia playback file corresponding to the start command from a preset multimedia set; An eye-tracking trajectory information acquisition unit is used to send the multimedia playback file to the interactive display screen for playback, and simultaneously acquire the eye-tracking trajectory information captured by the eye-tracking module; An eye-tracking projection information acquisition unit is used to project the eye-tracking trajectory information onto a virtual scene corresponding to the multimedia playback file to obtain eye-tracking projection information; The consistency analysis unit is used to perform consistency analysis on the eye movement projection information based on the eye movement reference coordinates corresponding to the multimedia playback file, and obtain the corresponding consistency analysis results. The evaluation unit is used to evaluate the consistency analysis results according to a preset evaluation model and obtain the corresponding evaluation score.

6. The cognitive ability training and assessment device according to claim 5, characterized in that, The multimedia playback file acquisition unit includes: The first filtering unit is used to filter multimedia files in the multimedia set according to the age value in the startup instruction, so as to obtain multimedia files that match the age value. The second filtering unit is used to filter the matching multimedia files according to the training type in the startup instruction, so as to obtain the multimedia files that match the training type as the multimedia playback files.

7. The cognitive ability training and assessment device according to claim 5, characterized in that, The eye-tracking projection information acquisition unit includes: A virtual scene construction unit is used to construct a virtual scene corresponding to the multimedia playback file based on the eye orbit position in the eye movement trajectory information; The projection line generation unit is used to generate projection lines corresponding to each moment based on the pupil gaze orientation at each moment in the eye movement trajectory information. The projection position acquisition unit is used to acquire the projection position corresponding to the projection line at each moment in the virtual scene, as the eye-tracking projection information.

8. A computer device, characterized in that, The device includes a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus; Memory, used to store computer programs; When a processor executes a program stored in memory, it implements the steps of the cognitive ability training and evaluation method according to any one of claims 1-4.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the steps of the cognitive ability training and evaluation method as described in any one of claims 1-4.

Images