Cognitive competence training evaluation method and device, equipment and medium

Abstract

The invention discloses a cognitive competence training evaluation method and device, equipment and a medium, and the method comprises the steps: receiving a starting instruction, and obtaining a multimedia playing file corresponding to the starting instruction from a preset multimedia set; sending the multimedia playing file to an interactive display screen for playing, and synchronously obtaining eye movement track information captured by an eyeball capturing module; projecting the eye movement track information to a virtual scene corresponding to the multimedia playing file to obtain eye movement projection information; performing consistency analysis on the eye movement projection information according to eye movement reference coordinates corresponding to the multimedia playing file to obtain a corresponding consistency analysis result; and evaluating the consistency analysis result according to a preset evaluation model to obtain a corresponding evaluation score. According to the cognitive competence training evaluation method, the multimedia playing file is played and the individual eye movement track information is acquired and analyzed, so that the cognitive competence evaluation result of the individual is accurately acquired.

Description

Technical Field

[0001] The present invention relates to the field of artificial intelligence technology, and in particular to a method, device, equipment and medium for training and evaluating cognitive abilities. Background Art

[0002] To assess individual users' cognitive abilities, hospital rehabilitation departments currently mostly use traditional paper-based questionnaires, assessing cognitive functions such as attention, memory, executive function, calculation ability, and thinking ability through questionnaires. Traditional training methods primarily involve proactive cognitive analysis and assessment through questionnaires and tests under the guidance of a therapist.

[0003] However, during the training evaluation process, the individual user's scale standardization, evaluation results, training type, and training parameters cannot accurately analyze and evaluate the individual user's attention performance and cognitive changes, thereby reducing the reliability of cognitive assessment. Therefore, the existing methods for evaluating individual cognitive abilities suffer from poor assessment accuracy. Summary of the Invention

[0004] The embodiments of the present invention provide a method, apparatus, device and medium for evaluating cognitive ability training, aiming to solve the problem of poor evaluation accuracy in existing methods for evaluating cognitive ability of individuals.

[0005] In a first aspect, an embodiment of the present invention provides a method for training and evaluating cognitive abilities, wherein the method is applied to a training and evaluation terminal, wherein the training and evaluation terminal is respectively communicatively connected to an interactive display screen and an eye capture module to implement data information transmission, and the method includes: Receiving a start instruction, and acquiring a multimedia playback file corresponding to the start instruction from a preset multimedia set; Sending the multimedia playback file to the interactive display screen for playback, and synchronously acquiring the eye movement trajectory information captured by the eyeball capture module; Projecting the eye movement trajectory information onto a virtual scene corresponding to the multimedia playback file to obtain eye movement projection information; Performing consistency analysis on the eye movement projection information according to the eye movement reference coordinates corresponding to the multimedia playback file to obtain a corresponding consistency analysis result; The consistency analysis result is evaluated according to a preset evaluation model to obtain a corresponding evaluation score.

[0006] In a second aspect, an embodiment of the present invention further provides a cognitive ability training and evaluation device, wherein the device is configured in a training and evaluation terminal, and the training and evaluation terminal is respectively connected to the interactive display screen and the eye capture module to realize data information transmission. The device is used to perform the cognitive ability training and evaluation method as described in the first aspect above, and the device includes: A multimedia play file acquisition unit, configured to receive a start instruction and acquire a multimedia play file corresponding to the start instruction from a preset multimedia set; an eye movement trajectory information acquisition unit, configured to send the multimedia playback file to the interactive display screen for playback, and synchronously acquire the eye movement trajectory information captured by the eyeball capture module; an eye movement projection information acquisition unit, configured to project the eye movement trajectory information onto a virtual scene corresponding to the multimedia playback file to obtain eye movement projection information; a consistency analysis unit, configured to perform consistency analysis on the eye movement projection information according to the eye movement reference coordinates corresponding to the multimedia playback file, and obtain a corresponding consistency analysis result; The evaluation unit is used to evaluate the consistency analysis result according to a preset evaluation model to obtain a corresponding evaluation score.

[0007] In a third aspect, an embodiment of the present invention further provides a computer device, wherein the device includes a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus; Memory for storing computer programs; The processor is configured to implement the steps of the cognitive ability training and evaluation method described in the first aspect above when executing the program stored in the memory.

[0008] In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the steps of the cognitive ability training and evaluation method as described in the first aspect above are implemented.

[0009] The embodiment of the present invention provides a method, apparatus, device and medium for training and evaluating cognitive abilities, the method comprising: receiving a start instruction, obtaining a multimedia playback file corresponding to the start instruction from a preset multimedia set; sending the multimedia playback file to an interactive display screen for playback, and synchronously obtaining eye movement trajectory information captured by an eye capture module; projecting the eye movement trajectory information to a virtual scene corresponding to the multimedia playback file to obtain eye movement projection information; performing consistency analysis on the eye movement projection information according to the eye movement reference coordinates corresponding to the multimedia playback file to obtain corresponding consistency analysis results; and evaluating the consistency analysis results according to a preset evaluation model to obtain corresponding evaluation scores. The above-mentioned method for training and evaluating cognitive abilities accurately obtains individual cognitive ability evaluation results by playing multimedia playback files and obtaining individual eye movement trajectory information for analysis. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0011] Figure 1 A flowchart of a method for training and evaluating cognitive abilities provided by an embodiment of the present invention; Figure 2 A schematic diagram of an application scenario of the cognitive ability training and evaluation method provided by an embodiment of the present invention; Figure 3 A schematic diagram of another application scenario of the cognitive ability training and evaluation method provided by an embodiment of the present invention; Figure 4 A schematic block diagram of a cognitive ability training and evaluation device provided by an embodiment of the present invention; Figure 5 It is a schematic block diagram of a computer device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0012] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0013] It will be understood that when used in this specification and the appended claims, the terms “comprises” and “comprising” indicate the presence of described features, integers, steps, operations, elements and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof.

[0014] It should also be understood that the terms used in the present specification are only for the purpose of describing particular embodiments and are not intended to limit the present invention. As used in the present specification and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms unless the context clearly indicates otherwise.

[0015] It should be further understood that the term "and / or" used in the present description and appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0016] The embodiment of the present invention provides a method for evaluating cognitive ability training, such as Figure 2 and Figure 3 As shown, the method is applied to a training and evaluation terminal 10, which is respectively connected to an interactive display screen 20 and an eyeball capture module 30 to realize data information transmission, and the training and evaluation terminal 10 executes the stored software program to realize the above-mentioned cognitive ability training and evaluation method. The training and evaluation terminal 10 can be a terminal device used by testers and individual users to train and evaluate cognitive abilities, such as an MCU chip. The interactive display screen 20 and related auxiliary structures are as follows. Figure 3As shown, the interactive display screen 20 faces the individual user and can play multimedia files. The keyboard 50 is connected to the training and evaluation terminal 10 for the tester to input commands. The operation display screen 60 is in communication with the training and evaluation terminal 10 and is used to input or adjust the training parameters corresponding to the individual user. By providing two display screens, the operation display screen 60 and the interactive display screen 20, the individual user can train through the interactive display screen 20, and the therapist can input and adjust training parameters through the operation display screen 60 without interfering with each other, thereby improving training efficiency. The operation display screen 60 is movably mounted on the device platform 70 via a screen support frame 61. The connection between the operation display screen 60 and the screen support frame 61 can be adjusted left and right, up and down, and the connection between the screen support frame 61 and the device platform 70 can also be adjusted left and right, up and down, to facilitate use by the therapist and the individual user. Furthermore, for assessment scales and training plans that are not visible to the individual user, the adjustment function of the operation display screen 60 can be used to rotate the operation display screen 60 to prevent the individual user from viewing the relevant content. The other side of the equipment platform 70, which corresponds to the placement slot 71, is connected to a chassis 73 via lifting columns 72. Several running wheels 74 are installed on the chassis 73. The installation of lifting columns 72 facilitates the height adjustment of the equipment platform 70 to accommodate a variety of training methods and individual heights of users. The installation of running wheels 74 also allows the position of the equipment platform 70 to be adjusted according to the training scenario during rehabilitation training, thereby improving training effectiveness.

[0017] like Figure 1 As shown, the method includes steps S110 to S150.

[0018] S110: Receive a start instruction, and obtain a multimedia playback file corresponding to the start instruction from a preset multimedia set.

[0019] The training and evaluation terminal is pre-configured with a multimedia collection containing a large number of multimedia files. The multimedia files include at least video content, and may also include both video and audio content. Upon receiving a startup command, the multimedia files in the multimedia collection are filtered according to the startup command to obtain a multimedia playback file corresponding to the startup command.

[0020] In a specific embodiment, step S110 includes sub-steps: filtering multimedia files in the multimedia collection according to the age value in the startup instruction to obtain multimedia files that match the age value; filtering matching multimedia files according to the training type in the startup instruction to obtain multimedia files that match the training type as the multimedia playback file.

[0021] Specifically, the start-up instruction includes an age value, which is the specific age of the individual user who is undergoing cognitive ability assessment; each multimedia file in the multimedia collection corresponds to an age segment and a file type. The multimedia files in the multimedia collection can be filtered by the age value in the start-up instruction to obtain multimedia files whose age segment matches the age value. Furthermore, the training type parameter can also be configured in the start-up instruction. For example, the training type can be basic cognitive training, concentration training, cognitive reaction training, etc. The training type can be matched with the file type of the matching multimedia file to obtain a multimedia file whose file type matches the training type as the multimedia playback file corresponding to the start-up instruction.

[0022] If there is only one multimedia file that matches the training type, the multimedia file is directly played as the multimedia playback file; if there are multiple multimedia files that match the training type, one of the multimedia files is randomly selected as the multimedia playback file to be played.

[0023] S120: Send the multimedia playback file to the interactive display screen for playback, and simultaneously obtain the eye movement trajectory information captured by the eye capture module.

[0024] Furthermore, the acquired multimedia file is sent to the interactive display screen, which then plays the multimedia file. Simultaneously, the eye movement of the individual user undergoing training and evaluation is captured by the eye capture module to obtain corresponding eye movement trajectory information. The eye movement trajectory information then includes the user's gaze trajectory during the multimedia file playback process.

[0025] S130: Projecting the eye movement trajectory information to a virtual scene corresponding to the multimedia playback file to obtain eye movement projection information.

[0026] The eye movement trajectory information obtained in the above steps is projected into the virtual scene corresponding to the multimedia playback file, thereby obtaining eye movement projection information.

[0027] In a specific embodiment, step S130 includes sub-steps: constructing a virtual scene corresponding to the multimedia playback file based on the orbital position in the eye movement trajectory information; generating a projection line corresponding to each moment based on the pupil gaze direction at each moment in the eye movement trajectory information; and obtaining the projection position corresponding to the projection line at each moment in the virtual scene as the eye movement projection information.

[0028] Specifically, the eye movement trajectory information includes the position of the eye sockets of an individual user, with the center point of the two eye sockets as the center point of the line of sight; the eye movement trajectory information includes eye images collected at different times (for example, if an eye image is collected every 0.05 seconds, the time difference between adjacent moments in the eye movement trajectory information is 0.05 seconds). The pupil in the eye image is black, and the other areas inside the eye socket are white or nearly white. Therefore, the eye socket position and pupil gaze direction can be determined by analyzing the eye images at each moment of the eye movement trajectory information.

[0029] Based on the relative position relationship between the interactive display screen and the center point of the line of sight (the relative position relationship between the interactive display screen and the center point of the line of sight can be obtained by analyzing the setting position of the interactive display screen, the setting position of the eye capture module, and the eye movement trajectory information obtained by the eye capture module), a virtual scene corresponding to the multimedia playback file can be constructed. In the virtual scene, the video screen of the multimedia playback file is used as the scene plane, and the center point of the line of sight is used as the reference point.

[0030] Furthermore, based on the center of sight, the pupil coordinates of the pupil gaze direction at each moment in the eye movement trajectory information are determined in the virtual scene, and corresponding projection lines are generated based on the pupil gaze direction at each moment in the eye movement trajectory information. The pupil gaze direction includes the pupil's movement position within the eye socket and the pupil's rotation angle. The pupil's movement position can be used as the starting point of the projection line, and the pupil's rotation angle can be used to determine the projection direction of the projection line, and the corresponding projection line is generated for each moment.

[0031] Obtaining the projection position corresponding to the projection line at each moment in the virtual scene involves determining the intersection of the projection line for each eye and the scene plane in the virtual scene. The intersection of the projection line and the scene plane is the projection position. If the user is concentrating on viewing a specific piece of information in a multimedia file, the deviation in the projection positions of the two eyes at the same moment is minimal. In this case, the projection positions of the two eyes can be considered to be projected simultaneously within a small field of view.

[0032] S140 , performing consistency analysis on the eye movement projection information according to the eye movement reference coordinates corresponding to the multimedia playback file to obtain a corresponding consistency analysis result.

[0033] Consistency analysis of eye movement projection information can be performed based on the eye movement reference coordinates corresponding to the multimedia playback file. The eye movement reference coordinates are the coordinates of the position of important information displayed on the screen during multimedia playback. If the individual user has strong cognitive ability and focused attention, their visual field will closely follow the eye movement reference coordinates. If their cognitive ability is weak or their attention is not focused, their visual field will generally deviate from the eye movement reference coordinates. Therefore, the consistency between the eye movement reference coordinates and the eye movement projection information can be analyzed to obtain the corresponding consistency analysis results.

[0034] In a specific embodiment, step S140 includes sub-steps: generating a corresponding temporal coordinate line according to the eye movement reference coordinates corresponding to the multimedia playback file; obtaining a plurality of eye movement projection lines corresponding to the eye movement projection information and a preset delay gradient time; calculating a coordinate consistency coefficient between the temporal coordinate line and each of the eye movement projection lines; obtaining the delay time corresponding to the eye movement projection line with the highest coordinate consistency coefficient; obtaining the intersection time ratio of the projection positions of both eyes in the eye movement projection information according to a preset position connection threshold; and combining the intersection time ratio, the delay time and the corresponding coordinate consistency coefficient as the consistency analysis result.

[0035] Specifically, the multimedia playback file contains a series of eye movement reference coordinates, which can be sequentially connected to generate a time-series coordinate line on the scene plane. Furthermore, the eye movement projection information is sequentially connected according to a preset delay gradient time to obtain multiple eye movement projection lines.

[0036] The delay gradient time is composed of multiple delay times, such as 0.05 seconds, 0.1 seconds, 0.15 seconds, 0.2 seconds, 0.25 seconds, 0.3 seconds, 0.35 seconds, 0.4 seconds, 0.45 seconds, and 0.5 seconds. When multimedia playback displays certain information, users have different cognitive abilities and reaction times. Faster users can adjust their field of view to the corresponding eye movement reference coordinates within a shorter delay time. Slower users require a longer delay time to adjust their field of view.

[0037] For example, if the delay time in the delay gradient time is 0.1 seconds, the projection center points of the projection positions of both eyes in the eye movement projection information are obtained. The time corresponding to each projection center point minus the delay time of 0.1 seconds is used as the new time point. Lines are connected sequentially based on the new time points of each projection center point to obtain eye movement projection lines corresponding to the 0.1 second delay time. Each delay time in the delay gradient time can be corresponding to a set of eye movement projection lines.

[0038] The number of projection centers in the eye movement projection line is not less than the number of eye movement reference coordinates. Each eye movement projection line and the temporal coordinate line are placed in the same time dimension, and the geometric distance between the projection center point in the eye movement projection line and the eye movement reference coordinate at the same time point in the temporal coordinate line is calculated. Based on the geometric distance corresponding to each eye movement reference coordinate, the coordinate consistency coefficient can be further calculated. For example, the coordinate consistency coefficient can be obtained using formula (1).

[0039] (1); Z is the calculated coordinate consistency coefficient, N is the total number of eye movement reference coordinates in the temporal coordinate connection line, (x 1,i ,y 1,i ) is the projection center point of the eye movement projection line at the i-th time point, (x 2,i ,y 2,i ) is the eye movement reference coordinate of the i-th time point in the temporal coordinate line. L is the length of the interactive display screen, and W is the width of the interactive display screen.

[0040] The delay time corresponding to the eye movement projection line with the highest coordinate consistency coefficient is obtained, and this group of delay times can accurately reflect the reaction speed of individual users.

[0041] The crossover time percentage of the eye movement projection positions in the eye movement projection information is obtained based on a preset position connection threshold. Specifically, the geometric distance between the eye movement projection positions at each moment in the eye movement projection information is calculated to determine whether the geometric distance is no greater than the position connection threshold. The number of time points at which the geometric distance is no greater than the position connection threshold is obtained and divided by the total number of eye images in the eye movement projection information to obtain the crossover time percentage. The crossover time percentage reflects the proportion of time when the eye movement projection positions are cross-connected.

[0042] The obtained crossover time ratio, delay time, and the coordinate consistency coefficient corresponding to the delay time (the largest obtained coordinate consistency coefficient is the coordinate consistency coefficient corresponding to the delay time) are combined to obtain the corresponding consistency analysis result.

[0043] S150: Evaluate the consistency analysis result according to a preset evaluation model to obtain a corresponding evaluation score.

[0044] Furthermore, the obtained consistency analysis results can be evaluated according to a preset evaluation model to obtain a corresponding evaluation score, and the evaluation score can accurately reflect the cognitive ability of the individual user.

[0045] In a specific embodiment, step S150 includes sub-steps: calculating the delay time in the consistency analysis result according to the reaction delay function in the evaluation model to obtain the corresponding delay coefficient; comprehensively calculating the delay coefficient and the consistency coefficient and cross-time ratio in the consistency analysis result according to the comprehensive evaluation function in the evaluation model to obtain the corresponding evaluation score.

[0046] Specifically, the delay time in the consistency analysis result can be calculated according to the reaction delay function. The reaction delay function can be expressed by formula (2): (2); F is the calculated delay coefficient, t ris the delay time in the consistency analysis results.

[0047] Furthermore, the delay coefficient and the consistency coefficient and crossover time ratio in the consistency analysis results are comprehensively calculated according to the comprehensive evaluation function set in the evaluation model, and the calculated value is used as the corresponding evaluation score. The comprehensive evaluation function can be expressed as formula (3): (3); y is the consistency coefficient in the consistency analysis result, e is the natural logarithm base, F is the delay coefficient, V is the crossover time ratio, and P is the calculated evaluation score.

[0048] In the cognitive ability training and evaluation method disclosed in the above embodiment, the method includes: receiving a start instruction, obtaining a multimedia playback file corresponding to the start instruction from a preset multimedia set; sending the multimedia playback file to the interactive display screen for playback, and synchronously obtaining eye movement trajectory information captured by the eye capture module; projecting the eye movement trajectory information to a virtual scene corresponding to the multimedia playback file to obtain eye movement projection information; performing consistency analysis on the eye movement projection information according to the eye movement reference coordinates corresponding to the multimedia playback file to obtain corresponding consistency analysis results; evaluating the consistency analysis results according to a preset evaluation model to obtain corresponding evaluation scores. The above cognitive ability training and evaluation method plays multimedia playback files and obtains individual eye movement trajectory information for analysis, thereby accurately obtaining individual cognitive ability evaluation results.

[0049] The embodiment of the present invention further provides a cognitive ability training and evaluation device, which can be configured in the training and evaluation terminal 10 and is used to execute any embodiment of the aforementioned cognitive ability training and evaluation method. Figure 4 , Figure 4 A schematic block diagram of a cognitive ability training and evaluation device provided by an embodiment of the present invention.

[0050] like Figure 4 As shown, the cognitive ability training and evaluation device 100 includes a multimedia playback file acquisition unit 110 , an eye movement trajectory information acquisition unit 120 , an eye movement projection information acquisition unit 130 , a consistency analysis unit 140 and an evaluation unit 150 .

[0051] The multimedia play file acquisition unit 110 is configured to receive a start instruction and acquire a multimedia play file corresponding to the start instruction from a preset multimedia set.

[0052] In a more specific embodiment, the multimedia playback file acquisition unit 110 includes: a first screening unit, used to screen the multimedia files in the multimedia collection according to the age value in the startup instruction to obtain multimedia files that match the age value; and a second screening unit, used to screen the matching multimedia files according to the training type in the startup instruction to obtain multimedia files that match the training type as the multimedia playback file.

[0053] The eye movement track information acquisition unit 120 is used to send the multimedia playback file to the interactive display screen for playback, and synchronously acquire the eye movement track information captured by the eyeball capture module.

[0054] The eye movement projection information acquisition unit 130 is configured to project the eye movement trajectory information onto a virtual scene corresponding to the multimedia playback file to obtain eye movement projection information.

[0055] In a more specific embodiment, the eye movement projection information acquisition unit 130 includes: a virtual scene construction unit, used to construct a virtual scene corresponding to the multimedia playback file according to the eye socket position in the eye movement trajectory information; a projection line generation unit, used to generate the projection line corresponding to each moment according to the pupil gaze direction at each moment in the eye movement trajectory information; a projection position acquisition unit, used to obtain the projection position corresponding to the projection line at each moment in the virtual scene as the eye movement projection information.

[0056] The consistency analysis unit 140 is configured to perform consistency analysis on the eye movement projection information according to the eye movement reference coordinates corresponding to the multimedia playback file to obtain a corresponding consistency analysis result.

[0057] The evaluation unit 150 is configured to evaluate the consistency analysis result according to a preset evaluation model to obtain a corresponding evaluation score.

[0058] The cognitive ability training and evaluation device provided in the embodiment of the present invention applies the above-mentioned cognitive ability training and evaluation method, receives a start-up instruction, obtains a multimedia playback file corresponding to the start-up instruction from a preset multimedia set; sends the multimedia playback file to the interactive display screen for playback, and simultaneously obtains the eye movement trajectory information captured by the eye capture module; projects the eye movement trajectory information to the virtual scene corresponding to the multimedia playback file to obtain eye movement projection information; performs consistency analysis on the eye movement projection information according to the eye movement reference coordinates corresponding to the multimedia playback file to obtain the corresponding consistency analysis result; evaluates the consistency analysis result according to the preset evaluation model to obtain the corresponding evaluation score. The above-mentioned cognitive ability training and evaluation method plays multimedia playback files and obtains individual eye movement trajectory information for analysis, thereby accurately obtaining the individual's cognitive ability evaluation result.

[0059] The above-mentioned cognitive ability training and evaluation device can be implemented in the form of a computer program. The computer program can be used in Figure 5 Runs on the computer equipment shown.

[0060] See also Figure 5 , Figure 5 is a schematic block diagram of a computer device provided by an embodiment of the present invention. The computer device may be a training evaluation terminal for executing a training evaluation method for cognitive ability to perform training evaluation on the cognitive ability of an individual user.

[0061] See Figure 5 The computer device 500 includes a processor 502 , a memory, and a communication interface 505 connected via a communication bus 501 , wherein the memory may include a storage medium 503 and an internal memory 504 .

[0062] The storage medium 503 may store an operating system 5031 and a computer program 5032. When the computer program 5032 is executed, the processor 502 may execute a cognitive ability training and assessment method. The storage medium 503 may be a volatile storage medium or a non-volatile storage medium.

[0063] The processor 502 is used to provide computing and control capabilities to support the operation of the entire computer device 500.

[0064] The internal memory 504 provides an environment for the operation of the computer program 5032 in the storage medium 503. When the computer program 5032 is executed by the processor 502, the processor 502 can execute the training and evaluation method of cognitive ability.

[0065] The communication interface 505 is used for network communication, such as providing data information transmission. Those skilled in the art will understand that Figure 5 The structure shown in the figure is merely a block diagram of a portion of the structure related to the solution of the present invention and does not constitute a limitation on the computer device 500 to which the solution of the present invention is applied. The specific computer device 500 may include more or fewer components than shown in the figure, or combine certain components, or have a different component arrangement.

[0066] The processor 502 is configured to run the computer program 5032 stored in the memory to implement the corresponding functions of the above-mentioned cognitive ability training and evaluation method.

[0067] Those skilled in the art will understand that Figure 5The embodiment of the computer device shown in the figure does not constitute a limitation on the specific composition of the computer device. In other embodiments, the computer device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently. For example, in some embodiments, the computer device may only include a memory and a processor. In such an embodiment, the structure and function of the memory and processor are the same as those in the figure. Figure 5 The embodiments shown are consistent and will not be described again here.

[0068] It should be understood that in the embodiment of the present invention, the processor 502 may be a central processing unit (CPU), and the processor 502 may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc.

[0069] In another embodiment of the present invention, a computer-readable storage medium is provided. The computer-readable storage medium may be volatile or non-volatile. The computer-readable storage medium stores a computer program, which, when executed by a processor, implements the steps included in the above-described cognitive ability training and assessment method.

[0070] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described equipment, devices and units can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here. Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented with electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0071] In the several embodiments provided by the present invention, it should be understood that the disclosed devices, apparatuses and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, or units with the same function may be combined into one unit. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interfaces, devices or units, or may be an electrical, mechanical or other form of connection.

[0072] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected according to actual needs to achieve the objectives of the embodiments of the present invention.

[0073] In addition, the functional units in the various embodiments of the present invention may be integrated into a single processing unit, each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0074] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the portion that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a computer-readable storage medium and includes several instructions for causing a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned computer-readable storage medium includes various media that can store program code, such as a USB flash drive, a mobile hard drive, a read-only memory (ROM), a magnetic disk, or an optical disk.

[0075] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in the present invention, and such modifications or substitutions are intended to be within the scope of protection of the present invention. Therefore, the scope of protection of the present invention shall be subject to the scope of protection of the claims.

Claims

1. A method for evaluating cognitive ability training, characterized in that: The method is applied to a training evaluation terminal, wherein the training evaluation terminal is respectively connected to an interactive display screen and an eye capture module to realize data information transmission, and the method includes: Receiving a start instruction, and acquiring a multimedia playback file corresponding to the start instruction from a preset multimedia set; Sending the multimedia playback file to the interactive display screen for playback, and synchronously acquiring the eye movement trajectory information captured by the eyeball capture module; Projecting the eye movement trajectory information onto a virtual scene corresponding to the multimedia playback file to obtain eye movement projection information; Performing consistency analysis on the eye movement projection information according to the eye movement reference coordinates corresponding to the multimedia playback file to obtain a corresponding consistency analysis result; The consistency analysis result is evaluated according to a preset evaluation model to obtain a corresponding evaluation score.

2. The cognitive ability training and evaluation method according to claim 1, characterized in that: The acquiring of the multimedia playback file corresponding to the startup instruction from the preset multimedia set includes: screening multimedia files in the multimedia collection according to the age value in the start instruction to obtain multimedia files matching the age value; Matching multimedia files are screened according to the training type in the start instruction to obtain multimedia files matching the training type as the multimedia playback files.

3. The cognitive ability training and evaluation method according to claim 1, characterized in that: Projecting the eye movement trajectory information onto a virtual scene corresponding to the multimedia playback file to obtain eye movement projection information includes: Constructing a virtual scene corresponding to the multimedia playback file according to the eye orbit position in the eye movement trajectory information; generating a projection line corresponding to each moment according to the pupil gaze direction at each moment in the eye movement trajectory information; The projection position corresponding to the projection line at each moment is obtained in the virtual scene as the eye movement projection information.

4. The cognitive ability training and evaluation method according to claim 1, characterized in that: The performing consistency analysis on the eye movement projection information according to the eye movement reference coordinates corresponding to the multimedia playback file to obtain a corresponding consistency analysis result includes: Generate a corresponding temporal coordinate line according to the eye movement reference coordinates corresponding to the multimedia playback file; Acquire a plurality of eye movement projection lines corresponding to the eye movement projection information and a preset delay gradient time; Calculating the coordinate consistency coefficient between the temporal coordinate line and each eye movement projection line; Obtain the delay time corresponding to the eye movement projection line with the highest coordinate consistency coefficient; Obtaining a crossover time ratio of the projection positions of both eyes in the eye movement projection information according to a preset position connection threshold; The crossover time ratio, the delay time and the corresponding coordinate consistency coefficient are combined as the consistency analysis result.

5. The cognitive ability training and evaluation method according to claim 1 or 4, characterized in that: The consistency analysis result is evaluated according to a preset evaluation model to obtain a corresponding evaluation score, including: Calculating the delay time in the consistency analysis result according to the reaction delay function in the evaluation model to obtain a corresponding delay coefficient; The delay coefficient and the consistency coefficient and the crossover time ratio in the consistency analysis result are comprehensively calculated according to the comprehensive evaluation function in the evaluation model to obtain a corresponding evaluation score.

6. A cognitive ability training and evaluation device, characterized in that: The device is configured in a training and evaluation terminal, and the training and evaluation terminal is respectively connected to the interactive display screen and the eye capture module to realize the transmission of data information. The device is used to perform the cognitive ability training and evaluation method according to any one of claims 1 to 5, and the device includes: A multimedia play file acquisition unit, configured to receive a start instruction and acquire a multimedia play file corresponding to the start instruction from a preset multimedia set; an eye movement trajectory information acquisition unit, configured to send the multimedia playback file to the interactive display screen for playback, and synchronously acquire the eye movement trajectory information captured by the eyeball capture module; an eye movement projection information acquisition unit, configured to project the eye movement trajectory information onto a virtual scene corresponding to the multimedia playback file to obtain eye movement projection information; a consistency analysis unit, configured to perform consistency analysis on the eye movement projection information according to the eye movement reference coordinates corresponding to the multimedia playback file, and obtain a corresponding consistency analysis result; The evaluation unit is used to evaluate the consistency analysis result according to a preset evaluation model to obtain a corresponding evaluation score.

7. The cognitive ability training and evaluation device according to claim 6, characterized in that: The multimedia playback file acquisition unit includes: a first screening unit, configured to screen multimedia files in the multimedia collection according to the age value in the start instruction to obtain multimedia files matching the age value; The second screening unit is configured to screen matching multimedia files according to the training type in the startup instruction, so as to obtain multimedia files matching the training type as the multimedia playback files.

8. The cognitive ability training and evaluation device according to claim 6, characterized in that: The eye movement projection information acquisition unit includes: A virtual scene construction unit, configured to construct a virtual scene corresponding to the multimedia playback file according to the eye orbit position in the eye movement trajectory information; A projection line generating unit, configured to generate a projection line corresponding to each moment according to the pupil gaze direction at each moment in the eye movement trajectory information; The projection position acquisition unit is used to acquire the projection position corresponding to the projection line at each moment in the virtual scene as the eye movement projection information.

9. A computer device, characterized in that: The device includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus; Memory for storing computer programs; The processor is configured to implement the steps of the cognitive ability training and evaluation method according to any one of claims 1 to 5 when executing the program stored in the memory.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the cognitive ability training and evaluation method according to any one of claims 1 to 5 are implemented.

Images