Vision-based cognitive function assessment method, device, equipment and program product

Abstract

The application relates to the field of cognitive function evaluation, and in particular to a vision-based cognitive function evaluation method, device, equipment and program product. The method comprises the following steps: obtaining individual information of a subject; determining a question for cognitive function evaluation according to the individual information of the subject; playing the determined question, capturing first pupil position change information of the subject and vital sign information of the subject; correcting the first pupil position change information according to the vital sign information to obtain second pupil position change information; comparing the second pupil position change information with a pupil reference model to determine a cognitive function evaluation result of the subject. The corresponding question is determined according to the individual information of the subject, so that the question can adapt to the differences in individual information of different subjects, the accuracy of the evaluation result is improved, and the accuracy of the evaluation result can be further improved through vital sign information correction.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of cognitive function assessment, and in particular, to a vision-based cognitive function assessment method, device, equipment and program product. BACKGROUND

[0002] Cognitive function is the ability of an individual to process information, understand, learn, remember, solve problems, make decisions, perceive, pay attention, and language, etc. Cognitive function assessment of a subject can be used to lock a suspected population, and facilitate further assessment by other means.

[0003] In the current cognitive function assessment method, a high-precision eye tracker is used to capture the position and change time of the pupil of the subject. However, the focusing position of the pupil of the human eye changes very quickly, usually showing discrete and irregular single-point focusing, which is not conducive to improving the accuracy of cognitive function assessment. SUMMARY

[0004] Therefore, the embodiments of the present application provide a vision-based cognitive function assessment method, device, equipment and program product to solve the problem that the accuracy of cognitive function assessment is not improved when the vision-based cognitive function assessment is performed in the prior art.

[0005] The first aspect of the embodiments of the present application provides a vision-based cognitive function assessment method, which comprises:

[0006] Obtaining individual information of a subject;

[0007] Determining a question for cognitive function assessment according to the individual information of the subject;

[0008] Playing the determined question, and capturing first pupil position change information of the subject and vital sign information of the subject;

[0009] Correcting the first pupil position change information according to the vital sign information to obtain second pupil position change information;

[0010] Comparing the second pupil position change information with a pupil reference model to determine a cognitive function assessment result of the subject.

[0011] In combination with the first aspect, in a first possible implementation manner of the first aspect, the question includes a target image for evaluation; playing the determined question comprises:

[0012] Playing the target image to make a visual point of the subject move in a predetermined horizontal direction.

[0013] In a second possible implementation manner of the first aspect, in the first possible implementation manner of the first aspect, the target image comprises a static image or a dynamic image.

[0014] playing the target image to move the visual point of the subject in a predetermined horizontal direction comprises:

[0015] when the target image comprises a plurality of static images, playing the plurality of static images in a predetermined horizontal display direction and a predetermined static image display time;

[0016] when the target image comprises a dynamic image, playing the dynamic image to move a dynamic target object included in the dynamic image in a predetermined horizontal direction.

[0017] In a third possible implementation manner of the first aspect, in the first aspect, capturing the first pupil position change information of the subject comprises at least one of the following manners:

[0018] capturing position change information of a fixation point of the pupil of the subject;

[0019] capturing a moving duration between two adjacent fixation points of the pupil of the subject;

[0020] capturing a staying duration of the fixation point of the pupil of the subject at different positions;

[0021] capturing a line connecting positions at which the staying duration of the fixation point of the pupil of the subject is greater than a predetermined first duration.

[0022] In a fourth possible implementation manner of the first aspect, in the first aspect, the individual information comprises an age of the subject.

[0023] determining a question for cognitive function evaluation according to the individual information of the subject comprises:

[0024] determining a question for cognitive function evaluation corresponding to the age of the subject according to a preset correspondence between an age interval to which the age of the subject belongs and a question.

[0025] In a fifth possible implementation manner of the first aspect, in any one of the first aspect to the fourth possible implementation manner of the first aspect, the vital sign information comprises a pulse rate.

[0026] correcting the first pupil position change information according to the vital sign information to obtain second pupil position change information comprises:

[0027] determining a first time period when the pulse rate of the subject deviates from a predetermined ratio of a fluctuation rate baseline value of the pulse rate of the subject;

[0028] According to the first time period, third pupil position change information in the first pupil position change information is searched, and the third pupil position change information in the first pupil position change information is corrected to obtain second pupil position change information.

[0029] With reference to the fifth possible implementation manner of the first aspect, in a sixth possible implementation manner of the first aspect, correcting the third pupil position change information in the first pupil position change information comprises:

[0030] According to the first pupil position change information and the pupil reference model, a correction parameter is determined.

[0031] According to the correction parameter, the third pupil position change information is corrected.

[0032] The second aspect of the embodiment of the present application provides a visual-based cognitive function evaluation device, the device comprising:

[0033] An individual information acquisition unit is configured to acquire individual information of a subject.

[0034] A question determination unit is configured to determine a question for cognitive function evaluation according to the individual information of the subject.

[0035] An information capturing unit is configured to play the determined question, and capture first pupil position change information of the subject and vital sign information of the subject.

[0036] A correction unit is configured to correct the first pupil position change information according to the vital sign information to obtain second pupil position change information.

[0037] An evaluation result determination unit is configured to compare the second pupil position change information with a pupil reference model to determine a cognitive function evaluation result of the subject.

[0038] The third aspect of the embodiment of the present application provides a visual-based cognitive function evaluation device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the computer program, the visual-based cognitive function evaluation device implements the method of any one of the first aspect.

[0039] The fourth aspect of the embodiment of the present application provides a computer program product, when it is executed on a computer, the computer executes the method of the first aspect or each implementation manner thereof.

[0040] The fifth aspect of the embodiments of the present application provides a computer readable storage medium, the computer readable storage medium stores a computer program, and the computer program is executed by a processor to implement the steps of the method in any one of the first aspect.

[0041] The sixth aspect of the embodiments of the present application provides a chip for implementing the method in any of the implementation manners of the first aspect. Specifically, the chip comprises a processor configured to call and run a computer program from a memory, so that a device installed with the chip executes the method in the first aspect or any of the implementation manners thereof.

[0042] Compared with the prior art, the embodiments of the present application have the beneficial effects that the embodiments of the present application determine the corresponding question according to the individual information of the subject, so that the question can adapt to the differences in individual information of different subjects, and the accuracy of the evaluation result is improved; when the determined question is played, the first pupil position change information of the subject and the vital sign information of the subject are captured, the first pupil position change information is corrected based on the vital sign information to obtain second pupil position change information, and the second pupil position change information and the pupil reference model are compared to determine the cognitive function evaluation result. Since the first pupil position change information can be corrected based on the vital sign information during the test, the accuracy of the evaluation result is further improved. BRIEF DESCRIPTION OF DRAWINGS

[0043] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings needed to be used in the embodiments or prior art description. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0044] Figure 1 is an implementation scenario schematic diagram of a cognitive function evaluation method based on vision provided by the embodiments of the present application;

[0045] Figure 2 is an implementation flow schematic diagram of a cognitive function evaluation method based on vision provided by the embodiments of the present application;

[0046] Figure 3 is a schematic diagram of image display provided by the embodiments of the present application;

[0047] Figure 4 is a schematic diagram of determining a correction parameter provided by the embodiments of the present application;

[0048] Figure 5 is a schematic diagram of correction based on a correction parameter provided by the embodiments of the present application;

[0049] Figure 6 is a schematic diagram of a cognitive function evaluation device based on vision provided by an embodiment of the present application;

[0050] Figure 7 is a schematic diagram of a cognitive function evaluation device based on vision provided by an embodiment of the present application. DETAILED DESCRIPTION

[0051] In the following description, for the purpose of explanation and not limitation, specific details are set forth, such as particular system configurations, techniques, etc., in order to provide a thorough understanding of the embodiments of the present application. However, it will be apparent to those skilled in the art that the present application can be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.

[0052] In order to illustrate the technical solutions described in the present application, the following will be described through specific embodiments.

[0053] Cognitive function refers to the ability of an individual to process, understand, learn, remember, solve problems, make decisions, perceive, focus attention, and use language, etc. Cognitive function evaluation of a subject can help identify individuals who may have cognitive problems, thereby providing a basis for further detailed evaluation.

[0054] In existing evaluation methods, high-precision eye trackers are widely used to capture the position and reaction time of the subject's pupil to evaluate cognitive function. However, due to the rapid change of the human eye pupil to the focusing position and the usual single-point focusing characteristics, these data often present irregular dispersion, which limits the accuracy of the evaluation.

[0055] In order to improve the evaluation accuracy of cognitive function, the embodiments of the present application propose a cognitive function evaluation method based on vision, Figure 1A schematic diagram of an implementation scenario of the method is shown. In the implementation scenario of the vision-based cognitive function evaluation method, a vision-based cognitive function evaluation device is included, which comprises a screen, a vital sign information acquisition apparatus and a pupil image acquisition apparatus. The vision-based cognitive function evaluation device can be used to obtain individual information of a subject, determine an average cognitive level of a group to which the subject belongs based on the individual information of the subject, and determine a corresponding question for cognitive function evaluation based on the average cognitive level of the group. The screen can be used to play the question determined based on the individual information of the subject. The vital sign information acquisition apparatus is used to acquire vital sign information of the subject. For example, a non-contact vital sign information acquisition apparatus can be used, which includes an infrared camera for capturing temperature changes on the skin surface of the subject. Since blood flow can cause slight changes in the skin surface temperature, the blood flow of the subject can be estimated by the temperature changes, so as to determine the pulse rate of the subject. The pupil image acquisition apparatus is used to acquire pupil images of the subject, determine change information of the center position of the pupil of the subject, and determine the position of the fixation point of the subject in the screen based on the change information of the center position of the pupil and by pre-calibration. During the playing of the question, the change characteristics of the fixation point of the subject can be captured by the pupil image acquisition apparatus, the vital sign change information of the subject can be captured by the vital sign information acquisition apparatus, the change characteristics of the fixation point are corrected based on the vital sign change information, and then compared with the pupil reference model to obtain the evaluation result of the cognitive function of the subject.

[0056] Figure 2 An implementation flowchart of a vision-based cognitive function evaluation method provided in the embodiments of the present application is shown, and the details are as follows:

[0057] In S201, individual information of a subject is obtained.

[0058] The individual information in the embodiments of the present application can include at least one of age, gender, cultural level and living habit. The individual information can be filled in by the subject or entered by the staff.

[0059] In general, the human brain will show certain change rules with age. With the increase of age, the perceptual speed basically shows linear decline, language memory, inductive reasoning and spatial orientation show decline at three platform periods of 55 years old, 65 years old and 75 years old, the decline speed of spatial orientation is slower than that of language memory and inductive reasoning, and digital calculation reaches the mature period at the 45-year-old high point and then gradually declines. Language ability has large individual difference and remains the best in the cognitive dimension.

[0060] The living habit information in the embodiments of the present application can include at least one of information such as whether to live alone, exercise frequency, medical history information and whether to have a smoking habit.

[0061] In a possible implementation, the embodiment of the present application can acquire the age of the subject, and determine the group to which the subject belongs based on the age of the subject. For example, the subjects can be divided into groups according to age, and the groups of less than 55 years old, between 55 and 75 years old, and more than 75 years old can be determined.

[0062] In S202, the question for cognitive function evaluation is determined according to the individual information of the subject.

[0063] According to the pre-set group division plan of individual information, the group to which the individual information of the subject belongs can be determined, and the questions matched with the average cognitive level of the group to which the subject belongs can be determined in combination with the pre-set correspondence between the groups and the questions, so that more accurate evaluation results can be obtained when the cognitive function is evaluated according to the matched questions.

[0064] In a possible implementation, the group to which the subject belongs can be determined according to the age of the subject, and the cognitive function of the subject can be evaluated based on the pre-set questions of the group.

[0065] For example, if the age of the subject is 60 years old, the subject belongs to the group between 55 and 75 years old, and the questions matched with the age interval are searched to evaluate the cognitive function.

[0066] In a possible implementation, the questions for cognitive function evaluation can include questions of multiple dimensions, such as questions of visual memory, visual logic, visual perception, and visual operation. Questions of different dimensions can be further divided according to the difficulty of the questions. Therefore, after the group to which the individual information of the subject belongs is determined, the questions of corresponding difficulty are determined according to the average cognitive level of the group. The questions of corresponding difficulty can include questions of different dimensions, such as questions of visual memory, visual logic, visual perception, and visual operation.

[0067] In S203, the determined question is played, and the first pupil position change information of the subject and the vital sign information of the subject are captured.

[0068] The screen for playing the question in the embodiment of the present application can be the screen of the device for interacting with the subject. For example, when the device for interacting with the subject is a robot, the screen can be the screen of the head of the robot. The device for interacting with the subject can also include an AR device, such as a virtual reality helmet.

[0069] The subject for playing in the embodiments of the present application can include a target image. The target image can include a dynamic image or a static image. When the target image is a dynamic image, the dynamic image can include a prominent dynamic target that moves in a predetermined direction, so that the visual point of the subject (a point of attention alignment or a point of pupil alignment) follows the dynamic target to move, such as moving from left to right or from right to left. When the target image is a static image, a plurality of static images can be included. The display time and display position of each static image can be controlled so that the visual point of the subject moves in a predetermined direction, such as moving in a predetermined horizontal direction, including moving from left to right or from right to left.

[0070] For example Figure 3 In the schematic diagram of the image display shown, three regions are included in the screen, which are a first region, a second region and a third region, for displaying a first image, a second image and a third image respectively (the number of actual regions and the number of images can not be limited to three, such as 4, 5, 6, 7, etc.). The display time of the first image can be controlled to be a first time t1, the display time of the second image can be controlled to be a second time t2, and the display time of the third image can be controlled to be a third time t3, and t1 is earlier than t2, and t2 is earlier than t3. Therefore, during the playing process, the visual point of the subject will move following the position of the latest displayed target image, such as moving from left to right. Figure 3 In the display mode in the above formula, the visual point moves from left to right.

[0071] The subject for cognitive function evaluation in the embodiments of the present application can include subjects of visual memory, visual logic, visual perception and visual operation dimensions.

[0072] For example, a series of images can be displayed to the subject in a predetermined horizontal direction, and after a period of time, the subject is required to describe the details of the played images, or to identify the previously played images from a group of images, so as to evaluate the visual memory of the subject.

[0073] A series of images can be displayed to the subject in a predetermined horizontal direction, and the subject is required to identify the common features of the images, so as to evaluate the visual logic of the subject.

[0074] A plurality of images including blurred or occluded parts can be displayed to the subject in a predetermined horizontal direction, and the subject is required to identify the objects in the images, so as to evaluate the visual perception of the subject.

[0075] A plurality of puzzle pieces can be displayed to the subject in a predetermined horizontal direction, and the subject is required to complete the puzzle, so as to evaluate the visual operation of the subject.

[0076] During the process of playing the target image, the first pupil position change information of the subject can be captured according to a predetermined sampling period. The first pupil position change information can represent the change information of the fixation point of the pupil of the subject in the screen. After the fixation point of the pupil of the subject in the screen is calibrated, the fixation point of the pupil in the screen at different positions can be determined according to the change of the center point of the pupil. According to the first pupil position change information, the change information of the fixation point in the screen can be determined.

[0077] The first pupil position change information captured in the embodiment of the application can be represented by the position information of the fixation point, and can be represented by the following characteristic factors:

[0078] The position change information of the fixation point: During the process of playing the target image, the fixation point of the subject will move with the change of the image, and the position change information of the fixation point of the subject can be captured. During the capturing process, sampling can be performed according to a predetermined sampling period, such as a sampling period of 10 milliseconds, and noise data can be filtered by filtering.

[0079] The moving duration between two adjacent fixation points: when the fixation point of the subject moves from a first position to a second position (the second position is adjacent to the first position in time), the moving duration of the fixation point from the first position to the second position can be recorded. The two adjacent fixation points are fixation points with a stay duration greater than a predetermined second duration.

[0080] The stay duration of the fixation point at different positions: during the evaluation of the subject, the stay duration of the fixation point of the subject at different positions is different, and the stay duration of different screen positions can be collected, or the type of the stay hotspot area can be determined according to the stay duration. For example, a plurality of stay hotspot areas can be divided according to values such as 300 milliseconds, 500 milliseconds, 1 second, 2 seconds and 3 seconds, and the stay hotspot area where the stay position is located can be determined.

[0081] The line connecting the positions with a stay duration greater than a predetermined first duration: the stay duration of each fixation point is screened by the first duration, the fixation points greater than the first duration are connected, and the trajectory of the main stay point of the subject is obtained.

[0082] The embodiment of the application acquires the first pupil position change information of the subject, and also collects the vital sign information of the subject. The vital sign information can include the pulse rate of the subject. It is not limited to this, and the body temperature, respiration rate and other vital sign information of the subject can also be collected.

[0083] For example, the infrared camera can emit infrared light of a specific wavelength, which can penetrate the skin surface. The blood under the skin has specific absorption characteristics for these infrared lights. After the infrared light is irradiated to the skin, part of it is reflected back to the camera, and part of it is absorbed by the blood. The amount of reflected infrared light is related to the flow of blood, and information related to blood flow can be extracted to calculate the pulse rate (PR value).

[0084] In S204, the first pupil position change information is corrected according to the vital sign information to obtain second pupil position change information.

[0085] When the first pupil position change information is corrected by the vital sign information, it can be determined whether the vital sign information is in a predetermined normal range. When the vital sign information is not in the normal range (in the abnormal range), the third pupil position change information to be corrected is determined according to the period not in the normal range.

[0086] The vital sign information can include pulse rate. When determining whether the current pulse rate is in the normal range, a predetermined time length can be collected, such as the pulse rate of the last 3 cycles / 90 seconds before the current time (which can be the last 3 cycles / 90 seconds before the current time, or a fixed time range). If the deviation of the current pulse rate from the fluctuation rate baseline value is greater than a predetermined deviation threshold, such as greater than 35%, it indicates that the pulse rate is in an abnormal range.

[0087] For example, Figure 4 A schematic diagram for correcting the first pupil position change information based on the pulse rate is shown. According to the deviation of the pulse rate from the fluctuation rate baseline value, the first time range is determined as the period when the pulse rate is abnormal. In this period, the subject may be in a state of tension or emotional abnormality. The third pupil position change information (dashed line in the figure) can be determined according to the first time range, i.e. the pupil position change information that needs to be corrected. In the second time range outside the first time range, the pulse rate is in a normal state. According to the second time range, reliable and effective fourth pupil position change information can be determined. After the correction of the third pupil position change information is completed, the second pupil position change information can be obtained according to the corrected third pupil position change information combined with the reliable and effective fourth pupil position change information.

[0088] When correcting the third pupil position change information, a correction parameter can be determined based on the deviation between the first pupil position change information and a pupil reference model (the pupil reference model has standard pupil position change information, which can be determined by the mean value of the pupil position change information when the same group completes the same task). Figure 5In the illustrated correction schematic diagram, the reliable and effective fourth pupil position change information can be compared with the pupil reference model to determine the deviation therebetween. An average deviation can be calculated according to a plurality of deviation values, and the average deviation can be used as a correction parameter. The correction parameter can be superimposed on the third pupil position change information in the first time range, and combined with the fourth pupil position change information to obtain the second pupil position change information after correction.

[0089] Without being limited thereto, the third pupil position change information in the abnormal range can also be corrected through statistical data of multiple evaluations or through machine learning.

[0090] In S205, the second pupil position change information is compared with the pupil reference model to determine the cognitive function evaluation result of the subject.

[0091] The feature factors used to represent the second pupil position change information can include the position change information of the fixation point, the movement duration between two adjacent fixation points, the dwell duration of the fixation point at different positions, and the connection of the positions at which the dwell duration of the fixation point is greater than a predetermined first duration. The standard pupil position change information can be obtained in the pupil reference model according to the individual information of the subject and the question. Based on the deviation between the second pupil position change information and the standard pupil position change information, and in combination with the predetermined deviation and the corresponding relationship between the cognitive function evaluation result, the cognitive function evaluation result of the subject is determined. Alternatively, in a possible implementation, the standard pupil position change information and the second pupil position change information of the subject can be input into a pre-trained cognitive function evaluation model to output the cognitive function evaluation result of the subject.

[0092] The application embodiment can effectively improve the evaluation efficiency and the accuracy of the evaluation by evaluating and screening the subject based on the deviation of the pupil position change information obtained through big data statistics, relative to the text evaluation or the inquiry evaluation. In addition, the influence of the process data distortion caused by the emotion of the subject can be effectively reduced through the detection of the non-contact vital sign information, and the evaluation accuracy can be improved. In addition, the detection data sensitivity can be effectively improved by moving the fixation point in the horizontal direction, so as to improve the accuracy of the evaluation result.

[0093] It should be understood that the size of the serial number of each step in the above embodiment does not mean the order of execution, and the execution order of each process should be determined according to its function and inherent logic, and should not constitute any limitation on the implementation process of the application embodiment.

[0094] Figure 6 A schematic diagram of a cognitive function evaluation device based on vision provided by the application embodiment is shown in the figure, and the device comprises:

[0095] Individual information acquisition unit 601 is used to acquire individual information of the subject;

[0096] The item determination unit 602 is used to determine items for cognitive function assessment based on the individual information of the subject.

[0097] The information capture unit 603 is used to play the determined question and capture the change information of the first pupil position of the subject, as well as the vital signs information of the subject.

[0098] The correction unit 604 is used to correct the first pupil position change information according to the vital sign information to obtain the second pupil position change information;

[0099] The assessment result determination unit 605 is used to compare the second pupil position change information with the pupil reference model to determine the cognitive function assessment result of the subject.

[0100] Figure 6 The vision-based cognitive function assessment device shown is... Figure 2 The visual-based cognitive function assessment method shown corresponds to this.

[0101] Figure 7 This is a schematic diagram of a vision-based cognitive function assessment device provided in an embodiment of this application. Figure 7 As shown, the vision-based cognitive function assessment device 7 of this embodiment includes: a processor 70, a memory 71, and a computer program 72 stored in the memory 71 and executable on the processor 70, such as a vision-based cognitive function assessment program. When the processor 70 executes the computer program 72, it implements the steps in the various vision-based cognitive function assessment method embodiments described above. Alternatively, when the processor 70 executes the computer program 72, it implements the functions of each module / unit in the various device embodiments described above.

[0102] For example, the computer program 72 may be divided into one or more modules / units, which are stored in the memory 71 and executed by the processor 70 to complete this application. The one or more modules / units may be a series of computer program instruction segments capable of performing a specific function, which describe the execution process of the computer program 72 in the vision-based cognitive function assessment device 7.

[0103] The vision-based cognitive function assessment device 7 can be a robot, AR device, desktop computer, laptop, handheld computer, cloud server, or other computing device. The vision-based cognitive function assessment device may include, but is not limited to, a processor 70 and a memory 71. Those skilled in the art will understand that...Figure 7 The above-mentioned visual-based cognitive function assessment device 7 is only an example and does not constitute a limitation on the visual-based cognitive function assessment device 7, which can include more or fewer components than shown, or combine some components, or different components, for example, the visual-based cognitive function assessment device can also include an input / output device, a network access device, a bus, etc.

[0104] The processor 70 can be a central processing unit (CPU), and can also be other general-purpose processors, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor.

[0105] The memory 71 can be an internal storage unit of the visual-based cognitive function assessment device 7, such as a hard disk or a memory of the visual-based cognitive function assessment device 7. The memory 71 can also be an external storage device of the visual-based cognitive function assessment device 7, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. Further, the memory 71 can include both the internal storage unit and the external storage device of the visual-based cognitive function assessment device 7. The memory 71 is used to store the computer program and other programs and data required by the visual-based cognitive function assessment device. The memory 71 can also be used to temporarily store data that has been output or will be output.

[0106] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the above-mentioned division of each functional unit and module is exemplified, and in actual application, the above-mentioned functions can be completed by different functional units and modules according to needs, that is, the internal structure of the device is divided into different functional units or modules to complete all or part of the functions described above. Each functional unit and module in the embodiment can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be realized in the form of hardware or software. In addition, the specific names of each functional unit and module are only for easy distinction, and do not limit the protection scope of the present application. The specific working process of the units and modules in the above system can refer to the corresponding process in the foregoing method embodiments, which will not be repeated here.

[0107] In the above embodiments, the description of each embodiment has its own emphasis, and the parts not described or recorded in detail in a certain embodiment can be referred to the related description of other embodiments.

[0108] Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be realized in electronic hardware or a combination of computer software and electronic hardware. Whether the functions are executed in hardware or software depends on the specific application and design constraints of the technical solution. A person skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0109] In the embodiments provided in the present application, it should be understood that the disclosed apparatus / terminal device and method can be implemented by other means. For example, the apparatus / terminal device embodiments described above are only schematic, for example, the division of the modules or units is only a logical function division, and actual implementation can have another division manner, for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the shown or discussed each other can be indirect coupling or communication connection through some interface, device or unit, which can be electrical, mechanical or other forms.

[0110] The units described as separate components can or can not be physically separated, and the components shown as units can or can not be physical units, that is, they can be located in one place, or can be distributed on multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.

[0111] In addition, each of the function units in each of the embodiments of the present application can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software function unit.

[0112] The integrated module / unit, if realized in the form of a software function unit and sold or used as an independent product, can be stored in a computer-readable storage medium. Based on such understanding, all or part of the processes in the above-mentioned embodiment methods can also be completed by computer program instruction-related hardware, and the computer program can be stored in a computer-readable storage medium. The computer program, when executed by a processor, can implement the steps of each method embodiment. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or some intermediate forms. The computer-readable medium can include any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal, and software distribution medium, etc. It should be noted that the computer-readable medium can include or exclude contents according to the requirements of legislation and patent practice in the jurisdiction, for example, in some jurisdictions, according to legislation and patent practice, the computer-readable medium does not include electrical carrier signals and telecommunication signals.

[0113] In addition, the embodiments of the present application also provide a computer program product, which, when running on a computer, causes the computer to execute the method in each of the above implementations.

[0114] The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than limit them; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacements to some technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the protection scope of the present application.

Claims

1. A method for assessing cognitive function based on vision, characterized by, The method comprises: obtaining individual information of a subject; determining a question for cognitive function evaluation according to the individual information of the subject; playing the determined question and capturing first pupil position change information of the subject and vital sign information of the subject, the vital sign information comprising pulse rate; correcting the first pupil position change information according to the vital sign information to obtain second pupil position change information, comprising: determining a first time period when the pulse rate of the subject deviates from a predetermined ratio of fluctuation rate baseline value of the pulse rate of the subject; searching for third pupil position change information in the first pupil position change information according to the first time period, determining a correction parameter according to the first pupil position change information and a pupil reference model, correcting the third pupil position change information according to the correction parameter to obtain the second pupil position change information; comparing the second pupil position change information with the pupil reference model to determine a cognitive function evaluation result of the subject.

2. The method of claim 1, wherein, The question comprises a target image for evaluation; playing the determined question comprises: playing the target image to make a visual point of the subject move in a predetermined horizontal direction.

3. The method of claim 2, wherein, The target image comprises a static image or a dynamic image; playing the target image to make a visual point of the subject move in a predetermined horizontal direction comprises: when the target image comprises a plurality of static images, playing the plurality of static images in a predetermined horizontal display direction and a predetermined static image display time; when the target image comprises a dynamic image, playing the dynamic image to make a dynamic target object included in the dynamic image move in a predetermined horizontal direction.

4. The method of claim 1, wherein, Capturing the first pupil position change information of the subject comprises at least one of the following manners: capturing position change information of a fixation point of the pupil of the subject; capturing a moving time length between two adjacent fixation points of the pupil of the subject; capturing a staying time length of a fixation point of the pupil of the subject at different positions; capturing a connecting line of positions at which a staying time length of a fixation point of the pupil of the subject is greater than a predetermined first time length.

5. The method of claim 1, wherein, The individual information comprises an age of the subject; determining the question for cognitive function evaluation according to the individual information of the subject comprises: determining the question for cognitive function evaluation corresponding to the age of the subject according to an age interval to which the age of the subject belongs and a preset corresponding relationship between age interval and question.

6. A visual-based cognitive function evaluation apparatus, characterized by comprising: The device comprises: an individual information obtaining unit configured to obtain individual information of a subject; a question determining unit configured to determine a question for cognitive function evaluation according to the individual information of the subject; an information capturing unit configured to play the determined question and capture first pupil position change information of the subject and vital sign information of the subject, the vital sign information comprising pulse rate; The correction unit is configured to correct the first pupil position change information according to the vital sign information to obtain second pupil position change information, and includes: determining a first time period when the pulse rate of the subject deviates from a predetermined ratio of a fluctuation rate baseline value of the pulse rate of the subject; searching for third pupil position change information in the first pupil position change information according to the first time period, determining a correction parameter according to the first pupil position change information and a pupil reference model, correcting the third pupil position change information according to the correction parameter to obtain second pupil position change information; The evaluation result determination unit is configured to compare the second pupil position change information with the pupil reference model to determine a cognitive function evaluation result of the subject.

7. A visual-based cognitive function assessment device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, The processor executes the computer program, so that the visual-based cognitive function evaluation device implements the method in any one of claims 1-5.

8. A computer program product comprising computer program instructions, characterised in that, The computer program is executed, so that the method in any one of claims 1-5 is executed.

Images