Information processing device, control method, and program
The information processing device corrects cognitive function scores based on the subject's alertness, addressing the issue of temporary internal state fluctuations in cognitive assessments.
Patent Information
- Application Number
- JP2024080986
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2024-05-17
- Publication Date
- 2025-11-06
- Estimated Expiration
- 2040-08-14
AI Technical Summary
Existing cognitive function tests do not account for the subject's internal state, leading to inaccurate assessments due to temporary fluctuations that can mimic cognitive decline.
An information processing device that acquires cognitive function measurements and internal state estimates, determining suitability for measurement and outputting results adjusted for the subject's alertness level, providing corrected cognitive function scores.
Enables accurate cognitive function assessments by accounting for short-term internal state changes, distinguishing between genuine decline and temporary fluctuations.
Smart Images

Figure 0007764913000001 
Figure 0007764913000002 
Figure 0007764913000003
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to the technical field of an information processing device, a control method, and a program that perform processing related to estimation of an inner surface state. [Background technology]
[0002] The Mini-Mental State Examination (MMSE) and other cognitive function tests are known for diagnosing mild cognitive impairment and dementia. Patent Document 1 discloses a system that displays a predetermined image on a screen and calculates a cognitive function score based on the eye movements of a subject when they view the image. Patent Document 2 discloses a system that predicts the severity of dementia by analyzing free conversation. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] International Publication WO2018 / 089852 [Patent Document 2] International Publication No. WO2020 / 054186 Summary of the Invention [Problem to be solved by the invention]
[0004] It is known that cognitive function declines with age, but it may also decline temporarily depending on the condition of the subject. However, Patent Documents 1 and 2 do not disclose or suggest anything that takes into account the condition of the subject.
[0005] In view of the above-mentioned problems, an object of the present disclosure is to provide an information processing device, a control method, and a program that can suitably output information related to the intellectual ability of a subject. [Means for solving the problem]
[0006] One aspect of the information processing device is a first acquisition means for acquiring a measurement result of the intellectual ability of a person to be measured; a second acquisition means for acquiring an estimated result of an internal state of the subject that affects the measurement of the intellectual ability; a determination means for determining whether the subject is in a state suitable for measuring the intellectual ability based on the estimation result of the inner state; and an output control means for displaying or outputting information about the measurement result of the intellectual ability based on the estimation result of the internal state. death, When it is determined that the subject is not in a state suitable for the measurement of intellectual ability, the output control means displays or outputs a sound as a warning regarding the measurement of intellectual ability as information regarding the measurement result of the intellectual ability. It is an information processing device. Another aspect of the information processing device is a first acquisition means for acquiring a measurement result of the intellectual ability of a person to be measured; a second acquisition means for acquiring an estimated result of an internal state of the subject that affects the measurement of the intellectual ability; a determination means for determining whether the subject is in a state suitable for measuring the intellectual ability based on the estimation result of the inner state; and an output control means for displaying or outputting information about the measurement result of the intellectual ability based on the estimation result of the internal state, When the measurement subject is determined to be in a state suitable for the measurement of intellectual ability, the output control means outputs the following information as information regarding the measurement result of intellectual ability: The results of the measurement of intellectual ability, or An estimation result of the intellectual ability based on the measurement result of the intellectual ability and the estimation result of the internal state. and an information processing device that displays at least one of the above.
[0007] One aspect of the control method includes: By computer, Obtain the measurement results of the subject's intellectual ability, Obtain an estimation result of the internal state of the subject that affects the measurement of the intellectual ability, determining whether the subject is in a state suitable for measuring the intellectual ability based on the estimation result of the internal state; Based on the estimation result of the inner state, information regarding the measurement result of the intellectual ability is displayed or output as sound. death, If it is determined that the subject is not in a state suitable for the measurement of intellectual ability, a warning regarding the measurement of intellectual ability is displayed or output as sound as information regarding the measurement result of intellectual ability. It is a control method. In addition, "computer" means any electronic device (including electronic devices) It may be a processor that includes a plurality of electronic devices. good.
[0008] One aspect of the program is Obtain the measurement results of the subject's intellectual ability, Obtain an estimation result of the internal state of the subject that affects the measurement of the intellectual ability, determining whether the subject is in a state suitable for measuring the intellectual ability based on the estimation result of the internal state; Based on the estimation result of the inner state, information regarding the measurement result of the intellectual ability is displayed or output as sound. death, If it is determined that the subject is not in a state suitable for the measurement of intellectual ability, a warning regarding the measurement of intellectual ability is displayed or output as sound as information regarding the measurement result of intellectual ability. It is a program that causes a computer to execute a process. [Effects of the Invention]
[0009] According to the present disclosure, information regarding the intellectual ability of a subject can be suitably output. [Brief explanation of the drawings]
[0010] [Figure 1] 1 shows a schematic configuration of a cognitive function testing system according to a first embodiment. [Figure 2] 1 shows a hardware configuration of an information processing device. [Figure 3] 2 is an example of a functional block of an information processing device. [Figure 4] 1 is a graph showing the relationship between cognitive function and alertness by age group. [Figure 5] FIG. 1 is a diagram showing an outline of calculation of an estimated cognitive function score. [Figure 6] 10 is an example of a test result screen in the first embodiment. [Figure 7] 4 is an example of a flowchart showing a procedure of a process executed by the information processing device in the first embodiment. [Figure 8] 1 shows a schematic configuration of a cognitive function testing system according to a first modified example. [Figure 9] 10 shows a schematic configuration of a cognitive function testing system according to a second modified example. [Figure 10] FIG. 10 is a functional block diagram of an information processing device according to a second embodiment. [Figure 11] 10 is an example of a test result screen in the second embodiment. [Figure 12]10 is an example of a flowchart illustrating a procedure of a process executed by an information processing device in the second embodiment. [Figure 13] FIG. 10 shows a schematic configuration diagram of an information processing device according to a third embodiment. [Figure 14] 11 is an example of a flowchart illustrating a procedure of a process executed by an information processing device in the third embodiment. [Figure 15] FIG. 10 shows a schematic configuration diagram of an information processing device according to a fourth embodiment. [Figure 16] 13 is an example of a flowchart illustrating a procedure of a process executed by an information processing device in the fourth embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0011] Hereinafter, embodiments of an information processing device, a control method, and a program will be described with reference to the drawings.
[0012] First Embodiment (1-1) System Configuration 1 shows a schematic configuration of a cognitive function testing system 100 according to the first embodiment. The cognitive function testing system 100 performs a test (also called a "cognitive function test") on the cognitive function of a measurement subject 9 and presents the test results to a user. The cognitive function testing system 100 mainly includes an information processing device 1, a camera (imaging means) 2, and a display device 3.
[0013] The information processing device 1 performs data communication with the camera 2 and the display device 3 via a communication network or by direct wireless or wired communication. The information processing device 1 then performs a simple cognitive function test on the person being measured 9 based on the captured image "S1" supplied from the camera 2. The information processing device 1 also generates a display signal "S2" based on the test results regarding the cognitive function of the person being measured 9, and supplies the generated display signal S2 to the display device 3. The information processing device 1 may be a personal computer, or may be a mobile terminal such as a smartphone that is integrated with the camera 2 and the display device 3.
[0014] The camera 2 generates a captured image S1 and supplies the generated captured image S1 to the information processing device 1. The camera 2 may be a camera built into the information processing device 1. The display device 3 displays predetermined information based on a display signal S2 supplied from the information processing device 1. The display device 3 is, for example, a display or a projector.
[0015] The configuration of the cognitive function testing system 100 shown in FIG. 1 is an example, and various modifications may be made to the configuration. For example, the cognitive function testing system 100 may further include an input device (including a voice input device) that accepts user input from the subject 9, etc., or a sound output device that outputs guidance, warning sounds, etc. Furthermore, the information processing device 1 may be composed of multiple devices. In this case, the multiple devices that make up the information processing device 1 exchange information required to execute pre-assigned processing between these multiple devices. In this case, the information processing device 1 functions as an information processing system.
[0016] (1-2) Hardware configuration of information processing device 2 shows the hardware configuration of the information processing device 1. The information processing device 1 includes, as hardware, a processor 11, a memory 12, and an interface 13. The processor 11, the memory 12, and the interface 13 are connected via a data bus 19.
[0017] The processor 11 functions as a controller (arithmetic unit) that performs overall control of the information processing device 1 by executing a program stored in the memory 12. The processor 11 is, for example, a processor such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a TPU (Tensor Processing Unit), or a quantum processor. The processor 11 may be composed of multiple processors. The processor 11 is an example of a computer.
[0018] The memory 12 is composed of various types of volatile and non-volatile memories, such as a RAM (Random Access Memory), a ROM (Read Only Memory), and a flash memory. The memory 12 also stores programs for executing processes performed by the information processing device 1. For example, the memory 12 also includes information on parameters used for estimating cognitive functions and estimating specific internal states. Some of the information stored in the memory 12 may be stored in one or more external storage devices capable of communicating with the information processing device 1, or may be stored in a storage medium that is detachable from the information processing device 1. The external storage device may be a server device that performs data communication with the information processing device 1.
[0019] The interface 13 is an interface for electrically connecting the information processing device 1 to other devices. These interfaces may be wireless interfaces such as network adapters for wirelessly transmitting and receiving data to and from other devices, or may be hardware interfaces for connecting to other devices via cables or the like.
[0020] It should be noted that the hardware configuration of the information processing device 1 is not limited to the configuration shown in Fig. 2. For example, the information processing device 1 may include at least one of the camera 2 and the display device 3.
[0021] (1-3) Functional Blocks Next, a description will be given of specific processing executed by the information processing device 1. In summary, the information processing device 1 measures the cognitive function of the measurement subject 9 and estimates the internal state that affects the measurement of the cognitive function, and estimates the cognitive function of the measurement subject 9 based on these measurement results and estimation results. Then, the information processing device 1 displays information related to the estimation result of the cognitive function of the measurement subject 9 on the display device 3.
[0022] Fig. 3 shows an example of functional blocks of the information processing device 1. Functionally, the processor 11 of the information processing device 1 has a cognitive function measurement unit 14, an inner state estimation unit 15, a cognitive function estimation unit 16, and an output control unit 17. Note that in Fig. 3, blocks where data is exchanged are connected by solid lines, but the combination of blocks where data is exchanged is not limited to that shown in Fig. 3. The same applies to other functional block diagrams described later.
[0023] The cognitive function measurement unit 14 measures cognitive function based on the captured image S1 supplied from the camera 2 via the interface 13, and supplies the measurement results to the cognitive function estimation unit 16 and the output control unit 17. In this case, the cognitive function measurement unit 14 calculates a score related to the cognitive function of the measurement subject 9 (also referred to as the "cognitive function measurement score Sm") as the measurement result based on the captured image S1. The cognitive function measurement score Sm is, for example, a comprehensive score (total score) related to the cognitive function of the measurement subject 9. Note that the cognitive function measurement score Sm may further include a score of cognitive ability for each function (also referred to as a "function-specific score") in addition to the above-mentioned total score. The function-specific score is, for example, a score for each of language comprehension, perceptual integration, working memory, and processing speed.
[0024] Here, a method for calculating the cognitive function measurement score Sm based on the captured image S1 will be described in more detail. For example, the cognitive function measurement unit 14 first supplies the captured image S1 to the display device 3 via the interface 13, thereby causing a predetermined test screen to be displayed on the display device 3. Then, the cognitive function measurement unit 14 analyzes the movement of the eyeballs (including the sclera, iris, and pupils) of the measurement subject 9 based on the captured image S1, which captures a state in which the measurement subject 9 is viewing the screen. In this way, the cognitive function measurement unit 14 calculates the cognitive function measurement score Sm, which is a score of the cognitive function of the measurement subject 9. Note that a technology for scoring the cognitive function of a subject by image analysis of the movement of the subject's eyeballs is disclosed in, for example, Patent Document 1.
[0025] The internal state estimation unit 15 estimates the internal state of the subject 9 at the time of measurement of the cognitive function based on the captured image S1 provided by the camera 2, and provides the estimation result to the cognitive function estimation unit 16 and the output control unit 17. In this case, the internal state to be estimated is an internal state of the subject 9 that affects the measurement of the cognitive function and exhibits short-term fluctuations. In this embodiment, the internal state estimation unit 15 estimates arousal level, which is an index representing an internal state that affects the measurement of the cognitive function and exhibits short-term fluctuations. In this case, the internal state estimation unit 15 analyzes the captured image S1 to recognize the eyelid movement or facial expression of the subject 9, and estimates the scored arousal level of the subject 9 at the time of measurement of the cognitive function based on the recognition result. Note that the internal state estimation unit 15 may estimate the stress level, drowsiness level, pulse rate (heart rate), concentration level, emotion, or alcohol level of the subject 9 instead of arousal level. In this case, as the above-mentioned "emotion," for example, the internal state estimation unit 15 may estimate to which category the emotion of the measurement subject 9 falls out of a plurality of emotions classified in advance.
[0026] Here, the cognitive function measurement unit 14 and the internal state estimation unit 15 may calculate the cognitive function measurement score Sm and the level of alertness by using an inference unit trained in advance based on machine learning such as deep learning. In this case, for example, the inference unit used by the cognitive function measurement unit 14 is a machine learning model trained using a predetermined number of images of the subject as input data and the subject's cognitive function score at the time the images were taken as correct answer data. In this case, the cognitive function score used as correct answer data may be determined based on any cognitive function testing method. Furthermore, the inference unit used by the internal state estimation unit 15 is a machine learning model trained using a predetermined number of images of the subject as input data and the subject's level of alertness at the time the images were taken as correct answer data. In this case, the level of alertness used as correct answer data may be measured by a sensor or estimated based on a questionnaire or the like. The parameters of the inference unit obtained by learning are pre-stored in the memory 12 or the like. In addition, when the above-mentioned machine learning model is a neural network such as a convolutional neural network, the memory 12 stores various parameters such as the layer structure, the neuron structure of each layer, the number and filter size of filters in each layer, and the weight of each element of each filter.
[0027] The cognitive function estimation unit 16 estimates the cognitive function of the measurement subject 9 based on the measurement result of the cognitive function of the measurement subject 9 by the cognitive function measurement unit 14 and the estimation result of the awakening level of the measurement subject 9 by the internal state estimation unit 15. Specifically, the cognitive function estimation unit 16 corrects the cognitive function measurement score Sm, which is the measurement result of the cognitive function of the measurement subject 9, based on the estimated awakening level. Hereinafter, the cognitive function score obtained by correcting the cognitive function measurement score Sm will also be referred to as the "cognitive function estimation score Se." A specific method for calculating the cognitive function estimation score Se will be described in "(1-4) Calculation of cognitive function estimate score The cognitive function estimation unit 16 supplies the cognitive function estimation score Se, which is the result of estimating the cognitive function of the measurement subject 9, to the output control unit 17.
[0028] In addition, when the cognitive function measurement score Sm includes a total score of cognitive functions and a function-specific score for each function, the cognitive function estimation unit 16 may correct each of them based on the estimated awakening level. In this case, the cognitive function estimation unit 16 calculates the estimated value of the total score of cognitive functions and the estimated value of each function score as the cognitive function estimation score Se.
[0029] The output control unit 17 causes the display device 3 to display the test results regarding the cognitive function of the measurement subject 9 based on the estimation results or measurement results respectively supplied from the cognitive function measurement unit 14, the inner state estimation unit 15, and the cognitive function estimation unit 16. In this case, the output control unit 17 generates a display signal S2 based on the estimation results and measurement results described above, and supplies the generated display signal S2 to the display device 3 via the interface 13. The information to be displayed on the display device 3 is described in "(1-5) Test result screen The viewer of the information displayed on the display device 3 may be, for example, the subject 9, or a medical professional who diagnoses the subject 9.
[0030] The cognitive function measurement unit 14, the internal state estimation unit 15, the cognitive function estimation unit 16, and the output control unit 17 described in FIG. 3 can be realized, for example, by the processor 11 executing a program. Alternatively, the necessary programs may be recorded in any nonvolatile storage medium and installed as needed to realize the respective components. At least a portion of these components may not necessarily be realized by software programs, but may be realized by any combination of hardware, firmware, and software. At least a portion of these components may be realized using a user-programmable integrated circuit, such as an FPGA (Field-Programmable Gate Array) or a microcontroller. In this case, the integrated circuit may be used to realize a program consisting of the respective components. At least a portion of the components may be configured using an ASSP (Application Specific Standard Produce) or an ASIC (Application Specific Integrated Circuit). In this way, the respective components described above may be realized by various hardware. Furthermore, the respective components may be realized by cooperation of multiple computers, for example, using cloud computing technology. The same applies to other embodiments described later.
[0031] (1-4) Calculation of cognitive function estimate score Next, a specific description will be given of a method for calculating the cognitive function estimation score Se by the cognitive function estimation unit 16. In summary, the cognitive function estimation unit 16 calculates the cognitive function estimation score Se by correcting the cognitive function measurement score Sm based on the degree of exertion of the cognitive function of the measurement subject 9, which is estimated based on the arousal level estimated by the internal state estimation unit 15. In this way, the cognitive function estimation unit 16 outputs an estimation result of the cognitive function that is not dependent on the arousal level of the measurement subject 9 at the time of measurement.
[0032] First, a general relationship between cognitive function and alertness, which is a premise for the estimation process by the cognitive function estimation unit 16, will be described with reference to FIG.
[0033] FIG. 4 shows the relationship between cognitive function scores and alertness by age group. In FIG. 4, graphs 50 to 52 are shown, each showing the relationship between cognitive function scores and alertness for normal, healthy individuals without cognitive impairment on two-dimensional coordinates for ages 50, 70, and 90. On each of these two-dimensional coordinates, the cognitive function scores of healthy individuals and individuals with cognitive impairments are plotted for alertness levels "Da1" to "Da3," "Db1" to "Db3," and "Dc1" to "Dc3." Individuals with cognitive impairments include those with mild cognitive impairment (MCI) and those with dementia.
[0034] As shown in graphs 50 to 52, the degree of cognitive function performance varies depending on the level of arousal in all age groups. For example, in people in their 50s, the cognitive function of healthy individuals at arousal levels "Da1" or "Da3" is lower than that of healthy individuals at arousal levels "Da2." In other words, the cognitive function performance is lower at arousal levels "Da1" or "Da3" than at arousal level "Da2." As a result, the cognitive function score of a healthy individual at a low level of arousal (e.g., "Da1") may be lower than the cognitive function score of a cognitively impaired individual at a high level of arousal (e.g., "Da2")
[0035] Thus, in people in their 50s, measured cognitive function scores depend on their level of alertness at the time of measurement. Similarly, in people in their 70s and 90s, measured cognitive function scores depend on their level of alertness at the time of measurement. This trend is consistent with the Yerkes-Dodson law, which states that performance is best when people are at an appropriate level of alertness.
[0036] Taking the above into consideration, the cognitive function estimation unit 16 corrects the cognitive function measurement score Sm based on the level of alertness at the time of measurement of the cognitive function measurement score Sm of the measurement subject 9. Specifically, the cognitive function estimation unit 16 estimates the level of exertion of the cognitive function compared to the level of alertness serving as a reference based on the level of alertness estimated at the time of measurement of the cognitive function measurement score Sm, and corrects the cognitive function measurement score Sm in accordance with the level of exertion.
[0037] Fig. 5 is a diagram showing an overview of calculation of the cognitive function estimation score Se by the cognitive function estimation unit 16. Fig. 5 shows a graph 53 showing the relationship between alertness and cognitive function score. This graph 53 is, for example, a statistical model calculated by applying a statistical method such as regression analysis to samples of multiple combinations of cognitive function scores and alertness measured for multiple subjects. In another example, graph 53 may be a statistical model calculated by applying a statistical method such as regression analysis to samples of multiple combinations of cognitive function scores and alertness measured multiple times for the same subject.
[0038] The cognitive function estimation unit 16 estimates, as the cognitive function estimation score Se, the cognitive function score exhibited at a reference alertness level "Dtag," which is a reference alertness level, based on the relationship shown in graph 53, the cognitive function measurement score Sm, and the alertness level estimated at the time of measuring the score. Here, as an example, the reference alertness level "Dtag" is set to the alertness level when the cognitive function score is best exhibited in the relationship shown in graph 53.
[0039] For example, when the internal state estimation unit 15 estimates the level of alertness of the measurement subject 9 during the cognitive function test as "Dx," the cognitive function estimation unit 16 corrects the cognitive function measurement score Sm based on the difference or ratio between the level of alertness Dx and the reference level of alertness Dtag in the graph 53. In this case, the cognitive function estimation unit 16 calculates the cognitive function estimation score Se by adding the difference to the cognitive function measurement score Sm or dividing the cognitive function measurement score Sm by the ratio (less than 1 in this case). For example, when the reference level of alertness Dtag for the level of alertness Dx is "0.7," the cognitive function estimation unit 16 calculates the cognitive function estimation score Se by dividing the cognitive function measurement score Sm by "0.7." Similarly, when the internal state estimation unit 15 estimates the level of alertness as "Dy," the cognitive function estimation unit 16 corrects the cognitive function measurement score Sm based on the difference or ratio between the level of alertness Dy and the reference level of alertness Dtag in the graph 53.
[0040] In this case, for example, a lookup table showing the above-mentioned difference or ratio for each level of arousal that can be estimated by the internal state estimation unit 15 is stored in the memory 12 or the like. The cognitive function estimation unit 16 then calculates the cognitive function estimation score Se by referring to this lookup table and specifying the above-mentioned difference or ratio. In another example, the cognitive function estimation unit 16 may calculate the cognitive function estimation score Se by using an equation for calculating the above-mentioned difference or ratio from the level of arousal and specifying the above-mentioned difference or ratio from the level of arousal estimated by the internal state estimation unit 15. In yet another example, the cognitive function estimation unit 16 may calculate the cognitive function estimation score Se using an equation or lookup table that uses the cognitive function measurement score Sm and the estimated level of arousal as input values and directly calculates a corrected cognitive function estimation score Se based on the above-mentioned difference or ratio. Note that instead of using an equation or lookup table, the cognitive function estimation unit 16 may calculate the cognitive function estimation score Se using an inference device trained by machine learning, such as deep learning, to infer the cognitive function estimation score Se when the cognitive function measurement score Sm and the estimated level of arousal are input.
[0041] The cognitive function estimation unit 16 may also calculate the cognitive function estimation score Se by further taking into account the age of the measurement subject 9. As shown in FIG. 4, the relationship between alertness and cognitive function generally varies depending on the age of the measurement subject 9. Therefore, a statistical relationship between the cognitive function score and alertness corresponding to graph 53 may be calculated for each predetermined age group, and the above-mentioned lookup table, formula, or inference device may be stored in memory 12 for each age group based on this statistical relationship. In this case, the cognitive function estimation unit 16 or another processing unit estimates the age of the measurement subject 9 by performing age estimation processing on the captured image S1, analyzing the face, etc., of the measurement subject 9. Note that if attribute information including the age of the measurement subject 9 registered before the cognitive function test is pre-stored in memory 12, etc., the cognitive function estimation unit 16 may identify the age of the measurement subject 9 by referring to the attribute information.
[0042] (1-5) Test result screen 6 is an example of a test result screen that the output control unit 17 displays on the display device 3 in the first embodiment. Here, as an example, 78-year-old "Nihon Taro" is the measurement subject 9. The output control unit 17 generates a display signal S2 based on information supplied from the cognitive function measurement unit 14, the inner state estimation unit 15, and the cognitive function estimation unit 16, and supplies the display signal S2 to the display device 3, thereby causing the display device 3 to display the test result screen shown in FIG. 6. The output control unit 17 mainly provides a score display field 60, a function-specific score request button 61, and a remarks display field 62 on the test result screen.
[0043] The output control unit 17 displays, in the score display field 60, a "cognitive function score (estimated value)" representing the overall cognitive function estimated for the measurement subject 9, as well as a "cognitive function score (measured value)," "alertness," and "normal value" as reference values. Here, the output control unit 17 displays, as the "cognitive function score (estimated value)," the cognitive function estimated score Se (here, a score on a 30-point scale) estimated by the cognitive function estimation unit 16. Furthermore, as the "alertness," the output control unit 17 displays a score (here, 4) representing the alertness estimated by the internal state estimation unit 15 on a 10-point scale. Furthermore, as the "normal value," the output control unit 17 displays a range of cognitive function scores (here, 26 or higher out of 30 points) that can be considered to be for a healthy person, which is stored in advance in the memory 12 or the like. The value presented as the "normal value" may be a value that varies depending on the age group of the measurement subject 9.
[0044] The function score request button 61 is a button for issuing an instruction to display the function score for each cognitive function of the measurement subject 9, and when the output control unit 17 detects that the function score request button 61 has been selected, it displays the function scores for the measurement subject 9. In this case, the output control unit 17 displays, for example, estimated function scores for each cognitive function such as language comprehension, perceptual integration, working memory, and processing speed on the test result screen.
[0045] The remarks display field 62 is a field for displaying comments on the estimated cognitive function score Se of the measurement subject 9. In the example of FIG. 6, the output control unit 17 displays a notice (warning) in the remarks display field 62 indicating that the measurement subject 9 is suspected of having mild cognitive impairment and that he or she should undergo more detailed testing, because the estimated cognitive function score Se of the measurement subject 9 is outside the normal range. In this case, the output control unit 17 determines text information to be displayed in the remarks display field 62 based on the estimated cognitive function score Se. For example, a table associating the estimated cognitive function score Se with the text information to be displayed in the remarks display field 62 is stored in the memory 12 or the like, and the output control unit 17 refers to the table to determine the text information to be displayed in the remarks display field 62 based on the estimated cognitive function score Se.
[0046] 6, the output control unit 17 can preferably present to the viewer the cognitive function estimation score Se that is not dependent on the short-term internal state of the measurement subject 9. In addition, the output control unit 17 can preferably present to the viewer various scores related to cognitive function other than the cognitive function estimation score Se, comments related to cognitive impairment, and the like.
[0047] (1-6) Processing Flow 7 is an example of a flowchart showing the procedure of processing executed by the information processing device 1 in the first embodiment. The information processing device 1 repeatedly executes the processing of the flowchart shown in FIG.
[0048] First, the information processing device 1 acquires a captured image S1 generated by the camera 2 (step S11). In this case, for example, when the information processing device 1 detects that a person is present within the shooting range of the camera 2, it acquires a captured image S1 capturing the person as the measurement target 9. In another example, the information processing device 1 may acquire a captured image S1 generated by the camera 2 at a timing designated by a user input. In this case, the user input may be an input based on an operation on an input device or may be a voice input.
[0049] Then, the cognitive function measurement unit 14 of the information processing device 1 measures cognitive function based on the captured image S1 acquired in step S11, and the internal state estimation unit 15 of the information processing device 1 estimates the level of arousal based on the captured image S1 (step S12). As a result, the cognitive function measurement unit 14 calculates a cognitive function measurement score Sm, and the internal state estimation unit 15 calculates an estimated value of the level of arousal. Note that the processing of the cognitive function measurement unit 14 and the processing of the internal state estimation unit 15 are performed in no particular order, and either may be performed first, or they may be performed simultaneously.
[0050] Then, the cognitive function estimation unit 16 estimates the cognitive function based on the cognitive function measurement results and the arousal level estimation results in step S12 (step S13). In this case, the cognitive function estimation unit 16 calculates a cognitive function estimation score Se that does not depend on the state (so-called condition) of the measurement subject 9 based on the cognitive function measurement score Sm calculated by the cognitive function measurement unit 14 and the estimated value of the arousal level calculated by the internal state estimation unit 15.
[0051] Then, the output control unit 17 causes the display device 3 to display the cognitive function estimation result (step S14). In this case, the output control unit 17 generates a display signal S2 based on the cognitive function estimation score Se calculated in step S13, etc., and supplies the display signal S2 to the display device 3 via the interface 13. As a result, the output control unit 17 causes the display device 3 to display a test result screen, etc., as shown in FIG.
[0052] (1-7) Technical effects Next, a supplementary explanation will be given of the technical effects of the first embodiment.
[0053] As shown in FIG. 4 , decline in cognitive function occurs not only due to cognitive impairment, but also due to aging and short-term changes in the internal state of the subject 9. However, conventional cognitive function testing methods do not take into account the internal state of the subject 9 at the time of the test, and therefore have the problem of being unable to distinguish whether the decline in cognitive function is due to a short-term change in the internal state of the subject 9 or due to cognitive impairment. Taking the above into consideration, in the first embodiment, the information processing device 1 corrects the cognitive function measurement score Sm based on the alertness of the subject 9 at the time of the test. This allows the information processing device 1 to suitably calculate the cognitive function estimation score Se that is not dependent on the internal state of the subject 9, which changes over a short period of time.
[0054] (1-8) Variations Next, a description will be given of preferred modifications of the first embodiment. The following modifications may be applied in combination.
[0055] (First Modification) The information processing device 1 may measure the cognitive function of the person to be measured 9 and estimate the internal state that influences the measurement, based on information other than an image of the person to be measured 9.
[0056] 8 is a schematic diagram showing the configuration of a cognitive function testing system 100A according to Modification 1. The cognitive function testing system 100A shown in FIG.
[0057] The sensor 5 is, for example, a wearable sensor that can be worn by the measurement subject 9, and measures biological signals, etc. of the measurement subject 9 and supplies the measured biological signals, etc. to the information processing device 1A as a sensor signal S3. In this case, the sensor signal S3 may be any biological signal (including vital information) such as the subject's heart rate, brain waves, sweat rate, hormone secretion level, cerebral blood flow, blood pressure, body temperature, electromyography, respiratory rate, etc. The sensor 5 may also be a device that analyzes blood collected from the subject and outputs a sensor signal S3 indicating the analysis results. The sensor 5 may also be a device that performs physical measurements such as jumping to measure physical fatigue, etc.
[0058] The input device 6 is an interface that accepts user input (manual input) of information about each subject, for example, accepting input of information (e.g., questionnaire responses) necessary for measuring cognitive function or estimating internal state. The input device 6 may be, for example, various user input interfaces such as a touch panel, buttons, a keyboard, a mouse, or a voice input device. The input device 6 supplies an input signal "S4" generated based on the user input to the information processing device 1.
[0059] The information processing device 1A has the same hardware configuration (see FIG. 1) and functional configuration (see FIG. 3) as the information processing device 1. A cognitive function measurement unit 14 of the information processing device 1A measures the cognitive function of the measurement subject 9 based on the sensor signal S3 or the input signal S4. An internal state estimation unit 15 of the information processing device 1A estimates the internal state of the measurement subject 9 based on the sensor signal S3 or the input signal S4. In this case, the internal state estimation unit 15 calculates, for example, the level of alertness, stress level, drowsiness level, pulse rate (heart rate), concentration level, emotion, or the level of alcohol consumed by the measurement subject 9 as an estimation result of the internal state. Note that the level of stress, drowsiness level, pulse rate (heart rate), concentration level, emotion, or the level of alcohol consumed by the measurement subject 9 are examples of indicators of the internal state that affect the cognitive function score, similar to the relationship between alertness and cognitive function score shown in FIG. 4. In other words, the degree to which the subject's cognitive function is exerted varies depending on the index (score) that indicates these internal states.
[0060] Here, a supplementary explanation will be given regarding the measurement of cognitive function. For example, if the sensor signal S3 is an audio signal, the cognitive function measurement unit 14 measures the cognitive function by analyzing the content of the speech of the measurement subject 9 based on the audio signal. Note that a technique for measuring cognitive function by analyzing free conversation is disclosed, for example, in Patent Document 2. In another example, if the input signal S4 is information indicating answers to questions used in a cognitive function test, the cognitive function measurement unit 14 measures the cognitive function based on the information indicating the answers. Note that an example of a cognitive function test based on the answers of the subject is the Mini Mental State Examination (MMSE).
[0061] The cognitive function estimation unit 16 estimates the cognitive function based on the measurement results of the cognitive function by the cognitive function measurement unit 14 and the estimation results of the internal state by the internal state estimation unit 15. Here, as described above, the level of alertness, stress level, drowsiness level, pulse rate (heart rate), concentration level, emotions, or the level of alcohol consumed by the measurement subject 9 estimated by the internal state estimation unit 15 all affect the measurement of the cognitive function score. Therefore, the cognitive function estimation unit 16 corrects the cognitive function measurement score Sm calculated by the cognitive function measurement unit 14 with the estimated value of the internal state estimated by the internal state estimation unit 15. As a result, the cognitive function estimation unit 16 can suitably calculate the cognitive function estimation score Se that is independent of the state of the measurement subject 9, similar to the first embodiment.
[0062] In this way, the information processing device 1A can preferably measure the cognitive function of the person being measured 9 and estimate the internal state that affects the measurement, even when using information other than images of the person being measured 9.
[0063] Instead of measuring cognitive functions and estimating internal states, the information processing device 1A may acquire, as input signals S4, cognitive function measurement results and internal state estimation results manually input by the user. In this case, the cognitive function estimation unit 16 of the information processing device 1A calculates a cognitive function estimation score Se based on the cognitive function score indicated by the input signal S4 and the estimated value of the internal state. This configuration also allows the information processing device 1A to preferably estimate cognitive functions that are not dependent on the internal state of the measurement subject 9, which changes over the short term.
[0064] (Second Modification) The information processing device 1 may function as a server in a server-client model.
[0065] 9 shows a schematic configuration of a cognitive function testing system 100B in the second modified example. The cognitive function testing system 100B mainly includes an information processing device 1B that performs data communication via a network (communication network) 7, and a terminal device 8. The cognitive function testing system 100B in the second modified example is a server-client model system, in which the information processing device 1B functions as the server device and the terminal device 8 functions as a client terminal.
[0066] The terminal device 8 is a terminal having an input function, a display function, and a communication function, and functions as the display device 3 shown in Fig. 1. The terminal device 8 may be, for example, a personal computer, a tablet terminal, a PDA (Personal Digital Assistant), etc. The terminal device 8 supplies the captured image S1 shown in Fig. 1 or the sensor signal S3 and the input signal S4 shown in Fig. 8 to the information processing device 1B.
[0067] The information processing device 1B has the same hardware configuration (see FIG. 1) and functional configuration (see FIG. 3) as the information processing device 1 or the information processing device 1A. The information processing device 1B executes the processes of the cognitive function measurement unit 14, the internal state estimation unit 15, the cognitive function estimation unit 16, and the output control unit 17 shown in FIG. 3 based on information received from the terminal device 8 via the network 7. The information processing device 1B then transmits a display signal S2 indicating the estimation result of the cognitive function, etc., to the terminal device 8 via the network 7. This aspect also allows the information processing device 1B to preferably execute estimation of the cognitive function that is not dependent on the internal state of the measurement subject 9, which changes in the short term, and to preferably present information related to the estimation result, etc., to the user of the terminal device 8.
[0068] (Third Modification) Instead of displaying the test result screen on the display device 3, the output control unit 17 may output audio output indicating the estimation result of the cognitive function estimation unit 16 from a sound output device such as a speaker.
[0069] In this case, the output control unit 17 generates an audio signal for notifying the cognitive function estimation score Se or the like, and supplies the audio signal to the sound output device via the interface 13, thereby causing the sound output device to output the cognitive function estimation score Se or the like as audio. This embodiment also allows the output control unit 17 to preferably notify the user of information related to the results of the cognitive function test.
[0070] Second Embodiment The cognitive function testing system 100 according to the second embodiment differs from the cognitive function testing system 100 according to the first embodiment in that it determines whether the cognitive function test is appropriate based on the estimation result of the internal state and displays the determination result. Hereinafter, the same components as those in the first embodiment will be appropriately designated by the same reference numerals, and their description will be omitted.
[0071] (2-1) Functional Blocks Fig. 10 is a functional block diagram of information processing device 1C according to the second embodiment. Information processing device 1C has the hardware configuration shown in Fig. 2, and processor 11 of information processing device 1A functionally includes cognitive function measurement unit 14, inner state estimation unit 15, cognitive function estimation unit 16, output control unit 17C, and determination unit 18C.
[0072] The determination unit 18C determines whether the measurement subject 9 is suitable for a cognitive function test based on the estimation result of the internal state (hereinafter, referred to as arousal level as an example) of the measurement subject 9 by the internal state estimation unit 15. In other words, the determination unit 18C determines whether the measurement subject 9 is in a state suitable for a cognitive function test (measurement of cognitive function). In this case, for example, if the arousal level estimated by the internal state estimation unit 15 is within a predetermined value range, the determination unit 18C determines that the measurement subject 9 is in a state in which the measurement subject 9 can appropriately perform measurement of cognitive function. On the other hand, if the arousal level estimated by the internal state estimation unit 15 does not belong to the above-mentioned predetermined value range, the determination unit 18C determines that the measurement subject 9 is in a state in which the measurement subject 9 cannot appropriately perform measurement of cognitive function. Here, the "predetermined value range" is a value range of arousal level suitable for the measurement subject 9 to exercise cognitive function, and is stored in advance in, for example, the memory 12. In this case, the "predetermined value range" may be determined based on the difference or ratio of the cognitive function score to the reference alertness Dtag, or may be set to be a value range of alertness such that the estimation error of the cognitive function estimation score Se is within an acceptable range. Then, the determination unit 18C supplies the output control unit 17C with the determination result regarding whether the cognitive function test of the measurement subject 9 is appropriate.
[0073] The output control unit 17C generates a display signal S2 based on the measurement results generated by the cognitive function measurement unit 14, the estimation results generated by the internal state estimation unit 15, the estimation results generated by the cognitive function estimation unit 16, and the judgment result of the judgment unit 18C. Then, the output control unit 17C supplies the generated display signal S2 to the display device 3 via the interface 13. As a result, the output control unit 17C causes the display device 3 to display a test result screen including notification content to the user regarding the pass / fail of the cognitive function test. A specific example of the test result screen in the second embodiment will be described later with reference to FIG. 11.
[0074] (2-2) Test result screen Fig. 11 is an example of a test result screen that the output control unit 17C causes the display device 3 to display in the second embodiment. The output control unit 17C supplies the display device 3 with a display signal S2 generated based on information supplied from the cognitive function measurement unit 14, the inner state estimation unit 15, the cognitive function estimation unit 16, and the determination unit 18C, thereby causing the display device 3 to display the test result screen shown in Fig. 6. The output control unit 17A mainly provides a notification display field 63 and a score display field 64 on the test result screen.
[0075] The output control unit 17C displays content based on the determination result by the determination unit 18C on the notification display field 63. In this example, the output control unit 17C detects that the test has been determined to be unsuitable based on the determination result supplied from the determination unit 18C, and displays a warning in the notification display field 63 that the current state of the measurement subject 9 is unsuitable for the cognitive function test and that the cognitive function test should be re-administered after a certain period of time.
[0076] When the output control unit 17C detects that the test has been determined to be appropriate based on the determination result supplied from the determination unit 18C, it may display, for example, a notification that the current state of the measurement subject 9 is appropriate for the cognitive function test in the notification display field 63. In another example, the output control unit 17C may provide the notification display field 63 on the test result screen only when the determination unit 18C determines that the test is inappropriate.
[0077] 11, the output control unit 17C displays each score related to cognitive function and internal state (here, alertness) in a score display field 64. Specifically, the output control unit 17C displays "cognitive function score (measured value)," "alertness," "cognitive function score (estimated value)," and "normal value," which are the same types of scores as those displayed in the score display field 60 in FIG. 6. Note that, in this case, since the test was determined to be inappropriate, the cognitive function estimated score Se has not been calculated. Therefore, the output control unit 17C hides the cognitive function estimated score Se that should be displayed in "cognitive function score (estimated value)."
[0078] Thus, according to the display example of Figure 11, if the current state of the measurement subject 9 is not suitable for a cognitive function test, the output control unit 17C can appropriately notify the user of this fact and the need to retry the cognitive function test.
[0079] (2-3) Processing Flow 12 is an example of a flowchart showing the procedure of processing executed by the information processing device 1C in the second embodiment. The information processing device 1C repeatedly executes the processing of the flowchart shown in FIG.
[0080] First, the information processing device 1C acquires the captured image S1 generated by the camera 2 (step S21). Then, the cognitive function measurement unit 14 of the information processing device 1 measures the cognitive function based on the captured image S1 acquired in step S21, and the internal state estimation unit 15 of the information processing device 1 estimates the level of arousal based on the captured image S1 (step S22).
[0081] Then, the determination unit 18C determines whether the internal state of the measurement subject 9 is appropriate for the test based on the arousal level estimated in step S22 (step S23). If the determination unit 18C determines that the internal state of the measurement subject 9 is appropriate for the test (step S23; Yes), the information processing device 1C performs the same processes as steps S13 and S14 in FIG. 7 described in the first embodiment. That is, the cognitive function estimation unit 16 estimates the cognitive function based on the measurement result of the cognitive function and the estimation result of the arousal level in step S22 (step S24). Then, the output control unit 17C causes the display device 3 to display the estimation result of the cognitive function (step S25).
[0082] On the other hand, if the determination unit 18C determines that the inner state of the measurement subject 9 is not an inner state suitable for the test (step S23; No), the output control unit 17C outputs a warning regarding the cognitive function test (step S26). For example, as the above warning, the output control unit 17C causes the display device 3 to display a test result screen including a notification display field 63, as shown in Fig. 11. In this way, when the cognitive function test is performed under inappropriate conditions, the output control unit 17C can appropriately notify the viewer that the results of the cognitive function test were not appropriate.
[0083] Note that the information processing device 1C may estimate cognitive function in step S24 regardless of the determination result in step S23, and display the cognitive function estimation score Se in step S26. Even in this case, the information processing device 1C can output a warning regarding the test in step S26, thereby making the viewer aware that the reliability of the displayed cognitive function estimation score Se is low.
[0084] (2-4) Technical effects Here, a supplementary explanation will be given of the technical effects of the second embodiment. As explained in the first embodiment using FIGS. 4 and 5, the measured cognitive function depends on the internal state of the subject 9 at the time of measurement, such as the level of alertness. Depending on the state of the subject 9 at the time of measurement, the cognitive function may be measured lower than the subject's actual ability. In such a state of the subject 9, the reliability of the cognitive function test may be reduced. In consideration of the above, in the second embodiment, the information processing device 1C determines whether the subject is in a state suitable for measuring intellectual ability based on the level of alertness, and outputs a notification regarding the reliability of the cognitive function measurement based on the result of the determination. This makes it possible to appropriately encourage the subject 9 to take the cognitive function test when in an appropriate condition.
[0085] (2-5) Variations In addition to the first to third modified examples described in the first embodiment, the following fourth and fifth modified examples may also be applied.
[0086] (Fourth Modification) 11, or in addition to this, the output control unit 17C may output a sound indicating that the measurement subject 9 is not in a state suitable for the cognitive function test and that a retest is necessary. In this case, for example, the output control unit 17C may cause the sound output device to output the audio of the text displayed in the notification display field 63, or may cause the sound output device to output a predetermined warning sound, etc. In this manner, the output control unit 17C can also suitably notify the user that the measurement subject 9 is not in a state suitable for the cognitive function test and that a retest is necessary.
[0087] (Fifth Modification) In the second embodiment, the information processing device 1C does not need to include the cognitive function estimation unit 16.
[0088] Generally, when the internal state of the measurement subject 9 is suitable for testing, a cognitive function measurement score Sm that reflects the original cognitive function of the measurement subject 9 is obtained. Taking the above into consideration, in this modification, when the determination unit 18C determines that the state of the measurement subject 9 is suitable for testing, the information processing device 1C regards the cognitive function measurement score Sm as the cognitive function estimation score Se, and does not calculate the cognitive function estimation score Se by the cognitive function estimation unit 16. Even in this case, the information processing device 1C can preferably present to the user a cognitive function score that is substantially not affected by short-term changes in the internal state of the measurement subject 9.
[0089] <Third embodiment> 13 is a schematic diagram illustrating the configuration of an information processing device 1X according to the third embodiment. The information processing device 1X mainly includes a first acquisition unit 14X, a second acquisition unit 15X, and an estimation unit 16X. Note that the information processing device 1X may be configured by a plurality of devices.
[0090] The first acquisition means 14X acquires the measurement result of the intellectual ability of the measurement subject. Here, the "measurement result of intellectual ability" is not limited to the measurement result of ability measured in a test for cognitive impairment or dementia, but also includes the measurement result of intellectual ability measured in an aptitude test conducted as part of an employment examination, the result of intellectual skill measured in an English proficiency test, etc. For example, the first acquisition means 14X can be the cognitive function measurement unit 14 in the first embodiment (including a case where a modified example is applied, the same applies hereinafter) or the second embodiment (including a case where a modified example is applied, the same applies hereinafter). Furthermore, the first acquisition means 14X may acquire the measurement result of the intellectual ability of the measurement subject by receiving the measurement result of the intellectual ability of the measurement subject provided from another device.
[0091] The second acquisition means 15X acquires an estimation result of the subject's internal state that affects the measurement of intellectual ability. The "internal state of the subject that affects the measurement of intellectual ability" represents one aspect of the subject's internal state, and corresponds to something that fluctuates from time to time, such as arousal level, stress level, concentration level, emotion, or sleepiness. For example, the second acquisition means 15X can be the internal state estimation unit 15 in the first or second embodiment. Furthermore, the second acquisition means 15X may acquire an estimation result of the subject's internal state that affects the measurement of intellectual ability by receiving the estimation result from another device.
[0092] The estimation means 16X estimates intellectual ability based on the measurement result of intellectual ability and the estimation result of the inner state. For example, the estimation means 16X can be the cognitive function estimation unit 16 in the first or second embodiment.
[0093] 14 is an example of a flowchart executed by the information processing device 1X in the third embodiment. The first acquisition means 14X of the information processing device 1X acquires the measurement result of the intellectual ability of the person being measured (step S31). Next, the second acquisition means 15X acquires the estimation result of the inner state of the person being measured, which affects the measurement of the intellectual ability (step S32). The estimation means 16X estimates the intellectual ability based on the measurement result of the intellectual ability and the estimation result of the inner state (step S33).
[0094] According to the third embodiment, the information processing device 1X can suitably estimate intellectual ability independent of the state (condition) of the person to be measured.
[0095] <Fourth embodiment> 15 is a schematic configuration diagram of an information processing device 1Y according to the fourth embodiment. The information processing device 1Y mainly includes a first acquisition unit 14Y, a second acquisition unit 15Y, and an output control unit 17Y. Note that the information processing device 1Y may be configured by a plurality of devices.
[0096] The first acquisition means 14Y acquires the measurement result of the intellectual ability of the measurement subject. For example, the first acquisition means 14Y can be the cognitive function measurement unit 14 in the first embodiment (including when a modified example is applied, the same applies hereinafter) or the second embodiment (including when a modified example is applied, the same applies hereinafter). Furthermore, the first acquisition means 14Y may acquire the measurement result of the intellectual ability of the measurement subject by receiving the measurement result of the intellectual ability of the measurement subject supplied from another device.
[0097] The second acquisition means 15Y acquires an estimation result of the subject's inner state that affects the measurement of intellectual ability. For example, the second acquisition means 15Y can be the inner state estimation unit 15 in the first or second embodiment. The second acquisition means 15Y may also acquire an estimation result of the subject's inner state that affects the measurement of intellectual ability by receiving the estimation result from another device.
[0098] The output control means 17Y displays or outputs sound information relating to the measurement results of intellectual ability based on the estimation results of the internal state. The "information relating to the measurement results of intellectual ability" may be the cognitive function measurement score Sm, the cognitive function estimation score Se, or both in the second embodiment, or may be a notification message displayed in the notification display field 63 in FIG. 11. "Displaying or outputting sound" is not limited to a case where the output control means 17Y itself displays or outputs sound, but also includes a case where the display or sound output is executed by transmitting a predetermined control signal to another processing unit within the information processing device 1 or an external device other than the information processing device 1. The output control means 17Y can be the output control unit 17C in the second embodiment.
[0099] 16 is an example of a flowchart executed by the information processing device 1Y in the fourth embodiment. The first acquisition means 14Y of the information processing device 1Y acquires the measurement results of the intellectual ability of the person being measured (step S41). Next, the second acquisition means 15Y acquires the estimation results of the internal state of the person being measured, which affects the measurement of the intellectual ability (step S42). The output control means 17Y displays or outputs sound information related to the measurement results of the intellectual ability based on the estimation results of the internal state (step S43).
[0100] According to the fourth embodiment, the information processing device 1Y can suitably present to the user information relating to the measurement results of the intellectual ability of the person being measured, based on the estimation results of the internal state of the person being measured that affects the measurement of intellectual ability.
[0101] In the above-described embodiments, the program can be stored using various types of non-transitory computer-readable media and supplied to a computer processor or the like. Non-transitory computer-readable media include various types of tangible storage media. Examples of non-transitory computer-readable media include magnetic storage media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical storage media (e.g., magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / Ws, and semiconductor memories (e.g., mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, and RAMs (Random Access Memory)). The program may also be supplied to a computer by various types of transitory computer-readable media. Examples of transitory computer-readable media include electrical signals, optical signals, and electromagnetic waves. The transitory computer-readable media can supply the program to a computer via a wired communication path such as an electric wire or optical fiber, or via a wireless communication path.
[0102] In addition, part or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes.
[0103] [Appendix 1] a first acquisition means for acquiring a measurement result of the intellectual ability of a person to be measured; a second acquisition means for acquiring an estimation result of the subject's internal state that affects the measurement of the intellectual ability; an estimation means for estimating the intellectual ability based on the measurement result of the intellectual ability and the estimation result of the internal state; An information processing device having the above. [Appendix 2] The information processing device described in Appendix 1, wherein the second acquisition means acquires at least one of the level of alertness, pulse rate, level of drowsiness, level of stress, level of concentration, emotion, or level of alcohol at the time of measuring the intellectual ability of the person being measured as the estimation result of the internal state. [Appendix 3] The measurement result of the intellectual ability is a score representing the intellectual ability, 3. The information processing device according to claim 1, wherein the estimation means calculates a score representing the intellectual ability corrected based on the estimation result of the inner state as the estimation result of the intellectual ability. [Appendix 4] 4. The information processing device according to any one of appendices 1 to 3, wherein the estimation means estimates the intellectual ability based on a degree of exertion of the intellectual ability, which is estimated based on a result of estimating the inner state. [Appendix 5] the first acquisition means generates a measurement result of the cognitive function of the person to be measured as a measurement result of the intellectual ability based on an image generated by an imaging means that images the person to be measured; 5. The information processing device according to any one of appendices 1 to 4, wherein the second acquisition means generates an estimation result of the inner surface state based on the image. [Appendix 6] 6. The information processing device according to any one of appendices 1 to 5, further comprising an output control means for displaying or outputting a sound of the result of the intellectual ability estimation by the estimation means. [Appendix 7] The information processing device according to claim 6, wherein the output control means displays or outputs as sound at least one of the measurement result of the intellectual ability or information representing the normal value of the intellectual ability, and the estimation result of the intellectual ability. [Appendix 8] The apparatus further comprises a determination means for determining whether the subject is in a state suitable for measuring the intellectual ability based on the estimation result of the inner state, 8. The information processing device according to claim 6, wherein the output control means issues a notification regarding the measurement of the intellectual ability based on the result of the judgment. [Appendix 9] the estimation means estimates the cognitive function of the measurement subject, An information processing device described in any one of Appendices 6 to 8, wherein the output control means displays or outputs sound information regarding the possibility of cognitive impairment of the measurement subject based on the estimated cognitive function results and criteria for cognitive impairment. [Appendix 10] Further, a third acquisition means for acquiring information regarding the age of the measurement subject is provided, 10. The information processing device according to any one of appendices 1 to 9, wherein the estimation means estimates the intellectual ability based on the measurement result of the intellectual ability, the estimation result of the inner state, and information related to the age. [Appendix 11] a first acquisition means for acquiring a measurement result of the intellectual ability of a person to be measured; a second acquisition means for acquiring an estimated result of an internal state of the subject that affects the measurement of the intellectual ability; an output control means for displaying or outputting information about the measurement result of the intellectual ability based on the estimation result of the internal state; An information processing device having the above. [Appendix 12] a determination means for determining whether the subject is in a state suitable for measuring the intellectual ability based on the estimation result of the inner state, The information processing device described in Appendix 11, wherein the output control means, when it is determined that the subject is not in a state suitable for measuring the intellectual ability, displays or outputs a warning regarding the measurement of the intellectual ability as information regarding the result of the measurement of the intellectual ability. [Appendix 13] a determination means for determining whether the subject is in a state suitable for measuring the intellectual ability based on the estimation result of the inner state, When the measurement subject is determined to be in a state suitable for the measurement of intellectual ability, the output control means outputs the following information as information regarding the measurement result of intellectual ability: The results of the measurement of intellectual ability, or An estimation result of the intellectual ability based on the measurement result of the intellectual ability and the estimation result of the internal state. 13. The information processing device according to claim 11 or 12, which displays at least one of the above. [Appendix 14] By computer, Obtain the measurement results of the subject's intellectual ability, Obtaining an estimation result of the subject's internal state that affects the measurement of the intellectual ability; estimating the intellectual ability based on the measurement result of the intellectual ability and the estimation result of the internal state; Control method. [Appendix 15] Obtain the measurement results of the subject's intellectual ability, Obtaining an estimation result of the subject's internal state that affects the measurement of the intellectual ability; A storage medium storing a program that causes a computer to execute a process of estimating intellectual ability based on the measurement results of intellectual ability and the estimation results of the inner state. [Appendix 16] By computer, Obtain the measurement results of the subject's intellectual ability, Obtain an estimation result of the internal state of the subject that affects the measurement of the intellectual ability, displaying or outputting information about the measurement result of the intellectual ability based on the estimation result of the internal state; Control method. [Appendix 17] Obtain the measurement results of the subject's intellectual ability, Obtain an estimation result of the internal state of the subject that affects the measurement of the intellectual ability, A storage medium storing a program that causes a computer to execute a process of displaying or outputting a sound information relating to the measurement results of the intellectual ability based on the estimation results of the internal state.
[0104] Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above embodiments. Various modifications within the scope of the present invention that would be understood by those skilled in the art can be made to the configuration and details of the present invention. In other words, the present invention naturally includes various modifications and alterations that would be possible for those skilled in the art based on the entire disclosure, including the claims, and the technical ideas. Furthermore, the disclosures of the above-cited patent documents and other documents are incorporated herein by reference. [Explanation of symbols]
[0105] 1, 1A, 1B, 1X, 1Y Information processing equipment 2. Camera (imaging means) 3 Display device 5 sensors 6 Input Devices 7 Network 8 Terminal Equipment 100, 100A, 100B Cognitive Function Testing System
Claims
1. a first acquisition means for acquiring a measurement result of the intellectual ability of the person to be measured; a second acquisition means for acquiring an estimated result of an internal state of the subject that affects the measurement of the intellectual ability; a determination means for determining whether the subject is in a state suitable for measuring the intellectual ability based on the estimation result of the inner state; and an output control means for displaying or outputting information about the measurement result of the intellectual ability based on the estimation result of the internal state, The output control means, when it is determined that the subject is not in a suitable state for measuring the intellectual ability, displays or outputs a warning regarding the measurement of the intellectual ability as information regarding the result of the measurement of the intellectual ability.
2. A first acquisition means for acquiring a measurement result of the intellectual ability of a person to be measured; a second acquisition means for acquiring an estimated result of an internal state of the subject that affects the measurement of the intellectual ability; a determination means for determining whether the subject is in a state suitable for measuring the intellectual ability based on the estimation result of the inner state; and an output control means for displaying or outputting information about the measurement result of the intellectual ability based on the estimation result of the internal state, When the measurement subject is determined to be in a state suitable for the measurement of intellectual ability, the output control means outputs the following information as information regarding the measurement result of intellectual ability: The results of the measurement of intellectual ability, or An estimation result of the intellectual ability based on the measurement result of the intellectual ability and the estimation result of the internal state. and an information processing device that displays at least one of the above.
3. By computer, Obtain the measurement results of the subject's intellectual ability, Obtain an estimation result of the internal state of the subject that affects the measurement of the intellectual ability, determining whether the subject is in a state suitable for measuring the intellectual ability based on the estimation result of the internal state; displaying or outputting information about the measurement result of the intellectual ability based on the estimation result of the internal state; If it is determined that the subject is not in a state suitable for the measurement of intellectual ability, a warning regarding the measurement of intellectual ability is displayed or output as sound as information regarding the measurement result of intellectual ability. Control method.
4. Obtain the measurement results of the subject's intellectual ability, Obtain an estimation result of the internal state of the subject that affects the measurement of the intellectual ability, determining whether the subject is in a state suitable for measuring the intellectual ability based on the estimation result of the internal state; displaying or outputting information about the measurement result of the intellectual ability based on the estimation result of the internal state; A program that causes a computer to execute a process of displaying or sounding a warning regarding the measurement of intellectual ability as information regarding the results of the measurement of intellectual ability when it is determined that the subject is not in a suitable state for the measurement of intellectual ability.
Citation Information
Patent Citations
How to predict a person's cognitive ability
JP2002529120A
Neurocognitive ability EEG measurement method and system
US6434419B1
Method and system for correlating an image capturing device to a human user for analysis of cognitive performance
WO2018089852A1
Information processing device, method, and program
WO2018179292A1
Cognitive impairment prediction device, prediction model generation device, and program for cognitive impairment prediction
WO2020054186A1