Information processing system

Abstract

To enable easy evaluation of a cognitive function.SOLUTION: An information processing system comprises: a PHR data acquisition section which acquires PHR data; an intervention information storage section which stores intervention information for improving the PHR data; an evaluation information acquisition section which acquires evaluation information for evaluating a user's cognitive function; a PHR identification section which, when an evaluation value based on the evaluation information is less than or equal to a first threshold, identifies a category of the PHR data for which the value is less than or equal to a second threshold among the PHR data; and an intervention information transmission section which acquires the intervention information corresponding to the identified PHR data and transmits the same to a user terminal.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing system. [Background technology]

[0002] Cognitive function has been evaluated based on walking behavior (see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-030050 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the method described in Patent Document 1 requires the subject to walk.

[0005] The present invention has been made in view of the above background, and aims to provide a technique that can easily evaluate cognitive function. [Means for solving the problem]

[0006] The main invention of the present invention for solving the above problem is an information processing system comprising a PHR data acquisition unit for acquiring PHR data, an intervention information storage unit for storing intervention information for improving the PHR data, an evaluation information acquisition unit for acquiring evaluation information for evaluating a user's cognitive function, a PHR identification unit for identifying PHR data among the types of PHR data that are below a second threshold when an evaluation value based on the evaluation information is below a first threshold, and an intervention information transmission unit for acquiring the intervention information corresponding to the identified PHR data and transmitting it to a user terminal.

[0007] Other problems and solutions disclosed in this application will be made clear in the description of the preferred embodiments of the invention and the drawings. Effect of the Invention

[0008] According to the present invention, cognitive function can be easily evaluated. [Brief description of the drawings]

[0009] [Figure 1] 1 is a diagram showing an example of the overall configuration of a cognitive function evaluation system according to an embodiment of the present invention; [Diagram 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of a computer that realizes the management server 20 and the user terminal 10. [Diagram 3] FIG. 2 is a diagram illustrating an example of the software configuration of the user terminal 10. [Figure 4] FIG. 2 illustrates an example of the software configuration of a management server 20. [Diagram 5] FIG. 13 is a diagram showing an example of a screen displayed during a cognitive function test. [Figure 6] FIG. 2 is a diagram illustrating the operation of the cognitive function assessment system according to the embodiment of the present application. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] <Summary of the Invention> The present invention will be described below with reference to the preferred embodiments thereof. [Item 1] A PHR data acquisition unit for acquiring PHR data; An intervention information storage unit that stores intervention information for improving the PHR data; An evaluation information acquisition unit that acquires evaluation information for evaluating a cognitive function of a user; A PHR identification unit that identifies, when an evaluation value based on the evaluation information is equal to or less than a first threshold, a type of the PHR data among the PHR data that is equal to or less than a second threshold; an intervention information transmission unit that acquires the intervention information corresponding to the identified PHR data and transmits it to a user terminal; An information processing system comprising: [Item 2] The information processing system according to item 1, A head mounted display worn by the user is communicatively connected to the head mounted display capable of detecting a gaze point of the user, the evaluation information acquisition unit displays image data on the head mounted display together with instructions to the user, acquires the gaze point on the image data from the head mounted display, and evaluates the cognitive function according to the gaze point; An information processing system comprising: [Item 3] The information processing system according to item 1 or 2, a learning model storage unit that stores a learning model created by machine learning using the PHR data as input data and the evaluation value as training data; A prediction unit that predicts the evaluation value by providing the acquired PHR data to the learning model; An information processing system comprising:

[0011] <System Overview> A cognitive function assessment system according to one embodiment of the present invention will be described below. The cognitive function assessment system of this embodiment is not intended to diagnose dementia, but to grasp the state of cognitive function.

[0012] The current testing methods used as primary screening tests, such as HDS-R and MMSE, are used as tools to diagnose the onset of dementia. On the other hand, even if a dementia diagnosis is made, there is currently no clear established method of recovery. In addition, it is said that by detecting the condition at the stage of mild cognitive impairment (MCI), which is the precursor to dementia, approximately 30% of people can recover to a healthy state.

[0013] It is recognized that early intervention and early detection are important when it comes to dementia, but rather than simply diagnosing whether or not someone has dementia, for which there is no clear treatment, it is necessary to focus on MCI, which is the precursor to dementia, and to grasp its progression from a healthy state and provide early intervention.

[0014] In the cognitive function assessment system of this embodiment, the state of cognitive function can be easily grasped using VR equipment, thereby making it possible to carry out early intervention from a healthy state.

[0015] 1 is a diagram showing an example of the overall configuration of a cognitive function assessment system according to this embodiment. The cognitive function assessment system according to this embodiment includes a management server 20. The management server 20 is communicably connected to a user terminal 10 via a communication network. The communication network is, for example, the Internet, and is constructed using a public telephone line network, a mobile phone line network, a wireless communication path, Ethernet (registered trademark), or the like.

[0016] The user terminal 10 is a computer operated by a user, such as a smart watch, a smartphone, a tablet computer, or a personal computer.

[0017] The HMD 11 is a head-mounted display that is a VR device. The HMD 11 displays an image (which may be a three-dimensional image, a two-dimensional image, or a moving image). The HMD 11 also has a gaze detection function and can obtain where on the image the user is looking (the gaze point).

[0018] By using the HMD 11, it is possible to automatically create a darkroom space. In addition, by using the HMD 11, it is possible to reduce the physical distance between the eyeball and the sensor that detects the line of sight, and it is possible to obtain eye movement tracking data with higher accuracy than when using a monitor-type or tablet-type device for tracking the gaze.

[0019] In addition, by using the HMD11, there is no need to worry about room brightness, the distance between the housing and the user's face, or fixing the face in a fixed position during the test, as compared to when using a monitor-type or tablet-type housing for eye tracking.

[0020] Furthermore, according to the cognitive function assessment system of this embodiment, the user can simply look into the HMD 11 to easily and inexpensively assess cognitive function in an objective, quantitative, and non-language-dependent manner.

[0021] The user terminal 10 controls the HMD 11. The user terminal 10 can display an image on the HMD 11 and can acquire data input or detected in the HMD 11 from the HMD 11. The HMD 11 may be linked to a controller (not shown), and the user terminal 10 can receive input from the controller directly or via the HMD 11.

[0022] The management server 20 is a computer that performs the evaluation of cognitive functions. The management server 20 may be a general-purpose computer such as a workstation or a personal computer, or may be logically realized by cloud computing.

[0023] <Computer> FIG. 2 is a diagram showing an example of the hardware configuration of a computer that realizes the management server 20 and the user terminal 10. Note that the illustrated configuration is an example, and other configurations may be used. The computer includes a CPU 201, a memory 202, a storage device 203, a communication interface 204, an input device 205, and an output device 206. The storage device 203 is, for example, a hard disk drive, a solid state drive, or a flash memory that stores various data and programs. The communication interface 204 is an interface for connecting to a communication network, for example, an adapter for connecting to Ethernet (registered trademark), a modem for connecting to a public telephone line network, a wireless communication device for wireless communication, a USB (Universal Serial Bus) connector or an RS232C connector for serial communication, etc. The input device 205 is, for example, a keyboard, a mouse, a touch panel, a button, a microphone, etc. that input data. The output device 206 is, for example, a display, a printer, a speaker, etc. that output data. Each functional unit of the user terminal 10 and management server 20 described below is realized in the user terminal 10 and management server 20 by the CPU 201 reading a program stored in the storage device 203 into the memory 202 and executing it, and each storage unit of the user terminal 10 and management server 20 described below is realized in the user terminal 10 and management server 20 as part of the storage area provided by the memory 202 and the storage device 203.

[0024] <User terminal 10> 3 is a diagram showing an example of the software configuration of the user terminal 10. The user terminal 10 includes a PHR data acquisition unit 121, a PHR data transmission unit 122, a test display unit 123, a gaze point acquisition unit 124, an answer input unit 125, an answer transmission unit 126, an intervention information output unit 127, a cognitive function prediction output unit 128, and a PHR storage unit 131.

[0025] The PHR data acquisition unit 121 acquires the user's PHR (Personal Health Record) data. The PHR data may include physical activity (amount of exercise, number of steps, etc.), weight, heart rate (pulse), stress, blood pressure, sleep time, nutrition ingested, amount of alcohol, chronic diseases such as diabetes, etc. The user terminal 10 may be equipped with, for example, a three-axis acceleration sensor, a barometer, etc., and the PHR data acquisition unit 121 may use these to grasp the amount of movement of the user terminal 10 as the amount of movement of the user and acquire physical activity data. The PHR data acquisition unit 121 may also analyze this physical activity data to periodically detect whether the user is sleeping or not, and may measure the sleep time by summing up the sleeping time. The user terminal 10 may also be equipped with a heart rate / pulse sensor, and the PHR data acquisition unit 121 may use this sensor to acquire heart rate (pulse) data, and may also analyze the heart rate (pulse) data to evaluate the user's stress state, sleep, etc. The user terminal 10 may also be provided with a blood pressure sensor, and the PHR data acquisition unit 121 may use this sensor to measure the user's blood pressure. The PHR data acquisition unit 121 may also acquire blood pressure data from a blood pressure monitor. The PHR data acquisition unit 121 may also conduct a questionnaire survey of the user and accept input of PHR data such as alcohol intake and smoking amount. The PHR data acquisition unit 121 registers the acquired PHR data in the PHR storage unit 131.

[0026] The PHR storage unit 131 stores the PHR data. The PHR storage unit 131 may be provided as a function of a smartphone, for example. The PHR storage unit 131 can store the date and time when the PHR data was measured or calculated, the type of PHR data (amount of exercise, number of steps, weight, heart rate, pulse, stress, blood pressure, sleep time, nutrients, alcohol amount, diabetes, etc.), and the PHR data in association with a user ID indicating a user.

[0027] The PHR data transmission unit 122 transmits the PHR data to the management server 20. The PHR data transmission unit 122 may transmit the PHR data stored in the PHR storage unit 131 periodically, or may transmit the PHR data every time the PHR data acquisition unit 121 acquires the PHR data.

[0028] The test display unit 123 displays test questions for evaluating the cognitive function of the user. The test questions are provided by the management server 20. In this embodiment, it is assumed that the test questions include character strings or voice data indicating instructions to the user, and image data. The test display unit 123 can display image data on the HMD 11 and can also display or output voice instructions to the user.

[0029] The gaze point acquisition unit 124 acquires the user's gaze point (the position on the image that the user is looking at) from the HMD 11.

[0030] The answer input unit 125 acquires the user's answers to questions related to the test. The answer input unit 125 can accept the gaze point acquired by the gaze point acquisition unit 124 as an answer, and can also accept the user's answers to a questionnaire from an input device such as a touch panel or a keyboard provided in the user terminal 10.

[0031] The answer sending unit 126 sends the answer to the management server 20. The answer includes the gaze point. When a questionnaire is conducted for users, the input data to the questionnaire can also be included in the answer.

[0032] The intervention information output unit 127 outputs advice (intervention information) related to the PHR data. The intervention information is provided from the management server 20. The intervention information may include information on diagnosis and prevention that is useful for improving cognitive function. The intervention information may be provided by, for example, a medical professional.

[0033] The cognitive function prediction output unit 128 outputs a predicted evaluation value of the user's cognitive function based on the PHR data. The predicted evaluation value of the cognitive function is provided by the management server 20. For example, the predicted evaluation value of the cognitive function is responded to from the management server 20 in response to the PHR data transmitted by the PHR data transmission unit 122, and the cognitive function prediction output unit 128 can display this predicted evaluation value of the cognitive function. In addition, the cognitive function prediction output unit 128 can output an alert to the user when the change value of the predicted evaluation value of the cognitive function (for example, the user terminal 10 is provided with a predicted evaluation history storage unit that records the history of the predicted evaluation value, and the acquired predicted evaluation value is lower than the aggregate value such as the most recent predicted evaluation value or the average value of the predicted evaluation value for a predetermined period in the past by a predetermined value or more. This alert can motivate the user to take an evaluation test of the cognitive function to check the state. In addition, this alert can motivate the user to check the intervention information and take measures against the decline in cognitive function. In addition, when the alert is output, a request for intervention information may be transmitted to the management server 20.

[0034] <Administration Server 20> 4 is a diagram showing an example of the software configuration of the management server 20. The management server 20 includes a PHR data acquisition unit 211, a test transmission unit 212, a response acquisition unit 213, a cognitive function assessment unit 214, a learning processing unit 215, an intervention information acquisition unit 216, an intervention information transmission unit 217, a cognitive function prediction unit 218, a PHR storage unit 231, a test storage unit 232, an intervention information storage unit 233, and a learning model storage unit 234.

[0035] The PHR data acquisition unit 211 acquires the PHR data of the user. The PHR data acquisition unit 211 receives the PHR data from the user terminal 10. The PHR data acquisition unit 211 can also be configured to acquire the PHR data by, for example, accessing a computer on which the user manages the PHR data. The PHR data acquisition unit 211 can register the acquired PHR data in the PHR storage unit 231.

[0036] The PHR storage unit 231 stores the PHR data. The configuration of the PHR storage unit 231 can be the same as the PHR storage unit 131 included in the user terminal 10, but other items may be added.

[0037] The test storage unit 232 stores information (test information) for carrying out a test to evaluate cognitive function. The test information may include questions and images in association with a test ID that identifies the test. In this embodiment, the test is assumed to display an explanation and show an image, and evaluate cognitive function according to a gaze point detected as to where the user is looking on the image. Note that the test information may also include a question image and an answer image.

[0038] FIG. 5 is a diagram showing an example of a screen displayed during a cognitive function test. For example, in the "memory problem," as shown in FIG. 5, a question 31 can be displayed as text data, and a problem image 32 showing a figure to be memorized (correct answer figure) can be displayed. For example, test information can be registered for each of the "memory problem," "attention problem," "spatial cognition problem," and "calculation problem" shown in FIG. 5. These questions 31 and problem images 32 (correct answer image and incorrect answer image) can be included in the test information. Also, multiple pieces of test information including the same test ID can be registered.

[0039] The test transmission unit 212 transmits the test information to the user terminal 10. The test transmission unit 212 can read all the test information including a specific test ID from the test storage unit 231 simultaneously or sequentially and transmit the read information to the user terminal 10. In response to the test information, a screen such as that shown in FIG. 5 is displayed on the HMD 11.

[0040] The answer acquisition unit 213 receives answers to the test from the user. In this embodiment, it is assumed that the answers include the gaze point measured by the HMD 11. The answers may also include data input by an input device such as a touch panel or keyboard of the user terminal 10.

[0041] The cognitive function evaluation unit 214 evaluates the cognitive function of the user according to the answer. For example, the cognitive function evaluation unit 214 displays a question 31 and a question image 32 (correct image 32) on a screen such as a "memory question" shown in Fig. 5, and then displays an answer image (not shown) including the correct image 32 and an incorrect image, measures the time during which the gaze point exists in the area of ​​the correct image in the answer image, and can determine that the answer is correct if the gaze point exists on the correct image for a predetermined time or more.

[0042] In addition, the cognitive function assessment unit 214 can also display a question 31 of text data and a question image 32 including a correct image 321 and an incorrect image 322 on the “Attention Question” screen in FIG. 5, and determine whether the answer is correct or incorrect based on the time the gaze point is on the correct image 321.

[0043] Then, the cognitive function assessment unit 214 can assess the cognitive function of the user according to all the answers. For example, the cognitive function can be assessed according to the proportion of correct answers to each question (correct answer rate).

[0044] The cognitive function assessment unit 214 can transmit the assessment value to the user terminal 10.

[0045] The learning processing unit 215 can analyze the correlation between the assessment value of the cognitive function and the PHR data. For example, the learning processing unit 215 can perform machine learning using the PHR data as input data and the assessment value of the cognitive function as teacher data to create a learning model. The learning model created by the learning processing unit 215 can be registered in the learning model storage unit 234. In addition, the learning processing unit 215 can also update the learning model stored in the learning model storage unit 234 by having it learn using new PHR data.

[0046] The learning model storage unit 234 stores the learning model. In this embodiment, it is assumed that one learning model is created by learning PHR data of multiple users and registered in the learning model storage unit 234. However, it is also possible to learn PHR data for each user, create a learning model for each user, and register the model in the learning model storage unit 234.

[0047] The intervention information storage unit 233 stores the intervention information. The intervention information storage unit 233 can store the intervention information in association with the type of PHR data.

[0048] The intervention information acquisition unit 216 acquires the intervention information. When the intervention information of the corresponding type is registered in the intervention information storage unit 233, the intervention information acquisition unit 216 can acquire the intervention information from the intervention information storage unit 233. When the intervention information of the corresponding type is not registered in the intervention information storage unit 233, the intervention information acquisition unit 216 may accept an input of the intervention information from a medical worker. For example, the intervention information acquisition unit 216 can transmit the PHR data and the evaluation value of the cognitive function to a terminal (not shown) of the medical worker and acquire the intervention information input to the terminal. The intervention information acquisition unit 216 can register the acquired intervention information in the intervention information storage unit 233.

[0049] The intervention information transmission unit 217 transmits the intervention information to the user terminal 10. For example, when the PHR data is equal to or less than a predetermined threshold (or equal to or more than the threshold), the intervention information transmission unit 217 can transmit the intervention information to the user terminal 10. For example, the threshold can be a value range without abnormalities used in general health checkups and medical checkups.

[0050] The intervention information transmitting unit 217 may transmit the evaluation value obtained by the cognitive function evaluating unit 214 .

[0051] The cognitive function prediction unit 218 obtains a predicted evaluation value of the cognitive function based on the PHR data. The cognitive function prediction unit 218 can obtain a predicted evaluation value of the cognitive function by providing the PHR data to a learning model. The cognitive function prediction unit 218 can transmit the predicted evaluation value to the user terminal 10. The cognitive function prediction unit 218 can obtain a predicted evaluation value every time PHR data is obtained from the user terminal 10, for example.

[0052] <Operation> FIG. 6 is a diagram illustrating the operation of the cognitive function evaluation system according to the embodiment of the present application.

[0053] The management server 20 receives PHR data from the user terminal 10 (S301), transmits test information including questions and question images to the user terminal 10 (S302), receives test answers including the gaze point from the user terminal 10 (S303), evaluates the user's cognitive function based on the received answers, and transmits the evaluation to the user terminal 10 (S304).

[0054] If the evaluation value of cognitive function is less than a predetermined threshold (S305: YES), the management server 20 identifies the type of PHR data that is lower than the average (S306), and if intervention information corresponding to the identified type is not registered (S307: NO), it transmits the PHR data and the evaluation value of cognitive function to the terminal of the medical staff (S308) and acquires the intervention information input by the medical staff (S309). The management server 20 transmits the intervention information to the user terminal 10 (S310).

[0055] As described above, according to the cognitive function assessment system of this embodiment, it is possible to perform intervention in PHR data to prevent cognitive function decline.

[0056] Although the present embodiment has been described above, the above embodiment is intended to facilitate understanding of the present invention, and is not intended to limit the present invention. The present invention may be modified or improved without departing from the spirit of the present invention, and equivalents thereof are also included in the present invention.

[0057] For example, in this embodiment, the cognitive function is evaluated based on the gaze point at which the problem image was viewed, but other methods can also be used to evaluate the cognitive function. For example, the size of the user's pupils and eye movement when answering a problem can be observed using the HMD 11, and the user's cognitive function can be evaluated based on the expansion and contraction of the user's pupils and microsaccade movement. Note that a known method can be used to evaluate the cognitive function based on the expansion and contraction of the pupils and microsaccade movement.

[0058] Also, iris authentication may be used for user authentication. In this case, the iris is photographed by the HMD 11, and authentication can be performed by a general iris authentication method based on the photographed iris image. In this case, a calibration storage unit that stores calibration data for each user is provided in the management server 20, and calibration of the HMD 11 can be performed based on the stored data without performing calibration every time. Also, based on the photographed iris image, deviations in the fit of the HMD 11 can be detected, and the calibration can be automatically adjusted (for example, setting an offset of the gaze point, etc.).

[0059] Also, face recognition may be used for authenticating the user. In this case, a face image of the user may be captured by the HMD 11, and authentication may be performed by a general face recognition method based on the face image. Also in this case, a calibration storage unit that stores calibration data for each user may be provided in the management server 20, and the HMD 11 may be calibrated based on the stored data without performing calibration every time. Also, based on the face image, deviations in the fit of the HMD 11 may be detected, and the calibration may be automatically adjusted (for example, setting an offset of the gaze point, etc.).

[0060] Also, in this embodiment, it has been described that the problem image is displayed and the gaze point on the problem image is measured, but the problem image may be a three-dimensional image. That is, a test question may be asked in a three-dimensional space, and the gaze point in the three-dimensional space may be detected by the HMD 11. For example, a memory question may be posed in which the subject is asked to answer what products were displayed as the subject walked around the store, or to answer the contents of conversations between people in the store. In this case, the number of correct answers (the number of times a subject was able to select a product that matched a product displayed in the store, the number of times a subject was able to select a word contained in the conversation, etc.) is counted, and a score is calculated according to the percentage of correct answers.

[0061] In addition, the HMD 11 can detect the user's gaze and evaluate the above-mentioned various abilities according to the time it takes to gaze at the correct image (the time it takes for the gaze point to reach the correct image) and the trajectory (movement trajectory of the gaze point) until the user gazes at the correct image. Here, the gaze point in three-dimensional space can be detected, and the depth of the point gazed by the user can be determined and diagnosed. For example, the cognitive function can be evaluated so that the shorter the time it takes to gaze at the correct image, the higher the evaluation. Also, for example, the shorter the length of the movement trajectory of the gaze point from when the correct image is displayed until the user's gaze point reaches the area of ​​the correct image and remains in the area for a predetermined time or more, the higher the evaluation. In addition, the gaze point (x, y, z coordinates) in three-dimensional space can be detected, and whether or not the correct object exists at the gaze point can be judged according to whether or not the user was able to recognize it (i.e., whether or not the user focused on the correct object, rather than just vaguely turning his / her face in the direction in which the correct object exists).

[0062] Also, for example, answers (which may be pictures or text) can be placed in a two-dimensional or three-dimensional space, the user's line of sight and point of gaze can be detected, and the answer that is placed at the position where the user was gazing can be detected.

[0063] It is also possible to measure changes in pupil diameter in response to on-screen or audio instructions and stimuli, and to evaluate cognitive function based on the pupillary system. [Explanation of symbols]

[0064] 10 User terminal 11 HMD 20 Management Server 121 PHR Data Acquisition Department 122 PHR data transmission unit 123 Test display unit 124 Gazing Point Acquisition Unit 125 Answer input section 126 Reply Sending Department 127 Intervention information output section 128 Cognitive Function Prediction Output Unit 131 PHR storage section 211 PHR Data Acquisition Department 212 Test Transmission Department 213 Answer acquisition part 214 Cognitive Function Assessment Division 215 Learning Processing Unit 216 Intervention Information Acquisition Department 217 Intervention information transmission unit 218 Cognitive Function Prediction Division 231 PHR storage section 232 Test Memory Section 233 Intervention information storage unit 234 Learning model memory unit

Claims

1. A PHR data acquisition unit that acquires PHR data; An intervention information storage unit that stores intervention information for improving the PHR data; An evaluation information acquisition unit that acquires evaluation information for evaluating a cognitive function of a user; a PHR identification unit that identifies, when an evaluation value based on the evaluation information is equal to or less than a first threshold, a type of the PHR data among the PHR data that is equal to or less than a second threshold; An intervention information transmission unit that acquires the intervention information corresponding to the identified PHR data and transmits it to a user terminal; An information processing system comprising:

2. 2. The information processing system according to claim 1, A head mounted display worn by the user is communicatively connected to the head mounted display capable of detecting a gaze point of the user, the evaluation information acquisition unit displays image data on the head mounted display together with instructions to the user, acquires the gaze point on the image data from the head mounted display, and evaluates the cognitive function according to the gaze point; An information processing system comprising:

3. 3. The information processing system according to claim 1, A learning model storage unit that stores a learning model created by machine learning using the PHR data as input data and the evaluation value as training data; A prediction unit that predicts the evaluation value by providing the acquired PHR data to the learning model; An information processing system comprising:

Images