Neural state evaluation system, neural state evaluation method, and neural state evaluation program

Abstract

The invention provides a neural state evaluation system. The neural state of a subject can be accurately evaluated, and an evaluation result suitable for the subject can be provided. A pupil index calculation unit generates waveform data of a pupil area on the basis of a moving image in which a pupil of a subject is imaged by an undistorted lens, and then calculates a pupil index, and a nerve state estimation unit estimates a sympathetic nerve age and a parasympathetic nerve age, which are nerve states of the left and right pupils of the subject, on the basis of the pupil index. The evaluation unit evaluates the neural state of the subject on the basis of the estimated neural state, the improvement measure generation unit generates a suggestion suitable for the subject on the basis of the evaluation result, and the display unit displays the evaluation result of the neural state and the suggestion.

Description

[Technical field]

[0001] The present invention relates to a nerve state evaluation system, a nerve state evaluation method and a nerve state evaluation program. [Background Technology]

[0002] In recent years, the rise in the number of people suffering from stress-related illnesses, depression, and anxiety disorders has become a social issue. The judgments of treating specialists are often subjective, and even experienced doctors struggle to consistently accurately assess a patient's physical and mental state. Against this backdrop, the need for objective assessments of physical and mental conditions is growing.

[0003] Patent Document 1 describes a system for determining a subject's physical and mental state based on temporal pupil expansion and contraction data relative to stimulating light. If the subject's pupil size is larger five seconds after the stimulating light is applied than at the moment of application, the system determines that the subject's sympathetic nervous system is dominant over the parasympathetic nervous system.

[0004] Patent Document 2 describes a brain function testing method that examines the degree of autonomic nervous system activity, the presence of dementia, and Alzheimer's disease based on a discriminant index obtained by performing multivariate operations on various pupil indices derived from measuring a subject's pupil size. Furthermore, this method uses two or more of the following pupil indices as pupil indices: latency, miosis duration, dilation duration, initial pupil diameter, miosis volume, miosis rate, miotic velocity, maximum miotic velocity, dilation velocity, maximum dilation velocity, miotic acceleration, maximum miotic acceleration, time to reach maximum miotic velocity, time to reach maximum dilation velocity, and time to reach maximum miotic acceleration.

[0005] [Prior art literature]

[0006] Patent Literature

[0007] Patent Document 1: Japanese Patent Application Laid-Open No. 2020-116312

[0008] Patent Document 2: Japanese Patent Application Laid-Open No. 2002-34920 [Summary of the invention]

[0009] Problems to be solved by the invention

[0010] Pupil size and movement vary with age and before and after procedures. Until now, systems that assess physical and mental health based on pupil data have only determined the health of the sympathetic and parasympathetic nervous systems and whether brain function is normal. It's difficult to accurately and accurately assess physical and mental health based on individual information like the patient's age. Consequently, it's difficult to provide personalized recommendations to patients.

[0011] The present invention has been made in view of the above-mentioned actual situation, and its object is to more accurately estimate the neurological state of a subject and provide an evaluation result suitable for the subject.

[0012] Means for solving problems

[0013] The invention described in the first aspect of the present invention is a neurological state evaluation system comprising: a light irradiation unit that irradiates light onto the pupil of a subject; an acquisition unit that acquires dynamic image data obtained by photographing the pupil of the subject; a calculation unit that calculates pupil indicators based on the dynamic image data; a state evaluation unit that evaluates the sympathetic nerve age and parasympathetic nerve age of the subject based on the pupil indicators; and a display unit that displays the sympathetic nerve age and the parasympathetic nerve age.

[0014] The invention recorded in the second aspect of the present invention is a neural state evaluation system according to the first aspect of the present invention, wherein the state evaluation unit evaluates the left and right sympathetic nerve ages and parasympathetic nerve ages based on the left and right pupil indicators of the subject, and the display unit displays the left and right sympathetic nerve ages and the parasympathetic nerve ages respectively.

[0015] The invention recorded in the third aspect of the present invention is a neural state evaluation system according to the first aspect of the present invention, wherein the acquisition unit acquires dynamic image data captured by a distortion-free lens, and the calculation unit calculates the pupil index by counting pupil-related pixels in the captured dynamic image data.

[0016] The invention described in the fourth aspect of the present invention is a neural state evaluation system according to the first aspect of the present invention, wherein the display unit displays multiple pupil indicators or the neural states at different times, or displays changes in the pupil indicators or the neural states at different times.

[0017] The invention described in the fifth aspect of the present invention is a neural state evaluation system according to any one of the first to fourth aspects of the present invention, which has: a suggestion generating unit, which generates suggestions for the subject based on the sympathetic nerve age and the parasympathetic nerve age, and the display unit displays the suggestions.

[0018] Effects of the Invention

[0019] According to the present invention, the neurological state of a subject can be accurately estimated, and an evaluation result suitable for the subject can be provided.

[0020] [Brief Description of the Drawings]

[0021] Figure 1 1 is a diagram showing the overall configuration of an autonomic nervous system state determination system to which this embodiment is applied.

[0022] Figure 2 is a diagram showing a pupil diameter measurement device.

[0023] Figure 3 It is a diagram showing the functional structure of the server.

[0024] Figure 4 This is a diagram illustrating parameters related to the pupil.

[0025] Figure 5 It is a diagram showing the functional structure of a terminal device.

[0026] Figure 6A This is a diagram showing an input screen on the terminal device side of the nervous state evaluation system.

[0027] Figure 6B This is a diagram showing a screen on the terminal device side of the nervous state evaluation system for accepting the start of measurement.

[0028] Figure 7 This is a diagram showing a measurement result display screen of a terminal device.

[0029] Figure 8 FIG. 1 is a diagram showing a suggestion display screen of a terminal device.

[0030] Figure 9 This is a flowchart showing the processing flow of the terminal device.

[0031] Figure 10 It is a flowchart showing the processing flow of the server.

[0032] Figure 11 This is a flowchart showing the processing flow of the terminal device.

[0033] Figure 12 (A) is a diagram illustrating pincushion distortion caused by an anamorphic lens, (B) is a diagram illustrating barrel distortion caused by an anamorphic lens, (C) is an image captured with barrel distortion, and (D) is an image captured with a non-distorted lens.

[0034] Figure 13 This is a diagram showing a measurement result display screen of a terminal device. [Specific implementation method]

[0035] [Overall structure of the neural status evaluation system]

[0036] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0037] Figure 1 1 is a diagram showing the hardware configuration of a neural state evaluation system to which this embodiment is applied.

[0038] A neurological status evaluation system 1 is a system comprising a pupillometer 10 for measuring a subject's pupils, a server 30 for evaluating the subject's neurological status, and a terminal device 50 for displaying the subject's neurological status, connected via a network 70. The neurological status evaluation system 1 illustrated in this embodiment evaluates the subject's neurological status based on dynamic image data obtained by capturing the subject's pupils, and provides evaluation results or recommendations to the subject or user. One example of this system is a system that analyzes and evaluates dynamic image data obtained by capturing the subject's pupils and provides information for improving the subject's movements.

[0039] The pupillometer 10 is configured as a dedicated measuring device for measuring pupil diameter, for example. The pupillometer 10 includes a control unit 11, which is a processor (CPU (Central Processing Unit)) that controls the pupillometer as a whole; a memory 12, such as RAM (Random Access Memory), which is used as a workspace during calculations; and a storage unit 13, which is a storage device such as an HDD (Hard Disk Drive) or semiconductor memory for storing programs and various setting data. Furthermore, the pupillometer 10 includes a communication unit 14 for transmitting and receiving data, such as dynamic image data, via a network 70. The pupillometer 10 also includes an operation unit 15, such as a measurement start button, that receives input from the subject on the pupillometer 10 side; a light irradiation unit 16 that irradiates light to the subject; and an imaging unit 17 that can capture the movement of the subject's pupil as dynamic image data.

[0040] The server 30 is composed of computer devices such as workstations, desktop PCs, and notebook PCs. The server 30 has a control unit 31, which is a processor (CPU (Central Processing Unit)) that controls the entire device; a memory 32 such as RAM (Random Access Memory) that is used as a work area during calculations; and a storage unit 33, which is a storage device such as an HDD (Hard Disk Drive) or semiconductor memory for storing programs, various setting data, etc. In addition, it has a communication unit 34 that sends and receives data via a network 70. It also has an operation unit 35 such as a keyboard, pointing device, or touch panel that accepts input operations from the user on the server 30 side; a display unit 36 ​​that displays images, text information, etc. to the server user and is composed of a liquid crystal display, etc.; and a display control unit 37 that controls the display unit 36.

[0041] The terminal device 50 is comprised of, for example, a computer terminal device such as a smartphone or tablet computer. The terminal device 50 includes a control unit 51, which is a processor (CPU (Central Processing Unit)) that controls the entire device; a memory 52, such as RAM (Random Access Memory), which is used as a workspace during calculations; and a storage unit 53, which is a storage device such as an HDD (Hard Disk Drive) or semiconductor memory for storing programs and various setting data.

[0042] The terminal device 50 also includes a communication unit 54 for transmitting and receiving data such as moving image data and evaluation results of the subject's neurological status via a network 70. It also includes an operation unit 55, such as a touch panel, keyboard, or pointing device, for accepting input operations from the subject on the terminal device 50 side; a display unit 56, such as a liquid crystal display, for displaying images and text information to the subject; and a display control unit 57 for controlling the display unit 56. The terminal device 50 also includes an imaging unit 58 capable of capturing moving images of the subject.

[0043] The CPU used by the pupillometer 10, server 30, terminal device 50, etc., or the CPU used by various devices connected to the pupillometer 10, server 30, terminal device 50, etc. constitutes the "one or more processors" in the present invention and realizes various functions in this embodiment.

[0044] also, Figure 1 The various structures of the pupil meter 10, server 30, and terminal device 50 shown do not necessarily need to have the same housing, and there is a form of understanding them as a system. When the main device and the housing are different, they are connected by wire or wirelessly.

[0045] Figure 2 : is a conceptual diagram showing the functional structure of the pupillometer. The pupillometer 10 has: a communication unit 14, which is a wired or wireless communication unit based on a communication cable, etc.; a light irradiation unit 16, which irradiates light toward the pupil of the subject; a camera unit 17, which takes a dynamic image of the pupil of the subject; and a cover 18, which blocks light from the outside. The light irradiation unit 16 is composed of a visible light irradiation unit 16a and an infrared light irradiation unit 16b. When the pupillometer 10 receives an input to start measurement from the server 30 or the terminal device 50 via the communication unit 14, the visible light irradiation units 16a (on the left and right sides of the inner side of the pupillometer housing) are respectively arranged. Figure 2(Only the left side is shown in the figure) irradiates visible light in the direction of the subject's pupil for about 0.5 seconds. The light stimulation that causes the pupil to change is performed by irradiating visible light, and the infrared light irradiation unit 16b further irradiates near-infrared rays with a wavelength of 850nm or more toward the pupil. The irradiation of near-infrared rays with a wavelength of 850nm or more will not affect the changes in the pupil, but by irradiating near-infrared light, the pupil can be clearly and reliably photographed. The imaging element that constitutes a part of the camera unit 17 can be a CMOS (Complementary Metal Oxide Semiconductor) sensor that can capture light from the infrared region to the visible light. The camera lens that constitutes a part of the camera unit 17 is arranged in a position where the pupil can be easily photographed inside the cover. The captured dynamic image data is sent to the server 30 or the terminal device 50 via the communication unit 14. Although not shown in the figure, it may also have a storage unit for storing the captured dynamic image data, etc., and a data processing unit for compressing the captured dynamic image data.

[0046] Figure 3 : is a diagram showing the functional structure of the server. The server 30 has: a storage unit 33 that stores various data; a communication unit 34 that sends and receives data such as dynamic images and evaluation results of neural states; an acceptance unit 38 that accepts various input data; and a data processing unit 39 that analyzes the acquired dynamic image data. In this specification, "analysis" includes not only analysis information, but also research on improvement measures for improving the state determined based on the analysis results. It also has a dynamic image data acquisition unit 48 that acquires the dynamic image data of the subject via the communication unit 34. In addition, it has an analysis result output unit 49 that outputs the analysis results to the display unit 56 of the subject's terminal device 50. In addition to the results of the analysis information, the "analysis results" can also include suggestions, measures, improvement plans, etc. for improving the state determined based on the analysis results.

[0047] The storage unit 33 includes a subject information storage unit 45 that stores subject information, an analysis result storage unit 46 that stores analysis results, and a learning-related data storage unit 47 that stores a learning data set and learned parameters.

[0048] The subject information stored in the subject information storage unit 45 may be acquired from the terminal device 50 and stored each time analysis is performed, or it may be stored in advance along with identification information for identifying the subject. This "subject information" is information related to the subject to be analyzed, such as identification information of the subject to be analyzed, physical information such as height and weight, age, gender, physical and mental condition of the subject, and examination history.

[0049] The analysis result storage unit 46 stores the data of the analysis result obtained by the data processing unit 39 in association with the subject information stored in the subject information storage unit 45 .

[0050] The learning-related data storage unit 47 stores, in addition to the subject's pupil index, the subject's actual neurological status, the subject's actual age, and the like, parameters after learning has been completed. Furthermore, the storage unit may also store the moving image data itself before learning data generation, moving image data after frame extraction, moving image data in the process of being analyzed, and compressed moving image data.

[0051] The data processing unit 39 includes: a pupil index calculation unit 40 that calculates an index related to the pupil; a state estimation unit 41 that estimates the neurological state of the subject; a model generation unit 42 that generates an estimation model; a comment generation unit 43 that generates comments related to the evaluation of the neurological state of the subject; and an improvement measure generation unit 44 that generates suggestions.

[0052] The pupil index calculation section 40 calculates various parameters related to the pupil based on the dynamic image data of the subject's pupil sent from the pupilometer 10. Specific pupil parameters will be described later.

[0053] The state estimation unit 41 estimates the subject's neurological state based on pupil-related parameters (pupil indices). The inference model for estimating the subject's neurological state can be a linear regression equation, a nonlinear regression equation, or a neural network model. Furthermore, it can be a discriminant model based on a decision tree, a support vector machine, or the like. The estimated neurological state data of the subject is transmitted to the terminal device 50 via the communication unit 34.

[0054] In this embodiment, "neurological state" refers to the physical and mental state and brain function state of the subject caused by the activity of nerves such as the autonomic nerves and cranial nerves. In addition, the neurological state is used as a concept that also includes the physical state related to the nerves. For example, it is generally believed that if the sympathetic nerves are dominant, it is easy to feel pain, and pain or no pain is felt due to the activity of the autonomic nerves, so the "pain" of the body is also included in the neurological state. In addition, even if the subject does not feel pain in the subjective evaluation, sometimes a waveform pattern similar to pain is detected from the measurement results of the pupillometer. Such unconscious pain is also interpreted as being included in the "neurological state" in this embodiment.

[0055] Furthermore, the function of the autonomic nervous system peaks around the age of 20, and neurological function declines with age. "Neural status" also includes "neurological age," which indicates the subject's neurological function level at a specific age, based on a standard functional level categorized by age. For example, the status estimation unit 41 estimates the subject's neurological level using a regression equation of an exponential function based on several pupil indices, determines the age corresponding to that level, and calculates the neurological age.

[0056] The state estimation unit 41 then evaluates the subject's neurological state by comparing the estimated neurological state with the subject's actual age. For example, if the subject's neurological age is calculated to be 40 years old and the subject's actual age is 45 years old, the state estimation unit 41 evaluates the subject's neurological state as being 5 years younger than the actual age.

[0057] In this embodiment, evaluating the neurological state includes estimating the neurological state. Therefore, even if only the neurological age is estimated, it may be considered as evaluating the neurological state.

[0058] Furthermore, the state estimation unit 41 can also evaluate the nervous state by judging whether the patient is in a state of “stress” or “tension” based on pupil indices related to the sympathetic nervous function and the parasympathetic nervous function.

[0059] The model generation unit 42 performs machine learning based on the learning data stored in the learning-related data storage unit 47, thereby determining the parameters of the estimated model. Machine learning refers to determining the model parameters based on a dataset of explanatory variables and explained variables so that the estimation error of the model that estimates the explained variables using the explanatory variables as input is minimized. Therefore, if the estimated model is a regression equation, this involves calculating the coefficients of the regression equation; if it is a neural network, this involves determining the coefficients of the neurons. The determined model parameters are stored in the learning-related data storage unit 47.

[0060] The comment generation unit 43 generates a comment describing the current state of the neural state based on the neural state estimated by the generated estimation model. When generating the content of the comment, not only the estimated neural state but also subject information such as age is taken into consideration, thereby enabling a high-precision evaluation consistent with the individual. For example, the comment generation unit 43 compares the age estimated based on the pupil index with the actual age of the subject. If the neural age is younger than the actual age, a comment is created that evaluates the neural state of the subject as being younger. In this embodiment, "evaluating" the neural state of the subject includes not only estimating the neural state of the subject, but also judging the neural state of the subject based on the estimated result. Therefore, comparing the estimated neural age with the actual age of the subject to diagnose the neural state is also equivalent to "evaluation."

[0061] Based on the neurological status evaluation results, the improvement measure generation unit 44 generates recommendations related to improving work hours, lifestyle, and injury treatment. The improvement measure generation unit 44 may also refer to the subject's self-declaration when generating recommendations. For example, even if the subject reports no pain, if the neurological status evaluation results show a spike waveform indicating pain in the waveform of the pupil area's temporal changes, the improvement measure generation unit 44 generates a recommendation to seek medical treatment because the subject is experiencing pain without conscious symptoms. The generated comments and recommendation data are transmitted to the terminal device 50 via the communication unit 34.

[0062] Figure 4 This is a diagram illustrating pupil-related parameters (pupil index). When light is irradiated into a subject's eye, the size (area) of the pupil produces Figure 4 The timing changes are as shown in the waveform of . The dilation of the pupil (mydriasis) is achieved by the action of the sympathetic nerves, and the constriction of the pupil (miosis) is achieved by the action of the parasympathetic nerves. Usually, when the sympathetic nerves are dominant, the subject is in a tense and excited state, and when the parasympathetic nerves are dominant, the subject is in a relaxed and calm state. Therefore, by measuring the dilation and constriction of the pupil, the activity state of the sympathetic and parasympathetic nerves can be detected. Figure 4 The following twelve pupil-related parameters (pupil indices) are conceptually shown: A1: Initial pupil area [mm2], A2: Minimum pupil area after light stimulation [mm2], A3: Change in pupil area after light stimulation [mm2], CR: Miosis ratio (A3 / A1) [%], D1: Initial pupil diameter [mm], T1: Time from light stimulation to the onset of pupil constriction [msec], T2: Time until the change in pupil area is 1 / 2 [msec], T3: Time until the pupil is at its smallest size [msec], T5: Time from pupil dilation to recovery to 63% of its minimum size [msec], VC: Maximum pupil velocity [mm2 / sec], VD: Maximum pupil velocity [mm2 / sec], AC: Maximum acceleration of pupil constriction [mm2 / s2]. It is generally believed that sympathetic nervous system function is reflected by VD and T5, while parasympathetic nervous system function is reflected by VC, CR, and A3.

[0063] Furthermore, based on waveform data from participants who responded to the subjective questionnaire with feelings of extreme anxiety, tension, chest tightness, and dyspnea, the researchers found that the speed of miosis / dilation decreased and that pupil size was difficult to recover after light exposure.

[0064] Furthermore, the functional levels of the sympathetic and parasympathetic nerves were measured for 424 experimental collaborators (206 males and 218 females, with an average age of 45.4 years). The results obtained by calculating the average values ​​of the functional levels of each age group showed that the maximum value of the pupillary dilation velocity (VD) measured by the pupillometer was correlated with the neural function. Therefore, age can be calculated based on the neural function level estimated based on pupillary indicators such as the maximum value of the pupillary dilation velocity (VD). The age of the subject estimated based on pupillary measurement, i.e., "neurological age," is an indicator that can be compared with the actual age as information about the neural status, and therefore can be said to be an indicator that is intuitively easy to understand.

[0065] The pupillometer 10 measures the pupil for approximately 7 seconds. The pupil index calculation unit 40 identifies the pupil from static images at each moment in the dynamic image captured by photographing the subject's pupil and calculates the pupil area, thereby generating time-series data (waveform data) of the pupil area. The dynamic image data may contain static images where the pupil cannot be identified due to blinking, etc. In such cases, the pupil index calculation unit 40 linearly supplements the pupil area obtained from static images where the pupil can be identified before and after the moment when the pupil cannot be identified, generating a waveform of the pupil area. Furthermore, the pupil index calculation unit 40 calculates the twelve pupil indices described above.

[0066] As described above, even with blinking, pupil area waveform data can be generated through supplementation. However, excessive blinking can reduce pupil measurement accuracy. Therefore, if the pupil index calculation unit 40 determines that the number of still images in which pupil identification is unsuccessful exceeds a predetermined threshold, it transmits an instruction signal to the server 30 or terminal device 50 to display a message prompting re-measurement.

[0067] Figure 5 : is a diagram showing the functional structure of the terminal device. The terminal device 50 has: a communication unit 54, which receives the analysis results analyzed by the server 30, that is, the evaluation results or suggestions of the neurological state, and other data, and sends the subject information to the server 30; and a display unit 56, which displays the evaluation results of the neurological state, comments on the evaluation results, suggestions, etc. The display unit 56 displays a plurality of pupil indices or neurological states at different times, or displays the changes in pupil indices or neurological states at different times. For example, the display unit 56 displays a plurality of pupil indices or neurological states calculated based on data obtained by measuring the pupils at different times before and after receiving a massage, or displays the changes in pupil indices or neurological states before and after a massage. Therefore, the user or subject of the present neurological state evaluation system can confirm the effect of a massage, for example, based on the visualized display information.

[0068] The terminal device 50 also includes a receiving unit 65 for receiving input of subject information from the subject; a storage unit 53 for storing the input subject information, neurological status estimation results, and the like; and a data processing unit 60 for processing data for rendering and function control. Furthermore, the terminal device 50 includes an output unit 61 for outputting the stored information.

[0069] The storage unit 53 includes an information storage unit 62 for storing information such as text input by the subject, a dynamic image data storage unit 63 for storing dynamic image data, and a result storage unit 64 for storing pupil area waveform data, neurological status evaluation results, suggestions, and the like.

[0070] The data processing unit 60 includes a screen drawing unit 53 that causes the display unit 56 to display the analysis result, and a function control unit 66 that controls the functions of the terminal device 50 .

[0071] FIG6(A) is a diagram showing an input screen on the terminal device side of the nerve state evaluation system.

[0072] (B) is a diagram showing a screen for accepting the start of measurement on the terminal device side of the nervous state evaluation system.

[0073] As shown in FIG6(A), the input screen on the terminal device side of the neurological status evaluation system is provided with a column for filling in the subject's name, a check box for gender, a column for filling in date of birth, and columns for filling in height, weight, contact information, and self-declaration. After the input is completed, the input information is confirmed by touching the confirm input button, and the screen shown in FIG6(B) is switched. In the screen shown in FIG6(B), the images of the subject's left and right pupils are displayed. After the subject determines that the pupil is located near the center of the image and is in a state that can be measured, the pupil meter 10 starts measuring by touching the start measurement button. However, the instruction to start the measurement can also be a method of instructing the server 30 to start the measurement.

[0074] Figure 7 This figure shows a measurement result display screen on a terminal device. The display screen displays a waveform indicating changes in pupil area, numerical values ​​of key pupil indices, neurological status estimation results, and neurological age. Multiple measurement results can be displayed for the waveform indicating changes in pupil area and the numerical values ​​of key pupil indices. In particular, the display screen displays the numerical values ​​and waveforms of pupil indices at different times on the same screen, allowing users, including subjects, to understand changes in neurological status between the first and second measurements based on the differences (changes) in multiple measurement results.

[0075] For example, by measuring the pupils of a stressed subject before and after a massage, the subject and the massage provider can confirm the relaxation effect of the massage on the subject in the form of visual information.

[0076] Furthermore, when targeting athletes, measurements taken before and after competition can be used to detect pain that the athlete is not aware of based on the pupillary waveform. In cases of sprains, for example, repeated spikes may be observed during pupil size recovery, but the athlete may not feel any pain. This approach is also effective in detecting symptoms that could lead to serious problems.

[0077] The "display of multiple pupil indicators or neural states at different times, or display of changes in the pupil indicators or neural states at different times" stated in the claims not only includes displaying in the same screen, but also includes the following content: by displaying pupil indicators or neural states at different times in multiple screens after screen conversion, the neural states at different times can be displayed comparably.

[0078] exist Figure 7 In the display screen shown, there is a check box in the display column of each measured value. By touching the button to delete the selected measurement data, the checked data can also be deleted.

[0079] In addition, by touching the Show Suggestion button, convert to Figure 8 The screen shown shows a suggestion.

[0080] Figure 8 This figure shows the advice display screen of a terminal device. The advice column displays comments describing the current neurological status, comments regarding the change between the first and second neurological status measurements, and comments regarding improvement measures. Furthermore, the neurological age comment column displays comments comparing neurological age to actual age and comments regarding the change between the first and second neurological age measurements.

[0081] Furthermore, by touching a button for returning to the screen displaying the measurement results, the screen can be switched to the screen displaying the measurement results, or by touching a button for saving the measurement results, the measurement data and the estimation result data can be saved in the storage unit 53 .

[0082] [Processing of the Neurological Status Evaluation System]

[0083] Next, the processing of the nervous state evaluation system 1 will be described.

[0084] Figure 9 、 Figure 11 is a flowchart showing the processing flow of the terminal device, Figure 10 It is a flowchart showing the processing flow of the server. Figure 9 The process is shown until the moving image data captured by the pupillometer 10 is transmitted to the server 30 and the terminal device 50 and whether or not re-measurement is required is confirmed. Figure 10 The flowchart of the process of evaluating the neurological state based on the pupil dynamic image data and the subject information transmitted from the pupillometer 10 is shown. Figure 11 The process is shown until the terminal device receives the analysis result from the server 30 and displays the analysis result.

[0085] [Processing of Terminal Device Until Pupil Measurement Completion (First Process)]

[0086] like Figure 9 As shown, Figure 5 The function control unit 66 shown starts the application of the neurological status evaluation system after the subject receives the start instruction (step 101). Then, the screen drawing unit 53 outputs the input screen shown in Figure 6 (step 102). The subject enters the subject's name, date of birth, height, weight, gender, self-declared subject information, etc. in the input screen shown in Figure 6. The information storage unit 62 stores the entered subject information (step 103). Then, the function control unit 66 sends the entered subject information to the server 30 via the communication unit 54 (step 104). When the start measurement button is touched, the function control unit 66 sends an instruction to start measurement to the pupillometer 10 (step 105). The pupillometer 10, which receives the instruction to start measurement, sends dynamic image data to the server 30 and the terminal device 50. The terminal device 50 obtains the dynamic image data from the pupillometer 10 or the server 30 and stores it in the dynamic image data storage unit 63 (step 106). Then, when the terminal device 50 receives an instruction signal to measure again from the server, it instructs the pupillometer 10 to start measurement. Otherwise, the first process of the terminal device 10 ends.

[0087] [Parsing processing in the server]

[0088] Next, the processing of the server 30 will be described.

[0089] Figure 102 is a flowchart showing the processing flow of the server 30. The server 30 receives the dynamic image data of the pupil of the subject and the subject information from the pupil meter 10 or the terminal device 50 (step 201). The subject information storage unit 45 stores the subject information, and the analysis result storage unit 46 stores the dynamic image data (step 202). The pupil index calculation unit 40 calculates the waveform data and pupil index of the pupil area based on the received dynamic image data (step 203). The state estimation unit 41 estimates the neural state based on the pupil index (step 204). The comment generation unit 43 generates comments based on the estimated neural state and the comparison between the last and current measurement results (step 205). The improvement measure generation unit 44 generates suggestions such as improvement measures (step 206). Furthermore, the communication unit 34 sends the waveform of the pupil area, the pupil index, the neural state estimation result and the suggestions to the terminal device 50 (step 207).

[0090] [Processing of the Terminal Device After Receiving the Nervous State Estimation Result from the Server]

[0091] like Figure 11 As shown, the terminal device 50 receives pupil area waveform data, pupil indices, neurological status estimation results, and recommendations from the server 30 (step 301). The screen drawing unit 53 of the terminal device 10 displays the pupil area waveform, pupil indices, and neurological status estimation results received from the server 30 (step 302). Next, the screen drawing unit 53 displays the recommendations in response to the subject's screen transition instruction (step 303). The subject instructs the output unit 61 to generate the analysis report as a PDF file or print the report (step 304).

[0092] As described above, the nervous state evaluation system 1 according to this embodiment can provide the user or the subject with the evaluation result of the nervous state of the subject by performing motion analysis on a moving image obtained by capturing the pupils of the subject.

[0093] This embodiment is described with the subject as the user of the neurological status evaluation system 1. However, the system can also be used by users other than the subject. For example, the subject can be an employee of a company, and the user can be a departmental member or a doctor who manages the employee's health. The user can also use the neurological status evaluation system 1 by operating the server 30 or the terminal device 50.

[0094] In this embodiment, the pupillometer 10, server 30, and terminal device 50 are described separately for their respective functions. However, the present invention is not limited to explaining in which of the pupillometer 10, server 30, and terminal device 50 each function resides. The neurological state assessment system of the present invention can also be configured so that the pupillometer 10 or the terminal device 50 performs some or all of the functions previously performed by the server 30. Furthermore, the pupillometer 10 and terminal device 50 can function as an integrated device even without being connected via the network 70. Furthermore, if the processing power and storage capacity of the terminal device can be sufficiently ensured, a system can also be configured so that all of the processing performed by the server 30 is performed by the terminal device 50.

[0095] In this embodiment, the imaging unit 17 can use a non-distortion lens with less distortion. Generally, the lens produces distortion and blurring due to the fact that the light passing through the lens is not focused on one point. The phenomenon that the shape on the object plane and the shape on the image plane are not similar is called "distortion aberration (distortion)", which manifests as a phenomenon of image distortion. Figure 12 As shown in (A), when the image shrinks towards the end, it is called barrel distortion. Figure 12 In (B), the more the end of the image is elongated, it is called pincushion distortion. In pupil measurement, due to the distortion aberration of the lens of the camera unit 17, for example, the area of ​​the elongated part of the image becomes larger, and the area of ​​the contracted part becomes smaller. When displaying the image of the pupil, when the number of pixels corresponding to the pupil is counted to calculate the area, the elongated part of the image will be counted too much, and the contracted part will be counted too little. That is, when distortion occurs in the image due to the elongation or contraction of a part of the image, if you want to calculate it by counting the area of ​​the object reflected in the image using pixels, the error becomes larger. That is, it is difficult to accurately calculate the pupil area based on the distorted image data. Figure 12 In (C), the object that was originally a square grid is distorted into a barrel-shaped image. If one attempts to calculate the area of ​​a square grid using the number of pixels, the grid area in the peripheral part will be too small compared to the central part.

[0096] In this embodiment, a distortion-free lens with little distortion is used for measurement. Figure 12As shown in (D), since the distortion of the distortion-free lens is small, the image forms an accurate similar shape of the real object. Therefore, the pupil area can be calculated based on the image captured by the distortion-free lens. Specifically, the pupil index calculation unit 40 counts the number of pixels corresponding to the pupil based on the image data obtained by capturing the pupil with the distortion-free lens, thereby calculating the pupil area. The count value of the number of pixels is not the absolute value of the pupil area, but rather represents the value after the pupil area is converted to a certain scale. Therefore, the rate of change of the value obtained by counting the pixels corresponding to the pupil based on the pupil image captured by the distortion-free lens can be measured as the accurate rate of change of the pupil area.

[0097] Conventionally, when measuring with an anamorphic lens, the center of the pupil must be positioned in the center, where distortion is minimal, for imaging. If the pupil position in the captured image is offset, this can cause errors in the calculation of pupil velocity and mydriasis velocity. However, as described above, by calculating the rate of change in the number of pixels corresponding to the pupil in a pupil image captured with a non-anamorphic lens, it is possible to accurately calculate the maximum mydriasis velocity (VD) and the maximum mydriasis velocity (VC).

[0098] In this embodiment, the subject's inputted chronological age can be compared with their neural age to provide recommendations. For example, if their neural age is five years higher than their chronological age, they can be informed that their concentration is poor and their performance is poor. Conversely, if their neural age is five years lower than their chronological age, their concentration is high and their performance is good.

[0099] In addition, in this embodiment, pupillary indices can also be calculated based on the left and right pupils of the subject, and the neural age of each of the left and right pupils can be calculated. In the case of a normal person, there will not be a big difference in the neural age of the left and right pupils. However, in the case of a situation where there is a hidden danger in the function of half of the body (such as pain in the right foot), there is a situation where the left-right difference increases. When the difference between the left and right pupils deviates from a certain value or more, it is possible to issue an alarm or other suggestions.

[0100] Pupil dilation (mydriasis) is achieved through the action of the sympathetic nervous system, while pupil constriction (miosis) is achieved through the action of the parasympathetic nervous system. Therefore, the maximum value of the pupil dilation velocity (VD) and the maximum value of the pupil constriction velocity (VC) can serve as indicators of the status of the sympathetic and parasympathetic nervous systems.

[0101] Here, "sympathetic age," like the simple neurological age described above, is an indicator that indicates the age of a subject's neurological function level based on age-specific standard functional levels. It is calculated based on pupil indices of sympathetic innervation. For example, sympathetic age is calculated based on the maximum value of pupil dilation velocity (VD). Furthermore, in this specification, sympathetic age may also be referred to as sympathetic nerve neurological age.

[0102] On the other hand, similar to the simple neurological age described above, the "parasympathetic age" indicates the age of a subject's neurological function level based on age-specific standard functional levels. It is an indicator calculated based on pupil indices of parasympathetic innervation. For example, the parasympathetic age is calculated based on the maximum value of the pupillary constriction velocity (VC). In this specification, the parasympathetic age is sometimes referred to as the parasympathetic neural age.

[0103] For example, Figure 13 This figure shows a measurement result display screen on a terminal device. This measurement result display shows the following: the neural age calculated from the left pupil is 36.9 years old, the neural age calculated from the right pupil is 27.4 years old, the sympathetic nerve age calculated from the left pupil is 35.4 years old, the sympathetic nerve age calculated from the right pupil is 22.3 years old, the parasympathetic nerve age calculated from the left pupil is 38.5 years old, and the parasympathetic nerve age calculated from the right pupil is 32.5 years old.

[0104] The measurement results show that the sympathetic nerve age (22.3 years) calculated from the right pupil is over ten years younger than the sympathetic nerve age (35.4 years) calculated from the left pupil and the parasympathetic nerve age (32.5 years) calculated from the right pupil. By comparing and displaying the nerve ages of the left and right pupils, as well as the sympathetic and parasympathetic nerves, it is possible to determine whether there are any imbalances. If there is a lack of left-right balance or sympathetic-parasympathetic balance, the device of the present invention can issue an alarm or display a warning or advice to the subject, as data indicating some physical abnormality.

[0105] In addition, Figure 13 While the neural age of the left and right sympathetic and parasympathetic nerves is displayed based on the measurement results at a certain time, the neural age of the left and right sympathetic and parasympathetic nerves at each measurement time can also be displayed based on the measurement results at different times. Furthermore, the changes in the neural age of the left and right sympathetic and / or parasympathetic nerves can also be displayed.

[0106] When evaluating neural age by averaging the left and right pupil measurement results, or when evaluating it as neural age without distinguishing between sympathetic and parasympathetic nerves, even if an abnormality exists in either the left or right pupil, or in either the sympathetic or parasympathetic nerves, it is difficult to notice the abnormal change. By displaying the neural age of both the left and right pupils, or displaying both the sympathetic and parasympathetic nerves, for example, an abnormality in the neural age of the left parasympathetic nerve can be detected. This allows for a more detailed understanding of the subject's neural state by displaying not only a simple neural age indication based on measurements at a specific point in time, but also the neural age of the sympathetic and parasympathetic nerves for each left and right pupil, and their temporal changes.

[0107] [Explanation of symbols]

[0108] 1: Neurological status evaluation system; 10: Pupilometer; 11: Control unit; 12: Memory; 13: Storage unit; 14: Communication unit; 15: Operation unit; 16: Light irradiation unit; 16a: Visible light irradiation unit; 16b: Infrared light irradiation unit; 17: Camera unit; 30: Server; 31: Control unit; 32: Memory; 33: Storage unit; 34: Communication unit; 35: Operation unit; 36: Display unit; 37: Display control unit; 38: Acceptance unit; 39: Data processing unit; 40: Pupil index calculation unit; 41: State estimation unit; 42: Model generation unit; 43: Comment generation unit; 44 : Improvement measure generation unit; 45: Subject information storage unit; 46: Analysis result storage unit; 47: Learning-related data storage unit; 48: Dynamic image data acquisition unit; 49: Analysis result output unit; 50: Terminal device; 51: Control unit; 52: Memory; 53: Storage unit; 54: Communication unit; 55: Operation unit; 56: Display unit; 57: Display control unit; 58: Camera unit; 60: Data processing unit; 61: Output unit; 62: Information storage unit; 63: Dynamic image data storage unit; 64: Result storage unit; 65: Acceptance unit; 66: Function control unit; 70: Network.

Claims

1. A neural status evaluation system, characterized in that: have: a light irradiation unit that irradiates light to the pupil of the subject; an acquisition unit configured to acquire dynamic image data obtained by photographing the pupil of the subject; a calculation unit, configured to calculate a pupil index based on the dynamic image data; a state evaluation unit that evaluates the sympathetic nerve age and parasympathetic nerve age of the subject based on the pupil index; as well as A display unit displays the sympathetic nerve age and the parasympathetic nerve age.

2. The neural status evaluation system according to claim 1, characterized in that: The state evaluation unit evaluates the left and right sympathetic nerve ages and the parasympathetic nerve ages based on the left and right pupil indices of the subject, The display unit displays the sympathetic nerve age and the parasympathetic nerve age on each of the left and right sides.

3. The neural status evaluation system according to claim 1, characterized in that: The acquisition unit acquires dynamic image data captured by a distortion-free lens, The calculation unit calculates the pupil index by counting pupil-related pixels in the captured dynamic image data.

4. The neural status evaluation system according to claim 1, characterized in that: The display unit displays a plurality of the sympathetic nerve ages and the parasympathetic nerve ages at different times, or displays changes in the sympathetic nerve age or the parasympathetic nerve age at different times.

5. The neural state evaluation system according to any one of claims 1 to 4, characterized in that: have: an advice generating unit that generates advice for the subject based on the sympathetic nerve age and the parasympathetic nerve age, The display unit displays the suggestion.

Images