Visuospatial cognitive processing system, visuospatial cognitive processing method, and program

Abstract

To realize a visuospatial cognitive processing system that appropriately and accurately performs examinations and training for complex visual cognitive impairments caused by multiple factors, without placing an excessive burden on patients and while taking into account the individual characteristics of each patient. [Solution] The visuospatial cognitive processing system sets stimulus rules considering the individual patient's attributes, generates various virtual objects based on the set stimulus rules, and displays them in a virtual 3D space using various parameters. For example, by obtaining responses from the patient, the system can perform visuospatial cognitive testing with high accuracy. In other words, this visuospatial cognitive processing system has the function of generating various virtual objects and displaying them in a virtual 3D space simply by setting parameters according to the patient's attributes, so that appropriate testing can be performed. This allows for highly accurate testing of visual cognitive impairments caused by complex factors that result in multiple impairments.

Description

[Technical Field]

[0001] This invention relates to visuospatial cognitive processing technology. [Background technology]

[0002] Brain damage caused by stroke, such as cerebral infarction or cerebral hemorrhage, as well as trauma, can lead to various cognitive impairments. Visual cognitive impairments can manifest in many forms, including prosopagnosia (a condition where a person can correctly recognize individual features like eyes and noses but cannot recognize a face), which is widely known. Because these symptoms occur due to impaired brain function even when there are no problems with vision, it is difficult for third parties without specialized knowledge to understand the situation, and the person themselves may not even be aware of their symptoms. In some cases, this can lead to misperception, where the condition is less severe than it actually is, resulting in difficulties with daily living activities.

[0003] Currently, various studies and proposals are being made for testing cognitive function, and for individual tests, there are often methods and testing equipment with sufficient performance. However, cognitive impairment often manifests as a complex interplay of multiple impairments, and the severity of the impairment varies greatly from patient to patient. Furthermore, stroke patients often also have impairments in motor function, for example, many patients have difficulty maintaining a seated position for extended periods. Generally, tests with a large number of trials can yield more accurate results, but for patients in such conditions, undergoing the test itself can be extremely distressing, and in some cases, the reliability of the test results may be compromised.

[0004] One type of visual cognitive impairment is called hemispatial neglect. Hemispatial neglect is a condition in which, although there are no problems with visual acuity, damage to the cerebral hemisphere impairs the ability to detect, report, react to, or turn towards stimuli on the opposite side of the hemispatial lesion (Heilman, KM. et al., 2003). Hemispatial neglect is known to have two forms: (1) "egocentric spatial neglect," in which, when the right hemisphere of the brain is damaged, the patient is unable to recognize the left side of their field of vision despite being able to see; and (2) "object-centered neglect," in which the patient is unable to recognize the left half of individual objects in their field of vision, for example, the left half of each of the dishes on multiple plates in their field of vision. The mechanism by which hemispatial neglect occurs is still being researched, but the lesions of object-centered neglect, for example, are not yet fully understood. Therefore, in treatment, it is necessary to examine the patient by presenting them with visual stimuli and obtaining their reactions, and to understand their cognitive state from the results.

[0005] As mentioned earlier, cognitive impairment can manifest as a combination of multiple symptoms, so it's not possible to determine the results using simple rules after presenting pre-prepared, static stimuli in sequence, as is the case with visual acuity tests using Landolt rings. For example, some patients may have no cognitive problems when tested on paper, but develop hemispatial neglect in real space, while others may not show symptoms within reach but only in spatially unreachable areas. In addition, exploratory neglect, stemming from a lack of persistence in searching ("it should still be on the left"), may be observed rather than perceptual neglect, and this can sometimes be misdiagnosed as hemispatial neglect. Conversely, in patients with hemispatial neglect whose verbal IQ is maintained, they may be able to draw half of a clock face or copy a cube, even though they should not be able to perceive it.

[0006] Currently, the most common tests for hemispatial neglect are those like the Behavioural Inattention Test, where the examiner manipulates paper or objects in front of the patient and observes their responses. These tests generally require about 45 minutes, which can be burdensome for patients who cannot tolerate continuous, long-term testing. Furthermore, these tests are basically for screening purposes and do not allow for the creation of customized stimuli for each patient. As a result, the granularity of the test results can be low, and it can be difficult to determine the contributing factors when multiple factors are influencing the results.

[0007] In recent years, there have been attempts to use electronic devices to test for hemispatial neglect. For example, the technology disclosed in Patent Document 1 displays points (visual stimuli) at random positions in a virtual three-dimensional space and records whether or not the patient perceived them, thereby allowing for the examination of the range of neglect as a visual field, including distal and proximal areas, and enabling the testing of egocentric spatial neglect. [Prior art documents] [Patent Documents]

[0008] [Patent Document 1] Japanese Patent Publication No. 2020-156956 [Overview of the project] [Problems that the invention aims to solve]

[0009] However, the technology disclosed in Patent Document 1 is limited to testing for egocentric spatial neglect and cannot test for object-centered neglect. Furthermore, it does not use individual patient attributes as parameters. Therefore, when complex disorders are present, it is difficult to test for the complex factors causing the complex disorders while taking into account the individual patient's attributes.

[0010] Therefore, in view of the above problems, the present invention aims to realize a visuospatial cognitive processing system, a visuospatial cognitive processing method, and a program that appropriately and accurately perform visuospatial cognitive processing, which includes examinations and training for visual cognitive function disorders caused by complex factors that result in complex impairments, while taking into account the individual patient's attributes and without imposing an excessive burden on the patient. [Means for solving the problem]

[0011] To solve the above problems, a representative example (one aspect) of the invention disclosed in this application is a visuospatial cognitive processing system for performing visuospatial cognitive processing on a subject by displaying virtual objects in a virtual three-dimensional space, comprising: a patient attribute data storage unit; an attribute data acquisition unit; a stimulus rule data storage unit; a stimulus rule setting unit; a display object generation processing unit; a display processing unit; and a three-dimensional display unit.

[0012] The patient attribute data storage unit is a functional unit for storing the patient attribute data of the subject.

[0013] The attribute data acquisition unit acquires patient attribute data of the subject from the attribute data storage unit.

[0014] The stimulus rule data storage unit is a functional unit for storing stimulus rule data, which is data about rules for generating virtual objects based on patient attribute data.

[0015] The stimulus rule setting unit retrieves stimulus rule data suitable for performing visuospatial cognitive processing on the subject from the stimulus rule data storage unit based on the patient attribute data of the subject acquired by the attribute data acquisition unit, and sets the stimulus rule data to be used when performing visuospatial cognitive processing on the subject.

[0016] The display object generation processing unit determines virtual object parameters, which are parameters for determining the virtual object to be displayed in the virtual 3D space, based on the patient attribute data of the subject acquired by the attribute data acquisition unit and the stimulus rule data set by the stimulus rule setting unit.

[0017] The display processing unit acquires virtual object display data, which is the display data for virtual objects to be displayed in the virtual 3D space, based on the parameters determined by the display object generation processing unit.

[0018] The 3D display unit performs processing to display virtual objects in a virtual 3D space based on the virtual object display data acquired by the display processing unit. [Effects of the Invention]

[0019] According to the present invention, a visuospatial cognitive processing system, a visuospatial cognitive processing method, and a program can be realized that perform visuospatial cognitive processing, which includes examinations and training for visual cognitive impairments caused by complex factors that result in complex disorders, appropriately and with high accuracy, without placing an excessive burden on the patient and while taking into account the individual patient's attributes. [Brief explanation of the drawing]

[0020] [Figure 1] A schematic diagram of the visuospatial cognitive processing system 1000 according to the first embodiment. [Figure 2] A schematic diagram of the 3D display device 200 of the visuospatial cognitive processing system 1000 according to the first embodiment. [Figure 3] This figure illustrates the case in which an image (video) of a virtual three-dimensional space is displayed in the visuospatial cognitive processing system 1000 according to the first embodiment. [Figure 4] This diagram schematically shows the virtual 3D space SP_3D and the 3D virtual object V_obj1 displayed within the virtual 3D space SP_3D in the visuospatial cognitive processing system 1000. [Figure 5]A flowchart of the processes performed by the visuospatial cognitive processing system 1000. [Figure 6] A flowchart of the processes performed by the visuospatial cognitive processing system 1000. [Figure 7] A diagram showing an example of a 3D virtual object generated from visual stimulus data. [Figure 8] A schematic diagram showing the virtual three-dimensional space displayed by the processing performed by the visuospatial cognitive processing system 1000. [Figure 9] A schematic diagram showing the virtual three-dimensional space displayed by the processing performed by the visuospatial cognitive processing system 1000. [Figure 10] A schematic diagram showing the virtual three-dimensional space displayed by the processing performed by the visuospatial cognitive processing system 1000. [Figure 11] A schematic diagram showing the virtual three-dimensional space displayed by the processing performed by the visuospatial cognitive processing system 1000. [Figure 12] A schematic diagram showing the virtual three-dimensional space displayed by the processing performed by the visuospatial cognitive processing system 1000. [Figure 13] A schematic diagram showing the virtual three-dimensional space displayed by the processing performed by the visuospatial cognitive processing system 1000. [Figure 14] A schematic diagram showing the virtual three-dimensional space displayed by the processing performed by the visuospatial cognitive processing system 1000. [Figure 15] A schematic diagram showing the virtual three-dimensional space displayed by the processing performed by the visuospatial cognitive processing system 1000. [Figure 16] This figure shows an example of judgment result data obtained by processing performed by the visuospatial cognitive processing system 1000. [Figure 17] This figure shows an example of judgment result data obtained by processing performed by the visuospatial cognitive processing system 1000. [Figure 18] This figure shows an example of judgment result data obtained by processing performed by the visuospatial cognitive processing system 1000. [Figure 19]This figure shows an example of judgment result data obtained by processing performed by the visuospatial cognitive processing system 1000. [Figure 20] A schematic diagram of the visuospatial cognitive processing system 2000 according to the second embodiment. [Figure 21] A schematic diagram showing the virtual three-dimensional space displayed by the processing performed by the visuospatial cognitive processing system 2000. [Figure 22] A schematic diagram showing the virtual three-dimensional space displayed by the processing performed by the visuospatial cognitive processing system 2000. [Figure 23] A schematic diagram showing the virtual three-dimensional space displayed by the processing performed by the visuospatial cognitive processing system 2000. [Figure 24] A schematic diagram showing the virtual three-dimensional space displayed by the processing performed by the visuospatial cognitive processing system 2000. [Figure 25] A schematic diagram showing the interface of egocentric spatial neglect estimated by processing performed by the visuospatial cognitive processing system 2000. [Figure 26] A diagram showing the CPU bus configuration. [Modes for carrying out the invention]

[0021] [First Embodiment] The first embodiment will be described below with reference to the drawings.

[0022] <1.1: Configuration of the Visuospatial Cognitive Processing System> Figure 1 is a schematic diagram of the visuospatial cognitive processing system 1000 according to the first embodiment.

[0023] Figure 2 is a schematic diagram of the 3D display device 200 of the visuospatial cognitive processing system 1000 according to the first embodiment.

[0024] Figure 3 is a diagram illustrating the case in which an image (video) of a virtual three-dimensional space is displayed in the visuospatial cognitive processing system 1000 according to the first embodiment.

[0025] The visuospatial cognitive processing system 1000 includes, for example, a visuospatial cognitive processing device 100 and a three-dimensional display device 200, as shown in Figure 1.

[0026] (1.1.1: Configuration of a visuospatial cognitive processing device) As shown in Figure 1, the visuospatial cognitive processing device 100 includes an input unit 11, an attribute data acquisition unit 12, a patient attribute data storage unit DB1, a stimulus rule setting unit 13, a stimulus rule data storage unit DB2, a response input acquisition processing unit 14, a display object generation processing unit 15, a display processing unit 16, a two-dimensional display unit 17, and a judgment processing unit 18.

[0027] The input unit 11 is a functional unit for inputting data to the visuospatial cognitive processing device 100. For example, the user (examiner) inputs data to identify the subject (patient) (for example, data about the ID for identifying the subject (patient)) as data Din to the input unit 11. The input unit 11 outputs the input data as data D1 to the attribute data acquisition unit 12.

[0028] The attribute data acquisition unit 12 receives data D1 output from the input unit 11. The attribute data acquisition unit 12 can also read data specified by the data read command from the patient attribute data storage unit DB1 by outputting a data read command to the patient attribute data storage unit DB1. The attribute data acquisition unit 12 generates a data read command to read the patient attribute data (patient attribute data) identified by data D1, outputs the data read command to the patient attribute data storage unit DB1, and reads (acquires) the patient attribute data (patient attribute data) identified by data D1 from the patient attribute data storage unit DB1. The attribute data acquisition unit 12 then outputs the data including the acquired data (patient attribute data) as data D_p_attri to the stimulus rule setting unit 13 and the display object generation processing unit 15.

[0029] The patient attribute data storage unit DB1 is a functional unit capable of storing and holding data, and is implemented, for example, using a database. The patient attribute data storage unit DB1 receives a data read command from an external source, reads the data specified in the data read command (for example, reads data from the area (memory area) specified in the data read command), and outputs it. The patient attribute data storage unit DB1 also receives a data write command from an external source, and writes the data specified in the write command to the area (memory area) specified in the data write command. In this embodiment, patient attribute data is stored in the patient attribute data storage unit DB1.

[0030] The stimulus rule setting unit 13 receives the data D_p_attri output from the attribute data acquisition unit 12. The stimulus rule setting unit 13 can also read the data specified by the data read command from the stimulus rule data storage unit DB2 by outputting a data read command to the stimulus rule data storage unit DB2. Based on the data D_p_attri, the stimulus rule setting unit 13 identifies the data to be read from the stimulus rule data storage unit DB2 (data about the stimulus rule (stimulus rule data)), generates a data read command to read that data, outputs the data read command to the stimulus rule data storage unit DB2, and reads (acquires) the data (stimulus rule data) identified by the data read command from the stimulus rule data storage unit DB2. The stimulus rule setting unit 13 then outputs the data including the data acquired above (stimulus rule data) as data D2 to the display object generation processing unit 15.

[0031] The Stimulus Rule Data Storage Unit DB2 is a functional unit capable of storing and holding data, and is implemented, for example, using a database. The Stimulus Rule Data Storage Unit DB2 receives a data read command from an external source, reads the data specified in the data read command (for example, reads data from the area (memory area) specified in the data read command), and outputs it. The Stimulus Rule Data Storage Unit DB2 also receives a data write command from an external source, and writes the data specified in the write command to the area (memory area) specified in the data write command. In this embodiment, the Stimulus Rule Data Storage Unit DB2 stores stimulus rule data (data about stimulus rules).

[0032] The response input acquisition processing unit 14 is a functional unit for automatically or manually acquiring responses from the subject (patient). The response input acquisition processing unit 14 receives data D3 output from the display object generation processing unit 15. The response input acquisition processing unit 14 acquires the subject (patient)'s response data, determines whether the subject (patient)'s response is correct or incorrect based on the acquired response data and data D3, and outputs data including the result of the correctness determination as data Dr1 to the display object generation processing unit 15.

[0033] Furthermore, the response input acquisition processing unit 14 is assumed to have a function that allows it to input data (data including the response content) output from a controller (for example, a controller for operating a 3D display device 200) (not shown) when the subject (patient) responds by operating the controller.

[0034] The display object generation processing unit 15 receives the data D_p_attri output from the attribute data acquisition unit 12 and the data D2 output from the stimulus rule setting unit 13. Based on the data D_p_attri (patient attribute data) and the data D2 (stimulation rule data), the display object generation processing unit 15 performs a process to generate a display object to be displayed in a virtual 3D space (display object generation process) (a process to generate a desired display object by setting parameters). The display object generation processing unit 15 then outputs the data containing the data of the display object generated by the display object generation process as data D3 to the display processing unit 16 and the response input acquisition processing unit 14.

[0035] Furthermore, the display object generation processing unit 15 receives data Dr1 output from the response input acquisition processing unit 14, performs adjustment processing for the display object generation process (for example, parameter adjustment for the display object generation process) based on data Dr1, and generates a display object through the display object generation process after the adjustment processing. The display object generation processing unit 15 then outputs data containing the data of the generated display object as data D3 to the display processing unit 16 and the response input acquisition processing unit 14.

[0036] Furthermore, the display object generation processing unit 15 performs score acquisition processing (processing to acquire evaluation values ​​(scores) based on the response content) based on data Dr1, and outputs the data including the score acquired through this process as data Dr11 to the judgment processing unit 18.

[0037] The display processing unit 16 receives data D3 output from the display object generation processing unit 15 and generates (acquires) display data to be displayed in the virtual 3D space based on the data D3. The display processing unit 16 then outputs the data containing the generated display data as data D_disp to the 3D display device 200. The display processing unit 16 also generates image data (an image obtained by projecting the 3D image onto a predetermined plane) for displaying the display data to be displayed in the virtual 3D space on a 2D screen, and outputs the data containing this image data as data D_2D to the 2D display unit 17.

[0038] The 2D display unit 17 receives the data D_2D output from the display processing unit 16 and displays the image data (2D image data) contained in the data D_2D. The 2D display unit 17 is a functional unit (display device) for the examiner to monitor the 3D image displayed to the subject (patient) as a 2D image.

[0039] The judgment processing unit 18 receives the data Dr11 output from the display object generation processing unit 15, obtains the score (evaluation value) contained in the data Dr11, and performs a process (judgment process) to obtain the inspection result data based on that score. The judgment processing unit 18 then outputs (obtains) the data including the result data of the judgment process as data D_rslt.

[0040] Furthermore, when the examination process or training process for the subject (patient) is completed (or when the data D_rslt is acquired), the judgment processing unit 18 acquires data including the result data of the examination process or the result data of the training process (including the answer content for each examination item, the correctness result data of the answer content, the total evaluation value, patient attribute data, and patient posture data (time-series data of the patient's posture) (the patient posture data is output from the answer input acquisition processing unit 14 to the judgment processing unit 18 via the display object generation processing unit 15)) as data D_rslt_all, outputs the acquired data D_rslt_all to the patient attribute data storage unit DB1, and stores the data D_rslt_all in the patient attribute data storage unit DB1 (a data write command is output to the patient attribute data storage unit DB1, and the data D_rslt_all is stored (written) in the patient attribute data storage unit DB1).

[0041] Furthermore, "posture" refers to the stance of the body and is a concept that includes both body position and attitude, and also includes the position, state, and relationship with the center of gravity of any part of the body. "Posture" is a concept that includes, for example, the direction of the gaze, the position and orientation of the head, the position and orientation of the face, etc. And "posture data" is a concept that refers to data about the above-mentioned "posture".

[0042] (1.1.2: Configuration of a 3D display device) The 3D display device 200 is a device for displaying objects in a virtual 3D space (or displaying virtual objects in a real 3D space by combining them), and is implemented using, for example, an HMD (Head Mounted Display) device (e.g., VR goggles (VR: Virtual Reality), MR goggles (MR: Mixed Reality), AR goggles (AR: Augmented Reality), etc.).

[0043] As shown in Figure 2, the 3D display device 200 comprises an input / output interface unit 21, a control unit 22, a memory 23, a spatial sensor 24, a left-eye display 25, a right-eye display 26, and a bus Bus 1. The input / output interface unit 21, the control unit 22, the memory 23, the spatial sensor 24, the left-eye display 25, and the right-eye display 26 are connected to the bus Bus 1 and can transmit and receive data, etc. (e.g., data, commands, control signals, etc.) to and from each other via the bus Bus 1. Note that one or more of the above-mentioned functional units may be directly connected and configured to transmit and receive data, etc. (e.g., data, commands, control signals, etc.) to and from each other.

[0044] The input / output interface unit 21 is an interface for inputting and outputting (sending and receiving) data (e.g., data, commands, control signals, etc.) to and from the outside. The input / output interface unit 21 receives data D_disp output from the display processing unit 16 of the visuospatial cognitive processing device 100, outputs the data D_disp to the memory 23 via the bus Bus1, and stores it in the memory 23.

[0045] The control unit 22 is a functional unit for controlling each functional part of the 3D display device 200, and is implemented, for example, using a CPU or processor.

[0046] Memory 23 is a storage unit capable of storing predetermined data.

[0047] The spatial sensor 24 is a sensor for acquiring information (position, orientation, etc.) within the three-dimensional space of the three-dimensional display device 200.

[0048] The left-eye display 25 is a display unit for the left eye that performs virtual three-dimensional display, and is a display unit that displays an image (video) seen by the user's (patient's (subject's)) left eye. The left-eye display 25 is controlled by the control unit 22 (controlled to display a virtual three-dimensional image (virtual three-dimensional video) based on the data D_disp) to display a left-eye image (left-eye video) for displaying a predetermined virtual three-dimensional image (virtual three-dimensional video) on its display surface (for example, a display surface installed in a position opposite the user's left eye).

[0049] For example, as shown in Figure 3 (a view of a virtual 3D space from above, assuming that the x, y, and z axes are set as in Figure 3), the position of the user's left eye is pL, the position of the right eye is point pR, a virtual plane (virtual screen) V_scr (xz plane) (d2 is the distance from the xz plane containing the viewpoints pL and pR) is set up as in Figure 3, and a virtual object V_obj (center position p1, d1 is the distance from the xz plane containing the viewpoints pL and pR) is set up as in Figure 3, then the left eye display 25 has point pL, a straight line V_p1 parallel to the z axis on the virtual plane V_scr, and the virtual plane V_ The image (video) of the space enclosed by the line V_p6 parallel to the z-axis on the virtual plane V_scr is projected onto the display surface (xz plane) of the left eye display 25, thereby processing to display the image (video) of the state shown in Figure 3 in virtual 3D. (For the virtual object V_obj0, the image (video) corresponding to the virtual object V_obj0 is displayed on the display surface of the left eye display 25 by projecting the space enclosed by point pL, the line V_p3 parallel to the z-axis on the virtual plane V_scr, and the line V_p5 parallel to the z-axis on the virtual plane V_scr onto the display surface (xz plane) of the left eye display 25.) For the sake of explanation, a virtual plane V_scr is set, but it is also possible to perform the processing to display the image (video) of the state shown in Figure 3 in virtual 3D by displaying an image (picture) of the space at infinity (the space including the space beyond the virtual plane V_scr) projected onto the display surface (xz plane) of the left eye display 25, without setting a virtual plane V_scr.

[0050] The right-eye display 26 is a display unit for the right eye that performs virtual three-dimensional display, and is a display unit that displays an image (video) seen by the user's (patient's (subject's)) right eye. The right-eye display 26 is controlled by the control unit 22 (controlled to display a virtual three-dimensional image (virtual three-dimensional video) based on the data D_disp) to display a right-eye image (right-eye video) for displaying a predetermined virtual three-dimensional image (virtual three-dimensional video) on its display surface (for example, a display surface installed in a position opposite the user's right eye).

[0051] For example, as shown in Figure 3 (a view of a virtual 3D space from above, assuming the x, y, and z axes are set as in Figure 3), if the position of the user's left eye is pL, the position of the right eye is point pR, a virtual plane (virtual screen) V_scr (xz plane) is set up as in Figure 3, and a virtual object V_obj (center position p1) is set up as in Figure 3, then the right-eye display 26 has a space on its display surface that encloses point pR, a line V_p1 parallel to the z axis on the virtual plane V_scr, and a line V_p6 parallel to the z axis on the virtual plane V_scr. The system performs processing to virtually display the image (video) of the state shown in Figure 3 in 3D by displaying an image (picture) projected onto the display surface (xz plane) of the right-eye display 26 (for the virtual object V_obj0, the system displays an image (picture) projected onto the display surface (xz plane) of the right-eye display 26 of the space surrounding point pR, a line V_p2 parallel to the z axis on the virtual plane V_scr, and a line V_p4 parallel to the z axis on the virtual plane V_scr, thereby displaying an image (picture) corresponding to the virtual object V_obj0 on the display surface of the right-eye display 26). For the sake of explanation, a virtual plane V_scr is set, but it is also possible to perform processing to virtually display the image (video) of the state shown in Figure 3 in 3D by displaying an image (picture) projected onto the display surface (xz plane) of the space at infinity (including the space beyond the virtual plane V_scr) on the display surface (xz plane) of the right-eye display 26 without setting a virtual plane V_scr.

[0052] <1.2: Operation of the Visuospatial Cognitive Processing System> The operation of the visuospatial cognitive processing system 1000, configured as described above, will be explained below with reference to the diagrams.

[0053] Figure 4 schematically shows the virtual 3D space SP_3D and the 3D virtual object V_obj1 displayed within the virtual 3D space SP_3D in the visuospatial cognitive processing system 1000.

[0054] Figures 5 and 6 are flowcharts of the processes performed by the visuospatial cognitive processing system 1000.

[0055] Figure 7 shows an example of a 3D virtual object generated from visual stimulus data.

[0056] Figures 8 to 15 schematically show the virtual three-dimensional space displayed by the processing performed by the visuospatial cognitive processing system 1000.

[0057] Figures 16 to 19 show an example of judgment result data obtained by processing performed by the visuospatial cognitive processing system 1000.

[0058] In the following, for the sake of explanation, we will describe an example where a 3D virtual object V_obj1, shown in the right-hand diagram of Figure 4, is displayed in the virtual 3D space SP_3D, shown in the left-hand diagram of Figure 4, and the object center neglect test is performed primarily. Note that the x, y, and z axes are set as shown in Figure 4 (the line of sight direction (the direction the user sees) when the user is facing forward is set to the positive direction of the y axis, as in Figure 3).

[0059] The following describes the processes performed by the visuospatial cognitive processing system 1000, referring to the flowcharts in Figures 5 and 6.

[0060] (Step S1): In step S1, data entry processing is performed. Specifically, the following processes are performed.

[0061] For example, the examiner inputs data to identify the subject (patient) (for example, data about the ID used to identify the subject (patient)) as data Din into the input unit 11. The input unit 11 then outputs the input data as data D1 to the attribute data acquisition unit 12.

[0062] (Step S2): In step S2, the attribute data acquisition process is executed. Specifically, the following processes are performed.

[0063] The attribute data acquisition unit 12 receives data D1 output from the input unit 11. The attribute data acquisition unit 12 generates a data read command to read the patient attribute data (patient attribute data) identified by data D1, outputs the data read command to the patient attribute data storage unit DB1, and reads (acquires) the patient attribute data (patient attribute data) identified by data D1 from the patient attribute data storage unit DB1.

[0064] For example, the patient attribute data of the subject (patient) Object center neglect: Yes (Level: Weak) Cerebral color blindness: Present (Level: Mild) Visual acuity: normal Dominant hand: Right Test load tolerance: Medium In this case, the attribute data acquisition unit 12 acquires the above data from the patient attribute data storage unit DB1 as the attribute data (patient attribute data) of the patient identified by data D1.

[0065] Furthermore, the patient attribute data stored in the patient attribute data storage unit DB1 may include, for example, the following types of data. (1) Data on the results of various tests already performed related to higher-order cognitive impairment (standard tests using MRI, etc., presence and location of damage through image analysis, neuropsychological tests, etc.) (2) Data on subjective symptoms and observational information, such as the Catherine Bergego Scale (an observational scale that assesses signs of unilateral spatial neglect during daily living activities. The scale is obtained by having the patient and observer answer 10 questions about the situation of daily living activities and score the severity of the symptoms). (3) Data on information that may affect the examination of color vision deficiency, etc. (4) Data on the patient's tolerance level for the burden of tests, based on their condition. The patient attribute data stored in the patient attribute data storage unit DB1 is not limited to the above and may include other data.

[0066] The attribute data acquisition unit 12 outputs the data, including the data acquired as described above (patient attribute data), as data D_p_attri to the stimulation rule setting unit 13 and the display object generation processing unit 15.

[0067] (Step S3): In step S3, the stimulus rule setting process is executed. Specifically, the following processes are performed.

[0068] The stimulus rule setting unit 13 receives the data D_p_attri output from the attribute data acquisition unit 12, identifies the data to be read from the stimulus rule data storage unit DB2 (data about the stimulus rule (stimulus rule data)) based on the data D_p_attri, and generates a data read command to read that data. The stimulus rule setting unit 13 then outputs the data read command to the stimulus rule data storage unit DB2 and reads (acquires) the data identified by the data read command (stimulus rule data) from the stimulus rule data storage unit DB2.

[0069] For example, the stimulus rule setting unit 13 extracts patient attribute data of the subject (patient) from the data D_p_attri. Object center neglect: Yes (Level: Weak) Visual acuity: normal Dominant hand: Right Test load tolerance: Medium If it determines that this is the case, the stimulus rule setting unit 13 acquires the following stimulus rule data based on the determination result. (1) Data for the stimulus rule for the object-center neglect test (general test, number of displayed objects: 1) (this will be referred to as test item d1) (2) Data for stimulus rules for the object-center neglect test (general test, number of displayed objects: multiple) (this will be referred to as test item d2) Furthermore, the stimulus rule data stored in the stimulus rule data storage unit DB2 may include, for example, the following types of data. (1) Data for stimulus rules for the object-center neglect test (general test) (the number of displayed objects may be variable) (2) Data for stimulus rules for the object center neglect test (proximal focus test) (the number of displayed objects may be variable) (3) Data for stimulus rules for the object center neglect test (distal emphasis test) (the number of displayed objects may be variable) (4) Data of stimulus rules for testing cerebral color blindness (the number of display objects may be variable) (5) Data for stimulus rules for egocentric spatial neglect (the number of displayed objects may be variable) The stimulus rule setting unit 13 outputs the data, including the data acquired as described above (stimulus rule data), as data D2 to the display object generation processing unit 15.

[0070] (Step S4): In step S4, visuospatial cognitive processing is performed. Specifically, the following processes are performed.

[0071] (Step S401): In step S401, the process for generating a visual stimulus data sequence is executed. Specifically, the following processes are performed.

[0072] The display object generation processing unit 15 receives the data D_p_attri output from the attribute data acquisition unit 12 and the data D2 output from the stimulus rule setting unit 13. Based on the data D_p_attri (patient attribute data) and the data D2 (stimulus rule data), the display object generation processing unit 15 generates a visual stimulus data sequence d i [j](i: integer, 1≦i≦Num_i, j: integer, 1≦j≦Num_j, Num_i, Num_j: natural number) is generated. At this time, the display object generation processing unit 15 calculates and obtains the data sequence that minimizes the number of test trials based on the data D_p_attri (patient attribute data) and the data D2 (stimulus rule data). For example, if the patient attribute data of the subject (patient) (data included in data D_p_attri) is, Object center neglect: Yes (Level: Weak) Visual acuity: normal Dominant hand: Right Test load tolerance: Medium This data shows that the stimulus rule data (data included in data D2) (1) Data for the stimulus rule for the object-center neglect test (general test, number of displayed objects: 1) (this will be referred to as test item d1) (2) Data for stimulus rules for the object-center neglect test (general test, number of displayed objects: multiple) (this will be referred to as test item d2) If this is the case, the display object generation processing unit 15 will generate the following visual stimulus data sequence d i Generate [j]. (Test 1): First visual stimulus data sequence (Number of displayed objects: 1, data sequence to vary the distance from the patient's viewpoint to the object in 4 steps) d1[1]~d1[4] (Test 2): Second visual stimulus data sequence (Number of display objects: 2, data sequence to vary the distance from the patient's viewpoint to the objects in 4 steps) d2[1]~d2[4] In the above, the display object generation processing unit 15 sets the parameters (adjustable variables) of the stimulus rule data, taking into consideration the patient attribute data, and the visual stimulus data column di It generates [j]. That is, the display object generation processing unit 15 sets the number of times of object display for (Test 1) and (Test 2) to a predetermined number of times (4 times in the above example) in consideration of "Tolerance to examination load: medium" in the patient attribute data, and in consideration of "Object center neglect: Yes (Level: weak)" in the patient attribute data, it generates a visual stimulus data sequence for changing the distance from the patient's viewpoint position to the object in multiple steps (4 steps in the above example) in order to accurately detect the symptom of object center neglect.

[0073] Here, a setting example (one example) of the first visual stimulus data sequence d1[1] to d1[4] and the second visual stimulus data sequence d2[1] to d2[4] is shown below. In the following, the visual stimulus data sequence d i [j] is assumed to have a data structure in which variables (parameters) can be set hierarchically, and each variable is as follows. ≪Data structure≫ d i [j].Obj.num: The number of virtual objects to be displayed d i [j].Obj k .dist: The distance to the k-th (k: natural number) virtual object d i [j].Obj k .pos: The coordinates in the 3D virtual space of the center point (center of gravity point) of the k-th (k: natural number) virtual object d i [j].Obj k .color: The color of the k-th (k: natural number) virtual object d i [j].Obj k [[ID=​​​​​​​​​[j].Obj k _L.color: The color of the object to display in the left-hand area of ​​the k-th virtual object. d i [j].Obj k _L.size: The size of the object to be displayed in the left-hand area of ​​the k-th virtual object. d i [j].Obj k _L.pos: The coordinates of the object to be displayed in the left region of the k-th virtual object within the 3D virtual space (3D coordinates with the given position as the origin). d i [j].Obj k _L.angle: The angle of the object to be displayed in the left-hand region of the k-th virtual object (tilt angle from the upright position). d i [j].Obj k _R.attri: Attributes of the object to be displayed in the right-hand area of ​​the k-th virtual object. d i [j].Obj k _R.disp: The specific shape (specific data) of the object to be displayed in the right-hand area of ​​the k-th virtual object. d i [j].Obj k _R.color: The color of the object to display in the right-hand area of ​​the k-th virtual object. d i [j].Obj k _R.size: The size of the object to be displayed in the right-hand area of ​​the k-th virtual object. d i [j].Obj k _R.pos::The coordinates of the object to be displayed in the right-hand region of the k-th virtual object in 3D virtual space (3D coordinates with the specified position as the origin). d i [j].Obj k _R.angle: The angle of the object to be displayed in the right-hand area of ​​the k-th virtual object (tilt angle from the upright position). Note (1)d i [j].Obj k.dist: Distance to the k-th (k: natural number) virtual object, (2) d i [j].Obj k .pos: It may be defined to be only one of the data of the coordinates in the three-dimensional virtual space of the center point (center of gravity point) of the k-th (k: natural number) virtual object.

[0074] Also, the coordinates in the three-dimensional virtual space of the object to be displayed in the right area of the k-th virtual object (three-dimensional coordinates with a predetermined position as the origin) are d i [j].Obj k .pos may be specified by three-dimensional coordinates with.pos as the origin.

[0075] Also, the coordinates in the above three-dimensional virtual space may be specified by Cartesian coordinates or may be specified by polar coordinates.

[0076] FIG. 7 is a diagram showing an example of a three-dimensional virtual object generated from visual stimulus data. As shown in FIG. 7, by setting the above variables to predetermined values (by setting various parameters), various three-dimensional virtual objects can be generated.

[0077] The following shows the first visual stimulus data series d1[1] to d1[4] (an example). In the following, it is assumed that the distances d1 to d4 satisfy d1 < d2 < d3 < d4. ≪1-1: First visual stimulus data d1[1] (distance d1, number of displays: 1)≫ d1[1].Obj.num = 1 (number of virtual objects to be displayed) d1[1].Obj1.dist = d1 (distance from the viewpoint to the virtual object) d1[1].Obj1.pos = (x1, y1, z1) (position of the center point of the virtual object) d1[1].Obj1.color = Yellow<00005​​​​d1[1].Obj1_L.color = Black d1[1].Obj1_L.size = Medium size d1[1].Obj1_L.pos = (xL1, yL1, zL1) d1[1].Obj1_L.angle = 0° d1[1].Obj1_R.attri = Number d1[1].Obj1_R.disp = "8" d1[1].Obj1_R.color = Black d1[1].Obj1_R.size = Medium size d1[1].Obj1_R.pos = (xR1, yR1, zR1) d1[1].Obj1_R.angle = 0° <<1-2: First visual stimulus data d1[2] (distance d2, number of displays: 1)>> d1[2].Obj.num = 1 (Number of virtual objects to be displayed) d1[2].Obj1.dist = d2 (Distance from the viewpoint to the virtual object) d1[2].Obj1.pos = (x2, y2, z2) (Position of the center point of the virtual object) d1[2].Obj1.color = Yellow d1[2].Obj1_L.attri = Hiragana d1[2].Obj1_L.disp = "あ" d1[2].Obj1_L.color = Black d1[2].Obj1_L.size = Medium size d1[2].Obj1_L.pos = (xL2, yL2, zL2) d1[2].Obj1_L.angle = 0° d1[2].Obj1_R.attri = Hiragana d1[2].Obj1_R.disp = "い" d1[2].Obj1_R.color = Black d1[2].Obj1_R.size = Medium size d1[2].Obj1_R.pos = (xR2, yR2, zR2) d1[2].Obj1_R.angle=0° ≪1-3: First visual stimulus data d1[3] (distance d3, number of displays: 1)≫ d1[3].Obj.num=1 (Number of virtual objects to display) d1[3].Obj1.dist = d3(distance from viewpoint to virtual object) d1[3].Obj1.pos=(x3,y3,z3)(Position of the center point of the virtual object) d1[3].Obj1.color=Yellow d1[3].Obj1_L.attri=Figure d1[3].Obj1_L.disp=Cube d1[3].Obj1_L.color=Black d1[3].Obj1_L.size=medium size d1[3].Obj1_L.pos=(xL3,yL3,zL3) d1[3].Obj1_L.angle=0° d1[3].Obj1_R.attri=Figure d1[3].Obj1_R.disp=Triangle d1[3].Obj1_R.color=Black d1[3].Obj1_R.size = Medium Size d1[3].Obj1_R.pos=(xR3,yR3,zR3) d1[3].Obj1_R.angle=0° ≪1-4: First visual stimulus data d1[4] (distance d4, number of displays: 1)≫ d1[4].Obj.num=1(number of virtual objects to display) d1[4].Obj1.dist = d4(distance from viewpoint to virtual object) d1[4].Obj1.pos=(x4,y4,z4)(Position of the center point of the virtual object) d1[4].Obj1.color=Yellow d1[4].Obj1_L.attri=Number d1[4].Obj1_L.disp=「6」 d1[4].Obj1_L.color=Black d1[4].Obj1_L.size=medium size d1[4].Obj1_L.pos=(xL4,yL4,zL4) d1[4].Obj1_L.angle=0° d1[4].Obj1_R.attri=Number d1[4].Obj1_R.disp=「8」 d1[4].Obj1_R.color=Black d1[4].Obj1_R.size = Medium Size d1[4].Obj1_R.pos=(xR4,yR4,zR4) d1[4].Obj1_R.angle=0° The following shows an example of the second visual stimulus data sequence d2[1]~d2[4]. ≪2-1: Second visual stimulus data d2[1] (distance d1, number of displays: 2)≫ d2[1].Obj.num=2(number of virtual objects to display) (First object): d2[1].Obj1.dist = d1(distance from viewpoint to virtual object) d2[1].Obj1.pos=(x11,y11,z11)(position of the virtual object's center point) d2[1].Obj1.color=Yellow d2[1].Obj1_L.attri=Number d2[1].Obj1_L.disp=「1」 d2[1].Obj1_L.color=Black d2[1].Obj1_L.size = Medium Size d2[1].Obj1_L.pos=(xL11,yL11,zL11) d2[1].Obj1_L.angle=0° d2[1].Obj1_R.attri=Number d2[1].Obj1_R.disp=「2」 d2[1].Obj1_R.color=Black d2[1].Obj1_R.size = Medium Size d2[1].Obj1_R.pos=(xR11,yR11,zR11) d2[1].Obj1_R.angle=0° (Second object): d2[1].Obj2.dist = d1(distance from viewpoint to virtual object) d2[1].Obj2.pos=(x12,y12,z12)(position of the virtual object's center point) d2[1].Obj2.color=Yellow d2[1].Obj2_L.attri=Number d2[1].Obj2_L.disp=「3」 d2[1].Obj2_L.color=Black d2[1].Obj2_L.size = Medium Size d2[1].Obj2_L.pos=(xL12,yL12,zL12) d2[1].Obj2_L.angle=0° d2[1].Obj2_R.attri=Number d2[1].Obj2_R.disp=「4」 d2[1].Obj2_R.color=Black d2[1].Obj2_R.size = Medium Size d2[1].Obj2_R.pos=(xR12,yR12,zR12) d2[1].Obj2_R.angle=0° ≪2-2: Second visual stimulus data d2[2] (distance d2, number of displays: 2)≫ d2[2].Obj.num=2(number of virtual objects to display) (First object): d2[2].Obj1.dist = d2(distance from viewpoint to virtual object) d2[2].Obj1.pos=(x21,y21,z21)(position of the virtual object's center point) d2[2].Obj1.color=Yellow d2[2].Obj1_L.attri=Number d2[2].Obj1_L.disp=「1」 d2[2].Obj1_L.color=Black d2[2].Obj1_L.size=medium size d2[2].Obj1_L.pos=(xL21,yL21,zL21) d2[2].Obj1_L.angle=0° d2[2].Obj1_R.attri=Number d2[2].Obj1_R.disp=「2」 d2[2].Obj1_R.color=Black d2[2].Obj1_R.size = Medium Size d2[2].Obj1_R.pos=(xR21,yR21,zR21) d2[2].Obj1_R.angle=0° (Second object): d2[2].Obj2.dist = d2(distance from viewpoint to virtual object) d2[2].Obj2.pos=(x22,y22,z22)(position of the virtual object's center point) d2[2].Obj2.color=Yellow d2[2].Obj2_L.attri=Number d2[2].Obj2_L.disp=「3」 d2[2].Obj2_L.color=Black d2[2].Obj2_L.size=medium size d2[2].Obj2_L.pos=(xL22,yL22,zL22) d2[2].Obj2_L.angle=0° d2[2].Obj2_R.attri=Number d2[2].Obj2_R.disp=「4」 d2[2].Obj2_R.color=Black d2[2].Obj2_R.size = Medium Size d2[2].Obj2_R.pos=(xR12,yR12,zR12) d2[2].Obj2_R.angle=0° ≪2-3: Second visual stimulus data d2[3] (distance d3, number of displays: 2)≫ d2[3].Obj.num=2(number of virtual objects to display) (First object): d2[3].Obj1.dist = d3(distance from viewpoint to virtual object) d2[3].Obj1.pos=(x31,y31,z31)(Position of the center point of the virtual object) d2[3].Obj1.color=Yellow d2[3].Obj1_L.attri=Number d2[3].Obj1_L.disp=「1」 d2[3].Obj1_L.color=Black d2[3].Obj1_L.size=medium size d2[3].Obj1_L.pos=(xL31,yL31,zL31) d2[3].Obj1_L.angle=0° d2[3].Obj1_R.attri=Number d2[3].Obj1_R.disp=「2」 d2[3].Obj1_R.color=Black d2[3].Obj1_R.size=medium size d2[3].Obj1_R.pos=(xR31,yR31,zR31) d2[3].Obj1_R.angle=0° (Second object): d2[3].Obj2.dist = d3(distance from viewpoint to virtual object) d2[3].Obj2.pos=(x32,y32,z32)(Position of the center point of the virtual object) d2[3].Obj2.color=Yellow d2[3].Obj2_L.attri=Number d2[3].Obj2_L.disp=「3」 d2[3].Obj2_L.color=Black d2[3].Obj2_L.size=medium size d2[3].Obj2_L.pos=(xL32,yL32,zL32) d2[3].Obj2_L.angle=0° d2[3].Obj2_R.attri=Number d2[3].Obj2_R.disp=「4」 d2[3].Obj2_R.color=Black d2[3].Obj2_R.size = Medium Size d2[3].Obj2_R.pos=(xR12,yR12,zR12) d2[3].Obj2_R.angle=0° ≪2-4: Second visual stimulus data d2[4] (distance d4, number of displays: 2)≫ d2[4].Obj.num=2(number of virtual objects to display) (First object): d2[4].Obj1.dist=d4(distance from viewpoint to virtual object) d2[4].Obj1.pos=(x41,y41,z41)(Position of the center point of the virtual object) d2[4].Obj1.color=Yellow d2[4].Obj1_L.attri=Number d2[4].Obj1_L.disp=「1」 d2[4].Obj1_L.color=Black d2[4].Obj1_L.size=medium size d2[4].Obj1_L.pos=(xL41,yL41,zL41) d2[4].Obj1_L.angle=0° d2[4].Obj1_R.attri=Number d2[4].Obj1_R.disp=「2」 d2[4].Obj1_R.color=Black d2[4].Obj1_R.size=medium size d2[4].Obj1_R.pos=(xR41,yR41,zR41) d2[4].Obj1_R.angle=0° (Second object): d2[4].Obj2.dist = d4(distance from viewpoint to virtual object) d2[4].Obj2.pos=(x42,y42,z42)(Position of the center point of the virtual object) d2[4].Obj2.color=Yellow d2[4].Obj2_L.attri=Number d2[4].Obj2_L.disp=「3」 d2[4].Obj2_L.color=Black d2[4].Obj2_L.size=medium size d2[4].Obj2_L.pos=(xL42,yL42,zL42) d2[4].Obj2_L.angle=0° d2[4].Obj2_R.attri=Number d2[4].Obj2_R.disp=「4」 d2[4].Obj2_R.color=Black d2[4].Obj2_R.size = Medium Size d2[4].Obj2_R.pos=(xR42,yR42,zR42) d2[4].Obj2_R.angle=0° As described above, the display object generation processing unit 15 generates the visual stimulus data sequence d i [j](In the above example, the first visual stimulus data sequence d1[1]~d1[4] and the second visual stimulus data sequence d2[1]~d2[4]) are obtained.

[0078] (Step S402): In step S402, the score setting rule determination process is executed. Specifically, the following processes are performed.

[0079] The display object generation processing unit 15 generates the visual stimulus data sequence d i For each data point in [j], a score is assigned based on whether the answer is correct or incorrect. In other words, the display object generation processing unit 15 processes the visual stimulus data sequence d i [j] A 3D virtual representation is created using each data point, and when the patient is examined, the responses obtained from the patient are as follows: Ans ij Based on this, the process of obtaining a score (evaluation value) is performed. That is, the display object generation processing unit 15, d_score=score(d i [j], Ans ij ) d_score: Score (evaluation value) score(): Function to retrieve the score Ans ij :d i Data showing the response content when [j] is displayed. By performing a corresponding process, the function score(), which obtains the score (evaluation value), is configured (score setting rule determination process is performed). For example, the function score() is configured so that if the correct answer is given in a difficult test, the score will be high, and if the correct answer is given in an easy test, the score will be low. The function score() may be obtained by a predetermined calculation (e.g., weighting calculation), or it may output a score that has been set in advance using a table (e.g., LUT (lookup table)).

[0080] (Step S403): In step S403, loop 1 processing (loop processing) is started. Loop 1 processing is performed on each inspection item d i (1≦i≦Num_i)(Visual stimulus data sequence d) i The command is executed on the i-th data column of [j] (incrementing the variable i by +1 sequentially from i=1 to i=Num_i).

[0081] (Step S404): In step S404, the initial setup process is executed. That is, the display object generation processing unit 15 sets the variable j, the variable sum_score(d i )(Inspection item d) i Set the initial value of the variable that stores the sum of the score values ​​for test item d, i The number of elements (number of checks) is obtained. That is, the display object generation processing unit 15, j=1 sum_score(d i )=0 Num_j=get_num(d i ) get_num(d i ):d i A function to get the number of elements (array size) The process is performed as follows:

[0082] (Step S405): In step S405, the display object generation processing unit 15 determines whether j > Num_j. If j > Num_j, the process proceeds to step S413; otherwise, the process proceeds to step S406.

[0083] (Step S406): In step S406, the visual stimulus data d i Display processing (3D virtual display processing) is performed by [j]. Specifically, the following processes are performed.

[0084] ≪First attempt (i=1, j=1) (State 1-1, Figure 8)≫ In the first processing, i=1, j=1, so the visual stimulus data d i The display process (3D virtual display process) is executed by [j](i=1, j=1).

[0085] The visual stimulus data d1[1] (distance d1, number of displays: 1) is, d1[1].Obj.num=1 (Number of virtual objects to display) d1[1].Obj1.dist = d1(distance from viewpoint to virtual object) d1[1].Obj1.pos=(x1,y1,z1)(Position of the center point of the virtual object) d1[1].Obj1.color=Yellow d1[1].Obj1_L.attri=Number d1[1].Obj1_L.disp=「6」 d1[1].Obj1_L.color=Black d1[1].Obj1_L.size = Medium Size d1[1].Obj1_L.pos=(xL1,yL1,zL1) d1[1].Obj1_L.angle=0° d1[1].Obj1_R.attri=Number d1[1].Obj1_R.disp=「8」 d1[1].Obj1_R.color=Black d1[1].Obj1_R.size = Medium Size d1[1].Obj1_R.pos=(xR1,yR1,zR1) d1[1].Obj1_R.angle=0° Therefore, the display object generation processing unit 15 outputs the data including the above data as data D3 to the display processing unit 16 and the response input acquisition processing unit 14.

[0086] The display processing unit 16 receives data D3 output from the display object generation processing unit 15 and generates (acquires) display data (virtual 3D display data based on visual stimulus data d1[1]) to be displayed in the virtual 3D space based on the data D3. The display processing unit 16 then outputs the data including the generated display data as data D_disp to the 3D display device 200. The display processing unit 16 also generates image data (an image obtained by projecting the 3D image onto a predetermined plane) to display the display data to be displayed in the virtual 3D space on a 2D screen, and outputs the data including this image data as data D_2D to the 2D display unit 17.

[0087] For the sake of explanation, the virtual 3D space SP_3D is as shown in Figure 4, and the display processing unit 16 generates data for displaying the background of the virtual 3D space SP_3D in 3D, either in advance or as needed, and outputs (transmits) it to the 3D display device 200.

[0088] The 3D display device 200 receives data D_disp output from the display processing unit 16 via the input / output interface unit 21. The control unit 22 generates left-eye image data to be displayed on the left-eye display 25 and right-eye image data to be displayed on the right-eye display 26 from the data D_disp. The generated left-eye image data is displayed on the left-eye display 25, and the generated right-eye image data is displayed on the right-eye display 26. As a result, the patient (subject) wearing the 3D display device 200 perceives the virtual 3D image of state 1-1 shown in Figure 8.

[0089] (Step S407): In step S407, a process for obtaining responses from the patient (subject) (response acquisition process) is executed. Specifically, the following processes are executed.

[0090] For example, the examiner verbally instructs the patient (subject) to read the displayed numbers (or, if a speaker (not shown) is installed on the visuospatial cognitive processing device 100 or 3D display device 200, the instructions may be given via automated voice using the speaker). The patient then responds, and the correctness of the response is determined.

[0091] Specifically, the response input acquisition processing unit 14 acquires the subject's (patient's) response data manually (for example, by having the examiner check the state displayed on the 2D display unit 17 and determine whether the response data is correct or incorrect) or automatically (for example, by having the response input acquisition processing unit 14 perform automatic speech recognition processing to acquire the patient's (subject's) response content). Based on the acquired response data and data D3, it determines whether the subject's (patient's) response is correct or incorrect, and outputs data including the result of the correctness determination as data Dr1 to the display object generation processing unit 15.

[0092] Furthermore, if the response input acquisition processing unit 14 manually acquires the subject's (patient's) response data, for example, if the 3D display device 200 is implemented using an HMD (Head Mounted Display) device (e.g., VR goggles (VR: Virtual Reality), MR goggles (MR: Mixed Reality), AR goggles (AR: Augmented Reality), etc.), the subject (patient) may respond by operating the controller of the HMD (e.g., a controller for operating the 3D display device 200) (not shown), and the data output from the controller (data including the response content) may be input to the response input acquisition processing unit 14.

[0093] Furthermore, if the response input acquisition processing unit 14 manually acquires the subject's (patient's) response data, the subject may operate an external input device, keyboard input device, dedicated input device, etc., to provide a response, and the data output from the device used to input the response (data including the response content) may be input to the response input acquisition processing unit 14.

[0094] Alternatively, the response data of the subject (patient) may be manually acquired by the response input acquisition processing unit 14 via an intermediate user (for example, by having the intermediate user input the subject (patient)'s response content by operating the above device). For example, if the subject (patient) suffers from aphasia or the like, and can only respond with a voice that is difficult to recognize, such as saying "juuzan" or "zuusan" instead of the number "13", an intermediate user (for example, a therapist) may be involved, and if the intermediate user determines that the subject (patient) recognized the display data (numbers, letters, shapes, etc. displayed on the virtual object) for the correct answer (for example, the correct answer "13" when "13" is displayed on the virtual object), and that there was only a problem with language expression but no problem with spatial cognition, the intermediate user may input data indicating that the subject's (patient's) response content was correct (for example, if "13" is displayed on the virtual object, data indicating that both "1" and "3" were correct) into the response input acquisition processing unit 14.

[0095] Furthermore, the patient's response data may include, for example, information on the time it took the patient to respond, and data indicating the circumstances (state) of the patient when they responded.

[0096] Furthermore, in order to understand the patient's response status, for example, the spatial sensor of the 3D display device 200 may be used to detect the posture of the subject (patient) (the subject wearing the 3D display device 200), and the 3D display device 200 may output data on the subject's posture during the period from the display of the virtual object to the response (data acquired by the 3D display device 200) to the response input acquisition processing unit 14, and the response input acquisition processing unit 14 may acquire this data (data on the subject's posture during the period from the display of the virtual object to the response) (referred to as "patient posture data").

[0097] Alternatively, the subject's (patient's) response data may be input to the response input acquisition processing unit 14 using eye tracking or head tracking. In this case, for example, a number (e.g., "1") may be displayed in the left area of ​​the virtual object, and a shape (e.g., a triangle) may be displayed in the right area of ​​the virtual object. The subject (patient) may be instructed verbally by an intermediate user's speech or automated voice, for example, "Look at it if it's a number" or "Look at it if it's a shape (triangle)." The movement of the subject's (patient's) gaze may be detected by the spatial sensor 24 of the 3D display device 200 (for example, if the 3D display device 200 is a wearable device, by using a process that tracks the gaze of the subject (patient) wearing the 3D display device 200 (eye tracking) or a process that tracks the orientation of the subject's (patient's) head (head tracking) based on the data acquired by the spatial sensor 24, etc.) to determine whether the subject (patient) is performing the action as instructed. Based on this determination, response data may be generated (acquired) and input to the response input acquisition processing unit 14.

[0098] Alternatively, an imaging device (e.g., a camera) (not shown) may be provided to photograph the subject (patient) from the outside, and the subject (patient) may be photographed using the imaging device. For example, the subject (patient)'s gaze, direction of gaze, head and face condition and orientation may be determined by image analysis processing, and response data may be generated (acquired) based on the determination results and input to the response input acquisition processing unit 14.

[0099] Alternatively, the subject's (patient's) response data may be input to the response input and acquisition processing unit 14 via touch or tap. In this case, for example, an imaging device (e.g., a camera) (not shown) that photographs the subject (patient) from the outside may be provided, and the subject (patient) may be photographed by the imaging device. For example, the touch or tap position of the subject (patient) may be identified by image analysis processing, and response data may be generated (acquired) based on the identified position and input to the response input and acquisition processing unit 14. For example, a triangle may be displayed in the right-hand area (or left-hand area) of a virtual object, and the subject (patient) may be instructed verbally to "touch the triangle" or "tap the triangle." The imaging device's captured image (video) may be analyzed to determine whether the subject (patient) touched or tapped the displayed triangle or the area nearby. Based on the result of this determination, response data may be generated (acquired) and input to the response input and acquisition processing unit 14.

[0100] (Steps S408, S409): In steps S408 and S409, the score acquisition process is executed. Specifically, the following processes are performed.

[0101] The display object generation processing unit 15 performs a process to obtain a score for the response data (data included in data D3) to the visual stimulus data d1[1]. In other words, the display object generation processing unit 15 performs a 3D virtual display using the visual stimulus data d1[1] and, when the test is performed on the patient, obtains the response content Ans from the patient. 11 Based on this, the process of obtaining a score (evaluation value) is performed. That is, the display object generation processing unit 15, d_score=score(d1[1],Ans 11 ) d_score: Score (evaluation value) score(): Function to retrieve the score Ans 11 Data showing the response content when :d1[1] is displayed. By performing the equivalent processing, a score (evaluation value) is obtained (step S408).

[0102] Then, the display object generation processing unit 15 outputs the data including the acquired score (evaluation value) as data Dr11 to the judgment processing unit 18, and the judgment processing unit 18 performs the score (evaluation value) accumulation process. In other words, the judgment processing unit 18 performs, sum_score(d1)←sum_score(d1)+score(d1[1],Ans 11 ) Perform the equivalent processing to obtain the cumulative score value sum_score(d1) (step S409).

[0103] (Step S410): In step S410, the score setting rule adjustment process is executed. Specifically, the following processes are performed.

[0104] For example, if, after considering the patient's response, it is determined that adjusting the score setting rules would result in more accurate processing (for example, if the response input acquisition processing unit 14 makes such determination), the data Dr1 may include data requesting score setting rule adjustment processing (for example, a request signal (request data)), and the display object generation processing unit 15 may be requested to execute the score setting rule adjustment processing.

[0105] For example, if a patient's answer is correct but the time it took to give the correct answer was extremely long, the response input acquisition processing unit 14 may request the display object generation processing unit 15 to adjust the score setting rules so that the weighting of the score calculation is changed based on that time.

[0106] When the display object generation processing unit 15 receives a request from the answer input acquisition processing unit 14 for score setting rule adjustment processing, it performs score setting rule adjustment processing in accordance with the request and processes to acquire the score (score(d i [j], Ans ij Adjust the processing by ).

[0107] (Step S411): In step S411, a determination process is executed to determine whether the score integration value sum_score(d i ) is within a predetermined range. Specifically, if the determination processing unit 18 sets the predetermined thresholds as Th1 and Th2 (Th1 < Th2), it determines whether the score integration value sum_score(d i ) satisfies Th1 ≦ sum_score(d i ). As a result of the determination, (1) if Th1 ≦ sum_score(d i ) ≦ Th2, the determination processing unit 18 determines that the determination result cannot be obtained and proceeds with the process to step S412. (2) If Th1 ≦ sum_score(d i ) ≦ Th2 is not satisfied, the determination processing unit 18 determines that the determination result can be obtained and proceeds with the process to step S413.

[0108] (Step S412): In step S412, the variable j is incremented by +1, and the process proceeds to step S405.

[0109] Then, the second processing for the inspection item d1 (visual stimulus data d1) is executed.

[0110] ≪Second time (i = 1, j = 2) (State 1-2, Figure 9)≫ In the second processing for the inspection item d1 (visual stimulus data d1), the same processing as the first processing is executed.

[0111] In the second processing, since i = 1 and j = 2, the display processing (3D virtual display processing) by the visual stimulus data d i [j] (i = 1, j = 2) is executed.

[0112] The visual stimulus data d1[2] (distance d2, number of displays: 1) is d1[2].Obj.num = 1 (number of virtual objects to be displayed) d1[2].Obj1.dist = d2 (distance from the viewpoint to the virtual object) d1[2].Obj1.pos = (x2, y2, z2) (position of the center point of the virtual object) d1[2].Obj1.color = Yellow d1[2].Obj1_L.attri = Japanese hiragana d1[2].Obj1_L.disp = "あ" d1[2].Obj1_L.color = Black d1[2].Obj1_L.size = medium size d1[2].Obj1_L.pos = (xL2, yL2, zL2) d1[2].Obj1_L.angle = 0° d1[2].Obj1_R.attri = Japanese hiragana d1[2].Obj1_R.disp = "い" d1[2].Obj1_R.color = Black d1[2].Obj1_R.size = medium size d1[2].Obj1_R.pos = (xR2, yR2, zR2) d1[2].Obj1_R.angle = 0° Therefore, the display object generation processing unit 15 outputs the data including the above data as data D3 to the display processing unit 16 and the response input acquisition processing unit 14 (step S406).

[0113] Then, in the same manner as the first processing, the processes of steps S407 to S412 are executed.

[0114] In the second processing, in the state shown in FIG. 9, a virtual object (virtual object based on d1[2]) is displayed in the virtual three-dimensional space SP_3D.

[0115] ≪Third time (i = 1, j = 3) (state 1-3, FIG. 10)≫ In the third processing for the inspection item d1 (visual stimulus data d1), the same processing as the first processing is executed.

[0116] In the third processing, i=1 and j=3, so the visual stimulus data d i Display processing (3D virtual display processing) is performed using [j](i=1, j=3).

[0117] The visual stimulus data d1[3] (distance d3, number of displays: 1) is, d1[3].Obj.num=1 (Number of virtual objects to display) d1[3].Obj1.dist = d3(distance from viewpoint to virtual object) d1[3].Obj1.pos=(x2,y2,z2)(Position of the center point of the virtual object) d1[3].Obj1.color=Yellow d1[3].Obj1_L.attri=Figure d1[3].Obj1_L.disp=Cube d1[3].Obj1_L.color=Black d1[3].Obj1_L.size=medium size d1[3].Obj1_L.pos=(xL2,yL2,zL2) d1[3].Obj1_L.angle=0° d1[3].Obj1_R.attri=Figure d1[3].Obj1_R.disp=Triangle d1[3].Obj1_R.color=Black d1[3].Obj1_R.size = Medium Size d1[3].Obj1_R.pos=(xR2,yR2,zR2) d1[3].Obj1_R.angle=0° Therefore, the display object generation processing unit 15 outputs the data including the above data as data D3 to the display processing unit 16 and the response input acquisition processing unit 14 (step S406).

[0118] Then, the processes in steps S407 to S412 are executed in the same manner as the first process.

[0119] In the third processing step, a virtual object (a virtual object based on d1[3]) is displayed in the virtual 3D space SP_3D, as shown in Figure 10.

[0120] ≪4th time (i=1, j=4) (States 1-4, Figure 11)≫ For the fourth processing step of test item d1 (visual stimulus data d1), the processing is performed in the same way as the first step.

[0121] In the fourth processing step, i=1 and j=4, so the visual stimulus data d i Display processing (3D virtual display processing) is performed using [j](i=1, j=4).

[0122] The visual stimulus data d1[4] (distance d4, number of displays: 1) is, d1[4].Obj.num=1(number of virtual objects to display) d1[4].Obj1.dist = d4(distance from viewpoint to virtual object) d1[4].Obj1.pos=(x4,y4,z4)(Position of the center point of the virtual object) d1[4].Obj1.color=Yellow d1[4].Obj1_L.attri=Number d1[4].Obj1_L.disp=「6」 d1[4].Obj1_L.color=Black d1[4].Obj1_L.size=medium size d1[4].Obj1_L.pos=(xL4,yL4,zL4) d1[4].Obj1_L.angle=0° d1[4].Obj1_R.attri=Number d1[4].Obj1_R.disp=「8」 d1[4].Obj1_R.color=Black d1[4].Obj1_R.size = Medium Size d1[4].Obj1_R.pos=(xR4,yR4,zR4) d1[4].Obj1_R.angle=0° Therefore, since it is as described above, the display object generation processing unit 15 outputs the data including the above data as data D3 to the display processing unit 16 and the response input acquisition processing unit 14 (step S406).

[0123] Then, in the same manner as the first-time processing, the processing of steps S407 to S412 is executed.

[0124] In the fourth-time processing, in the state shown in FIG. 11, a virtual object (a virtual object based on d1[4]) is displayed in the virtual three-dimensional space SP_3D.

[0125] (step S405): In step S405, in the fifth-time processing, since j = 5 and Num_j = 4, j>Num_j is not satisfied (it is determined that the inspection of d1 has been completed), so the processing proceeds to step S413.

[0126] (step S413): In step S413, the determination processing for the inspection item d i (i = 1) is executed. Specifically, the following processing is executed.

[0127] The determination processing unit 18 (1A) When sum_score(d i ) < Th1 (when it is below the negative determination threshold Th1), for the inspection item d i , it is determined as "abnormal", (1B) When sum_score(d i ) > Th2 (when it exceeds the positive determination threshold Th2), for the inspection item d i , it is determined as "normal", (2) When Th1 ≤ sum_score(d i ) ≤ Th_2 (when it is determined that j>Num_j is satisfied and the process has advanced to step S413), for the inspection item d i , it is determined as "indeterminable" (a state where it is impossible to determine normal / abnormal).

[0128] The judgment processing unit 18 then outputs (receives) the data including the judgment result data obtained by the judgment process as data D_rslt (for example, by displaying the judgment result data on an external or internal display device).

[0129] (Step S414): In step S414, inspection item d i The process of saving the acquired data for (i=1) is executed. Specifically, the following processes are performed.

[0130] The judgment processing unit 18 acquires data including the judgment result data (data D_rslt) acquired in step S413 and detailed data of the examination process (such as the answer content for each examination item, the correctness result data of the answer content, the total evaluation value, patient attribute data, patient posture data (time-series data of the patient's posture) (the patient posture data is output from the answer input acquisition processing unit 14 to the judgment processing unit 18 via the display object generation processing unit 15) as data D_rslt_all, outputs the acquired data D_rslt_all to the patient attribute data storage unit DB1, and stores the data D_rslt_all in the patient attribute data storage unit DB1 (a data write command is output to the patient attribute data storage unit DB1, and data D_rslt_all is stored (written) in the patient attribute data storage unit DB1).

[0131] Furthermore, if the determination processing unit 18 determines that there is data that updates the patient attribute data stored in the patient attribute data storage unit DB1, it includes such data in the data D_rslt_all and stores the data D_rslt_all in the patient attribute data storage unit DB1.

[0132] After performing the above process, proceed to step S415.

[0133] (Step S415): In step S415, an end determination process for loop 1 processing (loop processing) is executed. That is, if it is determined by the end determination process that the end determination condition is satisfied, the process is terminated. On the other hand, if it is determined by the end determination process that the end determination condition is not satisfied, the process returns to step S403.

[0134] (Step S403): In step S403, with i = 2, loop 1 processing (loop processing) is continued.

[0135] (Step S404): In step S404, an initial setting process is executed. That is, the display object generation processing unit 15 sets the initial values of the variable j, the variable sum_score(d i )(the variable for storing the total value of the score values of inspection item d i ) with i = 2, and obtains the number of elements (number of inspections) of inspection item d i . That is, the display object generation processing unit 15 j = 1 sum_score(d i ) = 0 Num_j = get_num(d i ) get_num(d i ): The function for obtaining the number of elements (number of arrays) of d i Performs the process of setting.

[0136] (Step S405): In step S405, the display object generation processing unit 15 performs a determination process as to whether j > Num_j. If j > Num_j, the process proceeds to step S413. If j > Num_j is not satisfied, the process proceeds to step S406.

[0137] (Step S406): In step S406, display processing (3D virtual display processing) using the visual stimulus data d i [j](i = 2) is executed. Specifically, the following processing is executed.​

[0138] ≪First attempt (i=2, j=1) (State 2-1, Figure 12)≫ In the first processing, i=2 and j=1, so the visual stimulus data d i Display processing (3D virtual display processing) is performed using [j](i=2, j=1).

[0139] The visual stimulus data d2[1] (distance d1, number of displays: 2) is, d2[1].Obj.num=2(number of virtual objects to display) (First object): d2[1].Obj1.dist = d1(distance from viewpoint to virtual object) d2[1].Obj1.pos=(x11,y11,z11)(position of the virtual object's center point) d2[1].Obj1.color=Yellow d2[1].Obj1_L.attri=Number d2[1].Obj1_L.disp=「1」 d2[1].Obj1_L.color=Black d2[1].Obj1_L.size = Medium Size d2[1].Obj1_L.pos=(xL11,yL11,zL11) d2[1].Obj1_L.angle=0° d2[1].Obj1_R.attri=Number d2[1].Obj1_R.disp=「2」 d2[1].Obj1_R.color=Black d2[1].Obj1_R.size = Medium Size d2[1].Obj1_R.pos=(xR11,yR11,zR11) d2[1].Obj1_R.angle=0° (Second object): d2[1].Obj2.dist = d1(distance from viewpoint to virtual object) d2[1].Obj2.pos=(x12,y12,z12)(position of the virtual object's center point) d2[1].Obj2.color=Yellow d2[1].Obj2_L.attri=Number d2[1].Obj2_L.disp=「3」 d2[1].Obj2_L.color=Black d2[1].Obj2_L.size = Medium Size d2[1].Obj2_L.pos=(xL12,yL12,zL12) d2[1].Obj2_L.angle=0° d2[1].Obj2_R.attri=Number d2[1].Obj2_R.disp=「4」 d2[1].Obj2_R.color=Black d2[1].Obj2_R.size = Medium Size d2[1].Obj2_R.pos=(xR12,yR12,zR12) d2[1].Obj2_R.angle=0° Therefore, the display object generation processing unit 15 outputs the data including the above data as data D3 to the display processing unit 16 and the response input acquisition processing unit 14.

[0140] The display processing unit 16 receives data D3 output from the display object generation processing unit 15 and generates (acquires) display data (virtual 3D display data based on visual stimulus data d1[1]) to be displayed in the virtual 3D space based on the data D3. The display processing unit 16 then outputs the data including the generated display data as data D_disp to the 3D display device 200. The display processing unit 16 also generates image data (an image obtained by projecting the 3D image onto a predetermined plane) to display the display data to be displayed in the virtual 3D space on a 2D screen, and outputs the data including this image data as data D_2D to the 2D display unit 17.

[0141] The 3D display device 200 receives data D_disp output from the display processing unit 16 via the input / output interface unit 21. The control unit 22 generates left-eye image data to be displayed on the left-eye display 25 and right-eye image data to be displayed on the right-eye display 26 from the data D_disp. The generated left-eye image data is displayed on the left-eye display 25, and the generated right-eye image data is displayed on the right-eye display 26. As a result, the patient (subject) wearing the 3D display device 200 perceives the virtual 3D image of state 1-1 shown in Figure 12.

[0142] (Step S407): In step S407, a process for obtaining responses from the patient (subject) (response acquisition process) is executed. Specifically, the following processes are executed.

[0143] For example, the examiner verbally instructs the patient (subject) to read the displayed numbers (or, if a speaker (not shown) is installed on the visuospatial cognitive processing device 100 or 3D display device 200, the instructions may be given via automated voice using the speaker). The patient then responds, and the correctness of the response is determined.

[0144] Specifically, the response input acquisition processing unit 14 acquires the subject's (patient's) response data manually (for example, by having the examiner check the state displayed on the 2D display unit 17 and determine whether the response data is correct or incorrect) or automatically (for example, by having the response input acquisition processing unit 14 perform automatic speech recognition processing to acquire the patient's (subject's) response content). Based on the acquired response data and data D3, it determines whether the subject's (patient's) response is correct or incorrect, and outputs data including the result of the correctness determination as data Dr1 to the display object generation processing unit 15.

[0145] Furthermore, if the response input acquisition processing unit 14 manually acquires the subject's (patient's) response data, for example, if the 3D display device 200 is implemented using an HMD (Head Mounted Display) device (e.g., VR goggles (VR: Virtual Reality), MR goggles (MR: Mixed Reality), AR goggles (AR: Augmented Reality), etc.), the subject (patient) may respond by operating the controller of the HMD (e.g., a controller for operating the 3D display device 200) (not shown), and the data output from the controller (data including the response content) may be input to the response input acquisition processing unit 14.

[0146] Furthermore, if the response input acquisition processing unit 14 manually acquires the subject's (patient's) response data, the subject may operate an external input device, keyboard input device, dedicated input device, etc., to provide a response, and the data output from the device used to input the response (data including the response content) may be input to the response input acquisition processing unit 14.

[0147] Furthermore, the patient's response data may include, for example, information on the time it took the patient to respond, and data indicating the circumstances (state) of the patient when they responded.

[0148] Furthermore, in order to understand the patient's response status, for example, the spatial sensor of the 3D display device 200 may be used to detect the posture of the subject (patient) (the subject wearing the 3D display device 200), and the 3D display device 200 may output data on the subject's posture during the period from the display of the virtual object to the response (data acquired by the 3D display device 200) to the response input acquisition processing unit 14, and the response input acquisition processing unit 14 may acquire this data (data on the subject's posture during the period from the display of the virtual object to the response) (referred to as "patient posture data").

[0149] Alternatively, similar to the first process (i=1, j=1), the response data of the subject (patient) may be manually acquired by the response input acquisition processing unit 14 via an intermediate user (for example, by having the intermediate user input the subject's (patient's) response content by operating the above-mentioned device).

[0150] Alternatively, similar to the first processing (i=1, j=1), the subject's (patient's) response data may be input to the response input acquisition processing unit 14 using eye tracking and head tracking.

[0151] Alternatively, similar to the first process (i=1, j=1), an imaging device (e.g., a camera) (not shown) may be provided to photograph the subject (patient) from the outside, and the subject (patient) may be photographed using the imaging device. For example, image analysis processing may be used to determine the subject's (patient's) gaze, direction of gaze, head and face condition and orientation, etc. Based on the determination results, response data may be generated (acquired) and input to the response input acquisition processing unit 14.

[0152] Alternatively, similar to the first process (i=1, j=1), the subject's (patient's) response data may be input to the response input / acquisition processing unit 14 via touch or tap.

[0153] (Steps S408, S409): In steps S408 and S409, the score acquisition process is executed. Specifically, the following processes are performed.

[0154] The display object generation processing unit 15 performs a process to obtain a score for the response data (data included in data D3) to the visual stimulus data d2[1]. In other words, the display object generation processing unit 15 performs a 3D virtual display using the visual stimulus data d2[1] and, when the test is performed on the patient, obtains the response content Ans from the patient. 21 Based on this, the process of obtaining a score (evaluation value) is performed. That is, the display object generation processing unit 15, d_score=score(d2[1],Ans 21 ) d_score: Score (evaluation value) score(): Function to retrieve the score Ans 21 Data showing the response content when :d2[1] is displayed. By performing the equivalent processing, a score (evaluation value) is obtained (step S408).

[0155] Then, the display object generation processing unit 15 outputs the data including the acquired score (evaluation value) as data Dr11 to the judgment processing unit 18, and the judgment processing unit 18 performs the score (evaluation value) accumulation process. In other words, the judgment processing unit 18 performs, sum_score(d2)←sum_score(d2)+score(d2[1],Ans 21 ) Perform the equivalent processing to obtain the cumulative score value sum_score(d2) (step S409).

[0156] (Step S410): In step S410, the score setting rule adjustment process is executed. Specifically, the following processes are performed.

[0157] For example, if, after considering the patient's response, it is determined that adjusting the score setting rules would result in more accurate processing (for example, if the response input acquisition processing unit 14 makes such determination), the data Dr1 may include data requesting score setting rule adjustment processing (for example, a request signal (request data)), and the display object generation processing unit 15 may be requested to execute the score setting rule adjustment processing.

[0158] For example, if a patient's answer is correct but the time it took to give the correct answer was extremely long, the response input acquisition processing unit 14 may request the display object generation processing unit 15 to adjust the score setting rules so that the weighting of the score calculation is changed based on that time.

[0159] It means that when the object generation processing unit 15 receives a request for score setting rule adjustment processing from the answer input acquisition processing unit 14, it performs the score setting rule adjustment processing according to the request and adjusts the processing (processing by score(d i [j],Ans ij )).

[0160] (Step S411): In step S411, a determination process is executed to determine whether the score accumulation value sum_score(d i ) is within a predetermined range. Specifically, if the determination processing unit 18 sets the predetermined threshold values as Th1 and Th2 (Th1 < Th2), it determines whether the score accumulation value sum_score(d i ) satisfies Th1 ≤ sum_score(d i ). As a result of the determination, (1) if Th1 ≤ sum_score(d i ) ≤ Th2, the determination processing unit 18 determines that the determination result cannot be obtained and proceeds with the process to step S412. (2) If Th1 ≤ sum_score(d i ) ≤ Th2 is not satisfied, the determination processing unit 18 determines that the determination result can be obtained and proceeds with the process to step S413.

[0161] (Step S412): In step S412, the variable j is incremented by +1, and the process proceeds to step S405.

[0162] Then, the second - round processing for the inspection item d1 (visual stimulus data d1) is executed.

[0163] ≪Second round (i = 2, j = 2) (state 2 - 2, Figure 13)≫ In the second - round processing for the inspection item d2 (visual stimulus data d2), the same processing as in the first - round processing is executed.

[0164] In the second - round processing, since i = 2 and j = 2, the visual stimulus data d iDisplay processing (3D virtual display processing) is performed using [j](i=2, j=2).

[0165] The visual stimulus data d2[2] (distance d2, number of displays: 2) is, d2[2].Obj.num=2(number of virtual objects to display) (First object): d2[2].Obj1.dist = d2(distance from viewpoint to virtual object) d2[2].Obj1.pos=(x21,y21,z21)(position of the virtual object's center point) d2[2].Obj1.color=Yellow d2[2].Obj1_L.attri=Number d2[2].Obj1_L.disp=「1」 d2[2].Obj1_L.color=Black d2[2].Obj1_L.size=medium size d2[2].Obj1_L.pos=(xL21,yL21,zL21) d2[2].Obj1_L.angle=0° d2[2].Obj1_R.attri=Number d2[2].Obj1_R.disp=「2」 d2[2].Obj1_R.color=Black d2[2].Obj1_R.size = Medium Size d2[2].Obj1_R.pos=(xR21,yR21,zR21) d2[2].Obj1_R.angle=0° (Second object): d2[2].Obj2.dist = d2(distance from viewpoint to virtual object) d2[2].Obj2.pos=(x22,y22,z22)(position of the virtual object's center point) d2[2].Obj2.color=Yellow d2[2].Obj2_L.attri=Number d2[2].Obj2_L.disp=「3」 d2[2].Obj2_L.color=Black d2[2].Obj2_L.size=medium size d2[2].Obj2_L.pos=(xL22,yL22,zL22) d2[2].Obj2_L.angle=0° d2[2].Obj2_R.attri=Number d2[2].Obj2_R.disp=「4」 d2[2].Obj2_R.color=Black d2[2].Obj2_R.size = Medium Size d2[2].Obj2_R.pos=(xR12,yR12,zR12) d2[2].Obj2_R.angle=0° Therefore, the display object generation processing unit 15 outputs the data including the above data as data D3 to the display processing unit 16 and the response input acquisition processing unit 14 (step S406).

[0166] Then, the processes in steps S407 to S412 are executed in the same manner as the first process.

[0167] In the second processing step, a virtual object (a virtual object based on d2[2]) is displayed in the virtual 3D space SP_3D, as shown in Figure 13.

[0168] ≪3rd time (i=2, j=3) (State 2-3, Figure 14)≫ For the third processing of test item d2 (visual stimulus data d2), the processing is performed in the same way as the first processing.

[0169] In the third processing, i=2 and j=3, so the visual stimulus data d i Display processing (3D virtual display processing) is performed using [j](i=2, j=3).

[0170] The visual stimulus data d2[3] (distance d3, number of displays: 2) is, d2[3].Obj.num=2(number of virtual objects to display) (First object): d2[3].Obj1.dist = d3(distance from viewpoint to virtual object) d2[3].Obj1.pos=(x31,y31,z31)(Position of the center point of the virtual object) d2[3].Obj1.color=Yellow d2[3].Obj1_L.attri=Number d2[3].Obj1_L.disp=「1」 d2[3].Obj1_L.color=Black d2[3].Obj1_L.size=medium size d2[3].Obj1_L.pos=(xL31,yL31,zL31) d2[3].Obj1_L.angle=0° d2[3].Obj1_R.attri=Number d2[3].Obj1_R.disp=「2」 d2[3].Obj1_R.color=Black d2[3].Obj1_R.size=medium size d2[3].Obj1_R.pos=(xR31,yR31,zR31) d2[3].Obj1_R.angle=0° (Second object): d2[3].Obj2.dist = d3(distance from viewpoint to virtual object) d2[3].Obj2.pos=(x32,y32,z32)(Position of the center point of the virtual object) d2[3].Obj2.color=Yellow d2[3].Obj2_L.attri=Number d2[3].Obj2_L.disp=「3」 d2[3].Obj2_L.color=Black d2[3].Obj2_L.size=medium size d2[3].Obj2_L.pos=(xL32,yL32,zL32) d2[3].Obj2_L.angle=0° d2[3].Obj2_R.attri=Number d2[3].Obj2_R.disp=「4」 d2[3].Obj2_R.color=Black d2[3].Obj2_R.size = Medium Size d2[3].Obj2_R.pos=(xR12,yR12,zR12) d2[3].Obj2_R.angle=0° Therefore, the display object generation processing unit 15 outputs the data including the above data as data D3 to the display processing unit 16 and the response input acquisition processing unit 14 (step S406).

[0171] Then, the processes in steps S407 to S412 are executed in the same manner as the first process.

[0172] In the second processing, a virtual object (a virtual object based on d2[2]) is displayed in the virtual 3D space SP_3D, as shown in Figure 14.

[0173] ≪4th time (i=2, j=4) (State 2-4, Figure 15)≫ For the fourth processing step of test item d2 (visual stimulus data d2), the processing is performed in the same way as the first step.

[0174] In the fourth processing step, i=2 and j=4, so the visual stimulus data d i Display processing (3D virtual display processing) is performed using [j](i=2, j=4).

[0175] The visual stimulus data d2[4] (distance d4, number of displays: 2) is, d2[4].Obj.num=2(number of virtual objects to display) (First object): d2[4].Obj1.dist=d4(distance from viewpoint to virtual object) d2[4].Obj1.pos=(x41,y41,z41)(Position of the center point of the virtual object) d2[4].Obj1.color=Yellow d2[4].Obj1_L.attri=Number d2[4].Obj1_L.disp=「1」 d2[4].Obj1_L.color=Black d2[4].Obj1_L.size=medium size d2[4].Obj1_L.pos=(xL41,yL41,zL41) d2[4].Obj1_L.angle=0° d2[4].Obj1_R.attri=Number d2[4].Obj1_R.disp=「2」 d2[4].Obj1_R.color=Black d2[4].Obj1_R.size=medium size d2[4].Obj1_R.pos=(xR41,yR41,zR41) d2[4].Obj1_R.angle=0° (Second object): d2[4].Obj2.dist = d4(distance from viewpoint to virtual object) d2[4].Obj2.pos=(x42,y42,z42)(Position of the center point of the virtual object) d2[4].Obj2.color=Yellow d2[4].Obj2_L.attri=Number d2[4].Obj2_L.disp=「3」 d2[4].Obj2_L.color=Black d2[4].Obj2_L.size=medium size d2[4].Obj2_L.pos=(xL42,yL42,zL42) d2[4].Obj2_L.angle=0° d2[4].Obj2_R.attri=Number d2[4].Obj2_R.disp=「4」 d2[4].Obj2_R.color = Black d2[4].Obj2_R.size = Medium size d2[4].Obj2_R.pos = (xR42, yR42, zR42) d2[4].Obj2_R.angle = 0° Therefore, the display object generation processing unit 15 outputs the data including the above data as data D3 to the display processing unit 16 and the response input acquisition processing unit 14 (step S406).

[0176] Then, in the same manner as the first-time processing, the processing of steps S407 to S412 is executed.

[0177] In the second-time processing, in the state shown in FIG. 15, a virtual object (virtual object based on d2[2]) is displayed in the virtual three-dimensional space SP_3D.

[0178] (Step S405): In step S405, in the fifth-time processing, since j = 5 and Num_j = 4, j>Num_j is not satisfied (it is determined that the inspection for d1 has been completed), so the processing proceeds to step S413.

[0179] (Step S413): In step S413, the determination process for the inspection item d i (i = 2) is executed. Specifically, the following processing is executed.

[0180] The determination processing unit 18 (1A) When sum_score(d i ) < Th1 (when it is below the negative determination threshold Th1), for the inspection item d i , it is determined as "abnormal", (1B) When sum_score(d i ) > Th2 (when it exceeds the positive determination threshold Th2), for the inspection item d i , it is determined as "normal", (2) When Th1 ≤ sum_score(di If ) ≤ Th2 (it is determined that j > Num_j is satisfied and the process proceeds to step S413), then the test item d i The result is determined to be "undeterminable" (a state where it is not possible to determine whether it is normal or abnormal).

[0181] The judgment processing unit 18 then outputs (receives) the data including the judgment result data obtained by the judgment process as data D_rslt (for example, by displaying the judgment result data on an external or internal display device).

[0182] (Step S414): In step S414, inspection item d i The process of saving the acquired data for (i=2) is executed. Specifically, the following processes are performed.

[0183] Furthermore, if the determination processing unit 18 determines that there is data that updates the patient attribute data stored in the patient attribute data storage unit DB1, it includes such data in the data D_rslt_all and stores the data D_rslt_all in the patient attribute data storage unit DB1.

[0184] After performing the above process, proceed to step S415.

[0185] (Step S415): In step S415, the termination determination process for loop 1 (loop processing) is executed. That is, if the termination determination process determines that the termination condition is met, the process is terminated; on the other hand, if the termination determination process determines that the termination condition is not met, the process returns to step S403.

[0186] If i=2, the termination condition is met, so the process is terminated.

[0187] As described above, in the visuospatial cognitive processing system 1000, test item d iTest result data can be obtained for (d1: Test using stimulus rules for object-center neglect test (general test, number of displayed objects: 1), d2: Test using stimulus rules for object-center neglect test (general test, number of displayed objects: multiple (2))).

[0188] Figure 16 shows an example of detailed data for the examination process of examination item d1 (object center neglect test (general test, number of displayed objects: 1)) (response content for each examination item, correct / incorrect result data of the responses, total evaluation value, patient attribute data, data to be updated as patient posture data, etc.) (corresponding to data D_rslt_all). In Figure 16, the visual stimulus data d when examination item d1 (object center neglect test (general test, number of displayed objects: 1)) is performed on patients 1, 2, and 3. i [j](1≦j≦Num_j) for each (1) answer (○: correct answer, ×: incorrect answer), (2) value (correct / incorrect) (Ans ij (Correct answer: 1, Incorrect answer: -1), (3) Weight (w ij ), and (4) score (evaluation value) (score(d i [j] , Ans ij The table below shows the results. The threshold values ​​used for the test results are Th1=0 and Th2=3.

[0189] Furthermore, the stimulus rule is the response value Ans ij (Ans ij ∈{-1,1}, if correct: Ans ij = 1, In case of incorrect answer: Ans ij Weight w = -1) ij The weighted value is used to evaluate the score (d i [j] , Ans ij The rule is that the total evaluation value sum_score(d i )(The final cumulative score obtained in the visuospatial cognitive processing of step S4 sum_score(d i The value corresponding to ) is obtained by performing the following mathematical process.

number

[0190] In this embodiment, the case of test items d1 and d2 in the visuospatial cognitive processing system 1000 has been described as above, but it is easy to further increase the number of test items. Here, Figures 18 and 19 show examples of test results when test items d3 and d4 are added to the visuospatial cognitive processing system 1000 and processed in the same way as in the case of test items d1 and d2.

[0191] Note that inspection item d3 is set as follows. Stimulus rule data (data included in data D2): Stimulus rules for the object center neglect test (distal-focused test, number of displayed objects: 1) Visual stimulus data column (Number of display objects: 1, data column to change the distance from the patient's viewpoint to the object in 4 steps): d3[1]~d3[4] Furthermore, the test item d4 is assumed to be set as follows. Stimulus rule data (data included in data D2): Stimulus rules for the object center neglect test (distal-focused test, number of displayed objects: 2) Visual stimulus data column (Number of display objects: 2, data column to change the distance from the patient's viewpoint to the objects in 4 stages): d4[1]~d4[4] Furthermore, if the stimulus rule is an object-center neglect test (distal-weighted test), the visual stimulus data d i [1], d i [2] Weighted value w i1 ~w i4 teeth, w i1 =w i2 =1 w i3 =1.2 w i4 =1.5 This is assumed (the weighting of response data is increased when displayed in the far (distal) region). <c1>(For patient 1, test for object center neglect (distal emphasis), number of displayed objects: 1) If patient 1 is the subject, then Figure 18 <c1>As shown, patient 1 correctly answered all questions regarding the 3D virtual representation using the visual stimulus data d3[1]~d3[4], so the total evaluation value sum_score(d3) = 4.7, and sum_score(d3) > Th2 (=3) is satisfied, so the judgment processing unit 18 determines that the patient is "normal" (the judgment result is set to "normal"). The judgment processing unit 18 then stores the data including the above judgment result as data D_rslt_all in the patient attribute data storage unit DB1. <c2>(For patient 2, test for object center neglect (distal emphasis), number of displayed objects: 1) When patient 2 is used as the subject, Figure 18 <c2>As shown in , patient 2 only gave correct answers to the tests on the 3D virtual display using the visual stimulus data d3[1], and gave incorrect answers to the tests on the 3D virtual displays using the visual stimulus data d3[2] to d3[4]. Therefore, the total evaluation value sum_score(d3) = -2.7. Since sum_score(d3) < Th1 (= 0) is satisfied, the determination processing unit 18 determines "abnormal" (sets the determination result to "abnormal"). Furthermore, the determination processing unit 18 determines from the above result data that "in the test for object-centered neglect (distal preference, single display), there is a tendency of object-centered neglect from the median to the distal", and stores the data including the above content and the above determination result (the determination result of "abnormal") in the patient attribute data storage unit DB1 as data D_rslt_all (updates the attribute data for patient 2). <c3>(For patient 3, test for object center neglect (distal emphasis), number of displayed objects: 1) If patient 3 is used as the subject, Figure 18 <c3>As shown in , patient 3 answered correctly for the test on the 3D virtual display using visual stimulus data d3[1] to d3[2], but answered incorrectly for the test on the 3D virtual display using visual stimulus data d3[3] to d3[4]. Therefore, the total evaluation value sum_score(d3) = -0.7. Since sum_score(d3) < th1 (= 0) is satisfied, the determination processing unit 18 determines "abnormal" (sets the determination result to "abnormal"). Furthermore, the determination processing unit 18 determines from the above result data that "in the object-centered neglect test (distal emphasis, single display), there is a tendency of object-centered neglect from the middle to the distal", and stores the data including the above content and the above determination result (the determination result of "abnormal") in the patient attribute data storage unit DB1 as data D_rslt_all (updates the attribute data for patient 3). <d1>(For patient 1, test for object center neglect (distal emphasis), number of displayed objects: 2) If patient 1 is the subject, then Figure 19 <d1>As shown, patient 1 correctly answers all questions in the examination regarding the 3D virtual representation using the visual stimulus data d4[1]~d4[4], so the total evaluation value sum_score(d4)=4, and sum_score(d4)>Th2(=3) is satisfied, so the judgment processing unit 18 determines that the patient is "normal" (the judgment result is set to "normal"). The judgment processing unit 18 then stores the data including the above judgment result as data D_rslt_all in the patient attribute data storage unit DB1. <d2>(For patient 2, test for object center neglect (distal emphasis), number of displayed objects: 2) When patient 2 is used as the subject, Figure 19 <d2>As shown, since patient 2 gave incorrect answers to the test on the 3D virtual display using the visual stimulus data d4[1] to d4[4], the total evaluation value sum_score(d4) = -4.7. Since sum_score(d4) < Th1 (= 0) is satisfied, the determination processing unit 18 determines "abnormal" (sets the determination result as "abnormal"). Further, from the above result data, the determination processing unit 18 determines that "there is a tendency of object-centered neglect in the object-centered neglect test (distal, multiple displays)", and stores the data including the above content and the above determination result (the determination result of "abnormal") in the patient attribute data storage unit DB1 as data D_rslt_all (updates the attribute data for patient 2). <d3>(For patient 3, test for object center neglect (distal emphasis), number of displayed objects: 2) If patient 3 is used as the subject, then Figure 19 <d3>As shown, patient 3 answered correctly for the test on the 3D virtual display with visual stimulus data d4[1] to d4[2], but answered incorrectly for the test on the 3D virtual display with visual stimulus data d4[3] to d4[4]. Therefore, the total evaluation value sum_score(d4) = -0.7, and since sum_score(d4) < Th1 (=0) is satisfied, the determination processing unit 18 determines "abnormal" (the determination result is set to "indeterminable"). Furthermore, the determination processing unit 18 determines from the above result data that "there is a tendency of object-centered neglect in the median to distal positions in the object-centered neglect test (distal, multiple displays)", and stores the data including the above content and the above determination result (the determination result of "abnormal") in the patient attribute data storage unit DB1 as data D_rslt_all (updates the attribute data for patient 3).

[0192] In this way, in the visuospatial cognitive processing system 1000, by adding the test items d3 and d4 and performing the test process, for patients who could not be determined only by the test items d1 and d2, a more accurate determination result can be obtained (for example, by adding and processing the test items d3 and d4, the determination result that "there is a tendency of object-centered neglect in the median to distal positions" for patient 3, which was "indeterminable" only by the test items d1 and d2, can be obtained).

[0193] In the above, the case of using it for the test process to determine the patient's symptoms in the visuospatial cognitive processing system 1000 has been described. However, in the visuospatial cognitive processing system 1000, the same process as the above can be performed, and training (for example, rehabilitation) for recovering the patient's symptoms can also be performed.

[0194] <<Summary>> As described above, the visuospatial cognitive processing system 1000 can perform highly accurate visuospatial cognition tests by setting stimulus rules considering the individual patient's attributes, generating diverse virtual objects based on the set stimulus rules (generating diverse virtual objects with diverse parameters), displaying them in a virtual 3D space with diverse parameters, and obtaining responses from the patient. In particular, the visuospatial cognitive processing system 1000 can perform highly accurate tests for object-center neglect, as explained above. For object-center neglect, a highly accurate test cannot be performed by testing only at the proximal position; therefore, it is effective to perform the test while changing the distance from the patient from proximal to distal. The visuospatial cognitive processing system 1000 can perform a test using a virtual object displayed proximal to the patient in a virtual 3D space, and display virtual objects in the virtual 3D space while changing the distance from the patient from proximal to distal, obtain responses from the patient, and judge the patient's symptoms from the situation of those responses, thus enabling extremely highly accurate tests for object-center neglect. Furthermore, the visuospatial cognitive processing system 1000 has a function and configuration that allows it to generate a variety of virtual objects and display them in a virtual 3D space simply by setting parameters, so that appropriate tests can be performed according to the patient's attributes (it has a function and configuration that dynamically generates a variety of virtual objects), so it can perform tests for visual cognitive impairments that develop due to a combination of factors that cause complex impairments with high accuracy.

[0195] Furthermore, the visuospatial cognitive processing system 1000 sets stimulus rules considering the individual patient's attributes. By setting stimulus rules considering the patient's tolerance for burden, and by setting the number of virtual objects to display in the virtual 3D space, the number of examinations, etc., it is possible to realize examinations that do not place an excessive burden on the patient.

[0196] Thus, the visuospatial cognitive processing system 1000 can appropriately and accurately perform visuospatial cognitive processing, which includes examinations and training for visual cognitive impairments caused by complex factors that result in complex disorders, while taking into account the individual patient's attributes and without placing an excessive burden on the patient.

[0197] [Second Embodiment] Next, a second embodiment will be described. Parts similar to those in the above embodiment are denoted by the same reference numerals, and detailed descriptions are omitted.

[0198] <2.1: Configuration of the Visuospatial Cognitive Processing System> Figure 20 is a schematic diagram of the visuospatial cognitive processing system 2000 according to the second embodiment.

[0199] The visuospatial cognitive processing system 2000 of the second embodiment has a configuration in which the visuospatial cognitive processing device 100 is replaced with a visuospatial cognitive processing device 100A in the visuospatial cognitive processing system 1000 of the first embodiment. The visuospatial cognitive processing device 100A of the second embodiment has a configuration in which the determination processing device 18 is replaced with a determination processing device 18A in the visuospatial cognitive processing device 100 of the first embodiment. Otherwise, the visuospatial cognitive processing system 2000 of the second embodiment is the same as the visuospatial cognitive processing system 1000 of the first embodiment.

[0200] The judgment processing unit 18A has the function of estimating the test results for egocentric spatial neglect, in addition to the functions of the judgment processing unit 18 of the first embodiment. If the judgment processing unit 18A determines that it can estimate the boundary of egocentric spatial neglect from the details of the test processing for the subject (patient), it acquires data about the boundary of egocentric spatial neglect. The acquired data about the boundary of egocentric spatial neglect is then included in the data D_rslt_all, output to the patient attribute data storage unit DB1, and stored in the patient attribute data storage unit DB1.

[0201] <2.2: Operation of the Visuospatial Cognitive Processing System> Next, we will explain the operation of the visuospatial cognitive processing system 2000.

[0202] Figures 21 to 24 schematically show the virtual three-dimensional space displayed by the processing performed by the visuospatial cognitive processing system 2000.

[0203] Figure 25 schematically shows the interface of egocentric spatial neglect estimated by processing performed by the visuospatial cognitive processing system 2000.

[0204] In the visuospatial cognitive processing system 2000, the same assumptions as in the first embodiment are used, and patient attribute data of the subject (patient) is acquired, and based on said patient attribute data, the acquired stimulus rule data (data included in data D2) is used. (1) Data for stimulus rules for the object-center neglect test (general test, number of displayed objects: multiple) (this will be referred to as test item d1) Assuming this is the case, the display object generation processing unit 15 generates the following visual stimulus data sequence d i Generate [j]. (Test 1): First visual stimulus data sequence (Number of display objects: 2, data sequence to vary the distance from the patient's viewpoint to the objects in 4 steps) d1[1]~d1[4] In the above, the display object generation processing unit 15 sets the parameters (adjustable variables) of the stimulus rule data, taking into consideration the patient attribute data, and the visual stimulus data column d i [j] is being generated. In other words, the display object generation processing unit 15 takes into account the patient attribute data "Test load tolerance: medium" to set the number of times the object is displayed in (Test 1) to a predetermined number (4 times in the above case), and takes into account the patient attribute data "Object center neglect: present (level: weak)" to generate a sequence of visual stimulus data to change the distance from the patient's viewpoint to the object in multiple stages (4 stages in the above case) in order to accurately detect the symptoms of object center neglect.

[0205] Here, an example of the settings for the first visual stimulus data sequence d1[1]~d1[4] is shown below. ≪1-1: First visual stimulus data d1[1] (distance d1, number of displays: 2)≫ d1[1].Obj.num=2(number of virtual objects to display) (First object): d1[1].Obj1.dist = d1(distance from viewpoint to virtual object) d1[1].Obj1.pos=(x11,y11,z11)(Position of the center point of the virtual object) d1[1].Obj1.color=Yellow d1[1].Obj1_L.attri=Number d1[1].Obj1_L.disp=「1」 d1[1].Obj1_L.color=Black d1[1].Obj1_L.size = Medium Size d1[1].Obj1_L.pos=(xL11,yL11,zL11) d1[1].Obj1_L.angle=0° d1[1].Obj1_R.attri=Number d1[1].Obj1_R.disp=「2」 d1[1].Obj1_R.color=Black d1[1].Obj1_R.size = Medium Size d1[1].Obj1_R.pos=(xR11,yR11,zR11) d1[1].Obj1_R.angle=0° (Second object): d1[1].Obj2.dist = d1(distance from viewpoint to virtual object) d1[1].Obj2.pos=(x12,y12,z12)(position of the virtual object's center point) d1[1].Obj2.color=Yellow d1[1].Obj2_L.attri=Number d1[1].Obj2_L.disp=「3」 d1[1].Obj2_L.color=Black d1[1].Obj2_L.size = Medium Size d1[1].Obj2_L.pos=(xL12,yL12,zL12) d1[1].Obj2_L.angle=0° d1[1].Obj2_R.attri=Number d1[1].Obj2_R.disp=「4」 d1[1].Obj2_R.color=Black d1[1].Obj2_R.size = Medium Size d1[1].Obj2_R.pos=(xR12,yR12,zR12) d1[1].Obj2_R.angle=0° ≪1-2: First visual stimulus data d1[2] (distance d2, number of displays: 2)≫ d1[2].Obj.num=2(number of virtual objects to display) (First object): d1[2].Obj1.dist = d2(distance from viewpoint to virtual object) d1[2].Obj1.pos=(x21,y21,z21)(position of the virtual object's center point) d1[2].Obj1.color=Yellow d1[2].Obj1_L.attri=Number d1[2].Obj1_L.disp=「1」 d1[2].Obj1_L.color=Black d1[2].Obj1_L.size = Medium Size d1[2].Obj1_L.pos=(xL21,yL21,zL21) d1[2].Obj1_L.angle=0° d1[2].Obj1_R.attri=Number d1[2].Obj1_R.disp=「2」 d1[2].Obj1_R.color=Black d1[2].Obj1_R.size = Medium Size d1[2].Obj1_R.pos=(xR21,yR21,zR21) d1[2].Obj1_R.angle=0° (Second object): d1[2].Obj2.dist = d2(distance from viewpoint to virtual object) d1[2].Obj2.pos=(x22,y22,z22)(position of the virtual object's center point) d1[2].Obj2.color=Yellow d1[2].Obj2_L.attri=Number d1[2].Obj2_L.disp=「3」 d1[2].Obj2_L.color=Black d1[2].Obj2_L.size=medium size d1[2].Obj2_L.pos=(xL22,yL22,zL22) d1[2].Obj2_L.angle=0° d1[2].Obj2_R.attri=Number d1[2].Obj2_R.disp=「4」 d1[2].Obj2_R.color=Black d1[2].Obj2_R.size = Medium Size d1[2].Obj2_R.pos=(xR12,yR12,zR12) d1[2].Obj2_R.angle=0° ≪1-3: First visual stimulus data d1[3] (distance d3, number of displays: 2)≫ d1[3].Obj.num=2(number of virtual objects to display) (First object): d1[3].Obj1.dist = d3(distance from viewpoint to virtual object) d1[3].Obj1.pos=(x31,y31,z31)(Position of the center point of the virtual object) d1[3].Obj1.color=Yellow d1[3].Obj1_L.attri=Number d1[3].Obj1_L.disp=「1」 d1[3].Obj1_L.color=Black d1[3].Obj1_L.size=medium size d1[3].Obj1_L.pos=(xL31,yL31,zL31) d1[3].Obj1_L.angle=0° d1[3].Obj1_R.attri=Number d1[3].Obj1_R.disp=「2」 d1[3].Obj1_R.color=Black d1[3].Obj1_R.size = Medium Size d1[3].Obj1_R.pos=(xR31,yR31,zR31) d1[3].Obj1_R.angle=0° (Second object): d1[3].Obj2.dist = d3(distance from viewpoint to virtual object) d1[3].Obj1.pos=(x32,y32,z32)(Position of the center point of the virtual object) d1[3].Obj1.color=Yellow d1[3].Obj2_L.attri=Number d1[3].Obj2_L.disp=「3」 d1[3].Obj2_L.color=Black d1[3].Obj2_L.size=medium size d1[3].Obj2_L.pos=(xL32,yL32,zL32) d1[3].Obj2_L.angle=0° d1[3].Obj2_R.attri=Number d1[3].Obj2_R.disp=「4」 d1[3].Obj2_R.color=Black d1[3].Obj2_R.size = Medium Size d1[3].Obj2_R.pos=(xR12,yR12,zR12) d1[3].Obj2_R.angle=0° ≪1-4: First visual stimulus data d1[4] (distance d4, number of displays: 2)≫ d1[4].Obj.num=2(number of virtual objects to display) (First object): d1[4].Obj1.dist = d4(distance from viewpoint to virtual object) d1[4].Obj1.pos=(x41,y41,z41)(Position of the center point of the virtual object) d1[4].Obj1.color=Yellow d1[4].Obj1_L.attri=Number d1[4].Obj1_L.disp=「1」 d1[4].Obj1_L.color=Black d1[4].Obj1_L.size=medium size d1[4].Obj1_L.pos=(xL41,yL41,zL41) d1[4].Obj1_L.angle=0° d1[4].Obj1_R.attri=Number d1[4].Obj1_R.disp=「2」 d1[4].Obj1_R.color=Black d1[4].Obj1_R.size = Medium Size d1[4].Obj1_R.pos=(xR41,yR41,zR41) d1[4].Obj1_R.angle=0° (Second object): d1[4].Obj2.dist=d4(distance from viewpoint to virtual object) d1[4].Obj2.pos=(x42,y42,z42)(Position of the center point of the virtual object) d1[4].Obj2.color=Yellow d1[4].Obj2_L.attri=Number d1[4].Obj2_L.disp=「3」 d1[4].Obj2_L.color=Black d1[4].Obj2_L.size=medium size d1[4].Obj2_L.pos=(xL42,yL42,zL42) d1[4].Obj2_L.angle=0° d1[4].Obj2_R.attri=Number d1[4].Obj2_R.disp=「4」 d1[4].Obj2_R.color=Black d1[4].Obj2_R.size = Medium Size d1[4].Obj2_R.pos=(xR42,yR42,zR42) d1[4].Obj2_R.angle=0° In the visuospatial cognitive processing system 2000, the processes of steps 1, 2, 3, and 401-405 in Figures 5 and 6 are executed, similar to the first embodiment.

[0206] (Step S406): In step S406, the visual stimulus data d i Display processing (3D virtual display processing) is performed by [j]. Specifically, the following processes are performed.

[0207] ≪First time (i=1, j=1) (State 3-1, Figure 21)≫ In the first processing, i=1, j=1, so the visual stimulus data d i The display process (3D virtual display process) is executed by [j](i=1, j=1).

[0208] The visual stimulus data d1[1] (distance d1, number of displays: 2) is, d1[1].Obj.num=2(number of virtual objects to display) (First object): d1[1].Obj1.dist = d1(distance from viewpoint to virtual object) d1[1].Obj1.pos=(x11,y11,z11)(Position of the center point of the virtual object) d1[1].Obj1.color=Yellow d1[1].Obj1_L.attri=Number d1[1].Obj1_L.disp=「1」 d1[1].Obj1_L.color=Black d1[1].Obj1_L.size = Medium Size d1[1].Obj1_L.pos=(xL11,yL11,zL11) d1[1].Obj1_L.angle=0° d1[1].Obj1_R.attri=Number d1[1].Obj1_R.disp=「2」 d1[1].Obj1_R.color=Black d1[1].Obj1_R.size = Medium Size d1[1].Obj1_R.pos=(xR11,yR11,zR11) d1[1].Obj1_R.angle=0° (Second object): d1[1].Obj2.dist = d1(distance from viewpoint to virtual object) d1[1].Obj2.pos=(x12,y12,z12)(position of the virtual object's center point) d1[1].Obj2.color=Yellow d1[1].Obj2_L.attri=Number d1[1].Obj2_L.disp=「3」 d1[1].Obj2_L.color=Black d1[1].Obj2_L.size = Medium Size d1[1].Obj2_L.pos=(xL12,yL12,zL12) d1[1].Obj2_L.angle=0° d1[1].Obj2_R.attri=Number d1[1].Obj2_R.disp=「4」 d1[1].Obj2_R.color=Black d1[1].Obj2_R.size = Medium Size d1[1].Obj2_R.pos=(xR12,yR12,zR12) d1[1].Obj2_R.angle=0° Therefore, the display object generation processing unit 15 outputs the data including the above data as data D3 to the display processing unit 16 and the response input acquisition processing unit 14 (step S406).

[0209] Then, the processing in steps S407 to S412 is performed in the same manner as in the first embodiment.

[0210] In the first processing, a virtual object (a virtual object based on d1[1]) is displayed in the virtual 3D space SP_3D, as shown in Figure 21.

[0211] Then, in the first processing, the judgment processing unit 18A will store the results of the following decisions: (1) The patient's response regarding the first (left) object (d1[1].Obj1) was incorrect for both numbers, and (1) the patient's response regarding the second (right) object (d1[1].Obj2) was correct for both numbers.

[0212] ≪Second attempt (i=1, j=2) (State 3-2, Figure 22)≫ In the second processing, i=1 and j=2, so the visual stimulus data d i Display processing (3D virtual display processing) is performed using [j](i=1, j=2).

[0213] The visual stimulus data d1[2] (distance d2, number of displays: 2) is, d1[2].Obj.num=2(number of virtual objects to display) (First object): d1[2].Obj1.dist = d2(distance from viewpoint to virtual object) d1[2].Obj1.pos=(x21,y21,z21)(position of the virtual object's center point) d1[2].Obj1.color=Yellow d1[2].Obj1_L.attri=Number d1[2].Obj1_L.disp=「1」 d1[2].Obj1_L.color=Black d1[2].Obj1_L.size = Medium Size d1[2].Obj1_L.pos=(xL21,yL21,zL21) d1[2].Obj1_L.angle=0° d1[2].Obj1_R.attri=Number d1[2].Obj1_R.disp=「2」 d1[2].Obj1_R.color=Black d1[2].Obj1_R.size = Medium Size d1[2].Obj1_R.pos=(xR21,yR21,zR21) d1[2].Obj1_R.angle=0° (Second object): d1[2].Obj2.dist = d2(distance from viewpoint to virtual object) d1[2].Obj2.pos=(x22,y22,z22)(position of the virtual object's center point) d1[2].Obj2.color=Yellow d1[2].Obj2_L.attri=Number d1[2].Obj2_L.disp=「3」 d1[2].Obj2_L.color=Black d1[2].Obj2_L.size=medium size d1[2].Obj2_L.pos=(xL22,yL22,zL22) d1[2].Obj2_L.angle=0° d1[2].Obj2_R.attri=Number d1[2].Obj2_R.disp=「4」 d1[2].Obj2_R.color=Black d1[2].Obj2_R.size = Medium Size d1[2].Obj2_R.pos=(xR12,yR12,zR12) d1[2].Obj2_R.angle=0° Therefore, the display object generation processing unit 15 outputs the data including the above data as data D3 to the display processing unit 16 and the response input acquisition processing unit 14 (step S406).

[0214] Then, the processing in steps S407 to S412 is performed in the same manner as in the first embodiment.

[0215] In the second processing step, a virtual object (a virtual object based on d1[2]) is displayed in the virtual 3D space SP_3D, as shown in Figure 22.

[0216] Then, in the second processing, if (1) the patient's response regarding the first (left) object (d1[2].Obj1) is incorrect for both numbers, and (1) the response regarding the second (right) object (d1[2].Obj2) is correct for both numbers, the judgment processing unit 18A will retain the contents of the response.

[0217] ≪3rd time (i=1, j=3) (State 3-3, Figure 23)≫ In the third processing, i=1 and j=3, so the visual stimulus data d i Display processing (3D virtual display processing) is performed using [j](i=1, j=3).

[0218] The visual stimulus data d1[3] (distance d3, number of displays: 2) is, d1[3].Obj.num=2(number of virtual objects to display) (First object): d1[3].Obj1.dist = d3(distance from viewpoint to virtual object) d1[3].Obj1.pos=(x31,y31,z31)(Position of the center point of the virtual object) d1[3].Obj1.color=Yellow d1[3].Obj1_L.attri=Number d1[3].Obj1_L.disp=「1」 d1[3].Obj1_L.color=Black d1[3].Obj1_L.size=medium size d1[3].Obj1_L.pos=(xL31,yL31,zL31) d1[3].Obj1_L.angle=0° d1[3].Obj1_R.attri=Number d1[3].Obj1_R.disp=「2」 d1[3].Obj1_R.color=Black d1[3].Obj1_R.size = Medium Size d1[3].Obj1_R.pos=(xR31,yR31,zR31) d1[3].Obj1_R.angle=0° (Second object): d1[3].Obj2.dist = d3(distance from viewpoint to virtual object) d1[3].Obj2.pos=(x32,y32,z32)(Position of the center point of the virtual object) d1[3].Obj2.color=Yellow d1[3].Obj2_L.attri=Number d1[3].Obj2_L.disp=「3」 d1[3].Obj2_L.color=Black d1[3].Obj2_L.size=medium size d1[3].Obj2_L.pos=(xL32,yL32,zL32) d1[3].Obj2_L.angle=0° d1[3].Obj2_R.attri=Number d1[3].Obj2_R.disp=「4」 d1[3].Obj2_R.color=Black d1[3].Obj2_R.size = Medium Size d1[3].Obj2_R.pos=(xR12,yR12,zR12) d1[3].Obj2_R.angle=0° Therefore, the display object generation processing unit 15 outputs the data including the above data as data D3 to the display processing unit 16 and the response input acquisition processing unit 14 (step S406).

[0219] Then, the processing in steps S407 to S412 is performed in the same manner as in the first embodiment.

[0220] In the second processing, a virtual object (a virtual object based on d1[3]) is displayed in the virtual 3D space SP_3D, as shown in Figure 23.

[0221] Then, in the third processing, if (1) the patient's response regarding the first (left) object (d1[3].Obj1) is incorrect for both numbers, and (1) the response regarding the second (right) object (d1[3].Obj2) is correct for both numbers, the judgment processing unit 18A will retain the contents of the response.

[0222] ≪4th time (i=1, j=4) (State 3-4, Figure 24)≫ In the fourth processing step, i=1 and j=4, so the visual stimulus data d i Display processing (3D virtual display processing) is performed using [j](i=1, j=3).

[0223] The visual stimulus data d1[4] (distance d2, number of displays: 2) d1[4].Obj.num=2(number of virtual objects to display) (First object): d1[4].Obj1.dist = d4(distance from viewpoint to virtual object) d1[4].Obj1.pos=(x41,y41,z41)(Position of the center point of the virtual object) d1[4].Obj1.color=Yellow d1[4].Obj1_L.attri=Number d1[4].Obj1_L.disp=「1」 d1[4].Obj1_L.color=Black d1[4].Obj1_L.size=medium size d1[4].Obj1_L.pos=(xL41,yL41,zL41) d1[4].Obj1_L.angle=0° d1[4].Obj1_R.attri=Number d1[4].Obj1_R.disp=「2」 d1[4].Obj1_R.color=Black d1[4].Obj1_R.size = Medium Size d1[4].Obj1_R.pos=(xR41,yR41,zR41) d1[4].Obj1_R.angle=0° (Second object): d1[4].Obj2.dist=d4(distance from viewpoint to virtual object) d1[4].Obj2.pos=(x42,y42,z42)(Position of the center point of the virtual object) d1[4].Obj2.color=Yellow d1[4].Obj2_L.attri=Number d1[4].Obj2_L.disp=「3」 d1[4].Obj2_L.color=Black d1[4].Obj2_L.size=medium size d1[4].Obj2_L.pos=(xL42,yL42,zL42) d1[4].Obj2_L.angle=0° d1[4].Obj2_R.attri=Number d1[4].Obj2_R.disp=「4」 d1[4].Obj2_R.color=Black d1[4].Obj2_R.size = Medium Size d1[4].Obj2_R.pos=(xR42,yR42,zR42) d1[4].Obj2_R.angle=0° Therefore, the display object generation processing unit 15 outputs the data including the above data as data D3 to the display processing unit 16 and the response input acquisition processing unit 14 (step S406).

[0224] Then, the processing in steps S407 to S412 is performed in the same manner as in the first embodiment.

[0225] In the second processing, a virtual object (a virtual object based on d1[4]) is displayed in the virtual 3D space SP_3D, as shown in Figure 24.

[0226] Then, in the fourth processing, if (1) the patient's response regarding the first (left) object (d1[4].Obj1) is incorrect for both numbers, and (1) the response regarding the second (right) object (d1[4].Obj2) is correct for both numbers, the judgment processing unit 18A will retain the contents of the response.

[0227] The judgment processing unit 18A estimates from the details of the test processing for the subject (patient) obtained through the above processing that (1) for d1[1].Obj1~d1[4].Obj1 (a virtual object displayed on the left, displayed as "12"), the patient answered both numbers incorrectly, and (2) for d1[1].Obj2~d1[4].Obj2 (a virtual object displayed on the right, displayed as "34"), the patient answered both numbers correctly. Therefore, the judgment processing unit 18A estimates that the boundary surface of egocentric spatial neglect exists at a position that separates the space containing all the positions where d1[1].Obj1~d1[4].Obj1 is displayed from the space containing all the positions where d1[1].Obj2~d1[4].Obj2 is displayed. For example, it estimates that the plane PL_boundary connecting (including) points pB1, pB2, pB3, and pB4 shown in Figure 20 is the boundary surface of egocentric spatial neglect.

[0228] Then, the determination processing unit 18A obtains data about the self-centered spatial neglect boundary surface through the estimation process described above, includes the obtained data about the self-centered spatial neglect boundary surface in the data D_rslt_all, outputs it to the patient attribute data storage unit DB1, and stores it in the patient attribute data storage unit DB1.

[0229] In the above description, the interface of egocentric spatial neglect is estimated as a plane in the visuospatial cognitive processing system 2000, but it is not limited to this, and the interface of egocentric spatial neglect may also be estimated as a curved surface.

[0230] As described above, in the visuospatial cognitive processing system 2000, while performing an object-center neglect test, if the patient makes incorrect answers with a high probability regarding letters, numbers, figures, etc. displayed on the surface of a virtual object displayed in a predetermined area, and makes correct answers with a high probability regarding letters, numbers, figures, etc. displayed on the surface of a virtual object displayed outside that area, the boundary surface of that area (a surface identified by a plane, curved surface, etc.) can be estimated as the boundary surface of the patient's (subject's) egocentric spatial neglect.

[0231] For the sake of explanation, the above description describes a case in which a virtual object is displayed near the boundary of egocentric spatial neglect in the visuospatial cognitive processing system 2000 to conduct the test. However, the system is not limited to this, and the visuospatial cognitive processing system 2000 may also display virtual objects at random positions in the 3D space SP_3D to grasp the status of the patient's (subject's) correct answer probability, and estimate the patient's (subject's) egocentric spatial neglect boundary from the status of the patient's (subject's) correct answer probability.

[0232] [Other embodiments] In the above embodiment, we have described an example in which the visuospatial cognitive processing system processes data by changing the distance from the patient to the position of the virtual object in the virtual 3D space where the virtual object is displayed in four stages. However, the system is not limited to this, and the number of stages for changing the distance may be increased, or the characters, numbers, figures, etc. on the surface of the virtual object displayed at a predetermined distance may be changed multiple times and displayed for examination and training (visuospatial cognitive processing). Furthermore, in the visuospatial cognitive processing system, virtual objects may be displayed randomly in the virtual 3D space for examination and training (visuospatial cognitive processing).

[0233] In the above embodiment, we have described a case in which, in a visuospatial cognitive processing system, characters, numbers, figures, etc., are displayed in regions that are equally divided left and right by a central axis (ax0 in Figure 7) on the surface of a virtual object displayed in a virtual 3D space. However, the system is not limited to this, and on the surface of the virtual object, left and right regions may be set up so that the size and shape of the left and right regions are different, and characters, numbers, figures, etc., of different sizes and shapes may be displayed in the left and right regions, respectively.

[0234] Furthermore, in the above embodiment, the virtual object displayed in the virtual 3D space in the visuospatial cognitive processing system was described as being in an upright state (ax0 in Figure 7 (the central axis for dividing the left and right regions) is in the vertical direction). However, the system is not limited to this, and the virtual object itself may be rotated when displayed in the virtual 3D space (a parameter for rotating the virtual object itself may be provided (for example, the angle that ax0 in Figure 7 (the central axis for dividing the left and right regions) makes with the vertical direction may be used as the parameter for rotating the virtual object itself)). In this case, the angle for rotating the virtual object itself should be set by a parameter between 0 and 90° (when the angle for rotating the virtual object itself is 90°, the surface of the virtual object will be divided into two regions, upper and lower).

[0235] In the above embodiment, a case was described in which one character, number, figure, etc. is displayed in the left region and the right region of the surface of a virtual object displayed in a virtual 3D space, respectively, in a visuospatial cognitive processing system. However, the system is not limited to this, and multiple characters (strings of two or more characters), numbers (numbers of two or more digits), figures (sequences of figures including two or more figures), etc. may be displayed in the left region of the surface of the virtual object, and multiple characters (strings of two or more characters), numbers (numbers of two or more digits), figures (sequences of figures including two or more figures), etc. may be displayed in the right region of the surface of the virtual object.

[0236] In the above embodiment, the case in which the virtual object displayed in the virtual 3D space in the visuospatial cognitive processing system is disc-shaped was described, but the system is not limited to this, and the shape of the virtual object may be other than disc-shaped.

[0237] In the visuospatial cognitive processing system of the above embodiment, the arrangement of the functional units of the visuospatial cognitive processing device and the 3D display device is not limited to the case shown in the above embodiment. One or more functional units of the visuospatial cognitive processing device may be installed in the 3D display device, or one or more functional units of the 3D display device may be installed in the visuospatial cognitive processing device.

[0238] Furthermore, the patient attribute data storage unit DB1 and the stimulus rule data storage unit DB2 of the visuospatial cognitive processing system in the above embodiment may be installed outside the visuospatial cognitive processing device.

[0239] Furthermore, in the visuospatial cognitive processing system of the above embodiment, the 3D display device 200 is realized using an HMD (Head Mounted Display) device (for example, VR goggles (VR: Virtual Reality), MR goggles (MR: Mixed Reality), AR goggles (AR: Augmented Reality), etc.), but it is not limited to this. Alternatively, an external display device (for example, a display device installed at the position of V_src in Figure 3) may be used to display a left-eye image (left-eye video) and a right-eye image (right-eye video) using, for example, spatial division or time division, so that the left-eye image (left-eye video) is input to the subject's left eye and the right-eye image (right-eye video) is input to the subject's right eye (for example, 3D video glasses) (to be worn by the subject), thereby performing a virtual 3D display so that the subject perceives virtual objects displayed in a virtual 3D space. Alternatively, hologram technology or a device that provides virtual 3D display without the need for 3D glasses may be used to display virtual objects within a virtual 3D space.

[0240] Furthermore, in the visuospatial cognitive processing system, visuospatial cognitive processing device, and 3D display device described in the above embodiments, each block may be individually integrated into a single chip using semiconductor devices such as LSIs, or it may be integrated into a single chip including some or all of the blocks.

[0241] Although we have used the term LSI here, depending on the degree of integration, they may also be called IC, system LSI, super LSI, or ultra LSI.

[0242] Furthermore, the method of integrated circuit implementation is not limited to LSIs; it may also be implemented using dedicated circuits or general-purpose processors. After LSI manufacturing, FPGAs (Field Programmable Gate Arrays) that can be programmed, or reconfigurable processors that allow for the reconfiguration of the connections and settings of circuit cells inside the LSI, may also be used.

[0243] Furthermore, some or all of the processing of each functional block in each of the above embodiments may be implemented by a program. And some or all of the processing of each functional block in each of the above embodiments is performed by the central processing unit (CPU) in a computer. The programs for each of these processes are stored in a storage device such as a hard disk or ROM, and are read from the ROM or RAM and executed.

[0244] Furthermore, each process of the above embodiment may be implemented by hardware, or by software (including cases where it is implemented together with an OS (operating system), middleware, or a predetermined library). It may also be implemented by a mixed process of software and hardware. Additionally, some or all of the processes of the above embodiment may be implemented (executed) using, for example, one or more processors and / or one or more memories accessible from one or more processors. The processor may be implemented using, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a DSP (Digital Signal Processor), or an ASIC (Application Specific Integrated Circuit). The processor may also be a multiprocessor including two or more independent processors (two or more cores). Furthermore, the processor may include memory.

[0245] Furthermore, for example, when each functional unit of the above embodiment (including modified versions) is implemented by software, the hardware configuration shown in Figure 26 (for example, a hardware configuration in which a CPU (which may be a GPU), ROM, RAM, input unit, output unit, etc. are connected by a bus) may be used to implement each functional unit by software processing.

[0246] Furthermore, when each of the functional units of the above embodiment is implemented by software, the software may be implemented using a single computer having the hardware configuration shown in Figure 26, or it may be implemented by distributed processing using multiple computers.

[0247] Furthermore, the execution order of the processing method in the above embodiments is not necessarily limited to the description of the embodiments, and the execution order can be changed without departing from the spirit of the invention. Also, in the processing method in the above embodiments, some steps may be executed in parallel with other steps without departing from the spirit of the invention.

[0248] A computer program that causes a computer to execute the method described above, and a computer-readable recording medium on which such program is recorded, are included in the scope of the present invention. Examples of computer-readable recording media include flexible disks, hard disks, CD-ROMs, MOs, DVDs, DVD-ROMs, DVD-RAMs, high-capacity DVDs, next-generation DVDs, and semiconductor memory.

[0249] The above-mentioned computer program is not limited to one recorded on the above-mentioned recording medium, but may also be transmitted via telecommunications lines, wireless or wired communication lines, networks such as the Internet, etc.

[0250] It should be noted that the specific configuration of the present invention is not limited to the embodiments described above, and various changes and modifications are possible without departing from the spirit of the invention.

[0251] [Note] The present invention can also be expressed as follows.

[0252] The first invention is a visuospatial cognitive processing system for performing visuospatial cognitive processing on a subject by displaying virtual objects in a virtual three-dimensional space, comprising a patient attribute data storage unit, an attribute data acquisition unit, a stimulus rule data storage unit, a stimulus rule setting unit, a display object generation processing unit, a display processing unit, and a three-dimensional display unit.

[0253] The patient attribute data storage unit is a functional unit for storing the patient attribute data of the subject.

[0254] The attribute data acquisition unit acquires patient attribute data of the subject from the attribute data storage unit.

[0255] The stimulus rule data storage unit is a functional unit for storing stimulus rule data, which is data about rules for generating virtual objects based on patient attribute data.

[0256] The stimulus rule setting unit retrieves stimulus rule data suitable for performing visuospatial cognitive processing on the subject from the stimulus rule data storage unit based on the patient attribute data of the subject acquired by the attribute data acquisition unit, and sets the stimulus rule data to be used when performing visuospatial cognitive processing on the subject.

[0257] The display object generation processing unit determines virtual object parameters, which are parameters for determining the virtual object to be displayed in the virtual 3D space, based on the patient attribute data of the subject acquired by the attribute data acquisition unit and the stimulus rule data set by the stimulus rule setting unit.

[0258] The display processing unit acquires virtual object display data, which is the display data for virtual objects to be displayed in the virtual 3D space, based on the parameters determined by the display object generation processing unit.

[0259] The 3D display unit performs processing to display virtual objects in a virtual 3D space based on the virtual object display data acquired by the display processing unit.

[0260] This visuospatial cognitive processing system takes into account the individual patient's attributes to set stimulus rules, generates a variety of virtual objects based on those rules (generating a variety of virtual objects using various parameters), and displays them in a virtual 3D space using various parameters. For example, by obtaining responses from the patient, it is possible to perform highly accurate examinations on visuospatial cognition.

[0261] In other words, this visuospatial cognitive processing system has the functionality and configuration to generate a variety of virtual objects and display them in a virtual 3D space simply by setting parameters according to the patient's attributes (it has the functionality and configuration to dynamically generate a variety of virtual objects), so it can perform highly accurate examinations for visual cognitive impairments that occur due to a combination of factors that cause complex impairments.

[0262] Therefore, this visuospatial cognitive processing system can appropriately and accurately perform visuospatial cognitive processing, which includes examinations and training for visual cognitive impairments caused by complex factors that result in multiple impairments, while taking into account the individual patient's attributes.

[0263] Furthermore, a virtual three-dimensional space is a concept that includes a virtually defined three-dimensional space on which virtual objects can be displayed against a virtually defined background. A virtual three-dimensional space may also be a space for displaying a virtual three-dimensional image (video) in which virtual objects are superimposed onto a real three-dimensional space (a three-dimensional space perceived by taking an image (video) of the real space captured at the position of the subject's left eye as the left-eye image (left-eye video), taking an image (video) of the real space captured at the position of the subject's right eye as the right-eye image (left-eye video), inputting the right-eye video into the right eye, and inputting the left-eye video into the left eye).

[0264] The second invention is the first invention, wherein the virtual object includes one base virtual object, a first virtual object located in a first region which is one of the regions obtained by dividing the surface of the base virtual object into two, and a second virtual object different from the first virtual object located in a second region which is the other region obtained by dividing the surface of the base virtual object into two.

[0265] The parameters for the virtual objects include parameters for determining the display attributes of the first and second virtual objects.

[0266] This allows the visuospatial cognitive processing system to display different display attributes in each region of the divided surface of a virtual object.

[0267] Furthermore, "display attributes" are a concept that includes the type of object to be displayed (numbers, characters, shapes, etc.), the size of the object to be displayed, the angle, the color, etc.

[0268] The "first virtual object" is, for example, something that forms a number, letter, figure, etc., and may form one or more numbers, one or more letters, and / or one or more figures, etc.

[0269] The "second virtual object" is, for example, something that forms a number, letter, figure, etc., and may form one or more numbers, one or more letters, and / or one or more figures, etc.

[0270] The third invention is the second invention, wherein the parameters for the virtual object include parameters for determining the display position of the virtual object in a virtual three-dimensional space, or parameters for determining the display positions of the first virtual object and the second virtual object in a virtual three-dimensional space.

[0271] This allows the visuospatial cognitive processing system to arbitrarily change the distance from the patient to a virtual object in a virtual 3D space. For example, in object-center neglect testing (or training), by changing the distance from the patient to the virtual object while processing, highly accurate object-center neglect testing (or training) can be performed.

[0272] The fourth invention is any of the first to third inventions, wherein the display object generation processing unit determines a burden tolerance level indicating the degree to which the subject can be burdened, based on the subject's patient attribute data, and acquires multiple data for displaying a virtual object by setting multiple virtual object parameters based on the burden tolerance level.

[0273] The display unit acquires multiple virtual object display data based on multiple data obtained by the display object generation processing unit.

[0274] The 3D display unit displays virtual objects in a virtual 3D space based on each of the multiple virtual object display data sets.

[0275] This allows the visuospatial cognitive processing system to set stimulus rules considering the individual patient's attributes, as well as the patient's tolerance for burden. By setting the number of virtual objects to display in the virtual 3D space, the number of examinations, etc., it is possible to realize examinations that do not place an excessive burden on the patient.

[0276] Therefore, this visuospatial cognitive processing system can appropriately and accurately perform visuospatial cognitive processing, including examinations and training, for visual cognitive impairments caused by complex factors that result in multiple disabilities, while taking into account the individual patient's attributes and without placing an excessive burden on the patient.

[0277] The fifth invention is the second or third invention, further comprising: an answer input acquisition unit that acquires a response from a subject when a virtual object is displayed in a virtual three-dimensional space; and a determination processing unit that determines the subject's state based on the response from the subject.

[0278] The display object generation processing unit determines whether the subject's response is correct or incorrect when the virtual object is displayed, based on the first and second virtual objects of the virtual object, sets an evaluation value for when the response is correct and an evaluation value for when the response is incorrect, and when the response input acquisition unit acquires a response from the subject, it acquires an evaluation value for that response.

[0279] The judgment processing unit determines the subject's condition based on the evaluation values ​​obtained by the display object generation processing unit.

[0280] This allows the visuospatial cognitive processing system to appropriately determine the subject's state based on evaluation values.

[0281] The sixth invention is the second or third invention, further comprising: an answer input acquisition unit that acquires a response from a subject when a virtual object is displayed in a virtual three-dimensional space; and a determination processing unit that determines the state of the subject based on the response from the subject.

[0282] The display object generation processing unit adjusts the parameters for the virtual object based on the responses from the subject, as determined by the response input acquisition unit.

[0283] This allows the visuospatial cognitive processing system to adjust parameters for virtual objects based on responses from the subject.

[0284] The seventh invention is the fifth invention, wherein the determination processing unit, based on the response from the subject obtained by the response input acquisition unit or the evaluation value obtained by the display object generation processing unit, determines that the subject has a tendency to neglect egocentric space, and then performs a process to estimate the boundary of the subject's egocentric space neglect.

[0285] This allows the visuospatial cognitive processing system to estimate the subject's egocentric spatial neglect boundary while simultaneously performing an object-centered neglect test.

[0286] The eighth invention is a visuospatial cognitive processing method for displaying virtual objects in a virtual three-dimensional space and performing visuospatial cognitive processing on a subject. A patient attribute data storage unit that stores patient attribute data of the subject, A stimulus rule data storage unit stores stimulus rule data, which is data about the rules for generating virtual objects based on patient attribute data. This is a visuospatial cognitive processing method that is performed using a system equipped with [specific features / features].

[0287] The visuospatial cognitive processing method comprises an attribute data acquisition step, a stimulus rule setting step, a display object generation processing step, a display processing step, and a 3D display step.

[0288] The attribute data acquisition step involves acquiring the patient attribute data of the subject from the attribute data storage unit.

[0289] The stimulus rule setting step retrieves stimulus rule data suitable for performing visuospatial cognitive processing on the subject from the stimulus rule data storage unit based on the subject's patient attribute data obtained in the attribute data acquisition step, and sets the stimulus rule data to be used when performing visuospatial cognitive processing on the subject.

[0290] The display object generation process step determines virtual object parameters, which are parameters for determining the virtual object to be displayed in the virtual 3D space, based on the patient attribute data of the subject obtained in the attribute data acquisition step and the stimulus rule data set in the stimulus rule setting step.

[0291] The display processing step obtains virtual object display data, which is the display data for the virtual object to be displayed in the virtual 3D space, based on the parameters determined in the display object generation processing step.

[0292] The 3D display step performs a process to display virtual objects in a virtual 3D space based on the virtual object display data acquired in the display processing step.

[0293] This makes it possible to realize a visuospatial cognitive processing method that produces the same effects as the first invention.

[0294] Each step of the visuospatial cognitive processing method is implemented (or executed) using, for example, one or more processors and / or one or more memories accessible from one or more processors.

[0295] The ninth invention is a program for causing a computer to execute the visuospatial cognitive processing method, which is the eighth invention.

[0296] This makes it possible to realize a program that causes a computer to execute a visuospatial cognitive processing method that produces the same effects as the first invention. [Explanation of Symbols]

[0297] 1000, 2000 Visuospatial Cognitive Processing Systems 100, 100A Visuospatial Recognition Processing Device 12. Attribute data acquisition unit 13. Stimulation Rule Setting Section 14. Response Input Acquisition Processing Unit 15 Display Object Generation Processing Unit 16 Display Processing Unit 18, 18A Determination Processing Unit 200 3D display device DB1 Patient Attribute Data Storage Unit DB2 Stimulus Rule Data Storage Unit

Claims

1. A visuospatial cognitive processing system for displaying virtual objects in a virtual three-dimensional space and performing visuospatial cognitive processing on a subject, A patient attribute data storage unit that stores the patient attribute data of the subject, An attribute data acquisition unit that acquires patient attribute data of the subject from the attribute data storage unit, A stimulus rule data storage unit stores stimulus rule data, which is data about the rules for generating the virtual object based on patient attribute data, A stimulus rule setting unit obtains stimulus rule data suitable for performing visuospatial cognitive processing on the subject from the stimulus rule data storage unit based on the patient attribute data of the subject obtained by the attribute data acquisition unit, and sets the stimulus rule data to be used when performing visuospatial cognitive processing on the subject. A display object generation processing unit that determines virtual object parameters, which are parameters for determining virtual objects to be displayed in the virtual three-dimensional space, based on the patient attribute data of the subject acquired by the attribute data acquisition unit and the stimulus rule data set by the stimulus rule setting unit, A display processing unit that acquires virtual object display data, which is the display data of a virtual object to be displayed in the virtual three-dimensional space, based on the parameters determined by the display object generation processing unit, A 3D display unit performs processing to display the virtual object in the virtual 3D space based on the virtual object display data acquired by the display processing unit, A visuospatial cognitive processing system equipped with the following features.

2. The aforementioned virtual object is, It includes one base virtual object, a first virtual object located in a first region which is one of the regions obtained by dividing the surface of the base virtual object into two, and a second virtual object different from the first virtual object located in a second region which is the other region obtained by dividing the surface of the base virtual object into two, The parameters for the virtual object are: Includes parameters for determining the display attributes of the first virtual object and the second virtual object, The visuospatial cognitive processing system according to claim 1.

3. The parameters for the virtual object are: A parameter for determining the display position of the virtual object in the virtual three-dimensional space, or a parameter for determining the display positions of the first virtual object and the second virtual object in the virtual three-dimensional space, The visuospatial cognitive processing system according to claim 2.

4. The aforementioned display object generation processing unit, Based on the patient attribute data of the subject, the burden tolerance level, which indicates the degree to which the subject can be burdened, is determined. Based on the aforementioned load tolerance, multiple parameters for the virtual object are set to acquire multiple data for displaying the virtual object. The aforementioned display unit is Based on the multiple data obtained by the display object generation processing unit, multiple virtual object display data are obtained, The three-dimensional display unit is Based on each of the plurality of virtual object display data, the virtual object is displayed in the virtual three-dimensional space. A visuospatial cognitive processing system according to any one of claims 1 to 3.

5. When the virtual object is displayed in the virtual three-dimensional space, the response input acquisition unit acquires a response from the subject, A determination processing unit that determines the state of the subject based on the response from the subject, Furthermore, The aforementioned display object generation processing unit, Based on the first virtual object and the second virtual object of the virtual object, the correctness of the response from the subject when the virtual object is displayed is determined, and an evaluation value is set for when the response is correct and an evaluation value is set for when the response is incorrect. When the response input acquisition unit acquires a response from the subject, the evaluation value for that response is acquired. The determination processing unit, Based on the evaluation value obtained by the display object generation processing unit, the state of the subject is determined. The visuospatial cognitive processing system according to claim 2 or 3.

6. When the virtual object is displayed in the virtual three-dimensional space, the response input acquisition unit acquires a response from the subject, A determination processing unit that determines the state of the subject based on the response from the subject, Furthermore, The aforementioned display object generation processing unit, The response input acquisition unit adjusts the parameters for the virtual object based on the responses from the subject. The visuospatial cognitive processing system according to claim 2 or 3.

7. The determination processing unit, If the response input acquisition unit determines that the subject has a tendency towards egocentric spatial neglect based on the response from the subject or the evaluation value acquired by the display object generation processing unit, the unit performs a process to estimate the boundary of the subject's egocentric spatial neglect. The visuospatial cognitive processing system according to claim 5.

8. This is a visuospatial cognitive processing method for displaying virtual objects in a virtual three-dimensional space and performing visuospatial cognitive processing on a subject. A patient attribute data storage unit that stores patient attribute data of the subject, A stimulus rule data storage unit stores stimulus rule data, which is data about the rules for generating the virtual object based on the patient attribute data, A visuospatial cognitive processing method performed using a system comprising: An attribute data acquisition step of acquiring patient attribute data of the subject from the attribute data storage unit, A stimulus rule setting step involves obtaining stimulus rule data suitable for performing visuospatial cognitive processing on the subject from the stimulus rule data storage unit based on the patient attribute data of the subject obtained in the attribute data acquisition step, and setting the stimulus rule data to be used when performing visuospatial cognitive processing on the subject. A display object generation process step that determines virtual object parameters, which are parameters for determining virtual objects to be displayed in the virtual three-dimensional space, based on the patient attribute data of the subject obtained in the attribute data acquisition step and the stimulus rule data set in the stimulus rule setting step. A display processing step that acquires virtual object display data, which is display data for a virtual object to be displayed in the virtual three-dimensional space, based on the parameters determined in the display object generation processing step, A 3D display step, which performs a process to display the virtual object in the virtual 3D space based on the virtual object display data obtained in the above display processing step, A visuospatial cognitive processing method comprising the following features.

9. A program for causing a computer to execute the visuospatial cognitive processing method described in claim 8.

Images