3D display system

Abstract

To provide a system that three-dimensionally displays information used for rehabilitation.SOLUTION: A three-dimensional display system comprises a three-dimensional display unit 300 that can perform display in mixed reality or virtual reality, and can execute rehabilitation by causing a three-dimensional display unit 300 to display information used for rehabilitation. The three-dimensional display unit 300 includes an image unit 320 that displays the information used for rehabilitation in mixed reality or virtual reality, and movement detection means that detects the movement of a subject. The three-dimensional display system causes the movement detection means to detect the movement of the subject, and executes rehabilitation while changing the display on the image unit 320 according to the movement of the subject.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention , Li relates to a three-dimensional display system used for rehabilitation. Hereinafter, in this specification and the drawings, when expressed as a three-dimensional display device, it means a three-dimensional display system.

Background Art

[0002] For example, Patent Document 1 (Japanese Patent Application Laid-Open No. 2015-213539) discloses a driving suitability diagnosis device that reliably diagnoses driving suitability.

[0003] In the driving suitability diagnosis device described in Patent Document 1, it includes a monitor that the subject visually recognizes, a switch that the subject operates, a storage means that stores a predetermined program, and a control means that executes the program. As means realized by the execution of the program by the control means, there are display means for displaying a plurality of types of moving objects distinguishable by vision and a boundary line through which the moving objects pass on the monitor, setting means for setting a moving object to be selected by the subject using the switch from among the plurality of types of moving objects, movement control means for controlling the movement of a plurality of moving objects simultaneously displayed on the monitor, first determination means for determining whether the type of the moving object approaching the boundary line matches the type of the moving object for which the subject has pressed the switch, first determination means for determining an incorrect answer when it is determined in the first determination means that the moving object is different from the moving object to be selected, second determination means for determining whether the moving object is on the boundary line when the subject presses the switch, and second determination means for determining a correct answer when it is determined in the second determination means that the moving object is on the boundary line and determining an incorrect answer when it is determined that the moving object is not on the boundary line, and when it is determined as an incorrect answer, determining a first incorrect answer when the moving object has not reached the boundary line and determining a second incorrect answer when the moving object has passed the boundary line, third determination means for determining an intermediate reaction when the position of the boundary line with respect to the moving object at the time of pressing the switch is in the front region of the moving object and determining a slow reaction when it is in the rear region of the moving object when it is determined as a correct answer in the second determination means, and diagnostic means for diagnosing the possibility of a traffic accident of the subject by collating the inspection results based on the determinations of the first determination means, the second determination means, and the third determination means with the data indicating the correlation between the existing inspection results stored in the storage means and traffic accidents.

[0004] Patent Document 2 (Japanese Unexamined Patent Application Publication No. 2000-126148) discloses an electroencephalogram data processing device that automates operations such as extracting characteristic patterns from individual (in a single trial) electroencephalogram data and obtaining an additive average of the electroencephalogram data.

[0005] In the electroencephalogram data processing device described in Patent Document 2, in an electroencephalogram data processing device that detects a characteristic pattern from individual electroencephalogram data obtained during a single trial, there is provided an electroencephalogram data storage means for storing digital electroencephalogram data, a wavelet transform means for performing wavelet transform on the digital electroencephalogram data read from the electroencephalogram data storage means to obtain wavelet coefficients, a wavelet coefficient surface output means for outputting the wavelet coefficients as function values of the scale parameter and the shift parameter in the wavelet transform, a wavelet coefficient window parameter setting means for setting a wavelet coefficient window, a wavelet coefficient window means for extracting a predetermined region from the wavelet coefficient surface defined by the scale parameter, the shift parameter, and the wavelet coefficients based on the wavelet coefficient window, and an electroencephalogram data discrimination means for discriminating whether or not the predetermined region has been extracted from the wavelet coefficient surface by the wavelet coefficient window means for each individual digital electroencephalogram data.

Prior Art Documents

Patent Documents

[0006]

Patent Document 1

Patent Document 2

Non-Patent Document 3

Non-Patent Document 4

Summary of the Invention

Problems to be Solved by the Invention

[0007] Patent Documents 1 and 2 disclose general in-flight inspections. Non-Patent Documents 3 and 4 disclose performing inspections using a personal computer.

[0008] However, performing a For example, higher-order brain function test with an in-flight or desktop personal computer is not optimal as an evaluation of spatial recognition ability. Also, For example, when performing a higher-order brain function test repeatedly, human learning ability can also be a factor inhibiting the test results, which is not preferable.

[0009] Also, conventionally, it has not been possible to confirm the gaze history of a subject in a higher-order brain function test.

[0010] Conventionally, although there have been proposals to perform inspections and rehabilitation using in-flight or flat personal computers, there has been no one that performs inspections and rehabilitation using three-dimensional displays. Therefore, an object of the present invention is to provide a system that performs information used for rehabilitation in a three-dimensional display.

Means for Solving the Problems

[0011] To solve the above problems, the present invention has the following features. The present invention is a three-dimensional display system including a three-dimensional display unit capable of displaying by mixed reality or virtual reality, and performing rehabilitation by displaying information for rehabilitation on the three-dimensional display unit. The three-dimensional display unit includes a video unit that displays information for rehabilitation by mixed reality or virtual reality, and motion detection means for detecting the motion of a subject by a tracking camera, eye tracking, or head tracking. Arranged in a three-dimensional space The information is an object selected by the subject, and the video unit displays the information. Then, the three-dimensional display system detects the movements of the subject by the motion detection means, and when the information displayed on the video unit is selected by the subject's movements, it determines whether the selected information meets a predetermined condition. If it meets the predetermined condition, the information is erased and rehabilitation is executed while changing the display on the video unit. Preferably, the video unit may be either an immersive type that displays the information used for rehabilitation over a predetermined viewing angle on the left and right and displays a hand together with the information, or a transmissive type that enables the information to be recognized through the subject's hand and displays the information. Preferably, the information may be numbers, and the predetermined condition may relate to the condition for selecting the numbers. Preferably, the three-dimensional display system may be controlled so that the information used for rehabilitation does not become the same as the rehabilitation performed by the subject in the past. Preferably, the three-dimensional display system may record the correct answer rate.

[0012] Also, this specification includes As an example, regarding cases of higher brain function disorders the following inventions. (1) A three-dimensional display device for higher brain function examination according to one aspect includes a recording unit that records the medical record history information of the subject, the examination history information of the higher brain function examination, and the higher brain function examination program information, a three-dimensional display unit, and a control unit that controls the display of the three-dimensional display unit. The control unit selects the higher brain function examination program information based on at least one or both of the medical record history information of the subject and the examination history information of the higher brain function examination recorded in the recording unit, and performs the display of the higher brain function examination on the three-dimensional display unit.

[0013] In this case, the higher brain function examination program information is selected by the control unit based on at least one or both of the medical record history information of the subject and the examination history information of the higher brain function examination. That is, it is possible to select the higher brain function examination program information that is optimal for the subject's medical condition. Also, when based on the examination history information of the higher brain function examination, since the examination history information of the higher brain function examination of other subjects can be used, the control unit can select the higher brain function examination program information in which the condition has recovered by rehabilitation among many other subjects. Therefore, better higher brain function examination program information for the subject can be displayed on the three-dimensional display unit. Furthermore, by displaying on the three-dimensional display unit, the spatial recognition ability can be enhanced as compared with the case of two-dimensional paper media. Also, as compared with the case of paper media, in repeated examinations, since the learning effect of the subject is less likely to appear, the problem of being unable to obtain the original examination results is less likely to occur. Also, by displaying on the three-dimensional display unit, unlike the situation on the desk, the ability in daily life scenes involving physical activities can be accurately reflected in the test results. Also, since a plurality of subjects can be examined simultaneously, even in a facility with a small number of doctors or examination technicians, the examinations of a plurality of subjects can be efficiently performed.

[0014] (2) The three-dimensional display device for higher brain function examination according to the second invention is a three-dimensional display device for higher brain function examination according to an aspect. After performing the display on the three-dimensional display unit, the control unit may record the results of the higher brain function examination in the recording unit.

[0015] In this case, after performing the display on the three-dimensional display unit, the control unit can record the results of the higher brain function examination in the recording unit. As a result, the information in the recording unit can be feedback-processed, and according to the state of the subject, the higher brain function examination program information in which the condition has recovered better by rehabilitation can be selected.

[0016] (3) The three-dimensional display device for higher brain function examination according to the third invention is the three-dimensional display device for higher brain function examination according to one aspect or the second invention, further including the line-of-sight history information of the higher brain function examination. The recording unit records the line-of-sight history information, and the control unit may select the higher brain function examination program information based on the line-of-sight history information and display the higher brain function examination on the three-dimensional display unit.

[0017] In this case, the control unit causes the recording unit to record the line-of-sight history information. As a result, the line-of-sight history in the higher brain function examination of the subject can be confirmed. Specifically, in the higher brain function examination, there may be a case where only a specific range such as the right half or the left half, the upper half or the lower half of the 180-degree visual field angle is recognized. In that case, the state of the subject can be recognized by leaving the line-of-sight history. Therefore, since the higher brain function examination program information including the line-of-sight history information can be selected, it can be hoped that the subject's medical condition will recover further.

[0018] (4) The three-dimensional display device for higher brain function examination according to the fourth invention is the three-dimensional display device for higher brain function examination according to any one of the first aspect to the third invention, and may further include a notification unit capable of displaying the selected higher brain function examination program information, the medical record history information of the subject, and the examination history information of the higher brain function examination.

[0019] In this case, since the selected higher brain function examination program information, the medical record history information of the subject, and the examination history information of the higher brain function examination are displayed by the notification unit, a doctor or medical staff can confirm the examination content, examination results, and examination status of the subject.

[0020] (5) The three-dimensional display device for higher brain function examination according to the fifth invention is the three-dimensional display device for higher brain function examination according to any one of the fourth inventions from one aspect. The higher brain function examination program information for higher brain function examination may include the program information of TMT (Trail Making Test) and / or the program information of BIT (Behavioural inattention test).

[0021] In this case, since the higher brain function examination program information includes the program information of TMT and / or the program information of BIT, it has various types of program information of TMT and / or various types of program information of BIT, and can surely conduct the examination of higher brain function examination.

[0022] (6) The three-dimensional display device for higher brain function examination according to the sixth invention is the three-dimensional display device for higher brain function examination according to any one of the fifth inventions from one aspect. It may include video information when the subject conducts the examination of higher brain function examination.

[0023] In this case, a doctor or medical staff can check the video information and easily check the examination status, recovery status, etc. of the subject. Also, using AI technology, it is possible to compare the video information with the video information of subjects whose medical conditions have recovered in the past with similar video information.

[0024] (7) The three-dimensional display device for higher brain function examination according to the seventh invention is the three-dimensional display device for higher brain function examination according to any one of the sixth inventions from one aspect. The examination history information of higher brain function examination may include the test results and incorrect answer information of the subject.

[0025] In this case, a doctor or medical staff can check the video information and easily check the examination status, recovery status, etc. of the subject. In particular, since the test results of the subject are accurately calculated, the labor of medical staff can be saved. Also, since it has incorrect answer information, a doctor or medical staff can accurately check the status of the subject.

[0026] (8) The three-dimensional display device for higher brain function examination according to the eighth invention is, in the three-dimensional display device for higher brain function examination according to any one of the seventh inventions from one aspect, the medical record history information of the subject may be linked to the MRI (Magnetic Resonance Imaging) examination result or the CT (Computed Tomography) examination result.

[0027] In this case, since the medical record history information of the subject is linked to the MRI examination result and the CT examination result, a higher brain function examination according to the MRI examination result and the CT examination result can be performed. Thereby, the brain function examination of the subject can be performed more accurately.

[0028] (9) The three-dimensional display device for higher brain function examination according to the ninth invention is, in the three-dimensional display device for higher brain function examination according to any one of the eighth inventions from one aspect, the recording unit may be composed of a cloud server or a hard disk drive recording medium.

[0029] In this case, when the recording unit is composed of a cloud server, a higher brain function examination can be carried out over a wide range. In particular, not limited to the domestic area, the results of higher brain function examinations around the world can be collected and recorded.

[0030] Also, when it is composed of a hard disk drive recording medium, data in the hospital can be easily searched. Also, since the test results can be shared among multiple facilities, the results of tests conducted at facilities with few doctors or no doctors can be used for the diagnosis and treatment of the subject.

[0031] (10) The three-dimensional display device for higher brain function examination according to the tenth invention is the three-dimensional display device for higher brain function examination according to any one of the ninth inventions from one aspect, and the three-dimensional display unit may be a head-mounted display device.

[0032] In this case, since the three-dimensional display unit is a head-mounted display device, the subject can easily immerse himself in the three-dimensional display. As a result, an accurate higher brain function examination can be carried out.

[0033] (11) The three-dimensional display method for higher brain function examination according to another aspect includes a recording step of recording the medical record information of the subject, the examination history information of the higher brain function examination, and the higher brain function examination program information, a three-dimensional display step, and a control step of controlling the display in the three-dimensional display step. The control step includes a selection step of selecting the higher brain function examination program information based on at least one or both of the recorded medical record information of the subject and the examination history information of the higher brain function examination, and a display step of displaying the higher brain function examination selected by the selection step in the three-dimensional display step.

[0034] In this case, the higher brain function examination program information is selected based on at least one or both of the medical record information of the subject and the examination history information of the higher brain function examination by the control step. That is, it is possible to select the higher brain function examination program information optimal for the subject's medical condition. In addition, when based on the examination history information of the higher brain function examination, the examination history information of the higher brain function examination of other subjects can be used. Therefore, in the control step, it is possible to select the higher brain function examination program information whose medical condition has recovered by rehabilitation among many other subjects. Therefore, it is possible to display better higher brain function examination program information for the subject on the three-dimensional display unit. Furthermore, by displaying it on the three-dimensional display unit, the spatial recognition ability can be enhanced as compared with the case of a two-dimensional paper medium. In the case of paper media, in repeated examinations, since the learning effect of the subject appears, there is a problem that the original examination results cannot be obtained. Also, by displaying in the three-dimensional display process, unlike the in-flight state, the ability in daily life scenes involving physical activities can be accurately reflected in the test results.

[0035] (12) The three-dimensional display method for higher brain function examination according to the twelfth invention, in the three-dimensional display method for higher brain function examination related to other aspects, the control process may include a feedback recording process of recording the results of the higher brain function examination in the recording process after the display process.

[0036] In this case, the control unit can record the results of the higher brain function examination in the recording process after performing the display in the three-dimensional display process. As a result, the information in the recording process can be feedback-processed, and according to the state of the subject, it is possible to select higher brain function examination program information in which the condition has recovered more by rehabilitation.

[0037] (13) The three-dimensional display program for higher brain function examination according to still other aspects includes a recording process of recording the medical record history information of the subject, the examination history information of the higher brain function examination, and the higher brain function examination program information, a three-dimensional display process, and a control process for controlling the display of the three-dimensional display process. The control process includes a selection process of selecting higher brain function examination program information based on at least one or both of the recorded medical record history information of the subject and the examination history information of the higher brain function examination, and a display process of displaying the higher brain function examination selected by the selection process in the three-dimensional display process.

[0038] In this case, the higher brain function examination program information is selected based on at least one or both of the medical record history information of the subject and the examination history information of the higher brain function examination by the control process. That is, it is possible to select the higher brain function examination program information that is optimal for the condition of the subject. In addition, when based on the examination history information of the higher brain function examination, since the examination history information of the higher brain function examination of other subjects can be used, the control process can select the higher brain function examination program information in which the condition has recovered by rehabilitation among many other subjects. Therefore, better higher brain function examination program information for the subject can be displayed by three-dimensional display processing. Furthermore, by displaying it through three-dimensional display processing, the spatial recognition ability can be enhanced as compared with the case of two-dimensional paper media. Also, in the case of paper media, in repeated examinations, since the learning effect of the subject appears, there is a problem that the original examination results cannot be obtained. Also, by displaying it through three-dimensional display processing, unlike the state on the desk, the ability in daily life scenes involving physical activities can be accurately reflected in the test results.

[0039] (14) In the three-dimensional display program for higher brain function examination according to the 14th invention, in the three-dimensional display program for higher brain function examination that follows other aspects, the control process may include feedback recording processing for recording the results of the higher brain function examination in the recording process after the display process.

[0040] In this case, the control process can record the results of the higher brain function examination after performing the display by three-dimensional display processing. As a result, the information of the recording process can be feedback processed, and according to the state of the subject, the higher brain function examination program information in which the condition has recovered more by rehabilitation can be selected by the selection process.

Effects of the Invention

[0041] According to the present invention , a system that performs information used for rehabilitation in a three-dimensional display will be provided. By the three-dimensional display unit, rehabilitation can be performed in a Mixed Reality (MR) space or a Virtual Reality (VR).

[0042] These, and other objects, features, aspects, and effects of the present invention will become clearer from the following detailed description in comparison with the accompanying drawings.

Brief Description of the Drawings

[0043]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Embodiments for Carrying Out the Invention

[0044] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Also, in the case of the same reference numerals, their names and functions are also the same. Therefore, detailed descriptions thereof will not be repeated.

[0045] (One Embodiment) First, FIG. 1 is a schematic diagram showing an example of a three - dimensional display device 100 for a higher - order brain function test according to the present embodiment.

[0046] (Outline of the Three - Dimensional Display Device for Higher - Order Brain Function Tests) The three - dimensional display device 100 for a higher - order brain function test shown in FIG. 1 includes a recording unit 200, a three - dimensional display unit 300, a notification unit 400, and a control unit 500.

[0047] (Recording Unit) The recording unit 200 records at least a plurality of subject histories 210, a plurality of CT scan data and / or MRI data 220, a plurality of TMT histories and / or BIT histories 230, and a plurality of line-of-sight histories 240. Also, the recording unit 200 consists of a cloud server.

[0048] Note that although the recording unit 200 is assumed to consist of a cloud server, it is not limited thereto and may be composed of a hard disk drive recording medium or both a hard disk drive recording medium and a cloud server.

[0049] Also, the plurality of subject histories 210 include the medical record information and the disease condition recovery information of the subject. The disease condition recovery information includes the degree of recovery of the disease condition, the recovery time of the disease condition, etc. The plurality of CT scan data and / or MRI data 220 include the results of CT scan examinations and the results of MRI examinations. Furthermore, the plurality of TMT histories and / or BIT histories 230 include the results of TMT examinations or the results of BIT examinations. Also, the plurality of line-of-sight histories 240 include the movement of the line of sight of the subject in the TMT examination and the movement of the line of sight of the subject in the BIT examination.

[0050] Note that in the present embodiment, the plurality of CT scan data and / or MRI data 220, the plurality of TMT histories and / or BIT histories 230, and the plurality of line-of-sight histories 240 are linked for each subject with the plurality of subject histories 210 as the axis.

[0051] (Three-dimensional display unit) The three-dimensional display unit 300 consists of a head-mounted display. Therefore, the three-dimensional display unit 300 mainly includes a three-dimensional display control unit 310, a video unit 320, a tracking camera 330, a line-of-sight detection unit 340, and a three-dimensional display recording unit 350. The three-dimensional display recording unit 350 temporarily records the history information of the higher brain function test program (TMT test or BIT test) described later, and also records a software program that enables the higher brain function test program (TMT test or BIT test) to operate. When the higher brain function test program is executed, the video unit 320 performs a display according to the program. Also, the tracking camera 330 can recognize the actions of the subject who has checked the video unit 320. The image detected by the tracking camera 330 is displayed on the video unit 320 (see Fig. 4).

[0052] In this embodiment, it is assumed to be a head-mounted display, but it is not limited to this, and it may be composed of any method such as a holographic lens (HOLOLENS) anaglyph method, a polarization method, a liquid crystal shutter method, a spatial division display method, a two-viewpoint setting method, a multi-viewpoint setting method, a ray space reproduction method, an integral method, etc. Also, although the tracking camera 330 is used, it is not limited to this, and it may be composed of any method such as other eye tracking, head tracking, etc.

[0053] (Notification unit) The notification unit 400 is composed of a display device with a liquid crystal screen. That is, it can output display and sound.

[0054] (Control unit 500) Fig. 2 is a flowchart showing an example of the processing of the control unit 500. As shown in Fig. 2, the control unit 500 acquires subject information (step S101). Here, the control unit 500 reads the subject history 210, which is the subject information recorded in the recording unit 200. Next, the control unit 500 selects an optimal higher brain function test program for the subject from among the plurality of higher brain function tests recorded in the recording unit 200 (step S102). The control unit 500 transmits the selected higher brain function test program to the three-dimensional display unit 300 (step S103). Here, when the subject has previously performed exactly the same program in the selected higher brain function test program, the control unit 500 controls so that even if it is the same test, the content is different. Specifically, when performing the test shown in FIG. 4 described later, it controls to perform the test with the arrangement of numbers changed. In the above embodiment, the test is mainly described, but the test includes the training of the subject. Also, in the case of the subject's training, the arrangement of numbers may be changed more significantly.

[0055] Next, the control unit 500 determines whether the result of the higher brain function test has been transmitted from the three-dimensional display unit 300 (step S104). When the result of the higher brain function test has not been transmitted from the three-dimensional display unit 300 (No in step S104), the control unit 500 repeats the process of step S104.

[0056] On the other hand, when the result of the higher brain function test has been transmitted from the three-dimensional display unit 300 (Yes in step S104), the control unit 500 receives the result of the higher brain function test (step S105). Next, the control unit 500 records the received result of the higher brain function test in the recording unit 200 (step S106). Finally, the control unit 500 records the degree of recovery of the disease state (correct answer rate) in the recording unit 200.

[0057] (Three-dimensional display control unit 310 of the three-dimensional display unit 300) FIG. 3 is a flowchart showing an example of the process of the three-dimensional display control unit 310.

[0058] The three-dimensional display control unit 310 determines whether it has received the optimal higher brain function test program for the subject transmitted from the control unit 500 (step S201). When it is determined that the higher brain function test program has not been received (No in step S201), the three-dimensional display control unit 310 repeats the process of step S201.

[0059] On the other hand, when it is determined that the higher brain function examination program has been received (Yes in step S201), the three-dimensional display control unit 310 reads the higher brain function examination program and executes the examination (step S202).

[0060] First, the three-dimensional display control unit 310 causes the video unit 320 to display the higher brain function examination program (step S203). Next, the three-dimensional display control unit 310 detects the actions of the subject using the tracking camera 330 (step S204). The detection of the subject's movement is the movement detection means. Note that in this embodiment, it is not limited to the tracking camera 330, and any other input device such as a clicker may be used. The three-dimensional display control unit 310 By the movement detection means According to the detected actions, in accordance with the higher brain function examination program, changes the display of the video unit 320 (step S205).

[0061] Also, the three-dimensional display control unit 310 detects the subject's line of sight using the line-of-sight detection unit 340 (step S206). The three-dimensional display control unit 310 causes the three-dimensional display recording unit 350 to record the examination results and the detected line-of-sight actions (step S207).

[0062] Next, the three-dimensional display control unit 310 transmits the results of the higher brain function examination recorded in the three-dimensional display recording unit 350 to the control unit 500 (step S208).

[0063] FIG. 4 is a schematic diagram showing an example of the TMT examination displayed on the video unit 320.

[0064] As shown in FIG. 4, on the video unit 320, for example, the numbers "1" to "30" are arranged and displayed over a left and right viewing angle of 180 degrees. Also, the subject's hand is displayed on the video unit 320. Here, when the video unit 320 is an immersive type, the hand H1 may be displayed, and when the video unit 320 is a transmissive type, the hand H1 may not be displayed and the subject's hand may be made recognizable through transmission. Note that, although the viewing angle of the video unit 320 according to the present embodiment is 180 degrees horizontally, it may be 10 degrees or more and 90 degrees or less horizontally, 10 degrees or more and 90 degrees or less vertically, or 3 degrees or more and 30 degrees or less vertically. Note that, in the three-dimensional display device 100 for the higher brain function examination according to the present embodiment, numbers "1" to "30" with different arrangements are displayed on the video unit 320 each time. Specifically, the three-dimensional display control unit 210 performs automatic arrangement of the numbers.

[0065] Also, the subject presses the numbers in ascending order from the smaller value with their hand. To select such that As a result, the subject's hand is detected by the tracking camera 330, and if the values pressed match the values in ascending order from the smaller value on the video unit 320 from the three-dimensional display control unit 310, an instruction is given to erase the pressed value. As a result, the value is erased and the display on the video unit 320 changes.

[0066] FIG. 5 and FIG. 6 are schematic diagrams showing an example of the display of the notification unit 400 of the control unit 500.

[0067] As shown in FIG. 5, the display of the notification unit 400 shows pull tabs such as IP address setting for communicating with the three-dimensional display unit 300, subject display, app setting, template setting, execution mode setting, color setting, time setting until hint display, display range setting, limit time setting, etc. As a result, a doctor or medical staff can set the operation of the three-dimensional display unit 300 and further recognize the examination content. Also, as shown in FIG. 6, the display of the video unit 320 may be displayed as it is, and the line-of-sight history EYE may be displayed. As a result, a doctor or medical staff can easily recognize the movement of the line of sight in the case of the higher brain function examination of the subject.

[0068] Note that, in the above embodiment, the display of the video unit 320 is displayed on the notification unit 400 in real time, but it is not limited to this. It may be recorded in the recording unit 200 and displayed on the notification unit 400 after a predetermined time has elapsed, or may be displayed at double speed or triple speed.

[0069] (Other embodiments) First, FIG. 7 is a schematic diagram showing another example of the three-dimensional display device 100 for the higher brain function examination according to the present embodiment.

[0070] The three-dimensional display device 100a for the higher brain function examination shown in FIG. 7 includes a recording unit 200 and a three-dimensional display unit 300. In the present embodiment, the processing operations of both the control unit 500 of the three-dimensional display device 100 for the higher brain function examination according to one embodiment and the three-dimensional display control unit 310 of the three-dimensional display unit 300 are processed independently by the three-dimensional display control unit 310 of the three-dimensional display unit 300.

[0071] FIG. 8 is a flowchart showing an example of the processing of the three-dimensional display control unit 310.

[0072] As shown in FIG. 8, the three-dimensional display control unit 310 communicates with the recording unit 200 composed of a cloud server (step S301). Here, the three-dimensional display control unit 310 reads the subject history 210, which is the subject information recorded in the recording unit 200. Next, the three-dimensional display control unit 310 selects an optimal higher brain function examination program for the subject from among the plurality of higher brain function examinations recorded in the recording unit 200 (step S302). The three-dimensional display control unit 310 reads the higher brain function examination program and executes the examination (step S303).

[0073] The three-dimensional display control unit 310 causes the video unit 320 to display the higher brain function examination program (step S304). Next, the three-dimensional display control unit 310 detects the movement of the subject by the tracking camera 330 (step S305). The detection of the subject's movement is the movement detection means. Three The three-dimensional display control unit 310 By the movement detection means changes the display of the video unit 320 according to the detected movement in accordance with the higher brain function examination program (step S306). Vision The line detection unit 340 detects the subject's line of sight (step S307). The three-dimensional display control unit 310 causes the recording unit 300 to record the inspection result and the operation of the detected line of sight (step S308).

[0074] In this embodiment, although it is assumed that the degree of recovery of the medical condition is recorded in the recording unit 200 by another terminal, the present invention is not limited to this. The doctor may use the three-dimensional display control unit 310 to record in the recording unit 200.

[0075] As described above, in the three-dimensional display devices 100 and 100a for the higher brain function examination according to this embodiment, by performing the brain function examination and training that were limited in effect as rehabilitation for higher brain function disorder patients on a plane in a three-dimensional or spatial manner, appropriate and effective rehabilitation can be realized.

[0076] In addition, the three-dimensional display device 100 can perform rehabilitation in a Mixed Reality (MR) space or a Virtual Reality (VR). In addition, the three-dimensional display device 100 according to this embodiment has the merit that the higher brain function examination or training that has been conventionally performed analogously can lead the subject himself / herself to a more effective examination and can find a clue to a solution for each subject by accumulating data.

[0077] As a result, it is possible to perform training for improving the brain function and treatment of the spatial recognition function for patients with higher brain function disorders caused by strokes, traffic accidents, etc., or dementia patients, or subjects who undergo higher brain function examinations multiple times over a long period.

[0078] In addition, by recording the results of the higher brain function examination in the recording unit 200, it is possible to expect the recovery of the subject by performing a higher brain function examination in which significant improvement or recovery symptoms are observed among patients with the same symptoms. In addition, by recording the results of individual higher brain function tests of the subject, qualitative analysis for each subject can be performed, and appropriate rehabilitation can be automatically selected for each of the acute, recovery, and maintenance stages in rehabilitation that were conventionally accumulated as know-how by some doctors and the like.

[0079] Moreover, by using the three-dimensional display device 100, the sense of presence and immersion, which were limited in two dimensions, can be demonstrated, and a high effect can be expected on the degree of recovery of the subject. In addition, in the higher brain function test using a paper medium or the like, since it is carried out on a desk using paper and a pencil, the nuance of "study" becomes strong, which increases the sense of pain for people who are not used to the act and causes the concentration to be interrupted. This problem can also be solved by using the three-dimensional display device 100.

[0080] Also, since the results of the higher brain function test are automatically recorded, automatic scoring can be performed, which can reduce the work of medical staff or doctors and can also improve the accuracy of the higher brain function test.

[0081] Furthermore, by recording the gaze history 240 in the recording unit 200, the gaze direction of the subject is left as a history, and problems or tasks in the test or training can be discovered. In addition, the test can be changed by the higher brain function test program. In the case of a conventional higher brain function test using a paper medium, the same sequence of tests is often repeated, and there is a problem that the patient memorizes the sequence during multiple implementations, and the meaning of the test fades. However, by using the three-dimensional display device 100, this problem can be solved.

[0082] As described above, based on the subject history 210, the TMT history, and / or the BIT history 230 by the control unit 500, the higher brain function test program information is selected. That is, the higher brain function test program information optimal for the subject's medical condition can be selected. Also, when based on the TMT history and / or the BIT history 230, since the TMT history and / or the BIT history 230 of other subjects can be used, the control unit 500 can select the higher brain function test program information in which the medical condition has recovered through rehabilitation among many other subjects. Therefore, better higher brain function test program information for the subject can be displayed on the three-dimensional display unit. Furthermore, by displaying on the three-dimensional display unit 300, the spatial recognition ability can be enhanced as compared with the case of a two-dimensional paper medium. Also, in the case of a paper medium, in repeated tests, since the learning effect of the subject appears, there is a problem that the original test result cannot be obtained. Also, by displaying on the three-dimensional display unit 300, unlike the state on the desk, the ability in the daily life scene involving physical activity can be accurately reflected in the test result.

[0083] Furthermore, after the three-dimensional display control unit 310 performs the display on the video unit 320 of the three-dimensional display unit 300, the result of the higher brain function test can be recorded in the recording unit 200. As a result, the information in the recording unit 200 can be feedback-processed, and higher brain function test program information in which the medical condition has recovered more through rehabilitation can be selected according to the state of the subject. be possible. Also, since the three-dimensional display control unit 310 automatically modifies the content of the higher brain function test, the subject does not perform the same test, and an accurate test result can be obtained.

[0084] Also, the control unit 500 causes the recording unit 200 to record the line-of-sight history 240. As a result, the line-of-sight history of the subject in the higher brain function test can be confirmed. Specifically, in the higher brain function test, there may be a case where only a specific range such as the right half or the left half, the upper half or the lower half of the 180-degree visual field angle is recognized. In that case, the state of the subject can be recognized by leaving the line-of-sight history. Furthermore, since the control unit 500 can select the higher brain function test program information including the gaze history 240, it can be expected that the subject's medical condition will further recover.

[0085] Since the higher brain function test program information selected by the notification unit 400, the subject history 210, the TMT history, and / or the BIT history 230 are displayed, a doctor or medical staff can check the test content, test results, and test status of the subject.

[0086] Since the higher brain function test program information includes the TMT program information and / or the BIT program information, it has various types of TMT program information and / or various types of BIT program information, and can surely perform the higher brain function test.

[0087] Furthermore, a doctor or medical staff can check the video information and easily check the test status, recovery status, etc. of the subject. Also, using AI technology, the video information can be compared with the video information of subjects whose medical conditions have recovered in the past with similar video information.

[0088] Furthermore, a doctor or medical staff can check the video information and easily check the test status, recovery status, etc. of the subject. Especially, since the test results of the subject can be accurately calculated, the labor of medical staff can be saved. Also, since it has incorrect answer information, a doctor or medical staff can accurately check the status of the subject.

[0089] Furthermore, since the subject history 210 includes CT scan data or / and MRI data 220, a higher brain function test corresponding to the CT scan data or / and MRI data 220 can be performed.

[0090] Furthermore, when the recording unit 200 consists of a cloud server, a higher brain function test can be performed over a wide range. In particular, not limited to domestic, the results of higher brain function tests around the world can be collected and recorded. Also, in the case of a hard disk drive recording medium, data within the hospital can be easily searched for.

[0091] Furthermore, since the three-dimensional display device 100 is a head-mounted display device, the subject can easily immerse themselves in the three-dimensional display. As a result, an accurate higher brain function examination can be carried out.

[0092] In the present invention, the subject history 210 corresponds to "medical record history information of the subject", the TMT history and / or BIT history 230 corresponds to "examination history information of the higher brain function examination", the higher brain function examination program corresponds to "higher brain function examination program information, TMT program information, BIT program information", the recording unit 200 corresponds to "recording unit, cloud server, hard disk drive recording medium", the three-dimensional display unit 300 corresponds to "three-dimensional display unit, head-mounted display device", the three-dimensional display control unit 310 corresponds to "control unit that controls the display of the three-dimensional display unit", the three-dimensional display devices 100, 100a for higher brain function examination correspond to "three-dimensional display devices for higher brain function examination", the control units 500, three-dimensional display control unit 310 correspond to "control unit", the gaze history 240 corresponds to "gaze history information", the notification unit 400 corresponds to "notification unit", and the CT scan data and / or MRI data 220 corresponds to "MRI examination results, CT examination results".

[0093] Note that in the present embodiment, although it is referred to as an "examination", this examination is intended to include training or therapy, treatment, rehabilitation, etc. Also, although it is referred to as a "subject", since the examination is intended to include training, therapy, treatment, rehabilitation, etc., the "subject" is intended to include patients, care recipients, users, etc. Medically, how the present invention is used for the examination (including training, therapy, treatment, rehabilitation) of any symptoms is based on the doctor's judgment. If the doctor determines that the present invention may be used for an examination (including training, therapy, treatment, rehabilitation) other than higher brain function disorders, then of course, it is not prohibited from being used for that purpose.。

[0094] A preferred embodiment of the present invention is as described above, but the present invention is not limited thereto. It will be understood that various embodiments may be made without departing from the spirit and scope of the present invention. Furthermore, in this embodiment, the actions and effects according to the configuration of the present invention are described, but these actions and effects are merely examples and do not limit the present invention. The present invention has been described in detail above. However, the foregoing description is merely illustrative of the present invention in every respect and is not intended to limit its scope. Needless to say, various improvements and modifications can be made without departing from the scope of the present invention. The constituent elements of the invention disclosed in this specification shall be regarded as constituting independent inventions individually. Inventions obtained by combining each constituent element in any combination method shall also be included in the present invention.

Explanation of Reference Numerals

[0095] 100, 100a Three-dimensional display device for higher brain function examination 200 Recording unit 210 Subject history 220 CT scan data and / or MRI data 230 TMT history and / or BIT history 240 Gaze history 300 Three-dimensional display unit 310 Three-dimensional display control unit 340 Gaze detection unit 400 Notification unit 500 Control unit

Claims

1. A three - dimensional display system comprising a three - dimensional display unit capable of displaying by mixed reality or virtual reality, and capable of performing rehabilitation by causing information used for rehabilitation to be displayed on the three - dimensional display unit, wherein the three - dimensional display unit, comprises a video unit that arranges and displays the information used for rehabilitation in a three - dimensional space by mixed reality or virtual reality, and an operation detection means for detecting the operation of a subject by a tracking camera, eye tracking, or head tracking, the information is an object selected by the subject, and the video unit displays the information, the three - dimensional display system detects the operation of the subject by the operation detection means, and when the information displayed on the video unit is selected by the operation of the subject, determines whether the selected information meets a predetermined condition. If it meets the predetermined condition, the information is erased, and while changing the display on the video unit, the three - dimensional display system is characterized by performing rehabilitation.

2. The video unit according to claim 1, wherein the video unit displays the information used for rehabilitation over a predetermined viewing angle on the left and right, and is either an immersive type that displays a hand together with the information, or a transmissive type that displays the information so that the hand of the subject can be recognized through it.

3. The information is a number, The three - dimensional display system according to claim 1 or 2, wherein the predetermined condition relates to a condition for selecting the number.

4. The three - dimensional display system according to any one of claims 1 to 3, wherein the three - dimensional display system is controlled so that the information used for rehabilitation does not become the same as the rehabilitation previously performed by the subject.

5. The three - dimensional display system according to any one of claims 1 to 3, wherein the three - dimensional display system records the correct answer rate.

Images