Spatial Cognition Ability Evaluation System

Abstract

A system, device, program, and method are provided that can objectively evaluate stereocognition ability by quantifying it, etc. [Solution] The position of a moving object that allows the distance between the moving object and the subject to be measured to be specified is acquired, and the subject's active reaction corresponding to the three-dimensional position of the object recognized by the subject is input. The input reaction is determined to determine whether the acquired object position and the input reaction correspond correctly, thereby evaluating the subject's three-dimensional cognitive ability. The moving object can be provided in virtual reality using a virtual reality headset, and a moving image of the object as viewed from a predetermined viewpoint in the virtual reality is displayed as it moves from a start position to an end position along a predetermined movement path in a direction approaching the predetermined viewpoint, and the stereoscopic cognitive ability of the subject can be evaluated based on the reaction to the object's position.

Description

Technical Field

[0001] The present invention relates to a three-dimensional recognition ability evaluation system that evaluates three-dimensional recognition ability based on the reaction to an object.

Background Art

[0002] Three-dimensional recognition ability is the ability to recognize the distance of an object and appropriately respond to it. In recent years, when cognitive function declines in the elderly etc., it has been observed that three-dimensional recognition ability also tends to decline in the same way. Evaluating three-dimensional recognition ability may have an effect similar to evaluating cognitive function. On the other hand, it is difficult to objectively evaluate cognitive function. Therefore, objectively evaluating cognitive function by quantifying three-dimensional recognition ability etc. also contributes to the objective evaluation of cognitive function and is extremely useful. However, there has been no technology for quantifying three-dimensional recognition ability.

[0003] Three-dimensional recognition ability is premised on the normal eye functions (such as pupil regulation, eye movement) for obtaining visual information. For example, when seeing a moving object etc., the brain accurately grasps the positional relationship of the object from the visual information of the moving object, and is defined as the ability to perform an appropriate and accurate action corresponding to the moving object based on the grasped positional relationship.

[0004] Here, as a method for confirming the normal function of the eye, for example, methods such as pupillometry and measurement of the near point distance are known. These measurements can be performed using a device called a Tryiris. Pupillometry includes at least measuring the pupillary reaction (light reaction) to visible light stimulation from a visual target, and measuring the pupillary change when looking at a moving visual target. Specifically, the pupillary change is caused by the pupillary near reflex, and the pupil constricts when the visual target moves closer. Also, for the measurement of the near point distance, specifically, when the subject being measured observes a visual target approaching at a constant refractive speed and it blurs, the subject presses a hand switch, and the position of the visual target at that time is recorded as the near point distance. These measurements are of the state of the eyeball (pupil) and the measurement of the near point distance by pressing the switch when it blurs, but the main purpose is the measurement of the near point distance.

[0005] Stereo recognition ability also includes the ability to accurately track a moving object with the eyes, correctly recognize its position, and respond appropriately to it. To measure the function of tracking a moving object with the eyes, a method of measuring pupillary accommodation and convergence reaction is considered particularly useful. These measurement methods will be described below. FIG. 6 is a diagram showing the concept of a visual target used for measuring the function of the eye. The visual target is moved in front of the eyes of the subject being measured between the receding direction and the approaching direction, and the subject is made to visually recognize it. It is preferable to repeat the movement and check the state of the subject's eyes each time.

[0006] FIG. 7 shows the relationship between the visual target distance (the distance between the subject's eye and the visual target) and the pupil diameter due to the pupillary near reflex. (A) of FIG. 7 shows that the pupil diameter becomes small when the visual target distance is close, and (B) of FIG. 7 shows that the pupil diameter becomes large when the visual target distance is far. (C) of FIG. 7 shows a graph when the horizontal axis is the visual target distance and the vertical axis is the pupil diameter. The solid line shows the graph of the left eye, and the dashed-dotted line shows the graph of the right eye. The graph shows that the pupil diameter becomes small when the visual target distance is close, and the pupil diameter becomes large when the visual target distance is far. Also, it is shown that the right eye and the left eye have almost the same pupil diameter regardless of the visual target distance.

[0007] Figure 8 shows the relationship between the visual target distance and the pupil position (vergence movement). In Fig. 8(A), it is shown that when the visual target distance is close, the left and right eyes are in a convergent state closer to the inside. In Fig. 8(B), it is shown that when the visual target distance is far, the left and right eyes are in a divergent state in a parallel state. Fig. 8(C) shows a graph when the horizontal axis is the visual target distance and the vertical axis is the pupil position. The solid line represents the graph of the left eye, and the dashed-dotted line represents the graph of the right eye. The graph shows that when the visual target distance is close, the distance between the pupils of the left and right eyes becomes smaller and is in a convergent state, and when the visual target distance is far, the distance between the pupils of the left and right eyes becomes larger and is in a divergent state.

[0008] When the visual target that the measurement subject is looking at is moved so as to change its distance, reactions such as the above-described change in pupil diameter and vergence movement occur accordingly. However, if the visual recognition function of the measurement subject is impaired, those reactions will decrease. Therefore, by measuring the change in pupil diameter and vergence movement of the measurement subject when the distance of the visual target is changed, the visual recognition function can be measured. However, for that purpose, a large-scale device for changing the distance of the visual target was required. In addition, the Triiris performs measurement by pressing a switch when it becomes blurred. However, the reaction of pressing the switch at this time is a passive reaction that is performed when the visual target, which is a visually recognized object that moves one-dimensionally regardless of the operation of the measurement subject, reaches a predetermined position, and is not an active reaction of the measurement subject to the moving visual target (such as bringing the hand closer to the visual target, an active operation in which the target position is dynamically determined depending on the position of the visually recognized object). Therefore, it is possible to obtain good results by chance, and it is also possible to obtain good results due to the falsification of the measurement subject. Thus, measurement based on a passive reaction such as simply pressing a switch in synchronization with the moving object being visually recognized has a problem in its accuracy.

[0009] On the one hand, with the spread of virtual reality (VR) technology, its application fields have been increasing. If a user wears a virtual reality headset that provides virtual reality, an object in the virtual reality is displayed in the line-of-sight direction, and a sense of presence as if being on the spot can be obtained. In a virtual reality headset, an electronic display is built into a housing shaped like goggles, and an image of an object existing in the line-of-sight direction is displayed there, and the user will visually recognize this image through an eyepiece lens. The electronic display is provided separately for each of the left and right eyes, and by changing the displayed position according to the position of the object in the depth direction to be displayed, an appropriate sense of depth is provided to the user. That is, an object closer to the user has corresponding images displayed on the left and right electronic displays closer to the center, causing a convergence movement in the user's eyes, thereby making the user recognize that the object exists nearby. In the measurement of eye functions, it is conceivable to use such a virtual reality headset to simulate changing the position of a visual target, but such a technology did not exist.

[0010] On the other hand, as a system for evaluating cognitive functions by using measurements related to vision, there is a system that uses a portable touch-screen personal computing device (Patent Document 1). In this technology, an individual's cognitive evaluation is performed based on the reaction speed to the displayed cognitive evaluation stimuli. In the examination, when a character is displayed, the user presses a button to react, and this is measured. However, in this technology, although the displayed object is moved, there is no mention of the depth distance of the object. Also, in this technology, the measurement results are affected by various attributes such as the concentration of the measurement subject and the proficiency in the operation method.

[0011] Also, there is a system that provides a video game for mapping the peripheral vision of a subject, including an examination in which the subject finds a visual stimulus presented for a short time (Patent Document 2). In that technology, a target is displayed on a display, and based on the user's reaction to it, the measurement of the visual field defect of glaucoma is performed. In this technology, the distance between the subject and the monitor is measured, but there is no mention of the depth distance of the displayed target.

Prior Art Documents

Patent Documents

[0012]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0013] As described above, since it is difficult to objectively evaluate the cognitive function, it is extremely useful to be able to objectively evaluate it by quantifying the three-dimensional recognition ability related to the cognitive function, etc., but such a technology did not exist. Also, in the measurement by a passive reaction such as pressing a switch when a moving visual target reaches a predetermined position, good results may be obtained by chance or falsehood, and there is a problem with its accuracy. In addition, in order to confirm the visual recognition function for the evaluation of the three-dimensional recognition ability, it is necessary to change the distance of the visual target that the measurement subject visually recognizes, but for this purpose, a large-scale device for physically moving the visual target was required. On the other hand, there is a device for confirming the visual recognition function with a computing device, but it was not possible to change the sense of distance either. Therefore, first, a method for accurately quantifying the three-dimensional recognition ability has been demanded. That is, there has been a demand for a small device that can evaluate the three-dimensional recognition ability including the visual recognition function by having the measurement subject visually recognize an object with a changed distance and measuring the reaction thereto.

[0014] The present invention has been made in view of the above problems, and an object thereof is to provide a method for quantifying the three-dimensional recognition ability and a small device capable of evaluating the three-dimensional recognition ability.

Means for Solving the Problems

[0015] A three-dimensional perception ability evaluation system according to an embodiment of the present invention is for evaluating a three-dimensional perception ability based on the reaction of a measurement subject to a moving object, and can identify the distance between the moving object and the measurement subject. It has an object position acquisition unit that acquires the position of the moving object, a reaction input unit that receives an input of an active reaction of the measurement subject made corresponding to the position of the object recognized by the measurement subject, and determines whether the acquired position of the object and the input reaction correctly correspond. And a three-dimensional perception ability determination unit that evaluates the three-dimensional perception ability of the measurement subject, and is characterized by having the above.

[0016] In the present invention, the three-dimensional perception ability determination unit can be configured to evaluate the three-dimensional perception ability of the measurement subject based on the position correspondence relationship between the acquired position of the object and the position specified by the reaction within a predetermined time range. In the present invention, the position correspondence relationship includes any one of the minimum distance between the position of the object and the position specified by the reaction, the average distance between the position of the object and the position specified by the reaction, or the difference between the maximum distance and the minimum distance between the position of the object and the position specified by the reaction. It can be configured as follows.

[0017] In the present invention, the moving object is an operation target object that is moved from a starting position toward a target position by the operation of the measurement subject, the reaction input unit receives the position of the operation target object as an input of the reaction, and the three-dimensional perception ability determination unit is based on the difference between the position of the operation target object and the target position. It can be configured to evaluate the three-dimensional perception ability of the measurement subject.

[0018] In the present invention, an eye state sensing unit that senses the line-of-sight directions of both eyes of the measurement subject, and a visual recognition determination unit that determines whether the measurement subject visually recognizes the object spatially by determining whether the line-of-sight direction correctly corresponds to the position of the moving object. The stereoscopic recognition ability determination unit determines whether the reaction input with respect to the acquired position of the object correctly corresponds when it is determined by the visual recognition determination unit that the measurement subject visually recognizes the object spatially, thereby evaluating the stereoscopic recognition ability of the measurement subject. It can be configured as described above.

[0019] In the present invention, the visual recognition determination unit can be configured to determine that the measurement subject visually recognizes the object when it is determined that the line-of-sight directions of both eyes coincide with the position of the moving object for a predetermined time or longer.

[0020] In the present invention, the eye state sensing unit further senses the pupil diameters of both eyes of the measurement subject, and the visual recognition determination unit further determines that the measurement subject visually recognizes the object spatially when it is further determined that the pupil diameters of both eyes gradually decrease as the position of the object approaches the predetermined viewpoint. It can be configured as described above.

[0021] In the present invention, the moving object is provided in virtual reality, and includes a virtual reality headset including an electronic display for displaying a moving image of virtual reality, and a moving object display unit that causes the electronic display to display a moving image when the object in the virtual reality is moved along a predetermined movement path in a direction approaching the predetermined viewpoint from the movement start position to the movement end position when viewed from the predetermined viewpoint. The object position acquisition unit acquires the position of the object in the virtual reality displayed by the moving object display unit, and the stereoscopic recognition ability determination unit determines whether the reaction input with respect to the acquired position of the object correctly corresponds, thereby evaluating the stereoscopic recognition ability of the measurement subject. It can be configured as described above.

[0022] In the present invention, the reaction input unit continuously identifies the position of a predetermined part of the body based on a signal from a sensor attached to a predetermined part of the body of the person to be measured, and inputs it as the reaction. The moving object display unit further displays, on the electronic display, an image of at least a part of the predetermined part of the body of the person to be measured in the virtual reality based on the identified position of the predetermined part of the body. The three-dimensional recognition ability determination unit determines that the reaction is correctly corresponding when the distance between a predetermined location related to the predetermined part of the body and the object is within a predetermined distance in the case where it is determined by the visual recognition determination unit that the person to be measured spatially recognizes the object. It can be configured as described above.

[0023] In the present invention, the three-dimensional recognition ability determination unit acquires three reaction parameters, namely, the visual recognition start time from the start of movement of the object until it is determined that the person to be measured spatially recognizes the object, the minimum distance between a predetermined location related to the predetermined part of the body and the object, and the response time from the start of movement of the object until the distance between the predetermined location related to the predetermined part of the body and the object becomes the minimum distance, and evaluates the three-dimensional recognition ability of the person to be measured based on them. It can be configured as described above.

[0024] In the present invention, the three-dimensional recognition ability determination unit calculates respective scores based on the numerical values of the respective reaction parameters, and evaluates the three-dimensional recognition ability of the person to be measured based on the sum of the products of the respective scores and respective predetermined weights. It can be configured as described above.

[0025] In the present invention, the movement of the object by the moving object display unit, the determination by the visual recognition determination unit as to whether the person to be measured visually and spatially recognizes the object, and the evaluation of the three-dimensional recognition ability by the three-dimensional recognition ability determination unit are repeated a plurality of predetermined number of measurement times, and the three-dimensional recognition ability determination unit outputs the number of times it is determined that the reaction correctly corresponds to the position of the object. It can be configured as described above.

[0026] The present invention can also be implemented as a device having a configuration for evaluating stereoscopic recognition ability based on the reaction of a measurement subject to a moving object within a single housing. The present invention can also be implemented as a program that, when executed by a computer, realizes a stereoscopic recognition ability evaluation system for evaluating the stereoscopic recognition ability of the computer based on the reaction of a measurement subject to a moving object, and a computer-readable recording medium storing the program. The present invention can also be implemented as a method including steps for evaluating stereoscopic recognition ability based on the reaction of a measurement subject to a moving object.

Effects of the Invention

[0027] The present invention acquires the position of a moving object whose distance from the measurement subject can be specified, accepts an input of an active reaction of the measurement subject made corresponding to the position of the object recognized by the measurement subject, and evaluates the stereoscopic recognition ability of the measurement subject by determining whether the acquired position of the object and the input reaction correctly correspond. By these means, it becomes possible to verify whether the reaction is correctly corresponding to the position of the object that needs to be spatially recognized visually based on the position of the object and the reaction, and there is an effect that the stereoscopic recognition ability related to the cognitive function can be quantified and objectively evaluated. Further, when the present invention is configured such that a moving object is an object to be operated that can be moved from a starting position toward a target position by the operation of the measurement subject, and the position of the object to be operated is accepted as an input of the reaction, and the stereoscopic recognition ability of the measurement subject is evaluated based on the difference between the position of the object to be operated and the target position, there is an effect that the stereoscopic recognition ability related to the cognitive function can be quantified and objectively evaluated without getting bored with the measurement test by a configuration that attracts interest and gives a sense of accomplishment, such as the operation of an object to be operated like a drone.

[0028] In addition, in the present invention, in order to obtain a measurement result based on an active reaction that requires a positive operation in which the target position is dynamically determined according to the position of the object to be visually recognized, the possibility of accidentally obtaining a good measurement result by a passive operation such as pressing a switch on a one-dimensionally moving object is eliminated, and the objectivity and accuracy of the measurement are improved. Further, in the present invention, the measurement result does not depend on various attributes of the person to be measured (concentration, proficiency in the operation method, tendency to lie, etc.), and by realizing measurement by a simple measurement test that attracts interest, the concentration can be measured by the certainty of visual recognition, so that an accurate measurement excluding falsehood can be performed. Further, the present invention can also provide a moving object in virtual reality. In that case, the present invention uses a virtual reality headset including an electronic display for displaying a moving image of virtual reality, and moves the object in virtual reality along a predetermined movement path in a direction approaching a predetermined viewpoint from the movement start position to the movement end position as seen from the predetermined viewpoint, and displays the moving image on the electronic display. By receiving an input of an active reaction made corresponding to the position of the object recognized by the person to be measured and determining whether the acquired position of the object and the input reaction correctly correspond, a large-scale device is not required, the movement of the object is accurately simulated including its sense of distance, and a measurement test based on this can be performed with a small device, so that the three-dimensional recognition ability can be simply and surely quantified and objectively evaluated.

Brief Description of the Drawings

[0029]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Mode for Carrying Out the Invention

[0030] (Configuration of the Stereo Perception Ability Evaluation System 100) Hereinafter, with reference to the drawings, the stereo perception ability evaluation system 100 according to an embodiment of the present invention will be described. FIG. 1 shows an outline of the appearance of the stereo perception ability evaluation system 100. In FIG. 1, the configuration represented by the broken line exists inside the main body of the stereo perception ability evaluation system 100 and cannot be visually recognized from the outside. Details of those configurations will be described later with reference to FIG. 2. The stereo perception ability evaluation system 100 is a system that evaluates the stereo perception ability of a measurement target person by allowing the measurement target person to visually recognize a moving object and evaluating the reaction of the measurement target person thereto. In the present invention, the reaction means recognizing the distance of an object and corresponding thereto. Further, in the present invention, the measurement target person means a person who is the target for measuring the stereo perception ability. The stereo perception ability evaluation system 100 is typically in the form of a virtual reality headset which is a head-mounted display (goggles) equipped with an electronic display for displaying a moving image representing three-dimensional virtual reality. Typically, a wearing band such as a rubber band is attached to the stereo perception ability evaluation system 100. The user wears the stereo perception ability evaluation system 100 around the eyes by applying the stereo perception ability evaluation system 100 so as to cover around the eyes and winding the rubber band around the head.

[0031] Figure 2 is a block diagram showing the configuration of the stereoscopic perception ability evaluation system 100. The stereoscopic perception ability evaluation system 100 is composed of a processor 101, a RAM 102, a memory 103, an electronic display 104, a gaze / pupil sensor 105, an arm state sensor 106, and an interface 107. The processor 101 is a processing circuit for executing various functions to control the operation of the stereoscopic perception ability evaluation system 100, and is typically a CPU that operates an information device such as a computer. The RAM 102 is a temporary memory and is used as a work area when the processor 101 operates and a storage area for temporary data. The memory 103 is typically a non-volatile memory such as a flash ROM and stores a computer program and data referred to during its execution. The memory 103 stores a stereoscopic perception ability evaluation program 103a as a computer program. When the computer program is executed, an OS (operation system) is usually used, but the functions of the OS are included in the functions of the processor 101 for executing the computer program, and thus the description thereof is omitted here. The characteristic functions of the stereoscopic perception ability evaluation system 100 according to the present invention are realized by the computer program being executed by the processor 101 and forming an execution module corresponding to such functions. By the processor 101 reading out the stereoscopic perception ability evaluation program 103a stored in the memory 103 and executing it using the work area of the RAM 102, a module for realizing various functions related to the stereoscopic perception ability evaluation is formed, and an operation for realizing the function is executed.

[0032] The memory 103 stores background information data 103b as data referred to during the execution of the stereoscopic perception ability evaluation program 103a. The background information data 103b is typically data of an expected value indicating a general test result and is data referred to when evaluating the reaction of the measurement subject by comparing it with the expected value.

[0033] Note that some of the functions implemented by the three-dimensional perception ability evaluation program 103a do not necessarily have to be executed by the processor within the housing of the head-mounted display. For example, a part of the three-dimensional perception ability evaluation program 103a and background information data 103b can be stored in an external smartphone or the like and executed by the processor of the smartphone. In this case, the function by the part of the three-dimensional perception ability evaluation program 103a executed by the processor 101 within the housing of the head-mounted display and the function by the part of the three-dimensional perception ability evaluation program 103a executed by an external smartphone or the like realize the function of three-dimensional perception ability evaluation as a whole while appropriately communicating with each other.

[0034] The electronic display 104 is a flat panel display such as an LCD (liquid crystal display) or an organic EL display, and displays a moving image of an object moving in virtual reality to a user wearing the three-dimensional perception ability evaluation system 100 around the eyes via an eyepiece lens arranged on the measurement subject side. When the data of the moving image to be displayed is transferred to the data buffer area of the electronic display 104, the electronic display 104 reads out the image data from the data buffer area and displays the moving image represented by it. The electronic display 104 is independent for the right eye and the left eye, and is visually recognized by the user via the eyepiece lens respectively. When the position of the object to be displayed is at infinity, it is displayed at the same position on the right-eye and left-eye electronic displays 104, no parallax occurs between the left and right eyes, and the left and right eyes are in a divergent state, giving the user a feeling of existing at infinity. As the position of the object to be displayed approaches the user side, it is displayed closer to the inside on the right-eye and left-eye electronic displays 104, parallax occurs between the left and right eyes, and the left and right eyes are in a convergent state, giving the user a feeling of existing nearby.

[0035] The line-of-sight and pupil sensor 105 is a sensor that is arranged facing the measurement subject side, such as above the electronic display 104, for detecting the line-of-sight direction and pupil size of each of the left and right eyes, and is configured to function as an eyeball state sensing unit. The line-of-sight and pupil sensor 105 acquires images of each of the left and right eyes by image acquisition means such as a camera, and determines the line-of-sight direction and pupil size by specifying the position of the pupil and the size of the pupil in the image, and outputs it. As the camera, a visible light camera or an infrared camera can be used. For determining whether an object is being visually recognized, first, the line-of-sight direction is important data. By confirming that the line-of-sight of each of the left and right eyes (the normal line at the center of the pupil) exactly passes through the object, the visual recognition of the object can be confirmed. At this time, if a nearby object is being visually recognized, due to parallax, the line-of-sight of the left and right eyes will be closer to the inside and in a convergent state. In addition, for determining whether a nearby object is being continuously visually recognized, the pupil diameter can be additionally used. When a nearby object is being continuously visually recognized, due to the pupillary near reflex, the pupil diameter gradually becomes smaller, and by detecting this, it is possible to confirm whether visual recognition is successful. The arm state sensor 106 is a sensor that is attached to the arm of the measurement subject for detecting states such as the position and direction of the arm of the measurement subject, and is a sensor for detecting motion, position, and direction such as a gyro sensor, an acceleration sensor, and an azimuth sensor. The arm state sensor 106 is connected to the processor 101 by a wired or wireless connection. Note that the arm state sensor 106 can be replaced with a sensor attached to a predetermined part of the body other than the arm, and can be configured to detect states such as the position and direction of the predetermined part of the body. The interface 107 is a user interface for inputting information such as operation instructions from the user and outputting information representing the operating state to the user, and includes input means such as operation buttons, touch panels, and answer selection buttons, and output means such as LEDs. Also, when a part of the three-dimensional recognition ability evaluation program 103a is executed on an external smartphone or the like, the interface 107 also includes wireless communication means such as Wi-Fi (registered trademark) and Bluetooth (registered trademark) for communication with it.

[0036] (Functional Blocks of the Three-Dimensional Cognition Ability Evaluation System 100) Next, the functional configuration of the three-dimensional cognition ability evaluation system 100 will be described. FIG. 3 is a functional block diagram showing the functional configuration of the three-dimensional cognition ability evaluation system 100. In the three-dimensional cognition ability evaluation system 100, a module that forms functional blocks such as a moving object display unit 101a, an object position acquisition unit 101b, a visual recognition determination unit 101c, a reaction input unit 101d, and a three-dimensional cognition ability determination unit 101e is configured by executing a three-dimensional cognition ability evaluation program 103a stored in a memory 103 by a processor 101. Therefore, in FIG. 3, instead of the processor 101 and the three-dimensional cognition ability evaluation program 103a in FIG. 2, the functional blocks realized by them are shown. Hereinafter, these functional blocks will be described.

[0037] The moving object display unit 101a is a functional block for causing the electronic display to display a moving image of an object moving along a predetermined moving path from a moving start position to a moving end position in a direction approaching a predetermined viewpoint when viewed from the predetermined viewpoint in virtual reality. The moving object display unit 101a generates a moving image composed of continuous images constituting an image of a moving object for measurement of a visual recognition function, and transmits image data for displaying the same to the electronic display 104 for display. For example, when measuring the reaction when a measured person sees a pitched ball, the moving object display unit 101a generates a background image, generates a predetermined moving path from the pitching position by the pitcher as the moving start position to the catching position by the catcher as the moving end position for the ball as the moving object, moves the information on the position of the ball along the predetermined moving path, continuously generates images of the ball viewed from the respective viewpoints of the left and right eyes of the catcher by three-dimensional rendering, generates image data obtained by superimposing the same on the background image, and transfers it to the data buffer area of the electronic display 104 as data representing the moving image. The image data is data for each of the electronic displays 104 for the right eye and the left eye, and depending on the position of the moving object (distance from the user), the position of the object in each of the right-eye and left-eye images causes a parallax. Therefore, the measured person viewing the moving image on the electronic display 104 will see the ball with a realistic sense of perspective. The moving object display unit 101a sends the position of the ball as the object position to the object position acquisition unit 101b in order to perform determination using the object position.

[0038] The object position acquisition unit 101b is configured to acquire the information on the position of the object used in the simulation generated by the moving object display unit 101a and send it to the visual recognition determination unit 101c and the stereoscopic recognition ability determination unit 101e. The information on the position of the object is information that can at least specify the distance between the object and the measurement subject, and is typically three-dimensional position information. The sense of distance between the object and the measurement subject is necessarily required when performing a predetermined reaction with respect to a target whose position is dynamically determined by the position of a moving object that is a visual recognition target, such as when capturing an approaching object or maintaining a constant distance from an object in front. When using the specific three-dimensional position (three-dimensional coordinates) of the measurement subject as the information on the position of the object, the three-dimensional position of the object can be used. In this case, the distance can be obtained using the distance formula from the coordinates representing the three-dimensional positions of both. Also, when not using the specific three-dimensional positions of the measurement subject or the object as the information on the position of the object, only the information on the distance from the object can be used. When using the information on the three-dimensional position of the object as the information on the position of the object, it becomes possible to specify the depth distance and the direction of the line of sight in the line of sight of the measurement subject. The object position acquisition unit 101b is typically configured to extract the position of the object generated by the moving object display unit 101a for display for use by the visual recognition determination unit 101c and the stereoscopic recognition ability determination unit 101e. It is a functional block configured by executing a routine for acquiring the position of the object for functional blocks that require the position of the object, such as the visual recognition determination unit 101c and the stereoscopic recognition ability determination unit 101e. Note that, as in Modification Example 4 described later, when the position of the object is not generated by the moving object display unit 101a and the position of the actual object is used for the measurement test, the object position acquisition unit 101b acquires the position of the object from a sensor or the like.

[0039] The visual recognition determination unit 101c is a functional block for determining whether the measurement subject visually recognizes an object spatially by determining whether the line-of-sight direction correctly corresponds to the position of the moving object. The visual recognition determination unit 101c receives data on the directions of the lines of sight of the left and right eyes of the measurement subject sensed by the line-of-sight / pupil sensor 105 that functions as an eyeball state sensing unit, and determines whether the directions of the lines of sight of the left and right eyes match the object position sent from the moving object display unit 101a, and whether the measurement subject is tracking the moving object with the line of sight, thereby determining whether the measurement subject recognizes the object spatially. The visual recognition determination unit 101c further receives data on the pupil diameters of the left and right eyes of the measurement subject sensed by the line-of-sight / pupil sensor 105, and further determines that when the pupil diameters of both eyes are gradually decreasing while the position of the object approaches a predetermined viewpoint and the depth distance becomes smaller (when the pupillary near-distance reflex corresponding to the decrease in the depth distance occurs), it can also operate to determine that the measurement subject recognizes the object spatially.

[0040] The reaction input unit 101d is a functional block that receives the input of an active reaction of the measurement subject corresponding to the three-dimensional position of the object recognized by the measurement subject. The reaction input unit 101d inputs the reaction from the measurement subject looking at the moving object based on the operation information of the measurement subject's arm from the arm state sensor 106 and the input information such as the operation of the measurement subject's button or touch panel through the interface 107. Note that an active reaction means an operation performed on a target whose position is dynamically determined by the position of the moving object. Examples of active reactions include bringing a moving object closer to a predetermined location (in this case, the difference between the position of the moving object and the position of the predetermined location is dynamically determined based on the position of the moving object, and the goal is to reduce this difference), bringing a predetermined part of the body closer to the moving object (in this case, the difference between the position of the moving object and the position of the predetermined part of the body is dynamically determined, and the goal is to reduce this difference), maintaining a certain distance between the moving object and oneself (in this case, the difference between the position of the moving object and one's own position is dynamically determined based on the position of the moving object, and the goal is to keep this difference at a constant value), etc., which are positive operations to achieve a predetermined purpose. The accuracy of the active reaction has a great impact on the result, as the measurement subject's accurate visual recognition of the visual object and accurate reaction based on its stereoscopic recognition are crucial. That is, if the measurement subject does not accurately visually recognize the visual object, it cannot accurately perform stereoscopic recognition in three-dimensional space. And without accurate stereoscopic recognition of the visual object, it is impossible to accurately react to the target whose position is dynamically determined by the visual object. Therefore, by verifying the accuracy of the active reaction, it becomes possible to accurately evaluate the stereoscopic recognition ability. On the other hand, a passive reaction is typically a reaction that is performed when recognizing that a visual object moving one-dimensionally has come to a predetermined position regardless of the operation of the measurement subject, and it is a reaction with little need for stereoscopic recognition by the measurement subject. Therefore, due to chance, the measurement result of a passive reaction often can be higher than the actual ability. Therefore, such a measurement result cannot accurately evaluate the stereoscopic recognition ability.

[0041] The stereoscopic perception ability determination unit 101e is a functional block that evaluates the stereoscopic perception ability of the measurement subject by determining whether the position of the object and the reaction of the measurement subject correctly correspond. The stereoscopic perception ability determination unit 101e checks whether the reaction correctly corresponds to the position of the object by checking, for example, that the reaction of the measurement subject from the reaction input unit 101d corresponds to the position of the object. That is, when the target reaction is to bring a moving object closer to a predetermined location, it is confirmed that the difference between the position of the moving object and the position of the predetermined location has decreased to a predetermined value or less (that they substantially coincide). When the target reaction is to bring a predetermined part of the body closer to the moving object, it is confirmed that the difference between the position of the moving object and the position of the predetermined part of the body has decreased to a predetermined value or less (that they substantially coincide). When the target reaction is to keep a certain distance between the moving object and oneself, it is confirmed that the difference between the position of the moving object and one's own position is close to a certain value (that the difference in their positions is substantially constant). The stereoscopic perception ability determination unit 101e can also be configured to determine whether the reaction correctly corresponds to the position of the object, with the additional condition that the recognition determination unit has determined that the measurement subject visually recognizes the object spatially. Furthermore, deep learning or the like may be used for the determination of the stereoscopic perception ability.

[0042] Among the above-described functional blocks, for the determination of the stereoscopic perception ability, in particular, the object position acquisition unit 101b, the reaction input unit 101d, and the stereoscopic perception ability determination unit 101e are essential functional blocks. In FIG. 3, those functional blocks are shown surrounded by a broken line. In Modification Example 4 described later, the main part of the system is configured by the functional blocks of the object position acquisition unit 101b, the reaction input unit 101d, and the stereoscopic perception ability determination unit 101e.

[0043] (Operation of the stereoscopic perception ability evaluation system 100) Next, the operation of the three-dimensional perception ability evaluation system 100 will be described with reference to the operation flow shown in FIG. 4. The three-dimensional perception ability evaluation system 100 evaluates whether a moving object can make an appropriate reaction corresponding to its position by performing a measurement test using simulation in order to determine the three-dimensional perception ability. As the measurement test, for example, a capture test of a moving object is typical. In this example, as a measurement test performed by simulation to determine the three-dimensional perception ability, a test of the success or failure and skill of the catching operation of a pitched ball is performed. Approaching the ball, which is a moving object, with a hand, which is a predetermined part of the body, or a catching tool held by the hand is an active reaction of the measurement subject. The measurement subject will approach the hand or the catching tool held by the hand with the position of the ball as the target. Therefore, a ball is used as the moving object, the pitching position by the pitcher is used as the moving start position, the catching position by the catcher is used as the moving end position, the trajectory of the ball pitched by the pitcher is used as the predetermined moving path, and the perspective from the catcher is used as the predetermined perspective. More specifically, the pitcher is a baseball pitcher, and the catcher is a baseball catcher. First, the moving object display unit 101a causes the moving object to be displayed on the electronic display 104 (step S101). That is, in order to measure the reaction when the measured object sees the pitched ball, the moving object display unit 101a generates a predetermined moving path (that is, the continuous position of the ball) from the pitching position by the pitcher (pitcher), who is the moving start position, to the catching position by the catcher (catcher), who is the moving end position, as the ball, which is the moving object. An image of the trajectory of the ball pitched by the pitcher is continuously generated by three-dimensional rendering from the perspective of the catcher, and the generated image data is superimposed on the image of the background (baseball ground and batter's box) and transmitted to the data buffer area of the electronic display 104. In order to generate an image of a series of pitching states, the moving object display unit 101a first sets a typical pitching position stored (or a position obtained by randomly changing it slightly, etc.) as the initial position of the ball.Then, the moving object display unit 101a determines the speed and the moving path by adopting an appropriate pattern from a plurality of pre-stored speed and moving path (or the direction in which the ball is thrown) patterns, or by randomly shifting the path a little from typical speeds and moving paths. It is preferable that the moving path and the speed of the ball are determined according to physical laws such as gravity and air resistance, with the direction and speed at the time of pitching as the initial values. Note that the end position of the moving path is the catching position when the catch is successful. Then, the moving object display unit 101a moves the position of the ball along a predetermined moving path from the pitching position to the catching position, generates a series of right-eye and left-eye images of the ball existing at that position as seen from the catcher's perspective, and transfers it to the buffer area of the electronic display 104 for display as a moving image. Preferably, the moving object display unit 101a further displays the hand, which is the end of the arm, based on the information on the position of the arm of the measurement target person acquired from the arm state sensor 106. The image of the hand can be an image of the catcher's catching equipment (mitt, glove, etc.) attached to cover the hand, rather than a bare hand. FIG. 9 shows an image of the use of the stereoscopic perception ability evaluation system 100. The measurement target person visually recognizes the ball virtually displayed on the electronic display 104 and moves the arm to catch the ball. The movement of the arm is detected by the arm state sensor 106, and based on this, the hand virtually displayed on the electronic display 104 moves. The measurement target person visually recognizes the movement of the ball and performs the operation of catching the ball by moving the displayed hand so as to intersect the trajectory of the ball. When the stereoscopic perception ability determination unit 101e calculates the information on the position of the hand, the moving object display unit 101a may acquire the information on the position of the hand from there.

[0044] FIG. 10 and FIG. 11 are examples of display screens of a measurement test by catching a pitched ball for measuring stereoscopic recognition ability. At the bottom of FIGS. 10 and 11, the pitch of the ball 1001 by the pitcher 1002 to the mitt 1003, which is the catcher's equipment for catching the ball, and an image of the ground background as seen from the catcher's perspective are shown. A moving image consisting of the image shown at the bottom of FIG. 10 or FIG. 11 is displayed on the electronic display 104. At the top of FIGS. 10 and 11, the state of viewing such a pitch from the side is shown. The images at the top of FIGS. 10 and 11 may or may not be additionally displayed at the top of the image on the electronic display 104. The pitch in FIG. 10 is pitched to the right of the batter's box in a mountainous path at a slower speed, and the pitch in FIG. 11 is pitched to the left of the batter's box in a straight path at a faster speed.

[0045] While an object in motion is being displayed on the electronic display 104, the visual recognition determination unit 101c calculates the difference between the direction of the line of sight and the position of the object (step S102). The visual recognition determination unit 101c acquires the position of the moving object in real time from the object position acquisition unit 101b. The visual recognition determination unit 101c acquires the directions of the lines of sight of the left and right eyes from the line of sight / pupil sensor 105, and calculates the difference between that and the position of the moving object. Next, the visual recognition determination unit 101c determines whether the difference between the direction of the line of sight and the position of the object is equal to or less than a predetermined value for a predetermined time or more, thereby determining whether the directions of the lines of sight of both eyes have been consistent with the position of the object for a predetermined time or more and the object is being tracked (step S103). In this way, the visual recognition determination unit 101c acquires the directions of the lines of sight of the left and right eyes from the line of sight / pupil sensor 105, determines whether it is correct and is directed at the position of the moving object, and determines whether the directions of the lines of sight of both eyes are tracking the position of the object. Thereby, it is determined whether the measurement subject visually recognizes the moving object spatially. When the directions of the lines of sight of both eyes have been consistent with the position of the object for a certain time or more, the visual recognition determination unit 101c determines that tracking has started, and records the time when the directions of the lines of sight of both eyes began to match the position of the object as the visual recognition start time T1. That is, the visual recognition start time T1 is the time from when measurement is started by the pitching of the ball until it is determined that the measurement subject visually recognizes the object spatially from the start of movement of the object. The visual recognition start time T1 represents the sensitivity of visual recognition, and it can be evaluated that the smaller this value is, the more sensitive the visual recognition is. In FIG. 5, the visual recognition start time is illustrated and explained. The horizontal axis of the graph in FIG. 5 is time, and the vertical axis shows a state where the line of sight is tracking the object and a state where the line of sight is not tracking the object. In this way, when the visual recognition determination unit 101c determines that the directions of the lines of sight of both eyes have been consistent with the position of the object for a predetermined time or more and are tracking, it determines that the measurement subject visually recognizes the object spatially.

[0046] The visual recognition determination unit 101c can further determine that the measurement subject visually recognizes the object spatially, on the additional condition that not only does the line-of-sight direction track the position of the object for a predetermined time or longer, but also the pupil diameter has become smaller (this step is not shown in FIG. 4). The upper part of FIG. 5 also shows the distance to the object and the state of the pupil diameter. When the pupil diameter becomes smaller as the distance to the object decreases due to the position of the object approaching the viewpoint direction, the visual recognition determination unit 101c determines that the measurement subject visually recognizes the object spatially. Note that it is preferable to perform this additional determination based on the pupil diameter when the object comes near the viewpoint. The calculation of the difference between the line-of-sight direction and the object position in step S102 and the determination of whether spatial recognition of the object by vision is being performed in step S103 can be preconditions for determining the stereoscopic recognition ability based on the reaction of the measurement subject, which will be described later. In that case, a reliable determination of the stereoscopic determination ability based on spatial recognition by vision can be made. However, it is also possible not to perform those steps before determining the stereoscopic recognition ability based on the reaction of the measurement subject. In this case, the stereoscopic recognition ability can be determined with a simpler system configuration and operation.

[0047] Next, the stereoscopic recognition ability determination unit 101e calculates the distance between the object and the hand based on the object position and the reaction of the measurement subject (step S104). The stereoscopic recognition ability determination unit 101e acquires the position of the moving object from the object position acquisition unit 101b in real time. The stereoscopic recognition ability determination unit 101e specifies the position of the hand, which is the end of the arm, based on the information on the position of the arm of the measurement subject acquired from the arm state sensor 106, and specifies the range of positions where the hand can capture the object in consideration of the size of the hand. When a catching tool (mitt, glove, etc.) is attached to the hand, the range of positions where the hand can capture the object (catching possible range) is specified in consideration of the size of the catching tool. Then, the stereoscopic recognition ability determination unit 101e calculates the distance between the position of the object and the hand (or catching tool) until the moving object reaches the movement end position.

[0048] Next, until the moving object reaches the movement end position, the three-dimensional recognition ability determination unit 101e determines whether the calculated minimum distance from the object to the hand becomes equal to or less than a predetermined value (step S105). Then, if the distance from the object to the hand (or the ball-catching tool) becomes equal to or less than the predetermined value, it is determined that the object has been captured by the hand (or the ball-catching tool) and the ball-catching has been successful, and the operation flow proceeds to step S106. That is, it is determined that the reaction of the measurement subject correctly corresponds to the position of the object. The three-dimensional recognition ability determination unit 101e records the minimum distance between the hand and the object as the minimum distance L1, and records the time when it is determined that the ball-catching has been successful as the reaction time T2. The minimum distance L1 represents the accuracy of the reaction, and it can be evaluated that the smaller this value is, the more accurate the reaction is. The reaction time T2 represents the sensitivity of the reaction, and it can be evaluated that the smaller this value is, the more sensitive the reaction is. The reaction time T2 is explained in FIG. 5. The reaction time T2 is the time from the start of the movement of the object until the distance between the hand and the object becomes the minimum distance. Thus, by the success of the ball-catching, it is possible to obtain a determination result that there is no problem with the three-dimensional recognition ability of the measurement subject. For more precise determination, it is also possible to perform the determination from a plurality of viewpoints. For example, parameters such as the visual recognition start time T1, the minimum distance L1 between the hand and the object, and the reaction time T2 (hereinafter referred to as reaction parameters) are acquired, and based on them, the three-dimensional recognition ability of the measurement subject can be quantitatively calculated. Specifically, by associating the numerical values of the respective reaction parameters with scores, scores are calculated based on the numerical values of the respective reaction parameters, and further, weights for the respective reaction parameters are set, and the three-dimensional recognition ability can be quantified by, for example, summing the products of the respective scores and the respective weights, and the three-dimensional recognition ability determination unit 101e can calculate and output it. The weight can be set to a larger value for the reaction parameter that has a greater influence on the determination result.

[0049] On the other hand, if the distance between the moving object and the hand (or the ball-catching tool) does not become equal to or less than a predetermined value even when the moving object reaches the movement end position (i.e., the object does not enter the ball-catching range), the three-dimensional recognition ability determination unit 101e determines that the ball-catching is not successful and advances the operation flow to step S107.

[0050] When the three-dimensional recognition ability determination unit 101e determines that the ball-catching is successful, it increments the success count N by adding 1 to the success count (step S106). Then, it advances the operation flow to step S107. Next, the three-dimensional recognition ability determination unit 101e determines whether the measurement test has been executed a predetermined number of times (step S107). If the measurement test has not been executed the predetermined number of times, it returns the operation flow to step S101 to execute the measurement test from the beginning. That is, the movement of the object by the moving object display unit 101a, the determination by the visual recognition determination unit 101c as to whether the measurement target person spatially recognizes the object visually, and the evaluation of the three-dimensional recognition ability by the three-dimensional recognition ability determination unit 101e are repeated a plurality of predetermined number of times. The predetermined number of times is, for example, a number such as 10 times, which is large enough for the number of successes to have meaning in the evaluation but not so large as to cause an excessive burden. If the measurement test has been executed the predetermined number of times in step S107, it advances the operation flow to step S108.

[0051] The three-dimensional recognition ability determination unit 101e determines the three-dimensional recognition ability based on the result of the measurement test and outputs the determination result (step S108). As the determination result, first, the measured value can be output as it is. For example, the three-dimensional recognition ability determination unit 101e can output the number of times the reaction is determined to be correctly corresponding to the position of the object. Also, instead of the number of times, the success rate obtained by dividing the success count by the number of measurement times may be output as the determination result. Further, the value (average value) of each reaction parameter and the success count may be combined and output as the determination result.

[0052] The three-dimensional recognition ability determination unit 101e can also output, as a determination result, the result of comparing the measured value with the expected value for each age. The expected value is the average of the measured values obtained by measuring a large number of people, and is the value expected of a standard measurement subject. The expected value for each age is the expected value with people in a predetermined age range as the population. FIG. 13 shows an example of a table of the reaction parameters for each age and the expected value of the number of successes. Specifically, FIG. 13 shows the expected values for each age of the visual recognition start time T1, the minimum distance L1 between the hand part and the object, the reaction time T2, and the number of successes N. The data shown in this table is stored as background information data 103b and is referred to by the three-dimensional recognition ability determination unit 101e. In addition to the expected value, data on the standard deviation may be stored. The three-dimensional recognition ability determination unit 101e can receive the input of the age of the measurement subject, obtain the expected value corresponding to that age from the background information data 103b, and output the comparison result between that and the measured value as the determination result. The comparison result can output the measured value and the expected value side by side for each reaction parameter, output their ratio, or calculate and output the deviation value using the standard deviation data.

[0053] The three-dimensional recognition ability determination unit 101e can also output, as a determination result, the result of comparing the measured value with the expected value for each proficiency rank. FIG. 14 shows an example of a table of reaction parameters and expected values of the number of successful attempts for each proficiency rank. Specifically, FIG. 14 shows the expected values of the visual recognition start time T1, the minimum distance L1 between the hand part and the object, the reaction time T2, and the number of successful attempts N for each proficiency rank. The expected value for each proficiency rank is the expected value with the people for each proficiency rank as the population. Here, the proficiency rank is, for example, in the case of catching a ball, a ranking of the proficiency in baseball, and can be classified, for example, by proficiency levels such as non-experienced, experienced, amateur player, professional player, top professional, etc. The data shown in this table is stored as background information data 103b and referred to by the three-dimensional recognition ability determination unit 101e. The three-dimensional recognition ability determination unit 101e can compare the measured value of the measurement target person with the expected value for each proficiency rank, quantify the degree of skill or clumsiness by specifying the proficiency rank closest to the measured value of the measurement target person, and output it as the determination result.

[0054] As described above, the three-dimensional recognition ability determination unit 101e can quantify the three-dimensional recognition ability from various viewpoints and output it as the determination result. That is, as the determination result, the three-dimensional recognition ability determination unit 101e can output measured values such as the number of successful attempts, the success rate, and reaction parameters (visual recognition start time T1, minimum distance L1 between the hand part and the object, reaction time T2). Further, the three-dimensional recognition ability determination unit 101e can output the result (such as co-listing, ratio, deviation value, etc.) of comparing those measured values with the expected values by age. Furthermore, the three-dimensional recognition ability determination unit 101e can output the proficiency rank closest to those measured values.

[0055] (Modification Example 1 - Hitting a Thrown Ball with a Bat) In the above-described embodiments, the stereoscopic recognition ability was determined based on whether a pitched ball could be caught. However, the stereoscopic recognition ability can be similarly determined using various sports competitions, driving operations, and the like. FIG. 12 shows an example of a display screen of a measurement test for hitting a pitched ball with a bat for measuring the stereoscopic recognition ability. Hitting a ball with a bat, like catching a pitched ball, is an active reaction of the measurement subject to bring the bat held by the arm, which is a predetermined part of the body, closer to the ball, which is a moving object, for hitting. The measurement subject will bring the bat closer to the position of the ball as the target. In this Modification 1, the stereoscopic recognition ability is measured based on whether the hitting with the bat is successful instead of catching. A system for such measurement can have substantially the same configuration as the above-described stereoscopic recognition ability evaluation system 100. However, the moving object display unit 101a uses a baseball ball 1001 as the moving object, the pitching position by the pitcher 1002 as the moving start position, the catching position by the catcher as the moving end position, the trajectory of the ball pitched by the pitcher as the predetermined moving path, and the viewpoint from the batter as the predetermined viewpoint. Then, the moving object display unit 101a identifies the position and direction of the bat 1004 held by the arm based on the information on the position of the arm of the measurement subject acquired from the arm state sensor 106, and further displays the bat 1004 held by the arm. The stereoscopic recognition ability determination unit 101e determines that the reaction of the measurement subject correctly corresponds to the ball when the distance between a predetermined hitting area in the bat 1004 and the object is within a predetermined distance. As the hitting area, the range within the contour of the bat 1004 or the range of the sweet spot of the bat 1004 can be used. Also, the score for a position close to the sweet spot of the bat 1004 can be increased.

[0056] (Modification 2 - Squash) In addition, squash can be used as a sports competition for determining three-dimensional recognition ability. Similar to catching a pitched ball, approaching a racket held in an arm, which is a predetermined part of the body, to a ball that is a moving object is an active reaction of the person being measured. The person being measured will approach the racket to the position of the ball as the target. FIG. 15 shows an example of a display screen of a measurement test using squash for measuring three-dimensional recognition ability. In this Modification 2, the three-dimensional recognition ability is measured based on whether the hitting of the ball by the racket in squash is successful. A system for such measurement can have substantially the same configuration as the above-described three-dimensional recognition ability evaluation system 100. However, the moving object display unit 101a uses the squash ball 1501 as the moving object, uses the reflection position on the wall as the moving start position, uses the position in front of the player as the moving end position, uses the trajectory of the ball 1501 reflected by the wall as the predetermined moving path, uses the viewpoint from the player as the predetermined viewpoint, and displays them with the squash court as the background. Then, based on the information on the position of the arm of the person being measured acquired from the arm state sensor 106, the moving object display unit 101a identifies the position and direction of the racket 1502 held in the arm and further displays the racket 1502 held in the arm. The three-dimensional recognition ability determination unit 101e determines that the reaction of the person being measured correctly corresponds to the ball when the distance between a predetermined hitting area in the racket 1502 and the object is within a predetermined distance. As the hitting area, the range of the racket face of the racket 1502 can be used, etc. Also, the score at a position closer to the center of the racket face of the racket 1502 can be increased. FIG. 16 is a diagram showing an example of the measurement results of the measurement test using squash. Here, the number of successful hits (Hit) is 4 / 10, the average distance (error) from the center of the racket at the time of success, and the minimum distance between the ball 1501 and the racket 1502 at the time of non-success (NG) are shown. The three-dimensional recognition ability determination unit 101e can output these as the determination results.

[0057] (Modification 3 - Drive Simulation) In addition, as a driving operation for determining the three-dimensional perception ability, the driving operation of an automobile can be used. As the driving operation, in order to evaluate the three-dimensional perception ability based on the sense of distance, an operation of keeping the distance from the vehicle ahead constant by means of an accelerator operation or the like can be used. In this case, keeping a certain distance between the vehicle ahead and the own vehicle is an active reaction of the measurement subject. The measurement subject aims to keep the difference between the position of the vehicle ahead and the position of the own vehicle constant, where the difference is dynamically determined depending on the position of the vehicle ahead. FIG. 17 shows an example of the display screen of the measurement test by drive simulation for measuring the three-dimensional perception ability. In this Modification 3, in the drive simulation, the three-dimensional perception ability is measured based on whether the distance from the vehicle ahead 1701 can be kept constant. The system for such measurement can have substantially the same configuration as the above-described three-dimensional perception ability evaluation system 100. However, the moving object display unit 101a displays the vehicle ahead 1701 whose speed changes within a predetermined range as a moving object at the far and near distance position (starting position) at the start of measurement with the road and the dashboard of the own vehicle as the background, calculates the speed and position of the own vehicle according to the accelerator opening of the measurement subject, and changes the distance from the vehicle ahead 1701 based on the difference from the position of the vehicle ahead 1701. The accelerator opening can be input, for example, based on the information on the position of the foot of the measurement subject obtained by attaching the arm state sensor 106 to the foot and based on the depression degree based on the position of the accelerator pedal depressed by the foot. Alternatively, it is also possible to prepare a control device having an accelerator pedal connected to the three-dimensional perception ability evaluation system 100 and input the accelerator opening by acquiring the information on the accelerator pedal depression degree from there. In addition, the accelerator opening can also be input using a dial or lever operated by hand. Further, in addition to the accelerator pedal, it may also be possible to distinguish whether the brake pedal is depressed and decrease the speed according to the depression degree of the brake pedal. The three-dimensional perception ability determination unit 101e can determine that the three-dimensional perception ability of the measurement subject is normal when the distance from the vehicle ahead 1701 is within a predetermined range or close to a certain value.Further, it can be determined that the subject has a high stereoscopic perception ability on the grounds that the smaller the difference between the maximum distance and the minimum distance between the position of the leading vehicle and the position of the host vehicle specified by the accelerator operation, the more accurately a certain distance can be maintained. FIG. 18 is a diagram showing an example of the measurement results of a measurement test by a driving simulation. Here, the average inter-vehicle distance, the maximum inter-vehicle distance, and the minimum inter-vehicle distance are shown. The stereoscopic perception ability determination unit 101e can output these as determination results.

[0058] (Modification Example 4 - Drone Landing Operation) Also, as a driving operation for determining the three-dimensional recognition ability, it is also possible to use an operation of an operation object such as a drone, for example, a landing operation of the drone. In this case, approaching the drone, which is a moving object, as the operation object to a landing pad, which is a predetermined location, is the active reaction of the measurement subject. The measurement subject aims to reduce the difference between the position of the drone and the position of the landing pad, which is dynamically determined based on the position of the drone. In this Modification 4, the three-dimensional recognition ability is measured based on the skill of the landing operation in the actual drone operation. A system for such measurement can be realized by an information terminal such as a smartphone connected to a predetermined sensor without using a virtual reality headset equipped with an electronic display such as the above-described three-dimensional recognition ability evaluation system 100. In the information terminal, when the processor of the information terminal executes a predetermined program, functional blocks corresponding to the object position acquisition unit 101b, the reaction input unit 101d, and the three-dimensional recognition ability determination unit 101e of the three-dimensional recognition ability evaluation system 100 are configured. In this case, the moving object is a drone, which is an operation object that is moved from the starting position toward the target position by the operation of the measurement subject. The reaction input unit 101d receives the position of the drone as the input of the reaction. The three-dimensional recognition ability determination unit 101e evaluates the three-dimensional recognition ability of the measurement subject based on the difference between the position of the drone and the target position. FIG. 19 shows an image diagram of a measurement test by a drone landing operation for measuring the three-dimensional recognition ability. Specifically, after the measurement subject actually visually recognizes the drone 1901 and operates it, it is determined whether the drone 1901 can be landed on the landing pad 1902, and the three-dimensional recognition ability is measured based on the skill. The center of the landing pad 1902 is the target position, and if the drone 1901 is landed at a position close to it, the landing operation is determined to be skillful. The object position acquisition unit 101b acquires the real-time position of the drone 1901 after the drone 1901 starts from the starting position. The position of the drone 1901 is a one-dimensional position on at least a straight line connecting the position of the measurement subject and the position of the landing pad 1902.As the position of the drone 1901, it is also possible to use a two-dimensional position obtained by adding the position in the orthogonal direction in the horizontal plane with respect to the straight line, or a three-dimensional position obtained by further adding the position in the height direction. Regarding the position of the drone 1901, the drone 1901 can be photographed by a camera or the like, and its position can be specified from the image, or the position of the drone 1901 can be specified by a distance sensor. Also, a position sensor can be attached to the drone 1901 to obtain the position of the drone 1901. The position of the drone 1901 is input to the reaction input unit 101d as the reaction of the measurement target person. The three-dimensional recognition ability determination unit 101e stores the position of the center (target position) of the landing pad 1902, and obtains the difference (distance) from the position of the drone 1901 input to the reaction input unit 101d in real time. Based on the difference (distance) between the real-time position of the drone 1901 and the position of the landing pad 1902, the three-dimensional recognition ability determination unit 101e specifies the success or failure of landing, the magnitude of the difference from the landing pad 1902 of the drone 1901, etc., and thereby determines the three-dimensional recognition ability. That is, if the distance between the drone 1901 and the landing pad 1902 is within the range of the size of the landing pad 1902 and the movement of the drone 1901 stops there, it can be determined that the drone 1901 has landed on the landing pad 1902. If the drone 1901 has landed at a position closer to the center of the landing pad 1902, it can be determined that the landing operation was more skillful. FIG. 20 is a diagram showing an example of the measurement results of the measurement test by the drone landing operation. Here, a graph showing how the distance of the drone 1901 from the landing pad 1902 has changed over time is shown. The three-dimensional recognition ability determination unit 101e can output the success or failure of landing as a determination result by determining whether the distance from the landing pad is within a predetermined range and the landing is successful. The three-dimensional recognition ability determination unit 101e can further output the distance of the drone 1901 from the center (target position) of the landing pad 1902 when the landing is successful as a determination result indicating the skillfulness of the landing operation. The three-dimensional recognition ability determination unit 101e can also output the minimum distance and the average distance of the drone 1901 from the center of the landing pad 1902 within a predetermined time range as determination results.

Industrial Applicability

[0059] The present invention can be used in fields such as medical treatment, preventive medicine, and medical devices where it is necessary to objectively grasp the stereoscopic perception ability and cognitive function of a subject by quantifying the stereoscopic perception ability.

Explanation of Signs

[0060] 100: Stereoscopic Perception Ability Evaluation System 101: Processor 101a: Moving Object Display Unit 101b: Object Position Acquisition Unit 101c: Visual Recognition Judgment Unit 101d: Reaction Input Unit 101e: Stereoscopic Perception Ability Judgment Unit 102: RAM 103: Memory 103a: Stereoscopic Perception Ability Evaluation Program 103b: Background Information Data 104: Electronic Display 105: Pupil Sensor 106: Arm State Sensor 107: Interface 1001: Ball 1002: Pitcher 1003: Mitt 1004: Bat 1501: Ball 1502: Racket 1701: Front-wheel Vehicle 1901: Drone 1902: Landing Pad L1: Minimum Distance N: Number of Successful Times T1: Visual Recognition Start Time T2: Reaction Time

Claims

1. A stereoscopic perception ability evaluation system for evaluating a stereoscopic perception ability based on a reaction of a measurement subject to a moving object provided in virtual reality, a virtual reality headset including an electronic display for displaying a moving image of virtual reality, a moving object display unit that causes the electronic display to display a moving image when the object in the virtual reality is moved along a predetermined movement path in a direction approaching the predetermined viewpoint from a movement start position to a movement end position when viewed from the predetermined viewpoint, an object position acquisition unit that acquires information on the position of the moving object in the virtual reality displayed by the moving object display unit and that can specify the distance between the moving object and the measurement subject, a reaction input unit that receives an input of an active reaction of the measurement subject made corresponding to the position of the object recognized by the measurement subject, a stereoscopic perception ability determination unit that evaluates the stereoscopic perception ability of the measurement subject by determining whether the acquired position of the object and the input reaction correctly correspond to each other, A stereoscopic perception ability evaluation system characterized by comprising the above components.

2. The stereoscopic perception ability determination unit evaluates the stereoscopic perception ability of the measurement subject based on a position correspondence relationship between the acquired position of the object and the position specified by the reaction within a range of a predetermined time. The stereoscopic perception ability evaluation system according to Claim 1.

3. The position correspondence relationship is the minimum distance between the position of the object and the position specified by the reaction, the average distance between the position of the object and the position specified by the reaction, or the difference between the maximum distance and the minimum distance between the position of the object and the position specified by the reaction. The stereoscopic perception ability evaluation system according to Claim 2, which includes any one of these.

4. an eyeball state perception unit that senses the line-of-sight directions of both eyes of the measurement subject, and a visual recognition determination unit that determines whether the measurement subject visually recognizes the object spatially by determining whether the line-of-sight direction correctly corresponds to the position of the moving object. The system further includes these components. When the three-dimensional recognition ability determination unit determines that the measurement subject is spatially recognizing the object visually by the visual recognition determination unit, the three-dimensional recognition ability evaluation system according to any one of claims 1 to 3 evaluates the three-dimensional recognition ability of the measurement subject by determining whether the input reaction correctly corresponds to the position of the obtained object.

5. When the visual recognition determination unit determines that the positions of the objects at which the line-of-sight directions of both eyes move respectively coincide with each other for a predetermined time or longer, the visual recognition determination unit determines that the measurement subject is recognizing the object visually. The three-dimensional recognition ability evaluation system according to claim 4.

6. The eye state sensing unit further senses the pupil diameters of both eyes of the measurement subject. When the visual recognition determination unit further determines that the pupil diameters of both eyes are gradually decreasing as the position of the object approaches the predetermined viewpoint, the visual recognition determination unit determines that the measurement subject is spatially recognizing the object visually. The three-dimensional recognition ability evaluation system according to claim 4 or 5.

7. The reaction input unit continuously specifies the position of a predetermined part of the body based on a signal from a sensor attached to the predetermined part of the body of the measurement subject, and inputs it as the reaction. The moving object display unit further causes the electronic display to display at least a part of an image of the predetermined part of the body of the measurement subject in the virtual reality based on the specified position of the predetermined part of the body. When the three-dimensional recognition ability determination unit determines that the measurement subject is spatially recognizing the object by the visual recognition determination unit, when the distance between a predetermined location related to the predetermined part of the body and the object is within a predetermined distance, the three-dimensional recognition ability determination unit determines that the reaction correctly corresponds. The three-dimensional recognition ability evaluation system according to any one of claims 4 to 6.

8. The three-dimensional recognition ability determination unit The visual recognition start time from the start of movement of the object until it is determined that the measurement subject spatially recognizes the object, the minimum distance between a predetermined location related to a predetermined part of the body and the object, and the response time from the start of movement of the object until the distance between the predetermined location related to the predetermined part of the body and the object becomes the minimum distance, are obtained, and based on these, the stereoscopic recognition ability of the measurement subject is evaluated. The stereoscopic recognition ability evaluation system according to claim 7.

9. The stereoscopic recognition ability determination unit calculates respective scores based on the respective numerical values of the reaction parameters, and evaluates the stereoscopic recognition ability of the measurement subject based on the sum of the respective scores multiplied by respective predetermined weights. The stereoscopic recognition ability evaluation system according to claim 8.

10. The movement of the object by the moving object display unit, the determination by the visual recognition determination unit as to whether the measurement subject visually and spatially recognizes the object, and the evaluation of the stereoscopic recognition ability by the stereoscopic recognition ability determination unit are repeated a plurality of predetermined number of measurement times, The stereoscopic recognition ability determination unit further outputs the number of times it is determined that the reaction correctly corresponds to the position of the object. The stereoscopic recognition ability evaluation system according to any one of claims 4 to 9.

11. A stereoscopic recognition ability evaluation apparatus for evaluating the stereoscopic recognition ability based on the reaction of a measurement subject to a moving object provided in virtual reality, a virtual reality headset including an electronic display for displaying a virtual reality moving image, a moving object display unit that causes the electronic display to display a moving image when the object in the virtual reality is moved along a predetermined movement path from a movement start position to a movement end position in a direction approaching the predetermined viewpoint when viewed from the predetermined viewpoint, an object position acquisition unit that acquires information on the position of the moving object in the virtual reality displayed by the moving object display unit, capable of specifying the distance between the moving object and the measurement subject, a reaction input unit that receives an input of an active reaction of the measurement subject made corresponding to the position of the object recognized by the measurement subject, a stereoscopic recognition ability determination unit that evaluates the stereoscopic recognition ability of the measurement subject by determining whether the acquired position of the object and the input reaction correctly correspond. A stereoscopic perception ability evaluation device characterized by being housed in a single housing.

12. A stereoscopic perception ability evaluation program for configuring, when executed by a computer, a stereoscopic perception ability evaluation system for the computer to evaluate the stereoscopic perception ability based on the reaction of a measurement subject to a moving object provided in virtual reality. The stereoscopic perception ability evaluation system includes: A virtual reality headset including an electronic display for displaying a virtual reality moving image; A moving object display unit for displaying, on the electronic display, a moving image when the object is moved in a predetermined movement path in a direction approaching the predetermined viewpoint from a movement start position to a movement end position when viewed from the predetermined viewpoint in the virtual reality; An object position acquisition unit for acquiring information on the position of the moving object in the virtual reality displayed by the moving object display unit, capable of specifying the distance between the moving object and the measurement subject; A reaction input unit for receiving an input of an active reaction of the measurement subject made corresponding to the position of the object recognized by the measurement subject; A stereoscopic perception ability determination unit for evaluating the stereoscopic perception ability of the measurement subject by determining whether the acquired position of the object and the input reaction correspond correctly; A stereoscopic perception ability evaluation program characterized by having the above.

13. A stereoscopic perception ability evaluation method for evaluating the stereoscopic perception ability based on the reaction of a measurement subject to a moving object provided in virtual reality, comprising: A moving object display step of displaying, on an electronic display of a virtual reality headset, a moving image when the object is moved in a predetermined movement path in a direction approaching the predetermined viewpoint from a movement start position to a movement end position when viewed from the predetermined viewpoint in the virtual reality; An object position acquisition step of acquiring information on the position of the moving object in the virtual reality displayed in the moving object display step, capable of specifying the distance between the moving object and the measurement subject; A reaction input step of receiving an input of an active reaction of the measurement subject made corresponding to the position of the object recognized by the measurement subject; A stereoscopic perception ability step of evaluating the stereoscopic perception ability of the measurement subject by determining whether the acquired position of the object and the input reaction correspond correctly; A stereoscopic perception ability evaluation method characterized by having the above.

Images