Eyesight training system, eyesight training method and program

Abstract

To provide an eyesight training system allowing a user to train eyesight.SOLUTION: An eyesight training system includes a first display device for displaying an image in one eye of a user, a second display device for displaying the image in the other eye of the user, and a display control part for executing such control that an object, the operation object of the user to be displayed on the first and second display devices, has different transparency on the first and second display devices.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a vision training system, a vision training method, and a program. [Background technology]

[0002] A vision training method has been proposed in which a headset is used to change how the right and left eyes see (see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2017 / 181010 Summary of the Invention [Problem to be solved by the invention]

[0004] However, as in Patent Document 1, if the way the entire space is viewed is changed for each eye, it is difficult to concentrate on the work object that should be seen. Also, if the contrast, brightness, darkness, etc. of the work object is changed, the object becomes more noticeable.

[0005] The present invention has been made in view of the above background, and has an object to provide a technique capable of training visual acuity. [Means for solving the problem]

[0006] The main invention of the present invention for solving the above problem is a vision training system comprising a first display device that displays an image to one eye of a user, a second display device that displays an image to the other eye of the user, and a display control unit that controls an object to be operated by the user displayed on the first and second display devices so that the object has different transparency on the first and second display devices.

[0007] Other problems and solutions disclosed in this application will be made clear in the description of the preferred embodiments of the invention and the drawings. Effect of the Invention

[0008] According to the present invention, vision can be trained. [Brief description of the drawings]

[0009] [Figure 1] 1 is a diagram illustrating an example of the configuration of a visual acuity training system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a diagram illustrating an example of the configuration of an HMD 1. [Diagram 3] FIG. 2 illustrates an example of the software configuration of a computer 2. [Figure 4] FIG. 2 is a diagram showing an example of an image displayed on the HMD 1. [Diagram 5] FIG. 13 is a diagram showing another example of an image displayed on the HMD 1. [Figure 6] FIG. 2 is a diagram illustrating the operation of the computer 2 in the visual acuity training system of the present embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] <Summary> A visual acuity training system according to an embodiment of the present invention will be described below. In the visual acuity training system of this embodiment, a user wears a head mounted display (HMD1) and performs tasks in a virtual space. By making the transparency of the object to be worked on different for the right and left eyes, it is possible to train a user with weak eyesight.

[0011] FIG. 1 is a diagram showing an example of the configuration of a visual acuity training system according to this embodiment. The visual acuity training system according to this embodiment includes a computer 2. The computer 2 is connected to an HMD 1 and an input device 3, and can receive data input from the input device 3 and control the display of an image on the HMD 1. As shown in FIG. 1, the computer 2 may include a CPU 201, a memory 202, and a storage device 203. The storage device 203 is, for example, a hard disk drive, a solid state drive, or a flash memory that stores various data and programs. Each functional unit of the computer 2 described later is realized by the CPU 201 reading a program stored in the storage device 203 into the memory 202 and executing it, and each storage unit of the computer 2 may be realized as a part of the storage area provided by the memory 202 and the storage device 203.

[0012] The input device 3 is, for example, a controller. The input device 3 can support the user in making a predetermined input in the virtual space. The input device 3 can be configured as, for example, a set of controllers for the left and right hands. The input device 3 can include, for example, an operation trigger button, an infrared LED, a sensor, a joystick, a menu button, and the like. The input device 3 can also detect posture and movement using an acceleration sensor (not shown) or the like, and input posture and movement data to the computer 2 as input data.

[0013] The computer 2 performs control processing to display a virtual object (three-dimensional object) to be worked on on the HMD 1, and also moves a virtual hand in response to input from the input device 3, allowing the user to perform work on the work object through the movement of the virtual hand.

[0014] FIG. 2 is a diagram showing an example of the configuration of the HMD 1. The HMD 1 can be worn on the user's head. The HMD 1 includes display devices 11 and 12 arranged in front of the user's left and right eyes. The display device 11 displays an image to one eye (the right eye in the example of FIG. 2). The display device 12 displays an image to the other eye (the left eye in the example of FIG. 2). For example, optically transmissive and non-transmissive displays can be used as the display devices 11 and 12. As described below, the transparency of the object to be worked on displayed on the display devices 11 and 12 is controlled to be different.

[0015] 3 is a diagram showing an example of the software configuration of the computer 2. The computer 2 can include an operation input unit 211, a display control unit 212, a setting storage unit 231, and an object storage unit 232.

[0016] The setting storage unit 231 can store various setting items. The setting storage unit 231 can store the setting items in association with information (user ID) indicating the user. The setting items can be set, for example, by an ophthalmologist who treats the user. The setting items can include, for example, information indicating the display device 11 or 12 for which the transparency of an object is to be increased. The setting items can include, for example, information specifying the eye with stronger or weaker vision of the user. In this case, the transparency of the object can be increased in the display device 11 or 12 corresponding to the eye with stronger vision, so that the eye with weaker vision can be trained to see the operation target more closely. The setting items can include, for example, the transparency of the object. The setting items can store the difficulty level set for the user. For example, when there are multiple objects to be operated, the setting items can include information indicating the object to be viewed with more concentration.

[0017] The object storage section 232 can store information for displaying a virtual object (hereinafter referred to as object information; for example, it can be a three-dimensional model).

[0018] The operation input unit 211 can receive input from the input device 3. The operation input unit 211 can receive, from the input device 3, information (event information) indicating operations such as the attitude and movement of the input device 3 and pressing of a button.

[0019] The display control unit 212 displays images on the display devices 11 and 12. The display control unit 212 can display a virtual object in a virtual space based on object information stored in the object storage unit 232. The display control unit 212 can refer to the setting storage unit 231 to determine which of the display devices 11 and 12 the transparency of the object should be increased on and to what degree the transparency of the object should be. Furthermore, when there are multiple objects to be operated, the display control unit 212 can determine which of the display devices 11 and 12 the transparency of which object should be increased on.

[0020] In this embodiment, the display control unit 212 controls the display devices 11 and 12 so that an object to be operated by the user, which is displayed on the display devices 11 and 12, has different transparency on the first and second display devices. The display control unit 212 can display various objects in a virtual space related to so-called VR (Virtual Reality). In this embodiment, the display control unit 212 can display a three-dimensional object on the display devices 11 and 12 so that a stereoscopic image is formed by utilizing parallax. The display control unit 212 can display an object on the display devices 11 and 12 so that the object is displayed three-dimensionally to the user and has different transparency on the display devices 11 and 12.

[0021] Furthermore, the display control unit 212 may display a virtual object in an augmented reality (AR) space or a mixed reality (MR) space. For example, the HMD 1 may be provided with a camera, and the display control unit 212 may display an image captured by the HMD 1 and superimpose the virtual object on the image from the camera so that the object to be operated is displayed in three dimensions.

[0022] The display control unit 212 can also detect an object from an image captured by a camera (not shown, which may be provided in the HMD 1 or the computer 2) and change the transparency of the detected object. In this case, the HMD 1 or the computer 2 can be provided with a first and second camera that captures the user's field of view, and the computer 2 can be provided with an image acquisition unit that acquires the first and second images captured by the first and second cameras. The display control unit 212 can detect an object from the first and second images and perform image processing to increase the transparency of the object area in the first or second image. The display control unit 212 can, for example, detect the user's gaze point, recognize the object at the gaze point position among the objects detected from the first and second images as the object to be operated, and change the transparency of the area occupied by the recognized object.

[0023] The display control unit 212 can perform control to increase the transparency of an object displayed on the display device 11 or 12 placed in front of the eye with the weaker degree of amblyopia (stronger eyesight). This makes it easier for the user to use the weaker eye, and allows the user to train to use the weaker eye more.

[0024] The display control unit 212 may perform control so as to increase over time the transparency of only one of the objects displayed on the display device 11 or 12. For example, the transparency can be changed while the user is working on the object.

[0025] The transparency can be changed according to the degree of treatment. When used for treating amblyopia, the transparency can be changed according to the degree of amblyopia. The transparency can be changed according to the difficulty level set for the user. That is, when a higher difficulty level is set, the transparency can be set to be higher. The difficulty level can be set by inquiring about the subjective difficulty of the user regarding the training through a questionnaire or the like, and by lowering the transparency when the user feels the training is more difficult than a predetermined difficulty level, and by raising the transparency when the user feels the training is less difficult than the predetermined difficulty level. The predetermined difficulty level and the transparency level may be set by an ophthalmologist.

[0026] It is also possible to have 100% transparency (totally invisible), meaning that an object can be seen by one eye while not being seen by the other eye.

[0027] Fig. 4 is a diagram showing an example of an image displayed on the HMD 1. In the example of Fig. 4, a kendama is displayed as an object to be operated, and it is assumed that the left eye has weaker vision than the right eye. In the example of Fig. 4, an object image 111 displayed to the right eye of the kendama has a higher transparency than an object image 121 displayed to the left eye. For example, the display control unit 212 can perform control to increase the transparency of an object displayed to one eye (the right eye in the example of Fig. 4) while the user is playing kendama using hand images 112 and the hands displayed by 112 in the virtual space.

[0028] In this way, by not only watching the image but also by performing actual movements, it is possible to train the user to perform coordinated movements of the eyes and hands and to be able to perform binocular vision well. It is also possible to increase the concentration level of the patient on the treatment or to improve their motivation for the treatment, which is expected to improve the effectiveness of the treatment. In addition, by having the patient operate an object in a virtual space and by changing the way the image is viewed by both eyes, it is also possible to train the function of stereoscopic vision.

[0029] Fig. 5 is a diagram showing another example of an image displayed on the HMD 1. In a case where there are multiple objects to work on and it is common to concentrate on looking at a first object rather than a second object, the transparency of the first object can be left unchanged (or lowered) for one eye (a person with a strong degree of amblyopia, weak eyesight, a person who is difficult to see, a person who is the subject of training) and the transparency of the second object can be increased, and the transparency of the first object can be increased and the transparency of the second object can be left unchanged (or lowered) for the other eye (a person with a weak degree of amblyopia, a person who is not the subject of training). For example, Fig. 5 shows an example in which the vision of the left eye is weak, and the transparency of the ball 1111 of the kendama 111 of the right eye is increased while the transparency of the kendama 1112 is not increased, while the transparency of the ball 1211 of the kendama 121 of the left eye is not increased, and the transparency of the kendama 1212 is increased.

[0030] <Operation> FIG. 6 is a diagram for explaining the operation of the computer 2 in the visual acuity training system of this embodiment.

[0031] The computer 2 reads out setting items corresponding to the user stored in the setting information storage unit 231 (S301), displays images on the display devices 11 and 12 so that the object to be operated is displayed three-dimensionally in the virtual space based on the object information stored in the object storage unit 232 (S302), receives an instruction to operate the object in response to an input from the input device 3 (S303), and performs an operation on the object, for example, by operating a virtual hand. The computer 2 increases the transparency of the object to be operated on either the display device 11 or 12 in response to the setting items (S304).

[0032] Although the present embodiment has been described above, the above embodiment is intended to facilitate understanding of the present invention, and is not intended to limit the present invention. The present invention may be modified or improved without departing from the spirit of the present invention, and equivalents thereof are also included in the present invention.

[0033] For example, the computer 2 may include an alert output unit that outputs an alert. The alert output unit can output an alert for, for example, forgetting to perform training. For example, the alert output unit can record in the storage device 203 the date and time when the processing of amblyopia training by the operation input unit 211 and the display control unit 212 is performed, and output an alert indicating that the training has not been performed if a predetermined time has passed since the recorded date and time.

[0034] The alert output unit may be provided in a server device (not shown) communicatively connected to the computer 2. In this case, the operation input unit 211 transmits the date and time when the amblyopia training was performed to the server device, and the server device can be provided with a training date and time storage unit that stores the date and time when the amblyopia training was performed in association with information that identifies the computer 2 or the user. The server device can also transmit an alert indicating that the amblyopia training has not been performed to the computer 2 or user for which a predetermined time has passed since the date and time stored in the training date and time storage unit.

[0035] The alert output unit can also transmit an alert to other users in addition to or instead of the user performing the training. For example, the alert output unit can transmit an alert to the user's guardian, the user's supervisor, an ophthalmologist examining the user, etc.

[0036] The computer 2 may also include a history storage unit that stores a history including the date and time when the amblyopia training was performed, and a schedule storage unit that stores a schedule of the training. For example, the number of trainings and / or the training time in a predetermined period (for example, one week or one month) may be set in the schedule of the training. For example, the date on which the training is scheduled to be performed may also be set in the schedule of the training. The alert output unit can compare the schedule of the training stored in the schedule storage unit with the history of the training stored in the history storage unit to determine the degree of compliance with the schedule (degree of compliance), and transmit the degree of compliance to the user or an ophthalmologist by email, chat, or the like. The degree of compliance can be calculated, for example, by tallying up the number of trainings and / or the time of training performed within a predetermined period from the history of the training, and calculating the difference or ratio between the number of trainings and / or the time set in the schedule. The degree of compliance can also be calculated by determining whether the training has been performed based on whether a history corresponding to the date set in the schedule (which may include a predetermined number of days before and after) is stored in the history storage unit, and dividing the number of days on the date on which the training was performed by the number of days on the scheduled date, for example.

[0037] The computer 2 may also include a reward providing unit that provides a reward to a user who has performed the training. By providing a reward, the user's adherence can be improved.

[0038] The reward granting unit may grant, for example, a monetary value (monetary reward) as the reward, or may issue points that can be used to purchase items.

[0039] The reward granting unit can grant, as a reward, for example, something that has meaning to the user himself (an inner reward) regardless of monetary value. The reward granting unit can adjust the difficulty level, for example, to give a sense of accomplishment. For example, the reward granting unit can display content that is only displayed to users who have completed a certain task, when the task is completed.

[0040] The reward giving unit can give, for example, a reward that can obtain recognition from other users (social reward). In this case, the reward giving unit gives points to a user when the user clears a game using an object with a changed transparency (a trick using a kendama in the above embodiment).

[0041] The computer 2 is communicatively connected to a server device (not shown), and the reward granting unit can transmit the points given to the user to the server device. The server device can include a score storage unit that records the user's score for each user. The score storage unit can tally up the scores (assuming a total, but other values ​​are also acceptable) for each predetermined period (which can be the length of a term, such as one hour, one day, one week, or one year), rank the users according to the totaled points (total points), and transmit the ranking to the computer 2 and / or the user's terminal (e.g., a smartphone). The ranking can include information indicating the user, such as a nickname, and the total points of the points during the period (which can be the entire period), sorted in order of total points, and include only a top predetermined number (e.g., 10 people).

[0042] By performing such ranking, it is possible to increase the motivation of users undergoing treatment for amblyopia regarding training, and improve adherence.

[0043] The reward granting unit can grant a reward according to the score (an amount according to the score or reward contents that vary depending on the score), for example.

[0044] The reward granting unit can grant a reward (an amount according to the score or content that varies depending on the score) depending on the number of times a program for amblyopia training is launched using the computer 2 (realizing the operation input unit 211 and the display control unit 212).

[0045] The reward granting unit can grant a reward in response to an instruction from an ophthalmologist. In this case, the reward granting unit stores the reward to be granted in the storage unit so that the reward cannot be used by the user, and grants the stored reward to the user in a usable state when an instruction from the ophthalmologist is received.

[0046] <Disclosures> The present disclosure also includes the following configurations. [Item 1] a first display device for displaying an image to one eye of a user; a second display device that displays an image to the other eye of the user; a display control unit that controls the first and second display devices so that an object to be operated by the user, which is displayed on the first and second display devices, has different transparency on the first and second display devices; A vision training system comprising: [Item 2] Item 1, a vision training system comprising: the object is a virtual object, the display control unit displays the object on the first and second display devices so that the object is displayed three-dimensionally to the user and has different transparency on the first and second display devices; A vision training system comprising: [Item 3] Item 1, a vision training system comprising: a setting information storage unit that stores information indicating one of the user's eyes having stronger vision, the display control unit controls to increase the transparency of the object displayed on the first or second display device that displays the image on the eye indicated by the information stored in the setting information storage unit; A vision training system comprising: [Item 4] Item 1, a vision training system comprising: First and second cameras for capturing an image of the user's field of view; an image acquisition unit that acquires first and second images captured by the first and second cameras; Equipped with the display control unit detects the object from the first and second images, and increases transparency of a region of the object in the first or second image; A vision training system comprising: [Item 5] A vision training method characterized by comprising the steps of: a computer executing a step of controlling an object to be operated by a user, which is displayed on a first display device that displays an image to one of the user's eyes, and a second display device that displays an image to the user's other eye, so that the object has different transparency on the first and second display devices. [Item 6] A program for causing a computer to execute a step of controlling an object that is to be operated by a user and is displayed on a first display device that displays an image to one eye of the user and a second display device that displays an image to the other eye of the user, so that the object has different transparency on the first and second display devices. [Explanation of symbols]

[0047] 1 HMD 2. Computer 3. Input Devices

Claims

[Claim 1] a first display device for displaying an image to one eye of a user; a second display device that displays an image to the other eye of the user; a display control unit that controls an object that is displayed on the first and second display devices and that is a target of an operation to be performed in response to an input from the user so that the object has different transparency levels on the first and second display devices; A vision training system comprising:

Images