Vision training system, vision training method and program

Abstract

To provide an eyesight training system allowing a user to train eyesight.SOLUTION: An eyesight training system includes a first display device for displaying an image in one eye of a user, a second display device for displaying the image in the other eye of the user, and a display control part for executing such control that an object, the operation object of the user to be displayed on the first and second display devices, has different transparency on the first and second display devices.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a vision training system, a vision training method, and a program. [Background technology]

[0002] A vision training method has been proposed in which the vision of the right eye and the left eye is changed using a headset (see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2017 / 181010 Summary of the Invention [Problem to be solved by the invention]

[0004] However, as in Patent Document 1, if the appearance of the entire space is changed for each eye, it becomes difficult to concentrate on the work object that should be looked at. Also, if the contrast, brightness, darkness, etc. of the work object is changed, the object will actually stand out.

[0005] The present invention has been made in view of the above background, and aims to provide a technique that enables training of visual acuity. [Means for solving the problem]

[0006] The main invention of the present invention for solving the above problem is a vision training system comprising a first display device that displays an image to one eye of a user, a second display device that displays an image to the other eye of the user, and a display control unit that controls the objects that are displayed on the first and second display devices and that are to be operated by the user to have different transparency levels on the first and second display devices.

[0007] Other problems and solutions disclosed in this application will be made clear in the section on preferred embodiments of the invention and the drawings. [Effects of the Invention]

[0008] According to the present invention, it is possible to train the eyesight. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a diagram illustrating an example of the configuration of a visual acuity training system according to an embodiment of the present invention. [Figure 2] FIG. 2 is a diagram illustrating an example of the configuration of an HMD 1. [Figure 3] FIG. 2 is a diagram illustrating an example of the software configuration of a computer 2. [Figure 4] FIG. 2 is a diagram showing an example of an image displayed on the HMD 1. [Figure 5] FIG. 10 is a diagram showing another example of an image displayed on the HMD1. [Figure 6] FIG. 2 is a diagram illustrating the operation of the computer 2 in the visual acuity training system of the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] <Summary> A visual acuity training system according to one embodiment of the present invention will be described below. In the visual acuity training system of this embodiment, a user wears a head-mounted display (HMD1) and performs tasks in a virtual space. By making the transparency of the object to be worked on differently for the right and left eyes, it is possible to train users with low vision.

[0011] FIG. 1 is a diagram showing an example of the configuration of a visual acuity training system according to this embodiment. The visual acuity training system of this embodiment includes a computer 2. The computer 2 is connected to an HMD 1 and an input device 3, and can receive data input from the input device 3 and control the display of images on the HMD 1. As shown in FIG. 1, the computer 2 may include a CPU 201, a memory 202, and a storage device 203. The storage device 203 stores various data and programs, and is, for example, a hard disk drive, a solid-state drive, or a flash memory. Note that each functional unit of the computer 2, which will be described later, is realized by the CPU 201 reading a program stored in the storage device 203 into the memory 202 and executing it, and each storage unit of the computer 2 may be realized as part of the storage area provided by the memory 202 and the storage device 203.

[0012] The input device 3 is, for example, a controller. The input device 3 can support the user in making predetermined inputs within the virtual space. The input device 3 can be configured, for example, as a set of controllers for the left and right hands. The input device 3 can include, for example, an operation trigger button, an infrared LED, a sensor, a joystick, a menu button, etc. The input device 3 can also detect posture and movement using an acceleration sensor (not shown) or the like, and input posture and movement data to the computer 2 as input data.

[0013] The computer 2 performs control processing to display a virtual object (three-dimensional object) to be worked on on the HMD 1, and also moves a virtual hand in response to input from the input device 3, allowing the user to perform work on the work object through the movement of the virtual hand.

[0014] FIG. 2 is a diagram showing an example configuration of the HMD 1. The HMD 1 can be worn on the user's head. The HMD 1 includes display devices 11 and 12 that are positioned in front of the user's left and right eyes. The display device 11 displays an image to one eye (the right eye in the example of FIG. 2). The display device 12 displays an image to the other eye (the left eye in the example of FIG. 2). For example, optically transmissive and non-transmissive displays can be used as the display devices 11 and 12. As will be described later, the transparency of the work target object displayed on the display devices 11 and 12 is controlled to be different.

[0015] 3 is a diagram showing an example of the software configuration of the computer 2. The computer 2 can include an operation input unit 211, a display control unit 212, a setting storage unit 231, and an object storage unit 232.

[0016] The setting storage unit 231 can store various setting items. The setting storage unit 231 can store the setting items in association with information identifying the user (user ID). The setting items can be set, for example, by an ophthalmologist treating the user. The setting items can include, for example, information indicating the display device 11 or 12 for which the transparency of an object is to be increased. The setting items can include, for example, information specifying the eye with stronger or weaker vision of the user. In this case, the transparency of the object can be increased on the display device 11 or 12 corresponding to the eye with stronger vision, thereby training the eye with weaker vision to view the operation target more closely. The setting items can include, for example, the transparency of the object. The setting items can store the difficulty level set by the user. For example, when there are multiple objects to be operated, the setting items can include information indicating the object on which the user should focus more.

[0017] The object storage unit 232 can store information for displaying a virtual object (hereinafter referred to as object information; for example, it can be a three-dimensional model).

[0018] The operation input unit 211 can receive input from the input device 3. The operation input unit 211 can receive, from the input device 3, information (event information) indicating operations such as the attitude and movement of the input device 3 and pressing of a button, for example.

[0019] The display control unit 212 displays images on the display devices 11 and 12. The display control unit 212 can display virtual objects in a virtual space based on object information stored in the object storage unit 232. The display control unit 212 can refer to the setting storage unit 231 to determine on which display device 11 or 12 the transparency of the object should be increased and to what degree the transparency of the object should be. Furthermore, when there are multiple objects to be operated, the display control unit 212 can determine on which display device 11 or 12 the transparency of which object should be increased.

[0020] In this embodiment, the display control unit 212 controls the display devices 11 and 12 so that an object to be operated by the user, which is displayed on the display devices 11 and 12, has different transparency levels on the first and second display devices. The display control unit 212 can display various objects in a virtual space related to so-called VR (Virtual Reality). In this embodiment, the display control unit 212 can display a three-dimensional object on the display devices 11 and 12 so that a stereoscopic image is formed by utilizing parallax. The display control unit 212 can display the object on the display devices 11 and 12 so that the object is displayed three-dimensionally to the user and has different transparency levels on the display devices 11 and 12.

[0021] Furthermore, the display control unit 212 may display a virtual object in an augmented reality (AR) space or a mixed reality (MR) space. For example, the HMD 1 may be provided with a camera, and the display control unit 212 may display an image captured by the HMD 1 and superimpose the virtual object on the image from the camera so that the object to be operated is displayed in three dimensions.

[0022] The display control unit 212 can also detect an object from an image captured by a camera (not shown, which may be provided in the HMD 1 or the computer 2) and change the transparency of the detected object. In this case, the HMD 1 or the computer 2 can be provided with first and second cameras that capture the user's field of view, and the computer 2 can be provided with an image acquisition unit that acquires the first and second images captured by the first and second cameras. The display control unit 212 can detect an object from the first and second images and perform image processing to increase the transparency of the object area in the first or second image. The display control unit 212 can, for example, detect the user's gaze point, recognize the object at the gaze point among the objects detected in the first and second images as the object to be operated, and change the transparency of the area occupied by the recognized object.

[0023] The display control unit 212 can perform control to increase the transparency of objects displayed on the display device 11 or 12 placed in front of the eye with the weaker degree of amblyopia (stronger eyesight). This makes it easier for the user to use the eye with poorer vision, and allows the user to train to use the eye with better vision.

[0024] The display control unit 212 may perform control so as to increase over time the transparency of only one of the objects displayed on the display device 11 or 12. For example, the transparency can be changed while the user is working on the object.

[0025] The transparency can be changed depending on the degree of treatment. When used to treat amblyopia, the transparency can be changed depending on the degree of amblyopia. The transparency can be changed depending on the difficulty level set for the user. That is, when a higher difficulty level is set, a higher transparency can be set. The difficulty level can be set by inquiring the user's subjective sense of difficulty of the training through a questionnaire or the like, and by lowering the transparency if the user feels the training is more difficult than a predetermined level, and by raising the transparency if the user feels the training is less difficult than the predetermined level. The predetermined difficulty level and transparency can be set by an ophthalmologist.

[0026] It is also possible to make the transparency 100% (totally invisible), meaning that one eye can see the object while the other eye cannot.

[0027] Fig. 4 is a diagram showing an example of an image displayed on the HMD 1. In the example of Fig. 4, a kendama is displayed as an object to be operated, and it is assumed that the left eye has weaker eyesight than the right eye. In the example of Fig. 4, the object image 111 displayed to the right eye of the kendama has a higher transparency than the object image 121 displayed to the left eye. For example, the display control unit 212 can perform control to increase the transparency of the object displayed to one eye (the right eye in the example of Fig. 4) while the user is playing kendama using the hand images 112 and 112 displayed in the virtual space.

[0028] In this way, by not only viewing images but also performing actual movements, the user can train their eyes and hands to work together and effectively use binocular vision. This also makes it possible to increase the patient's concentration on treatment and improve their motivation for treatment, which is expected to improve the effectiveness of treatment. Furthermore, by having the patient operate an object in virtual space and by changing the way it is viewed by both eyes, it is also possible to train the user's stereoscopic vision function.

[0029] 5 is a diagram showing another example of an image displayed on the HMD 1. In a case where there are multiple objects to work on and it is common for a user to focus on a first object more than a second object, the transparency of the first object can be left unchanged (or decreased) for one eye (a user with a strong degree of amblyopia, weak eyesight, poor vision, or the person being trained) and the transparency of the second object can be increased, while the transparency of the first object can be increased and the transparency of the second object can be left unchanged (or decreased) for the other eye (a user with a weak degree of amblyopia or not the person being trained). For example, FIG. 5 shows an example in which the left eye has weak eyesight, and the transparency of the ball 1111 of the kendama 111 for the right eye is increased but the transparency of the kendama 1112 is not increased, while the transparency of the ball 1211 of the kendama 121 for the left eye is increased but the transparency of the kendama 1212 is not increased.

[0030] <Operation> FIG. 6 is a diagram illustrating the operation of the computer 2 in the visual acuity training system of this embodiment.

[0031] The computer 2 reads out setting items corresponding to the user that are stored in the setting information storage unit 231 (S301), displays images on the display devices 11 and 12 so that the object to be operated is displayed in three dimensions in the virtual space based on the object information stored in the object storage unit 232 (S302), accepts instructions to operate the object in accordance with input from the input device 3 (S303), and operates the object by, for example, operating a virtual hand. The computer 2 increases the transparency of the object to be operated on either the display device 11 or 12 in accordance with the setting items (S304).

[0032] Although the present embodiment has been described above, the above embodiment is intended to facilitate understanding of the present invention and is not intended to limit the present invention. The present invention may be modified or improved without departing from the spirit thereof, and equivalents thereof are also included in the present invention.

[0033] For example, the computer 2 may be provided with an alert output unit that outputs an alert. The alert output unit can output an alert, for example, when training has been forgotten. For example, the alert output unit can record the date and time when the operation input unit 211 and the display control unit 212 performed the amblyopia training process in the storage device 203, and output an alert indicating that the training has not been performed if a predetermined time has passed since the recorded date and time.

[0034] The alert output unit may be provided in a server device (not shown) communicatively connected to the computer 2. In this case, the operation input unit 211 transmits the date and time when the amblyopia training was performed to the server device, and the server device may be provided with a training date and time storage unit that stores the date and time when the amblyopia training was performed in association with information that identifies the computer 2 or the user. The server device may also send an alert to the computer 2 or user for which a predetermined time has passed since the date and time stored in the training date and time storage unit, indicating that the amblyopia training has not been performed.

[0035] The alert output unit can also send an alert to other users in addition to or instead of the user performing the training, such as the user's guardian, the user's supervisor, or an ophthalmologist examining the user.

[0036] The computer 2 may also include a history storage unit that stores a history including the date and time of amblyopia training, and a schedule storage unit that stores a training schedule. The training schedule may include, for example, the number of training sessions and / or the training duration within a predetermined period (e.g., one week or one month). The training schedule may also include, for example, the date on which the training is scheduled to be performed. The alert output unit compares the training schedule stored in the schedule storage unit with the training history stored in the history storage unit to determine the degree of adherence to the schedule (adherence level), and transmits the adherence level to the user or an ophthalmologist via email, chat, or the like. The adherence level may be calculated, for example, by tallying the number and / or duration of training sessions performed within a predetermined period from the training history and calculating the difference or ratio between the number and / or duration set in the schedule. The adherence level may also be determined by determining whether training has been performed based on whether history corresponding to the date set in the schedule (which may include a predetermined number of days before and after) is stored in the history storage unit, and then calculating the adherence level by, for example, dividing the number of days since the scheduled date by the number of days since the training session.

[0037] The computer 2 may also include a reward providing unit that provides a reward to a user who has completed the training. By providing a reward, it is possible to improve adherence of the user.

[0038] The reward granting unit may grant, for example, a monetary reward as a reward, or may issue points that can be used to purchase items.

[0039] The reward granting unit can grant, as a reward, for example, something meaningful to the user (an inner reward) regardless of monetary value. The reward granting unit can, for example, adjust the difficulty level to give the user a sense of accomplishment. For example, the reward granting unit can display content that is only displayed to users who have completed a predetermined challenge, when the challenge is completed.

[0040] The reward granting unit can grant, for example, a reward that can gain recognition from other users (social reward). In this case, the reward granting unit grants points to a user when the user completes a game using an object with changed transparency (in the above-described embodiment, a trick using a kendama).

[0041] The computer 2 is communicatively connected to a server device (not shown), and the reward granting unit can transmit the points awarded to the user to the server device. The server device can include a score storage unit that records the user's score for each user. The score storage unit can tally (assuming a total, but not necessarily a total) the points for each predetermined period (which can be the length of a term, such as one hour, one day, one week, or one year), rank the users according to the tally (total points), and transmit the rankings to the computer 2 and / or the user's device (e.g., a smartphone). The rankings can include information indicating the user, such as a nickname, and the total points for the period (which can be the entire period), sorted in order of total points, and include only a predetermined number (e.g., 10) of users.

[0042] By performing such rankings, it is possible to improve the motivation of users undergoing amblyopia treatment for training, and improve adherence.

[0043] The reward awarding unit can award, for example, a reward according to the score (an amount according to the score or a reward that varies depending on the score).

[0044] The reward granting unit can grant a reward (in an amount corresponding to the score or with different content depending on the score) according to the number of times a program for amblyopia training is launched using the computer 2 (realizing the operation input unit 211 and the display control unit 212).

[0045] The reward granting unit can grant a reward in accordance with instructions from an ophthalmologist. In this case, the reward granting unit stores the reward to be granted in the storage unit so that it cannot be used by the user, and when instructions from the ophthalmologist are received, the reward granting unit can grant the stored reward so that it can be used by the user.

[0046] <Disclosures> The present disclosure also includes the following configurations. [Item 1] a first display device for displaying an image to one eye of the user; a second display device that displays an image to the other eye of the user; a display control unit that controls the first and second display devices so that the object to be operated by the user displayed on the first and second display devices has different transparency levels; A vision training system comprising: [Item 2] Item 1, a vision training system comprising: the object is a virtual object, the display control unit displays the object on the first and second display devices so that the object is displayed three-dimensionally to the user and has different transparency levels on the first and second display devices; A vision training system characterized by: [Item 3] Item 1, a vision training system comprising: a setting information storage unit that stores information indicating which of the user's eyes has stronger vision, the display control unit controls the first or second display device to display the image to the eye indicated by the information stored in the setting information storage unit, so as to increase the transparency of the object; A vision training system characterized by: [Item 4] Item 1, a vision training system comprising: First and second cameras for capturing the user's field of view; an image acquisition unit that acquires first and second images captured by the first and second cameras; Equipped with the display control unit detects the object from the first and second images, and increases transparency of a region of the object in the first or second image; A vision training system characterized by: [Item 5] A vision training method characterized by a computer executing a step of controlling an object to be operated by a user, which is displayed on a first display device that displays an image to one of the user's eyes, and a second display device that displays an image to the user's other eye, so that the first and second display devices have different transparency levels. [Item 6] A program for causing a computer to execute a step of controlling an object to be operated by a user, which is displayed on a first display device that displays an image to one of the user's eyes, and a second display device that displays an image to the user's other eye, so that the first and second display devices have different transparency levels. [Explanation of symbols]

[0047] 1 HMD 2. Computer 3 Input Devices

Claims

1. a first display device for displaying an image to one eye of a user; a second display device that displays an image to the other eye of the user; a setting information storage unit that stores, for each user, information indicating the difficulty level felt by the user and the eye of the user with stronger eyesight; a display control unit that controls the first and second display devices so that only an object that is a target of an operation to be performed in response to an input from the user has different transparency levels on the first and second display devices; Equipped with the display control unit refers to the setting information storage unit to identify the difficulty level and the stronger eye corresponding to the user, and increases the transparency of the object displayed to the stronger eye according to the difficulty level so that the object is not completely invisible. A vision training system characterized by:

2. 10. The vision training system of claim 1, the object is a virtual object that is the target of an operation to be performed in a virtual space, the display control unit displays the object on the first and second display devices so that the object is displayed three-dimensionally to the user and so that the transparency of the object displayed to the stronger eye is increased; A vision training system characterized by:

3. 10. The vision training system of claim 1, First and second cameras for capturing the user's field of view; an image acquisition unit that acquires first and second images captured by the first and second cameras; Equipped with the display control unit detects the object from the first and second images, and increases transparency of a region of the object displayed to the stronger eye in the first or second image; A vision training system characterized by:

4. A vision training method characterized by a computer executing a step of controlling the transparency of only the object displayed on the user's stronger eye, which is displayed on a first display device that displays an image to one eye of the user and a second display device that displays an image to the other eye of the user, and which is the subject of a task performed in accordance with the user's input, so that the object does not become completely invisible, depending on the difficulty perceived by the user that is preset for each user.

5. A program for causing a computer to execute a step of controlling the transparency of only an object displayed on a first display device that displays an image to one eye of a user and a second display device that displays an image to the other eye of the user, which object is the subject of a task performed in response to input from the user, to be increased so as not to become completely invisible, in accordance with the difficulty perceived by the user that is preset for each user.

Images