Information processing system, information processing method, and program

Abstract

To enable easy measurement of visual acuity.SOLUTION: An information processing system comprises: an image display unit that provides a virtual space to a user by displaying images on respective display devices corresponding to the user's left and right eyes; an index display unit that arranges an index and surrounding objects in the virtual space at a position distant from the user, displays the index only on the display device corresponding to one of the left and right eyes, displays the surrounding objects on the display devices corresponding to the left and right eyes, and moves the index to a distance at which the user can visually recognize it; and a visual acuity measurement unit that determines visual acuity of one of the user's left and right eyes according to the distance.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing system, an information processing method, and a program. [Background technology]

[0002] Patent Document 1 discloses a system for measuring visual acuity by displaying an index in a virtual space. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Special Publication No. 2022-512186 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the system of Patent Document 1 can only measure visual acuity in both eyes.

[0005] The present invention has been made in view of the above background, and has an object to provide a technique that can easily measure visual acuity. [Means for solving the problem]

[0006] The main invention of the present invention for solving the above problem is an information processing system comprising: an image display unit that displays images on display devices corresponding to the left and right eyes of a user to provide the user with a virtual space; an index display unit that positions an index and peripheral objects in the virtual space at a distance from the user, displays the index only on the display device corresponding to one of the left and right eyes, displays the peripheral objects on the display devices corresponding to both the left and right eyes, and moves the index to a distance visible to the user; and a vision measurement unit that determines the visual acuity of one of the left and right eyes of the user depending on the distance.

[0007] Other problems and solutions disclosed in this application will be made clear in the section on preferred embodiments of the invention and the drawings. [Effects of the Invention]

[0008] According to the present invention, visual acuity can be easily measured. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of a visual acuity measurement system. [Figure 2] FIG. 2 is a diagram illustrating an example of the configuration of an HMD 1. [Figure 3] FIG. 2 is a diagram illustrating an example of the software configuration of a computer 2. [Figure 4] FIG. 10 is a diagram illustrating how an index appears. [Figure 5] FIG. 10 is a diagram illustrating the display of dotted lines. [Figure 6] FIG. 2 is a diagram illustrating the operation of the computer 2. [Figure 7] FIG. 10 is a diagram illustrating an example of the configuration of an HMD 1 according to a second embodiment. [Figure 8] FIG. 10 is a diagram illustrating an example of the configuration of a computer 2 according to a second embodiment. [Figure 9] FIG. 10 is a diagram illustrating the operation of the computer 2 according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] First Embodiment An information processing system according to one embodiment of the present invention will be described below. The information processing system of this embodiment has a user wear a head-mounted display (HMD1) and attempts to measure the user's eyesight in a virtual space. The HMD1 may be any wearable device that provides the user with a virtual space, and may be, for example, a glasses-type augmented reality (AR) device (glasses-type display). The HMD1 does not have to be a wearable device, and may also be, for example, a naked-eye stereoscopic display.

[0011] FIG. 1 is a diagram showing an example of the configuration of a visual acuity measurement system. The visual acuity measurement system of this embodiment includes a computer 2. The computer 2 is connected to an HMD 1 and an input device 3, and can receive data input from the input device 3 and control the display of images on the HMD 1. As shown in FIG. 1, the computer 2 may include a CPU 201, a memory 202, and a storage device 203. The storage device 203 stores various data and programs, and is, for example, a hard disk drive, a solid-state drive, or a flash memory. Note that each functional unit of the computer 2, which will be described later, is realized by the CPU 201 reading a program stored in the storage device 203 into the memory 202 and executing it, and each storage unit of the computer 2 may be realized as part of the storage area provided by the memory 202 and the storage device 203.

[0012] The input device 3 is, for example, a controller, a microphone, a keyboard, a mouse, a touch panel, etc. The input device 3 can support the user in making predetermined inputs within the virtual space. The input device 3 can be configured, for example, as a set of controllers for the left and right hands. The input device 3 can include, for example, an operation trigger button, an infrared LED, a sensor, a joystick, a menu button, etc. The input device 3 can also detect posture and movement using an acceleration sensor (not shown) or the like, and input posture and movement data to the computer 2 as input data.

[0013] The computer 2 performs a visual acuity test on the user, which will be described later.

[0014] FIG. 2 is a diagram showing an example configuration of the HMD 1. The HMD 1 can be worn on the head of the user 4. The HMD 1 includes display devices 11 and 12 that are positioned in front of the left and right eyes of the user 4. The display device 11 displays an image to one eye (the right eye in the example of FIG. 2). The display device 12 displays an image to the other eye (the left eye in the example of FIG. 2). For example, optically transmissive and non-transmissive displays can be used as the display devices 11 and 12. The user 4 can view the virtual space by viewing the images on the display devices 11 and 12 with both eyes simultaneously.

[0015] 3 is a diagram showing an example of the software configuration of the computer 2. The computer 2 can include an image display unit 211, an index display unit 212, a visual acuity measurement unit 213, and a visual acuity output unit 214.

[0016] The video display unit 211 displays videos on the display devices 11 and 12 corresponding to the left and right eyes of the user, respectively, to provide the user with a virtual space. A known mechanism for stereoscopic viewing using a head-mounted display can be adopted.

[0017] The index display unit 212 places an index in the virtual space. The index display unit 212 places the index in the virtual space at a distance from the user. The index can be, for example, a Landolt ring. The index display unit 212 can place the index so that the plane on which the index, such as the Landolt ring, is drawn is perpendicular to the user's line of sight.

[0018] The index display unit 212 can generate images to be displayed on each of the display devices 11 and 12 according to the position and size of the index placed in the virtual space, and display them on the display devices 11 and 12. The index display unit 212 displays the image related to the index placed in the virtual space on only one of the display devices 11 and 12 (the one corresponding to the eye that is the subject of the visual acuity test).

[0019] The video display unit 211 places an object (hereinafter, a peripheral object) different from the index in the virtual space. The video display unit 211 places the peripheral object so that the user can view the index simultaneously. The video display unit 211 can place the peripheral object within the user's field of view. The video display unit 211 can place the peripheral object around the index. The peripheral object can be approximately the same size as the index or larger than the index. The peripheral object may also be smaller than the index. There may be multiple peripheral objects. The peripheral object may be any object, such as a window, a shelf, an examination instrument, a desk, a book, or a painting. The video display unit 211 displays the peripheral object (or an image corresponding to the peripheral object) on both display devices 11 and 12. Even if the index (or an image corresponding to the index) is displayed on only one of display devices 11 and 12, placing the peripheral object enables the user to experience binocular stereoscopic vision. This allows the eyes and brain to experience stereoscopic vision of the virtual space, even for an index displayed to only one eye, in the same state as the eyes and brain.

[0020] The video display unit 211 can place peripheral objects in the user's peripheral vision. Generally, the human eye is resistant to parallax in peripheral vision, and can maintain a three-dimensional effect even if the misalignment is large. If stereoscopic vision is possible in the peripheral vision, it means that stereoscopic vision is also possible in the central vision. Therefore, by displaying peripheral objects in the peripheral vision to both eyes and placing an index in the central vision, the user can see the index in stereoscopic vision even if the index is displayed to only one eye.

[0021] The indicator display unit 212 can also place a frame around the indicator. The frame can be displayed on both the display devices corresponding to the left and right eyes. If the indicator is displayed to only one eye, it is difficult to judge the sense of distance and to focus. However, by placing a frame around the indicator and displaying this frame to both eyes, it is expected that the sense of distance can be grasped and focusing can be made easier.

[0022] FIG. 4 is a diagram illustrating how an index appears. As shown in the figure, an index 41 is displayed on the display device 11 in front of the right eye, but the index 41 is not displayed on the display device 12 in front of the left eye. However, the index 41 is displayed in the field of view 13 of binocular vision. This index 41 is perceived only by the right eye. A frame 42 is displayed around the index 41. The frame 42 is displayed on both the display devices 11 and 12, and is naturally also perceived in the field of view 13 of binocular vision.

[0023] The indicator display unit 212 moves the indicator to a distance where the user can see it. The indicator display unit 212 can move the indicator to a distance where the user can see it best. The indicator display unit 212 accepts input from the user as to whether the user was able to see it, and determines the distance where the indicator is visible or best seen. For example, the indicator display unit 212 may place the indicator at a predetermined distance (which may be a fixed value set in advance, or may be a distance according to the user's self-reported visual acuity), gradually move the indicator closer to the user, accept input from the user that the indicator has become visible, stop the indicator at that position, and calculate the distance from the stopped indicator position to the user. Alternatively, the indicator display unit 212 may move the indicator several times forward and backward from the user, accept designation of the best visible position, determine the position of the indicator, and calculate the distance from the determined position to the user. The indicator display unit 212 moves a frame in accordance with the movement of the indicator. The frame is moved so that the distance from the user to the indicator and the distance from the user to the frame are the same (a state in which the frame surrounds the indicator).

[0024] The index display unit 212 can change the size of the index in the virtual space according to the distance so that the size of the index visually recognized by the user is constant. The index display unit 212 can expand or contract the index so that the size of the index increases when the distance between the user and the index is large, and decreases when the distance between the user and the index is small.

[0025] <Spherical power> The visual acuity measurement unit 213 can determine the spherical power of the eye being measured according to the distance from the user to the visible indicator. The relationship between the distance and the spherical power can be, for example, set as a function in advance. Also, a learning model that learns the relationship between the distance from the user to the visible or best visible indicator and the spherical power measured using conventional equipment can be prepared by machine learning, and the visual acuity measurement unit 213 can estimate the visual acuity by providing the distance to the learning model.

[0026] <Cylinder power> The index display unit 212 can display dotted lines on the top, bottom, left, and right as indices. The dotted lines are also displayed only on either the display device 11 or 12 corresponding to the eye being examined. FIG. 5 is a diagram illustrating the display of dotted lines. The index display unit 212 can display a dotted line 52 (first dotted line) extending in the up-down direction and a dotted line 53 (second dotted line) extending in the left-right direction as indices. The dotted lines 52 and 53 are arranged on the plane of the index (Landolt ring). In an eye without astigmatism, the dotted lines 51 and 52 on the top, bottom, left, and right are perceived as dotted lines with equal intervals, as in the field of view 51 in FIG. 5. In the case of astigmatism, the dotted lines 52 and / or 53 appear as solid lines (or the intervals between the dotted lines are narrow), as in the field of view 54 in FIG. 5. When either the dotted lines 52 or 53 appear to the user as a solid line (or the intervals between the dotted lines are narrow), the index display unit 212 deforms the index (all dotted lines) by enlarging them in the direction of the solid line or the dotted line with the narrow intervals so that both the dotted lines 52 and 53 appear to the user as dotted lines (dotted lines with the same intervals). The example in Figure 5 shows that the dotted line 52-1 in the vertical direction appears as a solid line in the visual field 54. In this case, by extending the dotted line 52 in the vertical direction as shown in the visual field 54-1, the dotted line 52 can be viewed as a dotted line even by an astigmatic eye.

[0027] In addition, the index display unit 212 may change the length (in the example of Figure 5, make it longer) of the dotted line (in the example of Figure 5, the dotted line 53 in the left-right direction) perpendicular to the direction of expansion and contraction so that the aspect ratio of the index remains constant (1:1 in the example of Figure 5).

[0028] Furthermore, the indicator display unit 212 can also display dotted lines extending diagonally in addition to the dotted lines on the top, bottom, left, and right. As in the above, the indicators (all dotted lines) can be deformed so that the solid lines or dotted lines are aligned in the direction of the dotted lines that appear to have shorter intervals, so that all dotted lines on the top, bottom, left, right, and diagonal directions are perceived as dotted lines.

[0029] The visual acuity measurement unit 213 can determine the user's cylindrical power according to the degree of deformation of the index. A function can be set in advance to represent the relationship between the degree of deformation of the index and the cylindrical power. In addition, a learning model that learns the relationship between the deformation power and the cylindrical power measured using a conventional method by machine learning is prepared, and the visual acuity measurement unit 213 can estimate the cylindrical power by providing the deformation power to the learning model. Note that the relationship between the deformation power and the direction of deformation and the cylindrical power may be set by a function or may be learned by machine learning.

[0030] The visual acuity measurement unit 213 can determine the astigmatic axis based on the deformation direction.

[0031] The visual acuity measurement unit 213 can calculate the spherical equivalent power based on the spherical power and the cylindrical power. The spherical equivalent power can be calculated by adding half the cylindrical power to the spherical power.

[0032] The visual acuity output unit 214 outputs the measured visual acuity. The visual acuity output unit can output spherical power, cylindrical power, and astigmatism axis. The visual acuity output unit 214 can transmit the measured visual acuity to a terminal operated by a medical technician, for example, to display it. The visual acuity output unit 214 may also print the measured visual acuity using, for example, a printer.

[0033] <Operation> FIG. 6 is a diagram illustrating the operation of the computer 2.

[0034] The computer 2 places the index and frame in the virtual space (S301), displays the index only on the eye being examined (S302), and displays frames on both eyes (S303). The computer 2 moves the index to a position where it can be seen from a distance (S304), and determines the spherical power according to the distance from the user to the visible index (S305).

[0035] The computer 2 arranges dotted lines in the virtual space, displaying them only on the eye being examined (S306), prompting the user to specify which dotted lines appear solid, and deforming the image so that all dotted lines extend in the direction of the specified dotted line (S307). The computer 2 determines the axis of astigmatism based on the direction of the solid lines (S308), and determines the degree of astigmatism according to the degree of deformation of the index (S309).

[0036] The computer 2 calculates the spherical equivalent power from the spherical power and the cylindrical power (S310), and outputs the spherical power, the cylindrical power, the astigmatism axis, and the spherical equivalent power (S311).

[0037] As described above, according to the information processing system of this embodiment, the visual acuity of one of the left and right eyes can be easily measured using a virtual space.

[0038] Second Embodiment In the second embodiment, the HMD 1 is provided with a lens for correcting vision, and corrected vision is measured.

[0039] FIG. 7 is a diagram showing an example of the configuration of an HMD 1 according to a second embodiment. In the second embodiment, the HMD 1 further includes lenses 111 and 121 between the display devices 11 and 12 and the left and right eyes of a user 4 wearing the HMD 1. The lenses 111 and 121 are provided with diopter (refractive power) adjustment mechanisms 112 and 122. The adjustment mechanisms 112 and 122 can change the refractive power of each of the left and right eyes of the user 4. The adjustment mechanisms 112 and 122 can change the refractive power, for example, from 0D to 7D. The adjustment mechanisms 112 and 122 can change the refractive power by, for example, changing the positions of the lenses 111 and 121 between the display devices 11 and 12 and the eyes of the user 4. The adjustment mechanisms 112 and 122 may be mechanisms that make the lenses 112 and 121 replaceable. The refractive power may be changed by placing lenses for astigmatism between the lenses 112 and 121 and the display devices 11 and 12, or between the left and right eyes of the user. The adjustment mechanisms 112 and 122 may include, for example, an actuator that changes the refractive power under control of the computer 2, or the refractive power may be changed manually by the user 4. The adjustment mechanisms 112 and 122 may also include a function that responds with the refractive power (for example, 0D to 7D) in response to a request from the computer 2.

[0040] 8 is a diagram showing an example of the configuration of the computer 2 according to the second embodiment. In the second embodiment, the computer 2 further includes a dioptric power setting unit 215 and a dioptric power acquisition unit 216.

[0041] The refractive power setting unit 215 sets the refractive power of the HMD 1. The refractive power setting unit 215 may, for example, receive an input of the refractive power to be set from a laboratory technician or a user, transmit a refractive power setting request including the refractive power to the adjustment mechanisms 112 and 122 of the HMD 1, and set the refractive power by, for example, activating an actuator that adjusts the position of the lenses 111 and / or 121 so that the adjustment mechanisms 112 and 122 reach the refractive power set in the setting request. The refractive power setting unit 215 may also, for example, receive an input of the refractive power to be set from a laboratory technician (for example, receive the refractive power from the laboratory technician's terminal), and output a message instructing the user to set the refractive power (for example, the message may be displayed on the display devices 11 and 12, or output as audio from a speaker (not shown)), allowing the user to manually adjust the refractive power. The refractive power may be input for both the left and right eyes and set in each of the adjustment mechanisms 112 and 122, or may be input for only one of the right and left refractive powers to be examined and the refractive power may be set in the adjustment mechanism 112 or 122 corresponding to the eye to be examined by the above-mentioned method. Also, the technician may transmit the refractive power from a remote terminal to the computer 2 via a communication network.

[0042] The dioptric power acquisition unit 216 acquires the dioptric power set in the HMD 1. The dioptric power acquisition unit 216 can accept input of the dioptric power from an input device such as a keyboard, a touch panel, a mouse, or a microphone. The dioptric power acquisition unit 216 may acquire the dioptric power set from the adjustment mechanisms 112 and 122. The dioptric power acquisition unit 216 can confirm that the dioptric power set by the dioptric power setting unit 215 matches the acquired dioptric power, and can output an alert if they do not match.

[0043] The indicator display unit 212 and the eyesight measurement unit 213 have the same functions as those in the first embodiment, and can measure corrected eyesight.

[0044] Furthermore, the visual acuity measurement unit 213 can display an index such as a Landolt ring or letters on the display device 11 or 12, and inquire of the user whether the index can be seen (this may be output by voice, or may be displayed as text on the display devices 11 and 12. Alternatively, for example, an instruction to make the inquiry may be given to a medical technician), and can receive a response from the user as to whether the index can be seen (for example, when a Landolt ring is displayed, the direction of the notch may be received, and when text is displayed, input of the text may be received). The visual acuity measurement unit 213 can also measure the user's visual acuity by displaying the index at different sizes and identifying the smallest size that the user can see.

[0045] The eyesight measurement unit 213 can display an index of varying size at a predetermined distance (for example, 5 meters) from the user in the virtual space. The eyesight measurement unit 213 displays an image relating to the virtual space on both display devices 11 and 12 to provide a three-dimensional virtual space, while adjusting the image so that the index is positioned at a predetermined distance in the virtual space, and displays the index only on either display device 11 or 12 corresponding to the eye to be measured. This makes it possible to measure the eyesight of each eye at a time.

[0046] FIG. 9 is a diagram illustrating the operation of the computer 2 according to the second embodiment.

[0047] The computer 2 receives a designation of the refractive power from, for example, a medical technician (S321). The computer 2 may determine the refractive power. For example, the refractive power may be determined to increase in order from a predetermined refractive power.

[0048] The computer 2 sets the refractive power of the HMD 1 (S322), provides a virtual space to the user via the display devices 11 and 12, and displays a resized index on the display device 11 or 12 in front of either the left or right eye (S323). The computer 2 accepts input of the index (S324). For example, if the index is a Landolt ring, the computer 2 accepts the direction of the notch, and if the index is a character, the computer 2 accepts the character. The computer 2 determines whether the user can see the index based on whether the accepted content matches the displayed index (S325), and if the user can see the index (S325: YES), the computer 2 updates the user's visual acuity according to the size of the index (S326).

[0049] The computer 2 receives an instruction from, for example, a technician as to whether or not to change the refractive power, and if the refractive power is to be changed (S327: YES), repeats the process from step S321.

[0050] The computer 2 receives an instruction from, for example, the technician as to whether or not to end the visual acuity test, and if not (S328: NO), the computer 2 returns to step S323 and can display the index with a changed size.

[0051] As described above, the vision measurement system of the second embodiment makes it possible to easily measure corrected vision.

[0052] In the second embodiment, the process shown in FIG. 6 can also be performed after the dioptric power is set (S322).

[0053] Although the present embodiment has been described above, the above embodiment is intended to facilitate understanding of the present invention and is not intended to limit the present invention. The present invention may be modified or improved without departing from the spirit thereof, and equivalents thereof are also included in the present invention.

[0054] <Disclosures> The present disclosure also includes the following configurations. [Item 1] an image display unit that displays images on display devices corresponding to the left and right eyes of the user, respectively, to provide the user with a virtual space; an index display unit that places an index and a peripheral object in the virtual space at a distance from the user, displays the index only on the display device corresponding to one of the left and right eyes, displays the peripheral object on the display devices corresponding to both the left and right eyes, and moves the index to a distance visible to the user; a visual acuity measuring unit that determines the visual acuity of one of the left and right eyes of the user according to the distance; An information processing system comprising: [Item 2] Item 1, an information processing system according to item 1, the index display unit arranges a frame around the index, displays the frame on both of the display devices corresponding to the left and right eyes, and moves the frame in accordance with movement of the index; An information processing system characterized by: [Item 3] Item 1, an information processing system according to item 1, the indicator display unit changes the size of the indicator in the virtual space according to the distance so that the size of the indicator visually recognized by the user is constant; An information processing system characterized by: [Item 4] Item 1, an information processing system according to item 1, the indicator includes a first dotted line extending in a vertical direction and a second dotted line extending in a horizontal direction, the indicator display unit, when either the first or second dotted line appears to the user as a solid line, transforms the indicator so that both the first and second dotted lines appear to the user as dotted lines; the visual acuity measurement unit determines the astigmatism power of the user according to the degree of deformation of the index; An information processing system characterized by: [Item 5] Item 4. The information processing system according to item 4, the indicator includes the first and second dotted lines and a third dotted line extending in an oblique direction, the indicator display unit transforms the indicator so that all of the first to third dotted lines appear to the user as dotted lines when any of the first to third dotted lines appear to the user as a solid line; An information processing system characterized by: [Item 6] a step of displaying images on display devices corresponding to the left and right eyes of the user, respectively, to provide the user with a virtual space; placing an index and a peripheral object in the virtual space at a distance from the user, displaying the index only on the display device corresponding to one of the left and right eyes, displaying the peripheral object on the display devices corresponding to both the left and right eyes, and moving the index to a distance visible to the user; determining the visual acuity of one of the left and right eyes of the user according to the distance; An information processing method characterized by being executed by a computer. [Item 7] a step of displaying images on display devices corresponding to the left and right eyes of the user, respectively, to provide the user with a virtual space; placing an index and a peripheral object in the virtual space at a distance from the user, displaying the index only on the display device corresponding to one of the left and right eyes, displaying the peripheral object on the display devices corresponding to both the left and right eyes, and moving the index to a distance visible to the user; determining the visual acuity of one of the left and right eyes of the user according to the distance; A program that causes a computer to execute the following. [Explanation of symbols]

[0055] 1 HMD 2. Computer

Claims

1. an image display unit that displays images on display devices corresponding to the left and right eyes of the user, respectively, to provide the user with a virtual space; an index display unit that places an index and a peripheral object in the virtual space at a distance from the user, displays the index only on the display device corresponding to one of the left and right eyes, displays the peripheral object on the display devices corresponding to both the left and right eyes, and moves the index to a distance visible to the user; a visual acuity measuring unit that determines the visual acuity of one of the left and right eyes of the user according to the distance; An information processing system comprising:

2. 2. The information processing system according to claim 1, the indicator display unit changes the size of the indicator in the virtual space according to the distance so that the size of the indicator visually recognized by the user is constant; An information processing system characterized by:

3. a step of displaying images on display devices corresponding to the left and right eyes of the user, respectively, to provide the user with a virtual space; placing an index and a peripheral object in the virtual space at a distance from the user, displaying the index only on the display device corresponding to one of the left and right eyes, displaying the peripheral object on the display devices corresponding to both the left and right eyes, and moving the index to a distance visible to the user; determining the visual acuity of one of the left and right eyes of the user according to the distance; An information processing method characterized by being executed by a computer.

4. a step of displaying images on display devices corresponding to the left and right eyes of the user, respectively, to provide the user with a virtual space; placing an index and a peripheral object in the virtual space at a distance from the user, displaying the index only on the display device corresponding to one of the left and right eyes, displaying the peripheral object on the display devices corresponding to both the left and right eyes, and moving the index to a distance visible to the user; determining the visual acuity of one of the left and right eyes of the user according to the distance; A program that causes a computer to execute the following.

Images