Information processing system, information processing method, and program

Abstract

[Problem] To make it possible to easily measure visual acuity. [Solution] This information processing system is characterized by comprising: a video display unit that displays a video on display devices respectively corresponding to the left and right eyes of a user, and presents a virtual space to the user; an index display unit that disposes an index and a peripheral object in the virtual space spaced away from the user, displays the index only on the display device corresponding to one of the left and right eyes, displays the peripheral object on the display devices corresponding to both of the left and right eyes, and moves the index to a distance visible to the user; and a visual acuity measurement unit that determines the visual acuity of one of the left and right eyes of the user in accordance with the distance.

Description

Information processing system, information processing method and program

[0001] The present invention relates to an information processing system, an information processing method, and a program.

[0002] Patent Document 1 discloses a system for measuring visual acuity by displaying an index in a virtual space.

[0003] Special Publication No. 2022-512186

[0004] However, the system of Patent Document 1 can only measure visual acuity in both eyes.

[0005] The present invention has been made in view of the above background, and has an object to provide a technique that can easily measure visual acuity.

[0006] The main invention of the present invention for solving the above problem is an information processing system comprising: an image display unit that displays images on display devices corresponding to the left and right eyes of a user to provide the user with a virtual space; an index display unit that positions an index and peripheral objects in the virtual space at a distance from the user, displays the index only on the display device corresponding to one of the left and right eyes, displays the peripheral objects on the display devices corresponding to both the left and right eyes, and moves the index to a distance visible to the user; and a vision measurement unit that determines the visual acuity of one of the left and right eyes of the user depending on the distance.

[0007] Other problems and solutions disclosed in this application will be made clear in the section on preferred embodiments of the invention and the drawings.

[0008] According to the present invention, visual acuity can be easily measured.

[0009] 1 is a diagram showing an example of the configuration of a visual acuity measurement system; FIG. 2 is a diagram showing an example of the configuration of an HMD 1; FIG. 3 is a diagram showing an example of the software configuration of a computer 2; FIG. 4 is a diagram explaining how an index appears; FIG. 5 is a diagram explaining the display of dotted lines; and FIG. 6 is a diagram explaining the operation of a computer 2. FIG. 7 is a diagram showing an example of the configuration of an HMD 1 according to a second embodiment; FIG. 8 is a diagram explaining the operation of a computer 2 according to the second embodiment.

[0010] First Embodiment An information processing system according to one embodiment of the present invention will now be described. The information processing system of this embodiment is intended to have a user wear a head-mounted display (HMD1) and measure the user's visual acuity in a virtual space. The HMD1 may be any wearable device that provides a virtual space to the user, and may be, for example, a glasses-type augmented reality (AR) device (glasses-type display). The HMD1 does not have to be a wearable device, and may be, for example, a naked-eye stereoscopic display.

[0011] FIG. 1 is a diagram showing an example configuration of a visual acuity measurement system. The visual acuity measurement system of this embodiment includes a computer 2. The computer 2 is connected to an HMD 1 and an input device 3, can receive data input from the input device 3, and can control the display of images on the HMD 1. As shown in FIG. 1 , the computer 2 may include a CPU 201, a memory 202, and a storage device 203. The storage device 203 stores various data and programs, and is, for example, a hard disk drive, a solid-state drive, or a flash memory. Note that each functional unit of the computer 2, which will be described later, is realized by the CPU 201 reading a program stored in the storage device 203 into the memory 202 and executing it, and each storage unit of the computer 2 may be realized as part of the storage area provided by the memory 202 and the storage device 203.

[0012] The input device 3 is, for example, a controller, microphone, keyboard, mouse, touch panel, etc. The input device 3 can support the user in making predetermined inputs within the virtual space. The input device 3 can be configured, for example, as a set of controllers for the left and right hands. The input device 3 can include, for example, an operation trigger button, an infrared LED, a sensor, a joystick, a menu button, etc. The input device 3 can also detect posture and movement using an acceleration sensor (not shown) or the like, and input posture and movement data to the computer 2 as input data.

[0013] The computer 2 performs a visual acuity test on the user, which will be described later.

[0014] FIG. 2 is a diagram showing an example configuration of the HMD 1. The HMD 1 can be worn on the head of the user 4. The HMD 1 includes display devices 11 and 12 that are positioned in front of the left and right eyes of the user 4. The display device 11 displays an image to one eye (the right eye in the example of FIG. 2). The display device 12 displays an image to the other eye (the left eye in the example of FIG. 2). For example, optically transmissive and non-transmissive displays can be used as the display devices 11 and 12. The user 4 can view the virtual space by viewing the images on the display devices 11 and 12 with both eyes simultaneously.

[0015] 3 is a diagram showing an example of the software configuration of the computer 2. The computer 2 can include an image display unit 211, an index display unit 212, a visual acuity measurement unit 213, and a visual acuity output unit 214.

[0016] The image display unit 211 displays images on the display devices 11 and 12 corresponding to the left and right eyes of the user, respectively, to provide the user with a virtual space. A known mechanism for stereoscopic vision using a head-mounted display can be adopted.

[0017] The indicator display unit 212 places an indicator in the virtual space. The indicator display unit 212 places the indicator in the virtual space at a distance from the user. The indicator can be, for example, a Landolt ring. The indicator display unit 212 can place the indicator so that the plane on which the indicator, such as the Landolt ring, is drawn is perpendicular to the user's line of sight.

[0018] The index display unit 212 can generate images to be displayed on each of the display devices 11 and 12 according to the position and size of the index placed in the virtual space, and display the images on the display devices 11 and 12. The index display unit 212 displays the image related to the index placed in the virtual space on only one of the display devices 11 and 12 (the one corresponding to the eye that is the target of the visual acuity test).

[0019] The video display unit 211 places an object (hereinafter, a peripheral object) different from the index in the virtual space. The video display unit 211 places the peripheral object so that the user can view it simultaneously with the index. The video display unit 211 can place the peripheral object within the user's field of view. The video display unit 211 can place the peripheral object around the index. The peripheral object can be approximately the same size as the index or larger than the index. The peripheral object may also be smaller than the index. There may be multiple peripheral objects. The peripheral object may be any object, such as a window, a shelf, an examination instrument, a desk, a book, or a painting. The video display unit 211 displays the peripheral object (or an image corresponding to the peripheral object) on both display devices 11 and 12. Even if the index (or an image corresponding to the index) is displayed on only one of the display devices 11 and 12, placing the peripheral object enables the user to experience binocular stereoscopic vision. This allows the eyes and brain to experience stereoscopic vision of the virtual space, even for an index displayed to only one eye.

[0020] The video display unit 211 can place peripheral objects in the user's peripheral vision. Generally, the human eye is resistant to parallax in peripheral vision, and can maintain a three-dimensional effect even if the misalignment is large. If stereoscopic vision is possible in the peripheral vision, it means that stereoscopic vision is also possible in the central vision. Therefore, by displaying peripheral objects in the peripheral vision to both eyes and placing an index in the central vision, the user can see the index in stereoscopic vision even if the index is displayed to only one eye.

[0021] The index display unit 212 can also place a frame around the index. The frame can be displayed on both the display devices corresponding to the left and right eyes. If the index is displayed to only one eye, it is difficult to judge the sense of distance and to focus. However, by placing a frame around the index and displaying this frame to both eyes, it is expected that the sense of distance can be grasped and it will be easier to focus.

[0022] 4 is a diagram illustrating how an index appears. As shown in the figure, an index 41 is displayed on the display device 11 in front of the right eye, but the index 41 is not displayed on the display device 12 in front of the left eye. However, the index 41 is displayed in the field of view 13 of binocular vision. This index 41 is perceived only by the right eye. A frame 42 is displayed around the index 41. The frame 42 is displayed on both the display devices 11 and 12, and is naturally also perceived in the field of view 13 of binocular vision.

[0023] The indicator display unit 212 moves the indicator to a distance where the user can see it. The indicator display unit 212 can move the indicator to a distance where the user can see it best. The indicator display unit 212 accepts input from the user regarding whether the indicator was visible or not, and determines the visible or best visible distance. The indicator display unit 212, for example, places the indicator at a predetermined distance (which may be a fixed value set in advance, or may be a distance according to the user's self-reported visual acuity), gradually moves the indicator closer to the user, accepts input from the user that the indicator has become visible, stops the indicator at that position, and calculates the distance from the stopped indicator position to the user. Alternatively, the indicator display unit 212 may move the indicator several times forward and backward from the user, accept designation of the best visible position, determine the position of the indicator, and calculate the distance from the determined position to the user. The indicator display unit 212 moves a frame in accordance with the movement of the indicator. The frame is moved so that the distance from the user to the indicator and the distance from the user to the frame are the same (a state in which the frame surrounds the indicator).

[0024] The indicator display unit 212 can change the size of the indicator in the virtual space according to the distance so that the size of the indicator visually recognized by the user is constant. The indicator display unit 212 can expand or contract the indicator so that the size of the indicator increases when the distance between the user and the indicator is large, and decreases when the distance between the user and the indicator is small.

[0025] <Spherical Power> The visual acuity measurement unit 213 can determine the spherical power of the eye being measured according to the distance from the user to the visible indicator. The relationship between the distance and the spherical power can be set, for example, as a function in advance. In addition, a learning model that learns the relationship between the distance from the user to the visible or best visible indicator and the spherical power measured using conventional equipment can be prepared by machine learning, and the visual acuity measurement unit 213 can estimate the visual acuity by providing the distance to the learning model.

[0026] <Cylindrical Power> The index display unit 212 can display dotted lines on the top, bottom, left, and right as indices. The dotted lines are also displayed only on either the display device 11 or 12 corresponding to the eye being examined. FIG. 5 is a diagram illustrating the display of dotted lines. The index display unit 212 can display a dotted line 52 (first dotted line) extending in the up-down direction and a dotted line 53 (second dotted line) extending in the left-right direction as indices. The dotted lines 52 and 53 are arranged on the plane of the index (Landolt ring). In an eye without astigmatism, the dotted lines 51 and 52 on the top, bottom, left, and right are perceived as dotted lines with equal spacing, as in the field of view 51 in FIG. 5. In the case of astigmatism, the dotted lines 52 and / or 53 appear as solid lines (or the spacing between the dotted lines is narrow), as in the field of view 54 in FIG. 5. When either the dotted lines 52 or 53 appear to the user as a solid line (or as having a narrow spacing between the dotted lines), the index display unit 212 deforms the index (all dotted lines) by enlarging them in the direction of the solid line or the dotted line with a narrow spacing so that both the dotted lines 52 and 53 appear to the user as dotted lines (dotted lines with the same spacing). The example in Figure 5 shows that the dotted line 52-1 in the vertical direction appears as a solid line in the field of view 54. In this case, by extending the dotted line 52 in the vertical direction as shown in the field of view 54-1, the dotted line 52 can be viewed as a dotted line even by an astigmatic eye.

[0027] In addition, the index display unit 212 may change the length (longer in the example of Figure 5) of the dotted line (dotted line 53 in the left-right direction in the example of Figure 5) perpendicular to the direction of expansion and contraction so that the aspect ratio of the index remains constant (1:1 in the example of Figure 5).

[0028] The indicator display unit 212 can also display dotted lines extending diagonally in addition to the dotted lines on the top, bottom, left, and right. As in the above, the indicators (all dotted lines) can be transformed so that the solid lines or the dotted lines are aligned in the direction of the dotted lines that appear to have shorter intervals, so that all dotted lines on the top, bottom, left, right, and diagonal directions are perceived as dotted lines.

[0029] The visual acuity measurement unit 213 can determine the user's cylindrical power according to the degree of deformation of the index. A function can be set in advance to represent the relationship between the degree of deformation of the index and the cylindrical power. In addition, a learning model that learns the relationship between the deformation power and the cylindrical power measured using a conventional method through machine learning is prepared, and the visual acuity measurement unit 213 can estimate the cylindrical power by providing the deformation power to the learning model. Note that the relationship between the deformation power and the direction of deformation and the cylindrical power may be set using a function or may be learned through machine learning.

[0030] The visual acuity measurement unit 213 can determine the astigmatic axis based on the deformation direction.

[0031] The visual acuity measurement unit 213 can calculate the spherical equivalent power based on the spherical power and the cylindrical power. The spherical equivalent power can be calculated by adding half the cylindrical power to the spherical power.

[0032] The visual acuity output unit 214 outputs the measured visual acuity. The visual acuity output unit can output spherical power, cylindrical power, and astigmatism axis. The visual acuity output unit 214 can transmit the measured visual acuity to a terminal operated by a medical technician for display. The visual acuity output unit 214 can also print the measured visual acuity using a printer, for example.

[0033] <Operation> FIG. 6 is a diagram illustrating the operation of the computer 2.

[0034] The computer 2 places an index and a frame in a virtual space (S301), displays the index only on the eye being examined (S302), and displays frames on both eyes (S303). The computer 2 moves the index to a position where it can be seen from a distance (S304), and determines the spherical power according to the distance from the user to the visible index (S305).

[0035] The computer 2 arranges dotted lines diagonally in the virtual space and displays them only on the eye being examined (S306), prompts the user to specify which dotted lines appear to be solid, and deforms the image so that all dotted lines extend in the direction of the specified dotted line (S307). The computer 2 determines the axis of astigmatism based on the direction of the solid line (S308), and determines the degree of astigmatism based on the degree of deformation of the index (S309).

[0036] The computer 2 calculates the spherical equivalent power from the spherical power and cylindrical power (S310), and outputs the spherical power, cylindrical power, astigmatism axis, and spherical equivalent power (S311).

[0037] As described above, according to the information processing system of this embodiment, the visual acuity of one of the left and right eyes can be easily measured using a virtual space.

[0038] Second Embodiment In a second embodiment, the HMD 1 is provided with a lens for vision correction, and corrected vision is measured.

[0039] FIG. 7 is a diagram illustrating an example configuration of an HMD 1 according to a second embodiment. In the second embodiment, the HMD 1 further includes lenses 111 and 121 between the display devices 11 and 12 and the left and right eyes of a user 4 wearing the HMD 1. The lenses 111 and 121 are also provided with diopter (refractive power) adjustment mechanisms 112 and 122. The adjustment mechanisms 112 and 122 can change the diopter of each of the left and right eyes of the user 4. The adjustment mechanisms 112 and 122 can change the diopter, for example, from 0D to 7D. The adjustment mechanisms 112 and 122 can change the diopter by, for example, changing the position of the lenses 111 and 121 between the display devices 11 and 12 and the eyes of the user 4. The adjustment mechanisms 112 and 122 may be configured to enable the lenses 112 and 121 to be replaced. The refractive power may be changed by placing lenses for astigmatism between the lenses 112 and 121 and the display devices 11 and 12, or between the left and right eyes of the user. The adjustment mechanisms 112 and 122 may include, for example, an actuator that changes the refractive power under control of the computer 2, or the refractive power may be changed manually by the user 4. The adjustment mechanisms 112 and 122 may also have a function of responding with the refractive power (e.g., 0D to 7D) in response to a request from the computer 2.

[0040] 8 is a diagram showing an example of the configuration of the computer 2 according to the second embodiment. In the second embodiment, the computer 2 further includes a dioptric power setting unit 215 and a dioptric power acquisition unit 216.

[0041] The refractive power setting unit 215 sets the refractive power of the HMD 1. The refractive power setting unit 215 may, for example, receive an input of the refractive power to be set from a laboratory technician or a user, transmit a refractive power setting request including the refractive power to the adjustment mechanisms 112 and 122 of the HMD 1, and set the refractive power by, for example, activating an actuator that adjusts the position of the lenses 111 and / or 121 so that the adjustment mechanisms 112 and 122 reach the refractive power set in the setting request. The refractive power setting unit 215 may also, for example, receive an input of the refractive power to be set from a laboratory technician (for example, receive the refractive power from the laboratory technician's terminal), and output a message instructing the user to set the refractive power (for example, display the message on the display devices 11 and 12, or output the message as audio from a speaker (not shown)), allowing the user to manually adjust the refractive power. The refractive power may be input for both the left and right eyes and set in each of the adjustment mechanisms 112 and 122, or may be input for only one of the right and left refractive powers to be examined and the refractive power may be set in the adjustment mechanism 112 or 122 corresponding to the eye to be examined by the above-mentioned method. Also, the technician may transmit the refractive power from a remote terminal to the computer 2 via a communication network.

[0042] The refractive power acquisition unit 216 acquires the refractive power set in the HMD 1. The refractive power acquisition unit 216 can accept input of the refractive power from an input device such as a keyboard, a touch panel, a mouse, or a microphone. The refractive power acquisition unit 216 may acquire the refractive power set from the adjustment mechanisms 112 and 122. The refractive power acquisition unit 216 can confirm that the refractive power set by the refractive power setting unit 215 matches the acquired refractive power, and can output an alert if they do not match.

[0043] The index display unit 212 and the visual acuity measurement unit 213 have the same functions as those in the first embodiment, and can measure corrected visual acuity.

[0044] Furthermore, the visual acuity measurement unit 213 can display an index such as a Landolt ring or letters on the display device 11 or 12 and ask the user whether they can see the index (this may be output by voice, or may be displayed as text on the display devices 11 and 12. Alternatively, for example, an instruction to make the inquiry may be given to a medical technician), and can receive a response from the user as to whether they can see the index (for example, when a Landolt ring is displayed, the direction of the notch may be received, and when text is displayed, input of the text may be received). The visual acuity measurement unit 213 can also measure the user's visual acuity by displaying the index at different sizes and identifying the smallest size that the user can see.

[0045] The visual acuity measurement unit 213 can display an index of varying size at a predetermined distance (for example, 5 meters) from the user in the virtual space. The visual acuity measurement unit 213 displays an image related to the virtual space on both display devices 11 and 12 to provide a three-dimensional virtual space, while adjusting the image to position the index at a predetermined distance in the virtual space, and displays the index only on either display device 11 or 12 corresponding to the eye to be measured. This makes it possible to measure the visual acuity of one eye at a time.

[0046] FIG. 9 is a diagram illustrating the operation of the computer 2 according to the second embodiment.

[0047] The computer 2 receives a designation of the refractive power from, for example, a medical technician (S321). The computer 2 may determine the refractive power. For example, the computer 2 may determine the refractive power in order of increasing refractive power from a predetermined refractive power.

[0048] The computer 2 sets the refractive power of the HMD 1 (S322), provides a virtual space to the user via the display devices 11 and 12, and displays a resized index on the display device 11 or 12 in front of either the left or right eye (S323). The computer 2 accepts input of the index (S324). For example, if the index is a Landolt ring, the computer 2 accepts the direction of the notch, and if the index is a character, the computer 2 accepts the character. The computer 2 determines whether the user can see the index based on whether the accepted content matches the displayed index (S325). If the user can see the index (S325: YES), the computer 2 updates the user's visual acuity according to the size of the index (S326).

[0049] The computer 2 receives an instruction from, for example, a technician as to whether or not to change the refractive power, and if the refractive power is to be changed (S327: YES), repeats the process from step S321.

[0050] The computer 2 receives an instruction from, for example, the technician as to whether or not to end the visual acuity test, and if not (S328: NO), the computer 2 can return to step S323 and display the index with a changed size.

[0051] As described above, the vision measurement system of the second embodiment makes it possible to easily measure corrected vision.

[0052] In the second embodiment, the process shown in FIG. 6 can also be performed after the refractive power is set (S322).

[0053] Although the present embodiment has been described above, the above embodiment is intended to facilitate understanding of the present invention and is not intended to limit the present invention. The present invention may be modified or improved without departing from the spirit thereof, and equivalents thereof are also included in the present invention.

[0054] <Disclosures> The present disclosure also includes the following configurations. [Item 1] An information processing system comprising: an image display unit that displays images on display devices corresponding to the left and right eyes of a user to provide the user with a virtual space; an index display unit that arranges an index and a peripheral object in the virtual space at a distance from the user, displays the index only on the display device corresponding to one of the left and right eyes, displays the peripheral object on the display devices corresponding to both the left and right eyes, and moves the index to a distance visible to the user; and a visual acuity measurement unit that determines the visual acuity of one of the left and right eyes of the user based on the distance. [Item 2] The information processing system according to item 1, wherein the index display unit arranges a frame around the index, displays the frame on both of the display devices corresponding to the left and right eyes, and moves the frame in accordance with movement of the index. [Item 3] The information processing system according to item 1, wherein the index display unit changes a size of the index in the virtual space according to the distance so that the size of the index visually recognized by the user is constant. [Item 4] The information processing system according to item 1, wherein the index includes a first dotted line extending in a vertical direction and a second dotted line extending in a horizontal direction, and when either the first or second dotted line appears to the user as a solid line, the index display unit deforms the index so that both the first and second dotted lines appear to the user as dotted lines, and the visual acuity measurement unit determines the user's astigmatism power according to the degree of deformation of the index. [Item 5] The information processing system according to Item 4, wherein the indicator includes the first and second dotted lines and a third dotted line extending diagonally, and when any of the first to third dotted lines appears to the user as a solid line, the indicator display unit deforms the indicator so that all of the first to third dotted lines appear to the user as dotted lines.[Item 6] An information processing method, characterized in that a computer executes the steps of: providing a virtual space to a user by displaying an image on each display device corresponding to the left and right eyes of the user, placing an index and peripheral objects in the virtual space at a distance from the user, displaying the index only on the display device corresponding to one of the left and right eyes, displaying the peripheral objects on the display devices corresponding to both the left and right eyes, and moving the index to a distance visible to the user, and determining the visual acuity of one of the left and right eyes of the user in accordance with the distance. [Item 7] A program for causing a computer to execute the steps of: providing a virtual space to the user by displaying an image on each display device corresponding to the left and right eyes of the user, placing an index and peripheral objects in the virtual space at a distance from the user, displaying the index only on the display device corresponding to one of the left and right eyes, displaying the peripheral objects on the display devices corresponding to both the left and right eyes, and moving the index to a distance visible to the user, and determining the visual acuity of one of the left and right eyes of the user in accordance with the distance.

[0055] 1 HMD 2 Computer

Claims

1. An information processing system comprising: an image display unit that displays images on display devices corresponding to the left and right eyes of a user to provide the user with a virtual space; an index display unit that places an index and peripheral objects in the virtual space at a distance from the user, displays the index only on the display device corresponding to one of the left and right eyes, displays the peripheral objects on the display devices corresponding to both the left and right eyes, and moves the index to a distance visible to the user; and a visual acuity measurement unit that determines the visual acuity of one of the left and right eyes of the user depending on the distance.

2. An information processing system as described in claim 1, characterized in that the indicator display unit changes the size of the indicator in the virtual space according to the distance so that the size of the indicator visually recognized by the user remains constant.

3. An information processing method characterized by being executed by a computer, comprising the steps of: displaying an image on each of display devices corresponding to the left and right eyes of a user to provide the user with a virtual space; arranging an indicator and peripheral objects in the virtual space at a distance from the user, displaying the indicator only on the display device corresponding to one of the left and right eyes, displaying the peripheral objects on the display devices corresponding to both the left and right eyes, and moving the indicator to a distance visible to the user; and determining the visual acuity of one of the left and right eyes of the user depending on the distance.

4. A program for causing a computer to execute the steps of: displaying images on display devices corresponding to the left and right eyes of a user to provide the user with a virtual space; arranging an indicator and peripheral objects in the virtual space at a distance from the user, displaying the indicator only on the display device corresponding to one of the left and right eyes, displaying the peripheral objects on the display devices corresponding to both the left and right eyes, and moving the indicator to a distance visible to the user; and determining the visual acuity of one of the left and right eyes of the user depending on the distance.

Images