Information processing system, information processing method, and program

Abstract

[Problem] To effectively perform a stereoscopic vision inspection. [Solution] This information processing system is characterized by comprising: a disposition unit that disposes a first object in a virtual space, and disposes a second object at a position closer to a user than the first object; and an input unit that receives an input indicating that the distances from the user to the first and second objects are different from each other.

Description

Information processing system, information processing method and program

[0001] The present invention relates to an information processing system, an information processing method, and a program.

[0002] Patent Document 1 discloses a method for performing stereoscopic viewing using parallax.

[0003] JP 2014-226180 A

[0004] There is a need for more effective testing of stereopsis.

[0005] The present invention has been made in view of the above background, and aims to provide a technique that can effectively perform a stereoscopic vision test.

[0006] The main invention of the present invention for solving the above problem is an information processing system comprising: a placement unit that places a first object in a virtual space and places a second object at a position closer to the user than the first object; and an input unit that accepts input that the distances from the user to the first and second objects are different.

[0007] Other problems and solutions disclosed in this application will be made clear in the section on preferred embodiments of the invention and the drawings.

[0008] According to the present invention, a stereoscopic vision test can be carried out effectively.

[0009] FIG. 1 is a diagram illustrating an example of the configuration of a stereoscopic vision testing system. FIG. 2 is a diagram illustrating an example of the configuration of an HMD 1. FIG. 3 is a diagram illustrating an example of the software configuration of a management server 2. FIG. 4 is a diagram illustrating the line of sight of each eye of a user. FIG. 5 is a diagram illustrating the line of sight of a user. FIG. 6 is a diagram illustrating an example of an index I to be placed in a virtual space. FIG. 7 is a diagram illustrating the placement of the index I. FIG. 8 is a diagram illustrating the display of the index I. FIG. 9 is a diagram illustrating the operation of a computer 2.

[0010] <Summary of the Invention> The details of embodiments of the present invention will be listed and described below. The present invention has, for example, the following configuration. [Item 1] An information processing system comprising: a placement unit that places a first object in a virtual space and places a second object at a position closer to the user than the first object; and an input unit that accepts input that the first and second objects are at different distances from the user. [Item 2] The information processing system according to Item 1, wherein the placement unit changes the size of the second object depending on the distance from the user. [Item 3] The information processing system according to Item 2, wherein the placement unit makes the size of the second object smaller than the first object as the distance from the user to the second object becomes shorter than the distance from the user to the first object. [Item 4] The information processing system according to Item 1, wherein the placement unit places the first and second objects within a predetermined distance from the user's line of sight. [Item 5] The information processing system according to Item 1, wherein the placement unit moves the first and second objects in accordance with a change in the user's line of sight. [Item 6] An information processing method, characterized in that a computer executes the steps of placing a first object in a virtual space and placing a second object at a position closer to the user than the first object, and accepting input that the distances from the user to the first and second objects are different. [Item 7] A program for causing a computer to execute the steps of placing a first object in a virtual space and placing a second object at a position closer to the user than the first object, and accepting input that the distances from the user to the first and second objects are different.

[0011] <System Overview> A stereoscopic vision testing system according to one embodiment of the present invention will now be described. In the stereoscopic vision testing system of this embodiment, a user wears a head-mounted display (HMD1), an index object is placed in a virtual space, and a test (hereinafter simply referred to as the test) to check whether the user has stereoscopic vision is performed, similar to a fly test. The HMD1 may be any wearable device that provides a virtual space to the user, and may be, for example, a glasses-type augmented reality (AR) device (glasses-type display). The HMD1 does not have to be a wearable device, and may be, for example, a naked-eye stereoscopic display.

[0012] FIG. 1 is a diagram showing an example of the configuration of a stereoscopic vision testing system. The stereoscopic vision testing system of this embodiment includes a computer 2. The computer 2 is connected to an HMD 1 and an input device 3, can receive data input from the input device 3, and can control the display of images on the HMD 1. As shown in FIG. 1 , the computer 2 may include a CPU 201, a memory 202, and a storage device 203. The storage device 203 stores various data and programs, and is, for example, a hard disk drive, a solid-state drive, or a flash memory. Note that each functional unit of the computer 2, which will be described later, is realized by the CPU 201 reading a program stored in the storage device 203 into the memory 202 and executing it, and each storage unit of the computer 2 may be realized as part of the storage area provided by the memory 202 and the storage device 203.

[0013] FIG. 2 is a diagram showing an example configuration of the HMD 1. The HMD 1 can be worn on the head of the user 4. The HMD 1 includes display devices 11 and 12 that are positioned in front of the left and right eyes of the user 4. The display device 11 displays an image to one eye (the right eye in the example of FIG. 2). The display device 12 displays an image to the other eye (the left eye in the example of FIG. 2). For example, optically transmissive and non-transmissive displays may be used as the display devices 11 and 12. By viewing the images on the display devices 11 and 12 simultaneously with the left and right eyes, the user 4 can visually recognize a virtual space and stereoscopically view objects in the virtual space.

[0014] The HMD 1 also includes cameras 13 and 14 that capture images of the user's eyes. The cameras 13 and 14 may be, for example, infrared cameras. The HMD 1 may also include an infrared light (not shown). For example, the cameras 13 and 14 may capture images of the user 4 shining an infrared light onto their left and right eyes.

[0015] The input device 3 is, for example, a controller, microphone, keyboard, mouse, touch panel, etc. The input device 3 can support the user in making predetermined inputs within the virtual space. The input device 3 can be configured, for example, as a set of controllers for the left and right hands. The input device 3 can include, for example, an operation trigger button, an infrared LED, a sensor, a joystick, a menu button, etc. The input device 3 can also detect posture and movement using an acceleration sensor (not shown) or the like, and input posture and movement data to the computer 2 as input data.

[0016] 3 is a diagram illustrating an example of the software configuration of the management server 2. The management server 2 includes a gaze detection unit 211, a placement unit 212, an input unit 213, a test information storage unit 231, and a test result storage unit 232.

[0017] <Storage Unit> The test information storage unit 231 stores information about tests related to stereoscopic vision (hereinafter referred to as test information). The test information can include placement information of virtual objects (hereinafter referred to as indicators) that are placed in the virtual space and that the user can view in stereoscopic vision, in association with a test ID that identifies the test. The placement information can set what objects are to be placed and in what positional relationship.

[0018] In this embodiment, it is assumed that four (or two, three, or five or more) indices of the same shape are displayed in a virtual space, one of which is positioned so as to protrude (or sink) from the user's perspective, and a test is conducted to see whether the user can recognize the protrusion (or sink). The four indices can be the same size.

[0019] It is also possible to arrange multiple sets of four (or two, three, or five or more) indicators in each set. In this case, the degree of protrusion (or depression) of one indicator in each set (the distance from the other indicators) can be made different.

[0020] Furthermore, although multiple indicators of the same shape are arranged, it is also possible to display a plate-shaped background object and one indicator, as in the fly test, and set the distance D1 between the background object and the indicator.

[0021] The test result storage unit 232 can store the test ID and information indicating whether or not the user was able to see stereoscopically (stereoscopic vision availability information) in association with information identifying the user who is the test subject (user ID). The stereoscopic visibility information can be set to indicate whether or not the user was able to recognize that the indices were protruding. When multiple sets of indices are arranged, it can be set for each set whether or not the user was able to recognize that the indices were protruding.

[0022] <Functional Unit> The gaze detection unit 211 detects the gaze of the user. The gaze detection unit 211 can detect the gaze of the user, for example, by analyzing images captured by the cameras 13 and 14. The gaze detection unit 211 can detect the gaze of the user, for example, by acquiring from the cameras 13 and 14 images of the user's eyes being irradiated with infrared rays from an infrared light, and analyzing the infrared irradiation position and the positions of the pupil and cornea from the acquired images. The gaze detection unit 211 detects the gaze of each of the right eye and the left eye.

[0023] FIG. 4 is a diagram illustrating the line of sight of each user's eye. As shown in FIG. 4, the line of sight detection unit 211 can detect the line of sight V1 of the right eye and the line of sight V2 of the left eye. The intersection of the line of sight V1 of the right eye and the line of sight V2 of the left eye can also be detected as the gaze point. The line of sight detection unit 211 can detect the line of sight V1, V2 of each eye as a unit vector, for example. Note that general processing can be used for the line of sight detection process. Furthermore, the line of sight detection unit 211 may determine the direction from the HMD 1 toward the front as the line of sight direction without analyzing the line of sight from the user's eyes.

[0024] 5 is a diagram illustrating the user's line of sight. The line of sight detection unit 211 can express, as the user's line of sight, a resultant vector V3 which is the sum of a line of sight V1 of the right eye and a line of sight V2 of the left eye, which are expressed as unit vectors.

[0025] The placement unit 212 places multiple objects in a virtual space for a stereoscopic vision test. The placement unit 212 places a first index and also places a second index at a position closer to the user than the first index (i.e., a position protruding from the user). Note that the second index may also be placed at a position farther from the user than the first index (i.e., a position recessed from the user). The second index may be placed at a position shifted in a direction parallel to the user's line of sight.

[0026] FIG. 6 is a diagram illustrating an example of indices I to be placed in a virtual space. In the example of FIG. 6, the placement unit 212 displays four indices I1-I4, and can place the indices I1-I4 so that one of them protrudes toward the user. The upper diagram of FIG. 6 is a front view in the virtual space, and the lower diagram of FIG. 6 is a top view in the virtual space. The indices I1-I4 are placed, for example, so as to form a diamond shape when viewed from the front. Of the indices I1-I4, three (indices I1, I2, and I4) are placed on plane B, and the remaining one (indicator I3) is placed so as to be spaced a distance D1 apart in the vertical direction of plane B. Note that the number of indices I ("4"), the positions of indices I1-I4 on plane B when viewed from the front (for example, these can be expressed as coordinates on the X and Y axes of plane B), "I3" specifying the spaced indices I, the distance D1 by which the indices I3 are spaced apart, and the placement unit 212 can place the indices I1-I4 by referring to the test information.

[0027] 7 is a diagram illustrating the placement of the indices I. As shown in FIG. 7, the indices I1-I4 are placed at distances D21-D24 above, below, left, and right, centered on a straight line L that is an extension of the user's line of sight (composite vector V3). In the examples of FIGS. 6 and 7, the distances from the user's line of sight L are the same, but it is sufficient that all of the indices I1-I4 are placed within a predetermined distance from the line of sight L.

[0028] 8 is a diagram illustrating the display of the index I. The placement unit 212 sets a plane B perpendicular to the user's line of sight (straight line L extending from the resultant vector V3) detected by the line of sight detection unit 211, places the indices I1, I2, and I4 on the plane B, and places the indices I1-I4 such that the index I3 is moved by a distance D1 in the vertical direction (parallel to the line L) from the plane B.

[0029] When the user's line of sight L changes, the placement unit 212 can also move the indices I1-I4 in accordance with the line of sight L. The placement unit 212 can set the orientation of the index I so that the user faces the index I directly. The placement unit 212 can set the orientation of the index I so that the line of sight L is perpendicular to the plane B. The placement unit 212 can continue to set the orientation of the index I so that the user always faces the index I directly. Furthermore, the placement unit 212 can control the position of the index I on the plane B so that the intersection of the line of sight L and the plane B is the center (e.g., center of gravity) of the index I on the plane B. The placement unit 212 can continue to control the position and orientation of the index I so that the line of sight L always intersects the plane B perpendicularly at the center (center of gravity) of the index I. This makes it possible to more accurately test whether stereoscopic vision is possible.

[0030] The placement unit 212 can change the size of the index I3 depending on the position of the index I3 (the protruding or recessed distance D1). When the index I3 is closer to the user than the other indexes I1, I2, and I4 (when the index I3 is farther from the plane B toward the user, i.e., when it protrudes toward the user), the placement unit 212 can make the size of the index I3 smaller than the other indexes I1, I2, and I4. When the index I3 is farther from the user than the other indexes I1, I2, and I4 (when the index I3 is farther from the plane B in the direction away from the user, i.e., when it is recessed toward the user), the placement unit 212 can make the size of the index I3 larger than the other indexes I1, I2, and I4. The placement unit 212 can change the size depending on the change in size due to perspective. That is, the size of the index I3 can be smaller the closer it is to the user and larger the farther it is from the user. The placement unit 212 can make the size of the index I3 the same as the other indexes when viewed from the user, even if the index I3 is protruding or recessed. The size can be expressed by the length (width and height) on the x and y axes on plane B. The placement unit 212 can control the size of the index I so that the user sees all of the indexes I as the same size. The placement unit 212 can control the size of each of the indexes I1 to I4 in accordance with the distance from the user to the index I. The placement unit 212 can continue to control the size of the indexes so that all of the indexes I always appear to the user as the same size.

[0031] The input unit 213 accepts input that the positions of the indices I1, I2, I4, and I3 are shifted in the line of sight direction (that the index I3 protrudes, that the distances from the user to each of the indices I are different, and that stereoscopic vision is possible). The input unit 213 may be configured to accept input only when stereoscopic vision is possible, or may be configured to accept input as to whether stereoscopic vision is possible or not. The input unit 213 can register the input result in the test result storage unit 232.

[0032] <Operation> FIG. 9 is a diagram illustrating the operation of the computer 2.

[0033] The computer 2 detects the lines of sight (unit vectors) V1 and V2 of the left and right eyes (S301) and calculates a resultant vector V3 by adding the vectors V1 and V2 (S302). The computer 2 sets a plane B perpendicular to L, a predetermined distance from the user along a straight line L extending from the resultant vector V3, and places indices I1-I4 on the plane B (S303). The computer 2 then moves one of the indices, I3, in a direction perpendicular to the plane B (i.e., parallel to L) so that it approaches the user (S304). The computer 2 changes the size of the indices I3 according to the distance moved (S305).

[0034] The computer 2 displays the indices I1-I4 (S306) and can receive input as to whether or not stereoscopic vision is possible (S307).

[0035] As described above, the stereoscopic vision testing system of this embodiment can perform a more detailed stereoscopic vision test.

[0036] According to the stereoscopic vision testing system of this embodiment, a test can be performed with the separation distance D1 changed in multiple stages, allowing for a more detailed evaluation of stereoscopic vision ability.

[0037] Although the present embodiment has been described above, the above embodiment is intended to facilitate understanding of the present invention and is not intended to limit the present invention. The present invention may be modified or improved without departing from the spirit thereof, and equivalents thereof are also included in the present invention.

[0038] <Modification 1> The placement unit 212 can maintain a constant distance between the user and the index I. Even when the user moves, the placement unit 212 can control the position of the index I so as to maintain a constant distance between the user and the index I.

[0039] The placement unit 212 can maintain a constant distance between the user and plane B. The placement unit 212 can set the position and orientation of the index I so that the user's line of sight L intersects with plane B perpendicularly, so that the intersection of the line of sight L and plane B is the center (center of gravity) of the multiple indices I, and so that the distance between the user and plane B is a predetermined distance. The predetermined distance may be a constant or may be set in advance.

[0040] <Variation 2> In the above-described embodiment, one of the indices I (index I3) is made to protrude toward the user (placed closer to the user than the other indices I), but the placement unit 212 may also make one of the indices I recessed (placed farther from the user than the other indices I).

[0041] Furthermore, during one stereoscopic vision test, the placement unit 212 may protrude or sink one of the indices I (index I3). Furthermore, the placement unit 212 may first protrude index I3, and then, if the input unit 213 cannot accept that the position of index I is shifted in the line of sight (i.e., if the user does not pass the stereoscopic vision test or if the user is unable to see stereoscopically), sink index I3 (place it at a position farther from the user than the other indices I).

[0042] The placement unit 212 can also change the degree to which the index I3 is protruded (the distance by which the index I3 is brought closer to the user than the other indices I). The distance by which the index I3 is brought closer to the user than the other indices I can be set in advance by the user or a medical professional. The placement unit 212 can also initially protrude the index I3 by a predetermined distance, and if the user is unable to achieve stereoscopic vision, increase the degree to which the index I3 is protruded (bring the index I3 closer to the user by a greater distance).

[0043] <Modification 3> The placement unit 212 can change at least one of the transparency and the contrast strength of the index I. The placement unit 212 can accept a setting for at least one of the transparency and the contrast strength from a user or a medical professional in advance. The placement unit 212 can initially set at least one of a predetermined transparency and a predetermined contrast strength for the index I, and can control the placement unit 212 to lower the transparency and increase the contrast if the user is unable to achieve stereoscopic vision.

[0044] 1 HMD 2 Computer

Claims

1. An information processing system comprising: a placement unit that places a first object in a virtual space and places a second object at a position closer to the user than the first object; and an input unit that accepts input indicating that the distances from the user to the first and second objects are different.

2. An information processing system according to claim 1, wherein the placement unit changes the size of the second object depending on the distance from the user.

3. An information processing system according to claim 2, characterized in that the placement unit makes the size of the second object smaller than the first object as the distance from the user to the second object becomes shorter than the distance from the user to the first object.

4. An information processing system according to claim 1, wherein the placement unit places the first and second objects within a predetermined distance from the user's line of sight.

5. An information processing system according to claim 1, characterized in that the placement unit moves the first and second objects in accordance with the user's line of sight when the user's line of sight changes.

6. An information processing method characterized by being executed by a computer, comprising the steps of: placing a first object in a virtual space and placing a second object at a position closer to the user than the first object; and accepting input indicating that the distances from the user to the first and second objects are different.

7. A program for causing a computer to execute the steps of: placing a first object in a virtual space and placing a second object at a position closer to the user than the first object; and accepting input indicating that the distances from the user to the first and second objects are different.

Images