Information processing system, information processing method, and program

Abstract

To effectively perform a stereoscopic vision test. [Solution] An information processing system comprising: a placement unit that places a first object in a virtual space and a second object at a position closer to the user than the first object; and an input unit that accepts input that the distances from the user to the first and second objects are different.

Description

[Technical field]

[0001] The present invention relates to an information processing system, an information processing method, and a program. [Background technology]

[0002] Patent Document 1 discloses performing stereoscopic viewing using parallax. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2014-226180 A Summary of the Invention [Problem to be solved by the invention]

[0004] There is a need for more effective testing of stereopsis.

[0005] The present invention has been made in view of the above background, and has an object to provide a technique that can effectively perform stereoscopic vision testing. [Means for solving the problem]

[0006] The main invention of the present invention for solving the above problem is an information processing system comprising: a placement unit that places a first object in a virtual space and places a second object at a position closer to a user than the first object; and an input unit that accepts input that the distances of the first and second objects from the user are different.

[0007] Other problems and solutions disclosed in this application will be made clear in the description of the preferred embodiments of the invention and the drawings. Effect of the Invention

[0008] According to the present invention, a stereoscopic vision test can be carried out effectively. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of a stereoscopic vision inspection system. [Diagram 2] FIG. 2 is a diagram illustrating an example of the configuration of an HMD 1. [Diagram 3] 2 illustrates an example of the software configuration of a management server 2. FIG. [Figure 4] FIG. 2 is a diagram illustrating the line of sight of each eye of a user. [Diagram 5] FIG. 1 is a diagram illustrating a user's line of sight. [Figure 6] FIG. 11 is a diagram showing an example of an index to be placed in a virtual space. [Figure 7] FIG. 13 is a diagram illustrating the arrangement of indices. [Figure 8] FIG. 13 is a diagram illustrating the display of an indicator. [Figure 9] FIG. 2 is a diagram illustrating the operation of the computer 2. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] <Summary of the Invention> The present invention will be described below with reference to the preferred embodiments thereof. [Item 1] a placement unit that places a first object in a virtual space and places a second object at a position closer to a user than the first object; an input unit that receives an input indicating that the first and second objects are at different distances from the user; An information processing system comprising: [Item 2] The information processing system according to item 1, the placement unit changes a size of the second object in accordance with a distance from the user; An information processing system comprising: [Item 3] Item 2. An information processing system according to the present invention, The placement unit is making the size of the second object smaller than that of the first object such that a distance from the user to the second object is shorter than a distance from the user to the first object; An information processing system comprising: [Item 4] The information processing system according to item 1, the placement unit places the first and second objects within a predetermined distance from a line of sight of the user; An information processing system comprising: [Item 5] The information processing system according to item 1, the placement unit moves the first and second objects in response to a change in the line of sight of the user; An information processing system comprising: [Item 6] placing a first object in a virtual space and placing a second object at a position closer to a user than the first object; receiving an input indicating that the first and second objects are at different distances from the user; An information processing method characterized by being executed by a computer. [Item 7] placing a first object in a virtual space and placing a second object at a position closer to a user than the first object; receiving an input indicating that the first and second objects are at different distances from the user; A program for causing a computer to execute the following.

[0011] <System Overview> A stereoscopic vision test system according to an embodiment of the present invention will be described below. In the stereoscopic vision test system of this embodiment, a user wears a head mounted display (HMD1), an object serving as an index is placed in a virtual space, and a test (hereinafter simply referred to as a test) is conducted to check whether or not the user has stereoscopic vision, such as a fly test. The HMD1 may be a wearable device that provides a virtual space to the user, and may be, for example, a glasses-type augmented reality (AR) device (glasses-type display). The HMD1 does not have to be a wearable device, and may be, for example, a naked eye stereoscopic display.

[0012] FIG. 1 is a diagram showing an example of the configuration of a stereoscopic vision test system. The stereoscopic vision test system of this embodiment includes a computer 2. The computer 2 is connected to an HMD 1 and an input device 3, and can receive data input from the input device 3 and control the display of images on the HMD 1. As shown in FIG. 1, the computer 2 may include a CPU 201, a memory 202, and a storage device 203. The storage device 203 is, for example, a hard disk drive, a solid state drive, or a flash memory that stores various data and programs. Each functional unit of the computer 2 described later is realized by the CPU 201 reading a program stored in the storage device 203 into the memory 202 and executing it, and each storage unit of the computer 2 may be realized as a part of the storage area provided by the memory 202 and the storage device 203.

[0013] FIG. 2 is a diagram showing an example of the configuration of the HMD 1. The HMD 1 can be worn on the head of the user 4. The HMD 1 includes display devices 11 and 12 arranged in front of the left and right eyes of the user 4. The display device 11 displays an image to one eye (the right eye in the example of FIG. 2). The display device 12 displays an image to the other eye (the left eye in the example of FIG. 2). For example, optically transmissive and non-transmissive displays can be used as the display devices 11 and 12. The user 4 can visually recognize a virtual space and stereoscopically view objects in the virtual space by simultaneously viewing the images on the display devices 11 and 12 with the left and right eyes.

[0014] The HMD 1 also includes cameras 13 and 14 that capture images of the user's eyes. The cameras 13 and 14 can be, for example, infrared cameras. The HMD 1 can also include an infrared light (not shown). For example, the cameras 13 and 14 can capture images of the infrared light being irradiated onto the left and right eyes of the user 4.

[0015] The input device 3 is, for example, a controller, a microphone, a keyboard, a mouse, a touch panel, etc. The input device 3 can support the user in making a predetermined input in the virtual space. The input device 3 can be configured, for example, as a set of controllers for the left and right hands. The input device 3 can include, for example, an operation trigger button, an infrared LED, a sensor, a joystick, a menu button, etc. The input device 3 can also detect posture and movement using an acceleration sensor (not shown) or the like, and input posture and movement data to the computer 2 as input data.

[0016] 3 is a diagram showing an example of the software configuration of the management server 2. The management server 2 includes a gaze detection unit 211, a placement unit 212, an input unit 213, a test information storage unit 231, and a test result storage unit 232.

[0017] <Storage section> The test information storage unit 231 stores information about tests related to stereoscopic vision (hereinafter referred to as test information). The test information can include placement information of virtual objects (hereinafter referred to as indicators) that are placed in the virtual space and that the user can view stereoscopically, in association with a test ID that identifies the test. The placement information can set what objects are to be placed in what positional relationship.

[0018] In this embodiment, it is assumed that four (or two, three, or five or more) indices of the same shape are displayed in the virtual space, one of the four is arranged so as to protrude (or sink) from the user, and a test is performed to see whether the user can recognize the protrusion (or sinking). The four indices can be the same size.

[0019] Note that multiple sets of four (or two, three, or five or more) indicators may be arranged. In this case, the degree of protrusion (or depression) of one indicator in each set (the distance from the other indicators) may be different.

[0020] Furthermore, although a plurality of indices of the same shape are arranged in the above embodiment, it is also possible to display a plate-shaped background object and one indices, as in the fly test, and set a distance D1 between the background object and the indices.

[0021] The test result storage unit 232 can store the test ID and information indicating whether or not the user was able to see stereoscopically (stereoscopic vision availability information) in association with information identifying the user who is the subject (user ID). In the stereoscopic visibility information, it is possible to set whether or not the user was able to recognize that the indices were protruding. When multiple sets of indices are arranged, it is possible to set, for each set, whether or not the user was able to recognize that the indices were protruding.

[0022] <Functional section> The gaze detection unit 211 detects the gaze of the user. The gaze detection unit 211 can detect the gaze of the user, for example, by analyzing images captured by the cameras 13 and 14. The gaze detection unit 211 can detect the gaze of the user, for example, by acquiring from the cameras 13 and 14 images of a state in which infrared rays from an infrared light are irradiated onto the user's eyes, and analyzing the infrared irradiation position and the positions of the pupil and cornea from the acquired images. The gaze detection unit 211 detects the gaze of each of the right eye and the left eye.

[0023] FIG. 4 is a diagram for explaining the line of sight of each eye of the user. As shown in FIG. 4, the line of sight detection unit 211 can detect the line of sight V1 of the right eye and the line of sight V2 of the left eye. It is also possible to detect the intersection of the line of sight V1 of the right eye and the line of sight V2 of the left eye as the gaze point. The line of sight detection unit 211 can detect the lines of sight V1 and V2 of each eye as unit vectors, for example. Note that general processing can be adopted for the line of sight detection processing. Furthermore, the line of sight detection unit 211 may determine the direction from the HMD 1 toward the front as the line of sight direction without analyzing the line of sight from the user's eyes.

[0024] 5 is a diagram illustrating the line of sight of a user. The line of sight detection unit 211 can express, as the line of sight of the user, a resultant vector V3 which is the sum of a line of sight V1 of the right eye and a line of sight V2 of the left eye expressed as unit vectors.

[0025] The placement unit 212 places a plurality of objects in a virtual space for a stereoscopic vision test. The placement unit 212 places a first index, and also places a second index at a position closer to the user than the first index (i.e., a position protruding from the user). The second index may be placed at a position farther from the user than the first index (i.e., a position recessed from the user). The second index may be placed at a position shifted in a direction parallel to the line of sight of the user.

[0026] FIG. 6 is a diagram showing an example of indices to be arranged in a virtual space. In the example of FIG. 6, the arrangement unit 212 can display four indices I1-I4 and arrange the indices I1-I4 so that one of them protrudes toward the user. The upper diagram of FIG. 6 is a front view in the virtual space, and the lower diagram of FIG. 6 is a top view in the virtual space. The indices I1-I4 are arranged, for example, to form a diamond shape when viewed from the front. Of the indices I1-I4, three (indices I1, I2, I4) are arranged on a plane B, and the other (indicator I3) is arranged so as to be spaced apart by a distance D1 in the vertical direction of the plane B. Note that the number of indices "4", the positions of the indices I1-I4 on the plane B when viewed from the front (for example, they can be expressed by coordinates on the XY axes of the plane B), "I3" specifying the indices to be spaced apart, the distance D1 by which the indices I3 are spaced apart, and the arrangement unit 212 can arrange the indices I1-I4 by referring to the test information.

[0027] Fig. 7 is a diagram for explaining the placement of indices. As shown in Fig. 7, indices I1-I4 are placed at distances D21-D24 above, below, left and right, centered on a straight line L extending from the user's line of sight (composite vector V3). In the examples of Figs. 6 and 7, the distances from the user's line of sight L are the same, but it is sufficient that all indices I1-I4 are placed within a predetermined distance from the line of sight L.

[0028] 8 is a diagram illustrating the display of indices. The arrangement unit 212 sets a plane B perpendicular to the line of sight of the user detected by the line of sight detection unit 211 (a straight line L extending the resultant vector V3), places indices I1, I2, and I4 on the plane B, and arranges the indices I1-I4 such that the index I3 is moved vertically from the plane B (parallel to the straight line L) by a distance D1.

[0029] When the user's line of sight L changes, the arrangement unit 212 can also move the indices I1-I4 in accordance with the line of sight L. This makes it possible to more accurately test whether or not stereoscopic vision is possible.

[0030] The arrangement unit 212 can change the size of the index I3 according to the position of the index I3 (protruding or recessed distance D1). When the index I3 is closer to the user than the other indexes I1, I2, and I4 (when it is farther from the plane B in the direction toward the user, i.e., when it is protruding toward the user), the arrangement unit 212 can make the size of the index I3 smaller than the other indexes I1, I2, and I4, and when the index I3 is farther from the user than the other indexes I1, I2, and I4 (when it is farther from the plane B in the direction opposite to the user, i.e., when it is recessed toward the user), the arrangement unit 212 can make the size of the index I3 larger than the other indexes I1, I2, and I4. The arrangement unit 212 can change the size according to the change in size due to perspective. That is, the size of the index I3 can be made smaller the closer it is to the user and larger the farther it is from the user. The arrangement unit 212 can make the index I3 have the same size as the other indexes even if it is protruding or recessed. The size can be expressed by the length (width and height) on the xy axis on the plane B.

[0031] The input unit 213 accepts an input that the positions of the indices I1, I2, I4, and I3 are shifted in the line of sight (the distance from the user is different, and stereoscopic vision is possible). The input unit 213 may be configured to accept an input only when stereoscopic vision is possible, or may be configured to accept an input as to whether stereoscopic vision is possible or not. The input unit 213 can register the input result in the test result storage unit 232.

[0032] <Operation> FIG. 9 is a diagram for explaining the operation of the computer 2. As shown in FIG.

[0033] The computer 2 detects the lines of sight (unit vectors) V1 and V2 of the left and right eyes (S301), and obtains a resultant vector V3 by adding the vectors V1 and V2 (S302). The computer 2 sets a plane B perpendicular to L, a predetermined distance away from the user along a straight line L extending from the resultant vector V3, and places indices I1-I4 on the plane B (S303), and moves one of the indices, I3, in a vertical direction from the plane B (i.e., parallel to L) so that it approaches the user (S304). The computer 2 changes the size of the index I3 according to the movement distance (S305).

[0034] The computer 2 displays the indices I1-I4 (S306) and can receive input as to whether or not stereoscopic vision is possible (S307).

[0035] As described above, the stereoscopic vision testing system of this embodiment makes it possible to perform a more detailed stereoscopic vision test.

[0036] According to the stereoscopic vision test system of this embodiment, a test can be performed in which the separation distance D1 is changed in multiple stages, so that a more detailed evaluation of stereoscopic vision ability can be performed.

[0037] Although the present embodiment has been described above, the above embodiment is intended to facilitate understanding of the present invention, and is not intended to limit the present invention. The present invention may be modified or improved without departing from the spirit of the present invention, and equivalents thereof are also included in the present invention. [Explanation of symbols]

[0038] 1 HMD 2. Computer

Claims

1. a placement unit that places a first object in a virtual space and places a second object at a position closer to a user than the first object, with a size that appears to be the same as the first object depending on a distance from the user; an input unit that receives an input indicating that the first and second objects are at different distances from the user; An information processing system comprising:

2. 2. The information processing system according to claim 1, the placement unit places the first and second objects perpendicular to a line of sight of the user at a predetermined distance from the line of sight; An information processing system comprising:

3. 2. The information processing system according to claim 1, the placement unit moves the first and second objects perpendicular to the line of sight and at a predetermined distance from the line of sight when the line of sight of the user changes; An information processing system comprising:

4. placing a first object in a virtual space and placing a second object at a position closer to a user than the first object, with a size that appears to be the same as the first object depending on a distance from the user; receiving an input indicating that the first and second objects are at different distances from the user; An information processing method characterized by being executed by a computer.

5. placing a first object in a virtual space and placing a second object at a position closer to a user than the first object, with a size that appears to be the same as the first object depending on a distance from the user; receiving an input indicating that the first and second objects are at different distances from the user; A program for causing a computer to execute the following.

Images