Information processing system, information processing method, and program

Abstract

To effectively carry out a stereoscopic inspection.SOLUTION: An information processing system comprises an arrangement part which arranges a first object within a virtual space and which arranges a second object in a position more adjacent to a user than the first object, and an input part which receives input of a difference between distances of the first and second objects from the user.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing system, an information processing method, and a program. [Background technology]

[0002] Patent Document 1 discloses a method for performing stereoscopic viewing using parallax. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-226180 Summary of the Invention [Problem to be solved by the invention]

[0004] There is a need for more effective testing of stereopsis.

[0005] The present invention has been made in view of the above background, and aims to provide a technique that can effectively perform a stereoscopic vision test. [Means for solving the problem]

[0006] The main invention of the present invention for solving the above problem is an information processing system comprising: a placement unit that places a first object in a virtual space and places a second object at a position closer to the user than the first object; and an input unit that accepts input that the distances from the user to the first and second objects are different.

[0007] Other problems and solutions disclosed in this application will be made clear in the section on preferred embodiments of the invention and the drawings. [Effects of the Invention]

[0008] According to the present invention, a stereoscopic vision test can be carried out effectively. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of a stereoscopic vision inspection system. [Figure 2] FIG. 2 is a diagram illustrating an example of the configuration of an HMD 1. [Figure 3] FIG. 2 illustrates an example of the software configuration of a management server 2. [Figure 4] FIG. 2 is a diagram illustrating the line of sight of each eye of a user. [Figure 5] FIG. 1 is a diagram illustrating a user's line of sight. [Figure 6] FIG. 10 is a diagram illustrating an example of an index placed in a virtual space. [Figure 7] FIG. 10 is a diagram illustrating the placement of indices. [Figure 8] FIG. 10 is a diagram illustrating the display of an index. [Figure 9] FIG. 2 is a diagram illustrating the operation of the computer 2. DETAILED DESCRIPTION OF THE INVENTION

[0010] <Summary of the Invention> The present invention will be described by listing the contents of the embodiments. For example, the present invention has the following configuration. [Item 1] a placement unit that places a first object in a virtual space and places a second object at a position closer to the user than the first object; an input unit that receives an input indicating that the distances of the first and second objects from the user are different; An information processing system comprising: [Item 2] Item 1, an information processing system according to item 1, the placement unit changes the size of the second object in accordance with the distance from the user; An information processing system characterized by: [Item 3] Item 2. The information processing system according to item 2, The placement unit making the size of the second object smaller than the size of the first object such that the distance from the user to the second object is shorter than the distance from the user to the first object; An information processing system characterized by: [Item 4] Item 1, an information processing system according to item 1, the placement unit places the first and second objects within a predetermined distance from the line of sight of the user; An information processing system characterized by: [Item 5] Item 1, an information processing system according to item 1, the placement unit moves the first and second objects in accordance with a change in the line of sight of the user; An information processing system characterized by: [Item 6] placing a first object in a virtual space and placing a second object at a position closer to the user than the first object; receiving an input indicating that the first and second objects are at different distances from the user; An information processing method characterized by being executed by a computer. [Item 7] placing a first object in a virtual space and placing a second object at a position closer to the user than the first object; receiving an input indicating that the first and second objects are at different distances from the user; A program that causes a computer to execute the following.

[0011] <System Overview> A stereoscopic vision testing system according to one embodiment of the present invention will be described below. In the stereoscopic vision testing system of this embodiment, a user wears a head-mounted display (HMD1), an index object is placed in a virtual space, and a test (hereinafter simply referred to as a test) to check whether the user has stereoscopic vision is performed, similar to a fly test. The HMD1 may be any wearable device that provides a virtual space to the user, and may be, for example, a glasses-type augmented reality (AR) device (glasses-type display). The HMD1 does not have to be a wearable device, and may be, for example, a naked-eye stereoscopic display.

[0012] FIG. 1 is a diagram showing an example of the configuration of a stereoscopic vision testing system. The stereoscopic vision testing system of this embodiment includes a computer 2. The computer 2 is connected to an HMD 1 and an input device 3, can receive data input from the input device 3, and can control the display of images on the HMD 1. As shown in FIG. 1, the computer 2 may include a CPU 201, a memory 202, and a storage device 203. The storage device 203 stores various data and programs, and is, for example, a hard disk drive, a solid-state drive, or a flash memory. Note that each functional unit of the computer 2, which will be described later, is realized by the CPU 201 reading a program stored in the storage device 203 into the memory 202 and executing it, and each storage unit of the computer 2 may be realized as part of the storage area provided by the memory 202 and the storage device 203.

[0013] FIG. 2 is a diagram showing an example configuration of the HMD 1. The HMD 1 can be worn on the head of the user 4. The HMD 1 includes display devices 11 and 12 that are positioned in front of the left and right eyes of the user 4. The display device 11 displays an image to one eye (the right eye in the example of FIG. 2). The display device 12 displays an image to the other eye (the left eye in the example of FIG. 2). For example, optically transmissive and non-transmissive displays can be used as the display devices 11 and 12. By viewing the images on the display devices 11 and 12 simultaneously with the left and right eyes, the user 4 can visually recognize a virtual space and stereoscopically view objects in the virtual space.

[0014] The HMD 1 also includes cameras 13 and 14 that capture images of the user's eyes. The cameras 13 and 14 may be, for example, infrared cameras. The HMD 1 may also include an infrared light (not shown). For example, the cameras 13 and 14 may capture images of the user 4 shining an infrared light onto their left and right eyes.

[0015] The input device 3 is, for example, a controller, a microphone, a keyboard, a mouse, a touch panel, etc. The input device 3 can support the user in making predetermined inputs within the virtual space. The input device 3 can be configured, for example, as a set of controllers for the left and right hands. The input device 3 can include, for example, an operation trigger button, an infrared LED, a sensor, a joystick, a menu button, etc. The input device 3 can also detect posture and movement using an acceleration sensor (not shown) or the like, and input posture and movement data to the computer 2 as input data.

[0016] 3 is a diagram showing an example of the software configuration of the management server 2. The management server 2 includes a gaze detection unit 211, a placement unit 212, an input unit 213, a test information storage unit 231, and a test result storage unit 232.

[0017] <Storage section> The test information storage unit 231 stores information about tests related to stereoscopic vision (hereinafter referred to as test information). The test information can include placement information of virtual objects (hereinafter referred to as indicators) that are placed in the virtual space and that the user can see in stereoscopic vision, in association with a test ID that identifies the test. The placement information can set what objects are to be placed and in what positional relationship.

[0018] In this embodiment, it is assumed that four (or two, three, or five or more) indices of the same shape are displayed in a virtual space, and one of the four is positioned so that it protrudes (or sinks) from the user's perspective, and a test is conducted to see if the user can recognize the protrusion (or sinking). The four indices can be the same size.

[0019] It is also possible to arrange multiple sets of four (or two, three, or five or more) indicators in one set. In this case, the degree of protrusion (or depression) of one indicator in each set (the distance from the other indicators) can be made different.

[0020] Furthermore, although a plurality of indices of the same shape are arranged in the above embodiment, it is also possible to display a plate-shaped background object and one indices, as in the fly test, and set the distance D1 between the background object and the indices.

[0021] The test result storage unit 232 can store the test ID and information indicating whether or not the user was able to see stereoscopically (stereoscopic vision availability information) in association with information identifying the user who is the subject (user ID). The stereoscopic visibility information can set whether or not the user was able to recognize that the indices were protruding. When multiple sets of indices are arranged, it can be set for each set whether or not the user was able to recognize that the indices were protruding.

[0022] <Functional section> The gaze detection unit 211 detects the gaze of the user. The gaze detection unit 211 can detect the gaze of the user by, for example, analyzing images captured by the cameras 13 and 14. The gaze detection unit 211 can detect the gaze of the user by, for example, acquiring from the cameras 13 and 14 images of the state in which infrared rays from an infrared light are irradiated onto the user's eyes, and analyzing the infrared irradiation position and the positions of the pupil and cornea from the acquired images. The gaze detection unit 211 detects the gaze of each of the right eye and the left eye.

[0023] FIG. 4 is a diagram illustrating the line of sight of each user's eye. As shown in FIG. 4, the line of sight detection unit 211 can detect the line of sight V1 of the right eye and the line of sight V2 of the left eye. It is also possible to detect the intersection of the line of sight V1 of the right eye and the line of sight V2 of the left eye as the gaze point. The line of sight detection unit 211 can detect the line of sight V1, V2 of each eye as a unit vector, for example. Note that general processing can be adopted for the line of sight detection processing. Furthermore, the line of sight detection unit 211 may determine the direction from the HMD 1 facing forward as the line of sight direction without analyzing the line of sight from the user's eyes.

[0024] 5 is a diagram illustrating the user's line of sight. The line of sight detection unit 211 can express, as the user's line of sight, a resultant vector V3 which is the sum of a line of sight V1 of the right eye and a line of sight V2 of the left eye, which are expressed as unit vectors.

[0025] The placement unit 212 places a plurality of objects in a virtual space for a stereoscopic vision test. The placement unit 212 places a first index and also places a second index at a position closer to the user than the first index (i.e., a position protruding from the user). Note that the second index may also be placed at a position farther from the user than the first index (i.e., a position recessed from the user). The second index may be placed at a position shifted in a direction parallel to the user's line of sight.

[0026] FIG. 6 is a diagram illustrating an example of indices to be placed in a virtual space. In the example of FIG. 6, the placement unit 212 displays four indices I1-I4, and can place the indices I1-I4 so that one of them protrudes toward the user. The upper view of FIG. 6 is a front view in the virtual space, and the lower view of FIG. 6 is a top view in the virtual space. The indices I1-I4 are placed, for example, so as to form a diamond shape when viewed from the front. Three of the indices I1-I4 (indices I1, I2, and I4) are placed on plane B, and the remaining one (indicator I3) is placed so as to be spaced a distance D1 apart in the vertical direction of plane B. Note that the number of indices ("4"), the positions of indices I1-I4 on plane B when viewed from the front (which can be expressed, for example, by coordinates on the X and Y axes of plane B), "I3" specifying the spaced indices, the distance D1 by which the indices I3 are spaced apart, and the like can be set in the test information, and the placement unit 212 can place the indices I1-I4 by referring to the test information.

[0027] Fig. 7 is a diagram illustrating the placement of indices. As shown in Fig. 7, indices I1-I4 are placed at distances D21-D24 above, below, left, and right, centered on a straight line L that is an extension of the user's line of sight (composite vector V3). In the examples of Figs. 6 and 7, the distances from the user's line of sight L are the same, but it is sufficient that all indices I1-I4 are placed within a predetermined distance from the line of sight L.

[0028] 8 is a diagram illustrating the display of indices. The placement unit 212 sets a plane B perpendicular to the user's line of sight (straight line L extending from the resultant vector V3) detected by the line of sight detection unit 211, places indices I1, I2, and I4 on the plane B, and places the indices I1-I4 such that the index I3 is moved by a distance D1 in the vertical direction (parallel to the line L) from the plane B.

[0029] When the user's line of sight L changes, the placement unit 212 can also move the indices I1-I4 in accordance with the line of sight L. This makes it possible to more accurately test whether or not stereoscopic vision is possible.

[0030] The arrangement unit 212 can change the size of the index I3 depending on the position of the index I3 (the protruding or recessed distance D1). When the index I3 is closer to the user than the other indices I1, I2, and I4 (when the index I3 is farther away from the plane B toward the user, i.e., when it protrudes toward the user), the arrangement unit 212 can make the size of the index I3 smaller than the other indices I1, I2, and I4, and when the index I3 is farther away from the user than the other indices I1, I2, and I4 (when the index I3 is farther away from the plane B in the direction away from the user, i.e., when it is recessed toward the user), the arrangement unit 212 can make the size of the index I3 larger than the other indices I1, I2, and I4. The arrangement unit 212 can change the size depending on the change in size due to perspective. That is, the size of the index I3 can be made smaller the closer it is to the user and larger the farther it is from the user. The arrangement unit 212 can make the size of the index I3 the same as the other indices even if it protrudes or recesses. The size can be expressed by the length (width and height) on the x- and y-axes on the plane B.

[0031] The input unit 213 accepts input that the positions of the indices I1, I2, I4, and I3 are shifted in the line of sight direction (the distances from the user are different, and stereoscopic vision is possible). The input unit 213 may be configured to accept input only when stereoscopic vision is possible, or may be configured to accept input as to whether stereoscopic vision is possible or not. The input unit 213 can register the input result in the test result storage unit 232.

[0032] <Operation> FIG. 9 is a diagram illustrating the operation of the computer 2.

[0033] The computer 2 detects the lines of sight (unit vectors) V1 and V2 of the left and right eyes (S301), and calculates a resultant vector V3 by adding the vectors V1 and V2 (S302). The computer 2 sets a plane B perpendicular to L, a predetermined distance from the user along a straight line L extending from the resultant vector V3, and places indices I1-I4 on the plane B (S303). The computer 2 then moves one of the indices, I3, in a vertical direction from the plane B (i.e., parallel to L) so that it approaches the user (S304). The computer 2 changes the size of the indices I3 according to the distance moved (S305).

[0034] The computer 2 displays the indices I1-I4 (S306) and can receive input as to whether or not stereoscopic vision is possible (S307).

[0035] As described above, the stereoscopic vision testing system of this embodiment can perform a more detailed stereoscopic vision test.

[0036] According to the stereoscopic vision testing system of this embodiment, a test can be performed with the separation distance D1 changed in multiple stages, allowing a more detailed evaluation of stereoscopic vision ability.

[0037] Although the present embodiment has been described above, the above embodiment is intended to facilitate understanding of the present invention and is not intended to limit the present invention. The present invention may be modified or improved without departing from the spirit thereof, and equivalents thereof are also included in the present invention. [Explanation of symbols]

[0038] 1 HMD 2. Computer

Claims

1. a placement unit that places a first object in a virtual space and places a second object at a position closer to a user than the first object; an input unit that receives an input indicating that the distances of the first and second objects from the user are different; An information processing system comprising:

2. 2. The information processing system according to claim 1, the placement unit changes the size of the second object in accordance with the distance from the user; An information processing system characterized by:

3. 3. The information processing system according to claim 2, The placement unit making the size of the second object smaller than the size of the first object so that the distance from the user to the second object is shorter than the distance from the user to the first object; An information processing system characterized by:

4. 2. The information processing system according to claim 1, the placement unit places the first and second objects within a predetermined distance from the line of sight of the user; An information processing system characterized by:

5. 2. The information processing system according to claim 1, the placement unit moves the first and second objects in accordance with a change in the line of sight of the user; An information processing system characterized by:

6. placing a first object in a virtual space and placing a second object at a position closer to the user than the first object; receiving input indicating that the first and second objects are at different distances from the user; An information processing method characterized by being executed by a computer.

7. placing a first object in a virtual space and placing a second object at a position closer to the user than the first object; receiving input indicating that the first and second objects are at different distances from the user; A program that causes a computer to execute the following.

Images