Information processing system, information processing method and program

Abstract

To provide a system that makes it easy for users to view contents.SOLUTION: An information processing system comprises a video display unit that provides a virtual space to a user by displaying a video on each of display units corresponding to each of the user's left and right eyes, an acuity storage unit that stores the user's acuity, and a magnification processing unit that magnifies the video in accordance with the acuity.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing system, an information processing method, and a program. [Background technology]

[0002] Patent Document 1 discloses a head-mounted display with detachable lenses. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2023-126207 Summary of the Invention [Problem to be solved by the invention]

[0004] The head-mounted display of Patent Document 1 requires that lenses suited to the user's eyesight be prepared.

[0005] The present invention has been made in view of the above background, and aims to provide a technique that enables users to easily view content. [Means for solving the problem]

[0006] The main invention of the present invention for solving the above problem is an information processing system characterized by comprising an image display unit that displays images on display devices corresponding to each of the user's left and right eyes to provide the user with a virtual space, a vision memory unit that stores the user's vision, and an enlargement processing unit that enlarges the image in accordance with the vision.

[0007] Other problems and solutions disclosed in this application will be made clear in the section on preferred embodiments of the invention and the drawings. [Effects of the Invention]

[0008] According to the present invention, it is possible to make it easier for the user to view content. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 illustrates an example of the configuration of an information processing system. [Figure 2] FIG. 2 is a diagram illustrating an example of the configuration of an HMD 1. [Figure 3] FIG. 2 is a diagram illustrating an example of the software configuration of a computer 2. [Figure 4] FIG. 10 is a diagram illustrating the display of dotted lines. [Figure 5] FIG. 2 is a diagram illustrating the operation of the computer 2. DETAILED DESCRIPTION OF THE INVENTION

[0010] An information processing system according to one embodiment of the present invention will be described below. The information processing system of this embodiment has a user wear a head-mounted display (HMD1) and attempts to measure the user's eyesight in a virtual space. The HMD1 may be any wearable device that provides the user with a virtual space, and may be, for example, a glasses-type augmented reality (AR) device (glasses-type display). The HMD1 does not have to be a wearable device, and may also be, for example, a naked-eye stereoscopic display.

[0011] FIG. 1 is a diagram showing an example of the configuration of an information processing system. The information processing system of this embodiment includes a computer 2. The computer 2 is connected to an HMD 1 and an input device 3, can receive data input from the input device 3, and can control the display of images on the HMD 1. As shown in FIG. 1, the computer 2 may include a CPU 201, a memory 202, and a storage device 203. The storage device 203 stores various data and programs, and is, for example, a hard disk drive, a solid-state drive, or a flash memory. Note that each functional unit of the computer 2, which will be described later, is realized by the CPU 201 reading a program stored in the storage device 203 into the memory 202 and executing it, and each storage unit of the computer 2 may be realized as part of the storage area provided by the memory 202 and the storage device 203.

[0012] The input device 3 is, for example, a controller, a microphone, a keyboard, a mouse, a touch panel, etc. The input device 3 can support the user in making predetermined inputs within the virtual space. The input device 3 can be configured, for example, as a set of controllers for the left and right hands. The input device 3 can include, for example, an operation trigger button, an infrared LED, a sensor, a joystick, a menu button, etc. The input device 3 can also detect posture and movement using an acceleration sensor (not shown) or the like, and input posture and movement data to the computer 2 as input data.

[0013] The computer 2 displays content on the HMD 1.

[0014] FIG. 2 is a diagram showing an example configuration of the HMD 1. The HMD 1 can be worn on the head of the user 4. The HMD 1 includes display devices 11 and 12 that are positioned in front of the left and right eyes of the user 4. The display device 11 displays an image to one eye (the right eye in the example of FIG. 2). The display device 12 displays an image to the other eye (the left eye in the example of FIG. 2). For example, optically transmissive and non-transmissive displays can be used as the display devices 11 and 12. The user 4 can view the virtual space by viewing the images on the display devices 11 and 12 with both eyes simultaneously.

[0015] 3 is a diagram showing an example of the software configuration of the computer 2. The computer 2 can include an image display unit 211, an object display unit 212, a gaze detection unit 213, an enlargement processing unit 214, a visual acuity measurement unit 215, a content storage unit 231, and a visual acuity storage unit 232.

[0016] The content storage unit 231 stores content to be viewed by the user. The content may be, for example, video data. The content may be, for example, information that defines the behavior of 3D model data.

[0017] The visual acuity storage unit 232 stores the visual acuity of the user. The visual acuity storage unit 232 stores information related to the visual acuity of the user (hereinafter referred to as visual acuity information). The visual acuity information can include the user's spherical power, cylindrical power, astigmatism axis, and spherical equivalent power in association with information identifying the user (user ID).

[0018] The video display unit 211 provides a virtual space to the user. The video display unit 211 displays images on the display devices 11 and 12 corresponding to the left and right eyes of the user, respectively, and can provide the user with a virtual space by enabling stereoscopic viewing using parallax.

[0019] The object display unit 212 displays objects in a virtual space. The objects may include a main object and sub-objects. The main object may be, for example, a character, and the sub-object may be, for example, a background. The object display unit 212 can place an object by specifying a position in a coordinate system within the virtual space using a known method.

[0020] The gaze detection unit 213 detects the gaze of the user. A known method can be used for the gaze detection process. For example, the gaze detection unit 213 can detect the gaze by detecting multiple reflection points of infrared light irradiated onto the user's eyes.

[0021] The magnification processing unit 214 magnifies the image in accordance with the user's visual acuity. The magnification processing unit 214 can magnify the image in accordance with the user's spherical power and / or spherical equivalent power.

[0022] The enlargement processing unit 214 may enlarge the object in accordance with the user's visual acuity. The enlargement processing unit 214 can control (for example, instruct the object display unit 212) to bring the object closer to the user in accordance with the user's visual acuity. The enlargement processing unit 214 may enlarge the main object in accordance with the visual acuity, but not enlarge the sub-objects. The enlargement processing unit 214 may enlarge the object located on the line of sight. For example, the enlargement processing unit 214 can control all objects located at positions intersecting the detected line of sight to bring them closer to the user in accordance with the spherical power and / or equivalent spherical refractive power.

[0023] The enlargement processing unit 214 may deform the image according to the user's cylindrical power. The enlargement processing unit 214 can also deform the object according to the user's cylindrical power. The enlargement processing unit 214 can stretch or shrink the object in a direction according to the astigmatic axis and by a degree according to the cylindrical power according to the user's astigmatic axis and cylindrical power.

[0024] The visual acuity measurement unit 215 measures the user's visual acuity. The visual acuity measurement unit 215 can display an object at a predetermined distance from the user in the virtual space and move the object away from the user or reduce its size until the object is no longer visible to the user. Alternatively, the visual acuity measurement unit 215 can move the object closer to the user or increase its size until the object is visible to the user. The visual acuity measurement unit 215 can display an index such as a Landolt ring as an object. The visual acuity measurement unit 215 can estimate the user's binocular visual acuity (spherical power) based on the position or size of the object. Whether the user can see the object can be determined by receiving input from the user. For example, when a Landolt ring is displayed, the visual acuity measurement unit 215 can receive input on the direction of the slit in the Landolt ring and determine whether the object is visible based on whether the input is correct. The visual acuity measurement unit 215 can register the estimated spherical power in the visual acuity memory unit 232.

[0025] The visual acuity measurement unit 215 can also measure the degree of astigmatism. For example, the visual acuity measurement unit 215 displays dotted lines on the top, bottom, left, and right as indicators. FIG. 4 is a diagram illustrating the display of dotted lines. The visual acuity measurement unit 215 can display a dotted line 52 (first dotted line) extending in the up-down direction and a dotted line 53 (second dotted line) extending in the left-right direction as indicators. The dotted lines 52 and 53 are arranged on the plane of the indicator (Landolt ring). For eyes without astigmatism, the dotted lines 51 and 52 on the top, bottom, left, and right are perceived as dotted lines with equal intervals, as in the visual field 51 of FIG. 4. In the case of astigmatism, the dotted lines 52 and / or 53 appear as solid lines (or the intervals between the dotted lines are narrow), as in the visual field 54 of FIG. 4. When either the dotted lines 52 or 53 appear to the user as a solid line (or the spacing between the dotted lines is narrow), the visual acuity measurement unit 215 deforms the indicators (all dotted lines) by enlarging them in the direction of the solid line or the dotted line with the narrow spacing so that both the dotted lines 52 and 53 appear to the user as dotted lines (dotted lines with the same spacing). The example in FIG. 4 shows that the dotted line 52-1 in the vertical direction appears as a solid line in the visual field 54. In this case, as shown in the visual field 54-1, by extending the dotted line 52 in the vertical direction, even an astigmatic eye can perceive the dotted line 52 as a dotted line. Note that the visual acuity measurement unit 215 may change the length (lengthen in the example in FIG. 4) of the dotted line perpendicular to the direction of expansion / contraction (the dotted line 53 in the horizontal direction in the example in FIG. 4) so ​​that the aspect ratio of the indicator remains constant (1:1 in the example in FIG. 4). The visual acuity measurement unit 215 can also display dotted lines extending in diagonal directions in addition to the dotted lines in the vertical and horizontal directions. Similarly to the above, the index (all dotted lines) can be deformed so that all dotted lines, up, down, left, right, and diagonal, are perceived as dotted lines, and the solid lines or dotted lines are aligned in a direction that makes the intervals between the dotted lines appear shorter. The visual acuity measurement unit 215 can determine the user's cylindrical power according to the degree of deformation of the index. A function can be set in advance to represent the relationship between the degree of deformation of the index and the cylindrical power. In addition, a learning model that has been trained by machine learning on the relationship between the deformation power and the cylindrical power measured using conventional methods can be prepared, and the visual acuity measurement unit 215 can estimate the cylindrical power by providing the deformation power to the learning model.The relationship between the deformation power, deformation direction, and cylinder power may be set by a function or may be learned by machine learning. The vision measurement unit 215 can determine the astigmatic axis based on the deformation direction. The vision measurement unit 215 can calculate the equivalent spherical power based on the spherical power and the cylindrical power. The equivalent spherical power can be calculated by adding half the cylindrical power to the spherical power. The vision measurement unit 215 can register the calculated cylindrical power, astigmatic axis, and equivalent spherical power in the vision memory unit 232.

[0026] <Operation> FIG. 5 is a diagram illustrating the operation of the computer 2.

[0027] The computer 2 registers the input of the user's visual acuity (S301), plays back the content (S302), and enlarges the content in accordance with the visual acuity (S303).

[0028] As described above, according to the information processing system of this embodiment, the content can be enlarged and displayed in accordance with the user's eyesight, making it easier for the user to view the content.

[0029] Although the present embodiment has been described above, the above embodiment is intended to facilitate understanding of the present invention and is not intended to limit the present invention. The present invention may be modified or improved without departing from the spirit thereof, and equivalents thereof are also included in the present invention.

[0030] For example, the processing by each of the functional units of the computer 2 described above may be performed by any of the functional units. Also, a different functional unit that performs part of the processing by each of the functional units described above may be added. Also, the functional units of the computer 2 may be distributed among multiple computers.

[0031] The storage unit of the computer 2 may be implemented in an external storage device. [Explanation of symbols]

[0032] 1 HMD 2. Computer

Claims

1. an image display unit that displays images on display devices corresponding to the left and right eyes of the user, respectively, to provide the user with a virtual space; a visual acuity storage unit that stores the user's visual acuity; an enlargement processing unit that enlarges the image in accordance with the visual acuity; An information processing system comprising:

2. 2. The information processing system according to claim 1, an object display unit that displays an object in the virtual space; the enlargement processing unit enlarges the object in accordance with the visual acuity; An information processing system characterized by:

3. 3. The information processing system according to claim 2, The objects include a main object and a sub-object, the enlargement processing unit enlarges the main object in accordance with the visual acuity; An information processing system characterized by:

4. 2. The information processing system according to claim 1, a gaze detection unit that detects the user's gaze; an object display unit that displays an object in the virtual space, the enlargement processing unit enlarges the object disposed on the line of sight in accordance with the visual acuity; An information processing system characterized by:

5. The computer memorizing the user's visual acuity; displaying images on display devices corresponding to the left and right eyes of the user, respectively, to provide the user with a virtual space; Enlarging the image in accordance with the visual acuity; An information processing method comprising:

6. On the computer, storing the user's visual acuity; a step of displaying an image on each of display devices corresponding to the left and right eyes of the user, respectively, to provide the user with a virtual space; enlarging the image according to the visual acuity; A program to execute.

Images