VR or mr goggle system, VR or mr goggles, method, and program

Abstract

These VR or MR goggles are provided with a VR display unit (10) and a holding unit (2) having a means for fixing the VR display unit to a face or a head in order to display a VR video generated by a VR display control unit (11) from input information including at least VR display data and 6DoF information independently for left and right eyes. The VR display unit comprises two left and right lens barrel units (3) each including at least one lens (4) and a display panel (5), an eyeball position measurement means (6) for measuring the position of the eye and the positional relationship and distance between the eye and the lens in a lens barrel, and an adjustment means (9) for measuring a vertex distance that is the distance between the eye of a user and the lens closest to the eye of the user in the lens barrel unit using the eyeball position measurement means, and adjusting the distance between the lens barrel unit and the eyeball such that the measurement result matches a design target value.

Description

VR or MR goggle system, VR or MR goggle, method, and program

[0001] The present disclosure relates to a VR or MR goggle system, a VR or MR goggle, a method, and a program.

[0002] The present disclosure relates to a VR or MR goggle system, VR or MR goggles, method, and program that enables the user to correctly perceive the size and distance of objects in a VR space by adjusting the positional relationship between the eyes and lenses.

[0003] Furthermore, the present disclosure relates to a VR or MR goggle system, VR or MR goggles, method, and program that realizes virtual glasses functions by setting one's own corrective vision information (glasses prescription information) in the head-mounted display, thereby mitigating issues when glasses users use a head-mounted display and enabling the head-mounted display to be used without glasses.

[0004] FIG. 30A shows a schematic diagram of a large head-mounted display (VR goggles or MR goggles), and FIG. 30B shows a schematic diagram of a small head-mounted display (VR goggles or MR goggles). In the case of the large head-mounted display of FIG. 30A, the distance between the vertices 41 is wide (about 30 to 40 mm), so space 42 for eyeglasses can be secured. Therefore, it can be used while wearing eyeglasses.

[0005] The advantage of a large head-mounted display is that you can use your own glasses, so there is no need for a mechanism to adjust it to each person's corrective vision. Also, because the lens panel is large, it is easy to enlarge the sweet spot. Therefore, there are fewer issues with the position of the display.

[0006] The drawback is that the distance between the eye and the lens increases, so if the same size lens panel is used, the field of view (FoV) becomes smaller. To maintain the size of the FoV, the lens panel must be enlarged, which makes the main body 1 larger and heavier.

[0007] Furthermore, if you use the head-mounted display while wearing glasses, the glasses may be distorted by being pressed against the display, making it impossible to see with corrected vision. Furthermore, the display may become cloudy due to sweat or other factors, and the glasses or temples may be pressed against the display, causing discomfort such as pain.

[0008] In the case of the small head-mounted display of Figure 30B, the vertex distance 41 is narrow (approximately 12 to 17 mm), so as shown in Figure 30A, it is not possible to secure space 42 for glasses, making it difficult to use while wearing glasses.

[0009] For this reason, a function that can replace glasses is required. The advantage of a small head mounted display is that the main body 1 can be made small, making it possible to realize a small and lightweight device.

[0010] The drawback is that, as a substitute for eyeglasses, it is necessary to create adapter lenses specifically for each individual, or to have a means of reproducing some of the functions of eyeglasses, such as the focus adjustment function.

[0011] In addition, because the lens magnification is high and the lens itself is small, the sweet spot tends to be small. Therefore, if you do not use it with your eyes in the correct position, you may not be able to see the VR image correctly.

[0012] In order to fully utilize VR, it is necessary to achieve high image quality (resolution, contrast, color space, frame rate, etc.) equivalent to that of a high-end PC monitor, while also being compact and lightweight to reduce the mental and physical burden (weight, size, wearability) when wearing it. Figure 31 shows a comparison table of the performance of display panels required for head-mounted displays (VR or MR).

[0013] Previously, there was no small, high-quality display panel technology. Recently, micro-display technologies such as micro-OLED have been put into practical use. By using this micro-OLED panel, it has become possible to achieve both small size and high image quality.

[0014] As shown in Figure 31, it is possible to achieve high-quality VR goggles with a resolution of 30 PPD (pixels per degree) or more with either an LCD panel or a micro-OLED panel. (In the case of a micro-OLED panel, a panel with a resolution of 3000 PPI (pixels per inch) is possible.) However, in order to achieve both compactness and high image quality, it is currently difficult to achieve this without using a micro-OLED panel.

[0015] Small head-mounted displays that combine compact size with high image quality are extremely convenient for those with normal vision or contact lens wearers. However, they cannot be used while wearing eyeglasses, so they must be adapted for eyeglass wearers. Currently available small VR goggles have focus adjustment and interchangeable lens attachment functions as an alternative to eyeglasses.

[0016] When eyeglass wearers use their own small head-mounted display, special lenses can be made to fit their eyeglass prescription and fitted in the correct position, allowing for comfortable use.

[0017] When head-mounted displays are used for work, they are often shared. In this case, each person cannot keep their own dedicated lenses attached to the shared head-mounted display, so they have to put on and take off their dedicated lenses every time, which is cumbersome and impractical.

[0018] An example of shared use of head-mounted displays is when automobile companies or construction design companies use VR to check products created with 3D-CAD. In this case, the head-mounted display must be shared among multiple employees, superiors, and customers to check the design.

[0019] Other examples include the use of head-mounted displays at theme parks and museums, and viewing real estate (apartment) properties, where an unspecified number of customers use VR to check out items for sale such as cars and cruisers.

[0020] Therefore, in order to use small VR goggles for business purposes, a mechanism equivalent to shared glasses for each person (such as a focus adjustment function) is required, and this usability contributes to improving the utilization efficiency of head-mounted displays.

[0021] For example, Reference Web Material 1 discloses an example of using eye-tracking technology to improve the wearing condition. Also, Patent Document 1 discloses a method of substituting glasses within a head-mounted display.

[0022] Special Publication No. 2022-553629 References

[0023] (Reference Web Material 1) https: / / www.tobii.com / en / solutions / extended-reality / device-optimization

[0024] The present disclosure aims to provide a VR or MR goggle system, VR or MR goggles, method, and program that solve the following two problems.

[0025] In order to correctly perceive size and distance, the head-mounted display must be used in a situation where the eyes and the lenses are positioned correctly.

[0026] Small goggles cannot accommodate eyeglasses, so they cannot be used without an alternative to eyeglasses. Therefore, it is necessary to provide an alternative.

[0027] However, while Reference Web Material 1 discloses an example of using eye-tracking technology to improve wearing conditions by correcting interpupillary distance and vertical position, there is a risk that the sense of size and distance of objects in the VR space cannot be reproduced because the distance between vertices is not corrected.

[0028] Furthermore, the device of Patent Document 1 is configured to change the optical characteristics of the lens itself, and therefore may not be able to appropriately accommodate the various eye characteristics of users.

[0029] To clarify these two issues, we will first discuss the positional relationship between the eyeglass lenses and the eyes using Figure 32. Then we will discuss the issues with head-mounted displays.

[0030] 32A shows the interpupillary distance 44 and pupillary horizontal line 43, which are eye information to be considered in eyeglasses and head-mounted displays. The pupillary horizontal line 43 is a horizontal line connecting the centers of the left and right pupils, and the interpupillary distance 44 (PD) is the distance from the vertical center line of the nose to the centers of the left and right pupils, and is measured separately for each eye during a vision test (although in eyeglass prescriptions and VR, only the total value may be used).

[0031] Figures 32B and 32C show the relationship between the structure of the eye and eyeglasses, which should be taken into consideration when creating eyeglasses (eyeglass prescriptions) for each individual. The line of sight 45 is not directed toward the horizon, but is directed slightly downward. This angle is called the forward tilt angle θ50. Eyeglasses are designed so that the line of sight 45 is perpendicular to the optical center point 52 of the eyeglass lenses 69. For distance glasses, this forward tilt angle θ50 is set to 5 degrees (regular use: 5-10 degrees, near use: 10-15 degrees; VR goggles are designed for use with distance glasses).

[0032] The eyeglass lens 69 is tilted by a forward tilt angle θ50. Therefore, the position of the optical center line 51 of the lens in the vertical direction is different from the pupil horizontal line 43. This shifted distance is called the deviation amount 47. This deviation amount 47 is calculated as follows:

[0033] In Japan, the vertex distance k48 is normally set to 12 mm (glasses must be worn so that the distance is 12 mm in order to achieve correct vision). Since the distance e49 between the centers of rotation is 13 mm, the deviation h47 is calculated by the formula h = (k + e) ​​× tan(θ) as follows: (0.0012 + 0.0013) × tan(5°) = 0.00022, or h = 2.2 mm.

[0034] 32D shows the positional relationship between the eyeglasses and the eyes. The vertical positional relationship is set so that the optical center line 51 (the line connecting the optical center points of the two eyeglass lenses) is 2.2 mm below the pupil horizontal line 43 because the deviation amount h47, which is the distance between the pupil horizontal line 43 and the optical center line 51 (the line connecting the optical center points of the two eyeglass lenses), is 2.2 mm. The vertical positional relationship is determined by the eyeglasses being manufactured so that the line of sight 45 is perpendicular to the optical center point 52 of the eyeglass lenses, and therefore the horizontal distance between the centers of the left and right lenses of the eyeglasses is determined by the interpupillary distance 44.

[0035] As described above, the eyeglasses are designed so that the positional relationship in the depth direction is such that the vertex distance k48 is fixed at 12 mm, the left and right are at the interpupillary distance 44, and the top and bottom are 2.2 mm below the pupillary horizontal line 43.

[0036] As a wearable visual augmentation device that uses lens technology, head-mounted displays also require the same consideration as eyeglasses regarding the lenses and the positional relationship between the lenses and eyeglasses.

[0037] Figure 1 shows the basic structure of a head-mounted display and its relationship to the eyes.

[0038] 1A is a schematic diagram showing the basic structure of a head-mounted display. The head-mounted display is composed of three parts: a lens barrel 3 (comprising a display panel, a lens group, etc.) for displaying images corresponding to the left and right eyes, a main body 1 for holding each lens barrel 3 and generating VR images to send them to the lens barrel 3, and a holder 2 (face pad, etc., that doubles as a shielding means) for attaching the head-mounted display to the face.

[0039] FIG. 1B shows the configuration of an integrated head-mounted display, and FIG. 1C shows a two-body configuration in which the VR display control unit 11 is placed in an external device such as a PC.

[0040] In the case of a TV or smartphone display, the displayed image enters the eye directly, so you see a real image. In contrast, in the case of a head-mounted display, you do not see the image displayed on the display panel 5 as is, but rather see the objects in the VR space projected onto the display panel 5 through the lens 4. In other words, you see a virtual image through the lens 4. Therefore, the image displayed on the display panel 5 is affected by the lens 4 before being projected onto the retina of the eye.

[0041] The lens(es) of the head-mounted display are configured as a lens barrel, taking into account the relationship between the display panel 5 and the lens 4, and the positional relationship between the lens and the eye. When using the head-mounted display, it is designed on the premise that the optimal vertex distance 41 is calculated from the positional relationship and the focal length of the lens so that the line of sight 45 and the optical center point 52 of the lens coincide. For this reason, if the eyes and lens 4 are not positioned correctly when viewing, objects in the VR space will appear distorted, and the size and sense of distance of the object will not be reproduced correctly (because the size (viewing angle) of the virtual image of the object will differ due to the influence of the lens, etc.).

[0042] 1D shows the case where the head-mounted display is worn on the face. The parts of the holder 2 that are worn on the face or head (such as the face pad) are made of soft materials, allowing them to accommodate different facial shapes. When wearing the head-mounted display, the size and sense of distance of objects in the VR space will not be reproduced correctly unless the VR space is viewed in a position where the line of sight 45 and the optical center point 52 of the lens coincide with each other and the positional relationship between the eyes and the lens is set to the vertex distance 41 assumed in the design.

[0043] However, if the positional relationship is such that the line of sight and the optical center of the lens coincide, even if the vertex distance 41 in the lens design varies slightly, the shape of the object will be almost clearly visible (however, the sense of size and distance will not be correct) as long as it is within the eyebox of lens 4 (the range in which it can be seen clearly), so in practice this may not be a major problem, and the user will not know whether they are looking at it at the correct distance.

[0044] The electrical and system components of a head-mounted display are contained in the main body 1 and its main part, the lens barrel 3, but in order to obtain the correct wearing position, the design of the holder 2 is extremely important in order to match the different shapes of each person's head and face (eyes, nose, ears). It is also important to guide the user to the correct position by providing feedback after wearing to see if the device is properly fitted, or by using a means for fine-tuning the relative positions of the lens barrel 3, main body 1, and holder 2.

[0045] Figure 33 shows the positional relationship between the head-mounted display and the eyes. In the case of a head-mounted display, as with the glasses in Figure 32, the VR space can be viewed correctly when the line of sight passes perpendicularly through the optical center point 52 of the lens of the head-mounted display. If there is a misalignment, the sense of size and distance may appear inappropriate, and the space may appear distorted.

[0046] 33A shows the main body 1 of the head-mounted display as seen from the wearing side (lens side). The two lens barrels 3 connected to the main body 1 can be moved left and right to align the optical center points 52 of the lenses 4 with the centers of the user's eyes.

[0047] 33B shows the relationship between the optical center points 52 of the lenses 4 and the pupil center points. In the "before adjustment" diagram on the left, the optical center points 52 of the left and right lenses 4 are located below the pupillary horizon 43, and the interpupillary distance 44 does not match the distance between the optical center points 52 of the left and right lenses 4. This makes it impossible to view the VR space correctly.

[0048] As shown in the "after adjustment" diagram on the right, by moving the lens barrel 3 so that the optical center points 52 of the left and right lenses 4 coincide with the pupil centers of the left and right eyes, it is necessary to adjust the distance between the optical center points 52 of the left and right lenses 4 to the interpupillary distance 44. Furthermore, by changing the positional relationship between the main body 1 and the holder 2, or by moving the holder 2 to change the wearing position, it is possible to bring the vertical positional relationship into the correct position.

[0049] Fig. 33C is a schematic diagram of a case where a user wears a head-mounted display. Even if the vertical and horizontal relationships are correct as in "after adjustment" in Fig. 33B, if the vertex-to-vertex distance 41 differs from the vertex-to-vertex distance of the design value of the head-mounted display, the user will be viewing with an incorrect sense of size, distance, and FoV, as shown in Fig. 34, and will no longer be able to sense an incorrect sense of size or distance.

[0050] Problem 1 to be solved will be explained with reference to FIG.

[0051] In the case of large head-mounted displays, the lens and panel are large, so the lens magnification is relatively small and it is easy to enlarge the sweet spot. This can reduce issues related to wearing position to some extent. In addition, since the eye box is large in terms of the distance between the eyes and the lenses, it is possible to view clear VR images within a certain range.

[0052] Compact VR goggles often have small lens panels, which means the lens magnification is relatively large and the sweet spot (eye box) is narrow. Therefore, when using compact VR goggles for VR experiences, issues regarding the wearing position are more likely to arise.

[0053] 34A shows a case where the actual vertex distance 41 is adjusted to the vertex distance 54 of the lens 4 design value using a depth distance adjustment mechanism or the like. In this case, the VR space can be viewed with the FoV at the time of design. In this case, the sense of size and distance can also be viewed correctly.

[0054] 34B shows the case where viewing is performed at a vertex distance of 56, which is closer than the design value of vertex distance 54. In this case, the FoV appears wider, but the image actually displayed on the display panel 5 does not change, so the FoV displayed in the VR space does not change, and a distorted VR space image is seen. Furthermore, because objects appear larger, the size of the objects appears larger and the sense of distance seems smaller, creating an unnatural feeling.

[0055] 34C shows the case where viewing is performed at a vertex distance of 58, which is farther than the design value of vertex distance 54. In this case, the FoV is narrower than the design value of the head-mounted display, resulting in a distorted VR space image. In addition, the size of objects appears smaller and the distance appears greater, creating an unnatural feeling.

[0056] Therefore, it is important to measure the distance between vertices and guide the head-mounted display to the optimal distance between vertices designed for the head-mounted display after wearing it, but there have been no examples of VR goggles with this function to date.

[0057] FIG. 35 shows the difference in configuration between the VR system and the MR system.

[0058] 35A is a schematic diagram of a VR system. The VR system is composed of an input means 65, a VR display control unit 11, and a VR display unit 10.

[0059] 35B shows a schematic diagram of an MR system (VST: Video See-Through system). The MR system has a VST input means 34 and a VST video synthesis means 36 in addition to the three components of the VR system.

[0060] 35C shows an example of MR image synthesis in an MR system. A VST input image 66 input from the VST input means 34 and a 3D spatial image 67 (an image capable of alpha blending) generated by the VR display control unit 11 are synthesized by the VST image synthesis means 36 to generate an MR synthesized image 68, which is sent to the VR display unit 10 and played back.

[0061] The MR composite image 68 obtained by combining the VST input image 66 input from the VST input means 34 and the 3D space image 67 generated by the VR display control unit 11 is synthesized using digital image processing, so as long as the axes and size of the 3D space obtained from the VST input means 34 match the axes and size of the 3D space of the 3D space image generated by the VR display control unit 11, there will be no inconsistency between the real space in the synthesized image and the size and sense of distance of the 3D objects.

[0062] However, after the synthesized MR composite image 68 is reproduced on the VR display unit 10, the user views it through the lenses, and is therefore affected by the wearing position and the distance between the vertices.

[0063] The issue shown in Figure 34 (the problem of the eyes (head) not correctly perceiving the sense of size and distance of the space because the VR space is not viewed with the optimal vertex distance at the time of design) becomes more serious when using MR goggles (VST: Video See-Through method).

[0064] FIG. 36 shows the problem in the case of MR goggles.

[0065] As shown in FIG. 36A, when viewing with the optimal vertex distance at the time of design (in the case of FIG. 34A), the real space and the digital MR space appear to be the same size.

[0066] As shown in Fig. 36B, when the distance between vertices is narrower than the optimum distance at the time of design (as in Fig. 34B), the digital MR space appears larger than the real space. Therefore, the sense of size does not match.

[0067] As shown in Fig. 36C, when the distance between vertices is wider than the optimum distance at the time of design (as in Fig. 34C), the digital MR space appears smaller than the real space. Therefore, the sense of size does not match.

[0068] If viewing is not possible at the optimal vertex distance, the displayed image will differ from the brain's sense of distance, and therefore when wearing MR goggles and moving around or operating machinery, the difference in size and sense of distance may prevent the user from correctly recognizing the distance to objects in real space, which could make it difficult to operate objects or walk around them.

[0069] Therefore, in the case of MR goggles, it is even more important to measure the distance between the vertices and guide the wearer to the optimal distance between the vertices when using them. However, there have been no examples of this in the past.

[0070] Problem 2 that the invention aims to solve will now be described.

[0071] Wearing a large head-mounted display for a long period of time can cause neck and shoulder fatigue due to its weight, and it is also inconvenient to carry around. For this reason, in order to popularize VR use, a high-quality, compact, lightweight head-mounted display is needed.

[0072] By adopting microdisplay technology (such as microOLED displays), it has become possible to manufacture small, lightweight, and high-quality head-mounted displays. However, when using a small head-mounted display to experience VR / MR, users who normally wear glasses cannot use the small head-mounted display while still wearing their glasses.

[0073] However, users who normally wear glasses would like to be able to experience VR / MR using a small head-mounted display while maintaining the same corrected vision as when wearing their glasses.However, currently, users have to create their own adapter lenses based on their glasses prescription and attach them to the head-mounted display, or adjust the focus adjustment function of the small head-mounted display to suit their own vision to some extent.

[0074] If eyeglass wearers could input their eyeglass prescription information and corrective vision information (lens information, etc.) for the eyeglasses they are currently using into a small head-mounted display, and the head-mounted display could then create virtual eyeglasses based on that information within the head-mounted display, it would be easier for eyeglass wearers to use small head-mounted displays, but such a head-mounted display did not exist.

[0075] The head-mounted display according to the present disclosure provides the following four means for solving the two problems to be solved.

[0076] For problem 1, "Unless the head-mounted display is worn so that the eyes are positioned as intended by the design of the head-mounted display (interpupillary distance, relationship between the pupillary horizon and the lens center point, distance between vertices, etc.), it is not possible to see with the intended sense of size and distance," the following solution is provided.

[0077] (1) In order to set the positional relationship as intended by the design, the positional relationship between the lens 4 in the lens barrel 3 and the eyeball is monitored using a technology such as eye tracking that measures the eyeglass position and the distance between the vertices, and if the current eye position differs from the design intention, a guidance screen is displayed on the display panel of the head-mounted display, allowing the user to correct the position using various adjustment functions in three axes (up / down, left / right, and depth), or the head-mounted display is automatically moved to the appropriate positional relationship by controlling the electric movement means of the head-mounted display instead of the user.

[0078] Regarding issue 2, "Small goggles cannot accommodate glasses, so mitigation measures are necessary for users who wear glasses," glasses users normally wear glasses (concave or convex lenses) to view the real world, so the size of objects and the sense of distance (viewing angle) are different from those of people with normal vision. Since the VR space (3D space) is generated assuming normal vision, additional functions are required to reproduce the sense of size, so we offer the following three solutions.

[0079] (2) A solution using a diopter adjustment mechanism that does not change the positional relationship (vertex distance) after it has been set to the intended design positional relationship

[0080] (3) A solution using a mechanism that switches VR space generation parameters such as distortion correction, taking into account the thickness of the adapter lens and shift lens.

[0081] (4) A solution to realize virtual glasses functionality within a head-mounted display based on eyeglass prescription information

[0082] (4) The virtual glasses function is a function that realizes functions equivalent to those of glasses within the head-mounted display in order to increase the convenience of head-mounted displays for glasses users (nearsighted and farsighted people). By inputting one's own glasses prescription into the head-mounted display and using the various setting functions of the head-mounted display, the user can experience VR while maintaining the same corrected vision as when wearing glasses.

[0083] Specifically, in addition to the function of wearing the glasses at the position intended by the design (1), the interpupillary distance adjustment means is set using the interpupillary distance value in the eyeglass prescription, the diopter adjustment function is set using the D value of the spherical lens in the eyeglass prescription, and if astigmatism correction is required, a function to correct regular astigmatism using cylindrical lens correction and mild strabismus correction using prism correction are provided.

[0084] According to the present disclosure, it is possible to provide an MR / VR viewing experience with the correct size and distance, and to display images that suit the characteristics of the user's eyes to users who wear glasses.

[0085] [Correction based on Rule 91 01.10.2024] FIGS. 1A to 1D are schematic diagrams of a head-mounted display illustrating an overview of the present disclosure. FIGS. 2A and 2B are diagrams illustrating an example (Type 1) of a configuration of a head-mounted display according to the present disclosure. FIGS. 3A and 3B are diagrams illustrating an example (Type 2) of a configuration of a head-mounted display according to the present disclosure. FIGS. 4A and 4B are diagrams illustrating an example (Type 3) of a configuration of a head-mounted display according to the present disclosure. FIGS. 5A and 5B are diagrams illustrating an example (Type 1) of a configuration of a head-mounted display (MR goggles) according to the present disclosure. FIGS. 6A and 6B are diagrams illustrating an example (Type 1) of a configuration of a head-mounted display according to the present disclosure, to which a diopter adjustment unit is added. FIGS. 7A and 7B are diagrams illustrating an example (Type 2) of a configuration of a head-mounted display according to the present disclosure, to which a diopter adjustment unit is added. 8A and 8B are diagrams showing an example in which a diopter adjustment means is added to the configuration of one embodiment (Type 3) of the head-mounted display of the present disclosure. FIGS. 9A and 9B are diagrams showing an example in which a diopter adjustment means is added to the configuration of one embodiment (Type 1) of the head-mounted display of the present disclosure. FIGS. 10A and 10B are diagrams showing an example in which a diopter adjustment means using an additional lens is added to the configuration of one embodiment (Type 1) of the head-mounted display of the present disclosure. FIGS. 11A and 11B are diagrams showing an example in which an additional lens (shift lens) is added to the configuration of one embodiment (Type 1) of the head-mounted display of the present disclosure. FIG. 12 is a diagram showing an example in which a user information storage means is added to the configuration of one embodiment (Type 1) of the head-mounted display of the present disclosure. FIG. 13 is a diagram showing an example in which an additional lens attachment means is added to the configuration of one embodiment (Type 1) of the head-mounted display of the present disclosure. 14A and 14B are diagrams showing an example of the configuration of a head-mounted display according to the present disclosure (an example having an additional lens and multiple distortion corrections), and 15A and 15B are diagrams showing an example of the configuration of a head-mounted display according to the present disclosure (an example having an additional lens and a spherical lens correction means and multiple distortion corrections).16A and 16B are diagrams showing an example of the configuration of a head-mounted display according to the present disclosure (an example of MR goggles having an additional lens and multiple distortion corrections). FIGS. 17A and 17B are diagrams showing an example of the configuration of a head-mounted display according to the present disclosure (an example of MR goggles having an additional lens and a spherical lens correction means and multiple distortion corrections). FIG. 18 is a diagram showing an example of the configuration of a head-mounted display with a virtual glasses function according to the present disclosure (with a spherical lens adjustment means). FIG. 19 is a diagram showing an example of the configuration of a head-mounted display with a virtual glasses function according to the present disclosure (with an additional lens attached and a spherical lens adjustment means). FIG. 20 is a diagram showing an example of the configuration of a head-mounted display with a virtual glasses function according to the present disclosure (MR goggles with a spherical lens adjustment means). FIG. 21 is a diagram showing an example of the configuration of a head-mounted display with a virtual glasses function according to the present disclosure (MR goggles with an additional lens attached and a spherical lens adjustment means). FIG. 22 is a diagram showing an example of the configuration of a head-mounted display with a virtual glasses function according to the present disclosure (with astigmatism correction). FIG. 23 is a diagram showing an example of the configuration of a head-mounted display with a virtual glasses function of the present disclosure (MR goggles with astigmatism correction). FIG. 24 is a diagram showing an example of the configuration of a head-mounted display with a virtual glasses function of the present disclosure (another example of MR goggles with astigmatism correction). FIG. 25 is a diagram showing an example of the configuration of a head-mounted display with a virtual glasses function of the present disclosure (with strabismus correction). FIG. 26 is a diagram showing an example of the configuration of a head-mounted display with a virtual glasses function of the present disclosure (MR goggles with strabismus correction). FIG. 27 is a diagram showing an example of the configuration of a head-mounted display with a virtual glasses function of the present disclosure (with user information storage means). FIG. 28 is a diagram showing an example of the configuration of a head-mounted display with a virtual glasses function of the present disclosure (MR goggles with user information storage means). FIG. 29 is a diagram showing an example of the configuration of a head-mounted display with a virtual glasses function of the present disclosure (with user information storage means and strabismus correction). FIGS. 30A and 30B are schematic diagrams of a large head-mounted display and a small head-mounted display.Figure 31 is a comparison table of display panel performance requirements for head-mounted displays. Figures 32A to 32D are diagrams showing the positional relationship between eyeglass lenses and eyes. Figures 33A to 33C are diagrams showing the positional relationship between a head-mounted display and eyes. Figures 34A to 34C are diagrams showing issues related to the distance between the eyes and lenses. Figures 35A to 35C are diagrams showing the differences in configuration between VR systems and MR systems. Figures 36A to 36C are diagrams showing issues with MR goggles. Figure 37 is a table showing methods for attaching a head-mounted display to the face / head. Figures 38A to 38D are diagrams showing four methods for attaching the main unit to the face (head). Figure 38E is an external view of a head-mounted display with a deco pad-type mounting member attached to the top surface of the main unit. Figure 38F is a perspective view of the deco pad-type mounting member alone. Figure 39 is a table showing the relationship between the three-axis movement means for adjusting the positional relationship between the eyes and lenses and the mounting method. FIG. 40 is a diagram showing a flowchart of an embodiment (Type 1) of the configuration of a head-mounted display according to the present disclosure. FIGS. 41A and 41B are diagrams (schematic diagrams) showing an embodiment of means for moving the interpupillary distance by moving the lens barrel. FIG. 42 is a diagram showing guide information for interpupillary distance setting processing. FIG. 43 is a diagram showing guide information for vertical position setting processing. FIG. 44 is a diagram showing guide information for vertex-to-vertex setting processing. FIG. 45 is a diagram showing a flowchart of an embodiment (Type 2) of the configuration of a head-mounted display according to the present disclosure. FIG. 46 is a diagram showing guide information for vertex-to-vertex setting processing (Type 2). FIG. 47 is a diagram showing a flowchart of an embodiment (Type 3) of the configuration of a head-mounted display according to the present disclosure. FIG. 48 is a diagram showing guide information for vertical position setting processing (Type 3). FIG. 49 is a diagram showing guide information for vertex-to-vertex setting processing (Type 3). FIGS. 50A to 50D are diagrams showing diopter adjustment means in a head-mounted display. 51A to 51F are diagrams showing a means for moving a display panel inside a lens barrel. Fig. 52 is a diagram showing a flowchart of an example in which a diopter adjustment means is added to the configuration of an embodiment (Type 1) of the head-mounted display of the present disclosure. Fig. 53 is a diagram showing a guide image for diopter adjustment.54A to 54C are diagrams showing a diopter adjustment means using an additional lens. FIG. 55 is a diagram showing the adjustment range of a shift lens. FIG. 56 is a diagram showing a flowchart for resetting. FIG. 57 is a diagram showing a guide image for diopter adjustment. FIGS. 58A to 58D are diagrams showing problems when using an additional lens. FIGS. 59A and 59B are diagrams showing eyeglass prescriptions and eyeglass information obtained from an auto lens meter. FIG. 60 is a flowchart of the configuration diagram of FIG. 18. FIG. 61 is a diagram showing a guide image for diopter adjustment. FIG. 62 is a diagram showing three symptoms of astigmatism. FIG. 63 is a diagram explaining the basic concept of correcting regular astigmatism. FIG. 64 is a diagram showing another example explaining the basic concept of correcting regular astigmatism. FIG. 65 is a flowchart of the configuration diagram of FIG. 22. FIGS. 66A and 66B are diagrams explaining strabismus. FIGS. 67A to 67B are diagrams showing problems faced by strabismus users when using a head-mounted display. Figures 68A to 68C are diagrams showing the basic concept of correcting strabismus using VR. Figures 69A and 69B are diagrams showing the basic method of correcting strabismus using VR. Figure 70 is a flowchart of the configuration diagram of Figure 25. Figures 71A to 71H are diagrams showing four configurations of head-mounted displays. Figure 72 is a diagram showing software configuration example 1 of an integrated head-mounted display of the present invention. Figure 73 is a diagram showing software configuration example 1 of a separate head-mounted display of the present invention. Figure 74 is a diagram showing software configuration example 2 of an integrated head-mounted display of the present invention. Figure 75 is a diagram showing software configuration example 2 of a separate head-mounted display of the present invention. Figure 76 is a diagram showing software configuration example 3 of an integrated head-mounted display of the present invention. Figure 77 is a diagram showing software configuration example 3 of a separate head-mounted display of the present invention. Figure 78 is a diagram showing an example of authentication by a doctor or the like. Figure 79 is a diagram showing cooperation with an autolens meter. Figure 80A is a diagram showing an example of a method for measuring the vertex distance. Fig. 80B is a diagram showing an example of a technique for measuring the vertex distance. Fig. 80C is a diagram showing an example of a technique for measuring the vertex distance. Fig. 80D is an explanatory diagram of an example of a technique for measuring the interpupillary distance. Fig. 80E is an explanatory diagram of an example of a technique for measuring the interpupillary distance.Fig. 81 is a diagram showing an example of how to determine refractive power distribution for astigmatism correction. Fig. 82A shows a diagram for explaining the basic concept of correcting strabismus with VR. Fig. 82B shows a diagram for explaining the basic concept of correcting strabismus with VR.

[0086] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings.

[0087] For issue 1, "Unless the head-mounted display is worn so that the eyes are in the position (interpupillary distance, relationship between the pupillary horizon and the lens center point, distance between vertices, etc.) intended by the design of the head-mounted display, it will be impossible to see with the intended sense of size and distance," we will describe a method to solve this problem by monitoring the positional relationship between the lens 4 inside the lens barrel 3 and the eyeball using technology such as eye tracking to measure the eyeglass position and distance between vertices, and if the current eye position differs from the design intention, displaying a guidance screen on the display panel of the head-mounted display allows the user to correct the position using various adjustment functions in three axes (up / down, left / right, and depth), or by automatically moving the head-mounted display to the appropriate positional relationship by controlling the electric movement means of the head-mounted display instead of the user.

[0088] The vertex distance is the distance between the eyeball and the lens surface, and is also called the eye relief. If the lens is a lens system having multiple lenses, the vertex distance is, for example, the distance between the eyeball and the lens surface of the lens (ocular lens) that is closest to the eyeball in the lens system.

[0089] We will discuss the types of ways to wear a head-mounted display and then present solutions.

[0090] Figure 37 shows a table showing the methods for wearing a head-mounted display on the face / head, and Figure 38 shows a schematic diagram of each method. There are four methods for wearing the main body on the face (head), including a method in which the holding part also serves as the shielding means, and two types in which the holding part and the shielding means are configured independently.

[0091] Face pad + band holding type (holding part also serves as shielding means): Fig. 38A Face pad + temple holding type (holding part also serves as shielding means): Fig. 38B Deco pad holding type (holding part and shielding means are independent): Fig. 38C Nose pad + temple holding type (holding part and shielding means are independent): Fig. 38D

[0092] In the method shown in Figure 38A, the holder 2 serves as a face pad and is in close contact with the face, and the main body 1 of the head-mounted display is fixed to the head with the side bands 59 and headband 60. This allows the head-mounted display to be firmly fixed to the head. Conversely, after wearing the head-mounted display, it is difficult to shift the wearing position to change the relative position of the eyes and lenses. Furthermore, because the main body 1 is fixed to the head with the side bands 59 and headband 60, it is difficult to create a mechanism for moving the main body 1 up and down while keeping the holder 2 fixed to the face. If a vertical shift occurs, it is necessary to loosen the side bands 59 and headband 60 and reattach the display. It is possible to introduce a mechanism for slight movement in the depth direction (e.g., Meta's Quest 3).

[0093] In the method of FIG. 38B, the holding unit 2 serves as a face pad and is brought into close contact with the face, and the main unit 1 of the head-mounted display is fixed to the head with the temples 61. This allows the head-mounted display to be fixed to the head relatively securely. Because it is fixed only with the temples 61, it is possible to shift the wearing position after wearing to change the positional relationship between the eyes and the lenses (in the event of vertical misalignment, for example). However, as with method 1, it is difficult to create a mechanism for moving the main unit 1 up and down while keeping the holding unit 2 fixed to the face. A mechanism for slight movement in the depth direction can be realized by changing the thickness of the face pad, for example (HTC's XR Elite, etc.).

[0094] In the system shown in Figure 38C, the holding unit 2 is attached to the head with a deco pad 62 and is connected to the main unit 1 via a hinge 63. Therefore, the main unit 1 is not attached to the face. Furthermore, although the shielding means 38 needs to be attached to the face to some extent to block light, it is not attached for that reason and can be moved relatively freely. Therefore, after wearing the device, it is possible to shift the wearing position to change the positional relationship between the eyes and the lens by devising the structure of the hinge 63 connecting the deco pad 62 and the main unit 1. In other words, it is possible to construct a mechanism that allows the main unit 1 to be moved up and down after wearing it. Similarly, it is also possible to introduce a mechanism that allows it to be moved slightly in the depth direction (e.g., Sony's PSVR2, etc.).

[0095] The hinge 63 also makes it possible to set a forward tilt angle equivalent to the forward tilt angle θ50 of the glasses described in FIG. 32 , enabling higher image quality and more comfortable VR use. The tilt angle can be adjusted not only by the hinge 63 but also by providing an angle between the lens barrel 3 and the main body 1, but adjusting it with the hinge 63 allows the user to easily adjust it while watching VR images. Setting the tilt angle to a default value can be achieved by providing a shallow groove or the like that locks the hinge 63 at the default value (e.g., 5 degrees). Adjustment to suit the user can be easily achieved by adding a fixing method using screws or the like so that it can be fixed at values ​​other than the default value.

[0096] Next, we will explain the mechanism for adjusting the vertex distance using the method shown in Figure 38C. Figure 38E shows an external view of a deco pad-holding mounting member 300 attached to the top surface of the main body 1 of a head-mounted display. Here, we will explain how to adjust the deco pad-mounting mounting member 300. The deco pad 62 is connected to the base 301 via a hinge 63, and is configured to be flippable to match the inclination of the user's forehead. The base 301 is also fixed to the top surface of the main body 1, and can be moved back and forth relative to the user's forehead by moving the base 301 along slide rails 302.

[0097] Figure 38F shows a perspective view of the deco pad-holding type mounting member 300 alone. After wearing the main body 1, the user adjusts the deco pad 62 using an adjustment dial (not shown) to match the inclination of the user's forehead and secures it in place. The base 301 and slide rail 302 are provided with engaging teeth, and the base 301 is moved back and forth and secured in place using an adjustment lever 304. It is also equipped with a mechanism to stop the hinge 63 from rotating and a mechanism to stop the base 301 from moving on the slide rail 302, but details are omitted here.

[0098] Although details are omitted, pressing the release button 305 releases a wedge member (not shown) that stops the flipping of the deco pad 62 relative to the rotation axis of the hinge 63, and the wedge member fixes the deco pad 62 when the release button 305 is released. With this configuration, the deco pad 62 can be adjusted to match the inclination of the user's forehead while the release button 305 is pressed, and the position of the deco pad 62 can be fixed by releasing the release button 305.

[0099] Since the mounting member 300 has the above-mentioned configuration, after the user mounts the main body 1, the user can adjust the posture of the hinge 63 connecting the deco pad 62 and the main body 1 and move the base 301 along the slide rail 302, thereby shifting the mounting position to change the positional relationship between the user's eyes and the lens.

[0100] In the system shown in Figure 38D, the holder 2 is attached to the nose and ears (head) using temples 61 and nose pads 64, like eyeglasses. The main body 1 is connected to the face (nose) via the nose pads 64. Therefore, the main body 1 is not attached to the face. Furthermore, the shielding means 38 needs to be attached to the face to some extent to block light, but since it is not attached for that reason, it can be moved relatively freely. Therefore, after wearing the glasses, the positional relationship between the eyes and the lenses can be changed by shifting the position of the nose pads 64 or by changing the height or depth of the nose pads. In other words, it is possible to construct a mechanism that allows the main body 1 to be moved up and down and in the depth direction after wearing the glasses. (Example: Shiftall's MeganeX Business Edition, etc.)

[0101] In Figure 33, the constraints on the positional relationship between the eyes and lenses in a head-mounted display are explained using three axes: up / down, left / right, and depth.

[0102] FIG. 39 shows a table summarizing the relationship between three-axis moving means for adjusting the positional relationship between the eye and the lens and the holding method, as a mechanism for realizing the constraints in FIG.

[0103] For the four holding methods, the left-right movement means has the function of moving the lens barrel 3 left and right, since adjusting the interpupillary distance is essential for VR viewing. It is considered difficult to create a mechanism to move the lens barrel 3 up and down in each method. Therefore, it is necessary to address this with mechanical innovation, but as described in the explanation of Figure 38, this is difficult with methods 1 and 2 that realize the holding unit 2 using a face pad, and adjustment is only possible by reattaching the device. In methods 3 and 4, this can be achieved by innovating the hinge 63 and nose pad 64. In the depth direction, all four methods allow for movement of the lens barrel 3, but in methods 3 and 4, it is easier to achieve this with innovating the hinge 63 and nose pad 64, just as with up and down. Even in methods 1 and 2, fine adjustments are possible with mechanical innovation. Specifically, in method 1, the distance between the main unit 1 and the holding unit 2 can be changed, while in method 2, it can be achieved by changing the thickness of the face pad. Similarly, tilt adjustment, like with eyeglasses, can be achieved by changing the shapes of the hinge 63, nose pad 64, and face pad.

[0104] Therefore, there are three methods for adjusting the depth direction (distance between vertices): (Type 1) a moving mechanism for the lens barrel part 3, (Type 2) a modification to the face pad (changing the thickness or changing the distance between the face pad and the main body part 1), and (Type 3) a modification between the holding part 2 and the main body (modification of the hinge 63 or nose pad 64).

[0105] The three methods will be described below.

[0106] FIG. 2 shows an example of the configuration of a head-mounted display according to the present disclosure (an example of a mechanism for moving the lens barrel 3 of (Type 1)).

[0107] FIG. 2A is an example of a schematic diagram of a head-mounted display viewed from above, and FIG. 2B is an example of a system configuration diagram of FIG. 2A.

[0108] 2A and 2B , in addition to the components of the basic structure of the head-mounted display shown in Fig. 1 , there are also provided an eyeball position measurement means 6 (an example of an eyeball position measurement means) for measuring whether the constraints on the positional relationship between the eyes and the lenses shown in Fig. 33 are satisfied, a lens barrel horizontal movement means 8 for moving the lens barrel 3 left and right to adjust the inter-pupillary distance to that of the user, a lens barrel depth movement means 9 (an example of an adjustment means) for retrieving a design value for the inter-vertex distance stored in an optimal inter-vertex distance information storage means 20 and moving the lens barrel 3 in the depth direction to adjust the actual inter-vertex distance to the design value, and a lens barrel control means 7 for controlling the movement of the lens barrel 3 by controlling the lens barrel horizontal movement means 8 and the lens barrel depth movement means 9 based on the measurement value from the eyeball position measurement means 6 and reporting the adjusted lens position to a lens position information storage means 18.

[0109] The VR display control unit 11 has a VR image generation means 15, which converts VR image data 16 or VR data generated by the VR application 16 into an image to be displayed on the VR display unit 10 based on the 6DoF information. The converted image is sent to the VR display unit 10 via a distortion correction means 14 that corrects distortion based on distortion correction data stored in a lens distortion information storage means 19 and based on the optical characteristics of the lens 4 and other components of the VR display unit 10.

[0110] The VR display unit 10 has a vertical position adjustment means 12 that notifies the user of any vertical position deviation based on the measurement values ​​from the eyeball position measurement means 6 and urges them to make corrections, and has an image display processing means 13 that superimposes user guidance information generated based on information from the telescope tube horizontal movement means 8, telescope tube depth movement means 9, telescope tube control means 7, and vertical position adjustment means 12 onto the image sent from the VR display control unit 11.

[0111] FIG. 40 shows a flowchart of one embodiment of the configuration of the head-mounted display of the present disclosure (an example of a mechanism for moving the lens barrel 3 of (Type 1)).

[0112] Immediately after wearing, the main processing of S0000 is called. In step S001, the eyeball position measurement means 6 detects the positional relationship and distance between each eye and the optical center point 52 of the lens 4. In step S002, the interpupillary distance is confirmed, and if it is correct, the process jumps to step S004. If setting is required, the process jumps to step S003. If the head-mounted display has an automatic interpupillary distance adjustment function, the process of step S010 is called. If it does not have this automatic adjustment function, the process of step S020 is called. In step S004, the upper and lower wearing positions are confirmed using the measurement value of the eyeball position measurement means 6, and if it is correct, the process jumps to step S006. If setting is required, the process jumps to step S005. In step S005, the process of step S030 is called. In step S006, the interpupillary distance is confirmed, and if it is correct, the process ends. If setting is required, the process jumps to step S007. If the head-mounted display has an automatic intervertex distance adjustment function, the process of step S050 is called. If it does not have this automatic adjustment function, the process of step S040 is called.

[0113] Step S001 of detecting differences in positional relationships by the eyeball position measurement means 6 (also steps S011 and S021 of detecting interpupillary distance, step S031 of detecting differences between the top and bottom, and steps S041 and S051 of detecting differences between vertices) can be easily realized by using eye tracking technology used in head-mounted displays.

[0114] For example, an eye-tracking system using multiple infrared light sources and an infrared camera for each eye has been put into practical use (see Tobii's eye-tracking system, https: / / www.tobii.com / ja / solutions / extended-reality / extended-reality). In a head-mounted display using this eye-tracking technology, an infrared camera is placed between the user and the display, and an infrared light source is arranged in a ring around the lens barrel. AI interprets the image from the infrared camera and can measure pupil size, gaze vector, eye opening, and other parameters in real time. Using this technology, it is possible to detect the center position of the pupil and measure the distance between the vertices.

[0115] As another example, an eye tracking system using only one infrared light source and one infrared camera for each eye has also been put into practical use (see Gazin's (Taiwan) eye tracking system, https: / / ganzin.com / ). An infrared light source illuminates the user's eyes and receives the infrared light reflected by the eyes. By using infrared light, it is possible to eliminate interference from visible light and obtain a clear image of the user's eyes. The obtained eye images can then be processed using image processing and machine learning techniques to obtain image data for multiple eyes, which can then be used to estimate the user's eye position and gaze position. This system can also detect the pupil center position and measure the vertex distance.

[0116] 80A to 80C are diagrams illustrating an example of a method for measuring the intervertex distance. As shown in FIG. 80A, a light source 201 and a light receiving unit 203 used for eye tracking are provided around the lens 4 inside the lens barrel 3. The light source 201 and the light receiving unit 203 are included in the eyeball position measurement means 6. The light receiving unit 203 can be configured with an imaging element such as a CCD. In the method described in FIGS. 80A to 80C, the light source 201 irradiates the user's eye with light, and the light receiving unit 203 receives and processes the reflected light from the user's eye to not only estimate the eye orientation but also calculate the intervertex distance. The intervertex distance can be calculated from the position of the center of the eye relative to the light receiving unit 203 and the positional relationship between the light source 201, the light receiving unit 203, and the lens 4. In practice, errors occur due to the curvature of the cornea, but if the positions of the eye and lens 4 are adjusted before measurement, the intervertex distance can be measured from the position of the center of the eye relative to the light receiving unit 203.

[0117] The light source 201 and the light receiving unit 203 are provided in association with the lens 4, and move in the depth direction in conjunction with movement of the lens 4 in the depth direction. Therefore, if the light receiving unit 203 is adjusted in advance to receive reflected light from the user's eye at a central portion (an example of a predetermined position) (so that the center of the eyeball is located in the central portion) as shown in Fig. 80A when the vertex distance is desired, it can be easily measured whether the vertex distance is the desired one.

[0118] Note that, as shown in FIG. 80B , when the light receiving unit 203 receives light reflected from the user's eye at its left end (the side closest to the lens) (the center of the eyeball is located at the left end), this indicates that the actual inter-vertex distance is shorter than the desired inter-vertex distance. In this case, the actual inter-vertex distance can be adjusted to the desired inter-vertex distance by moving the lens 4 away from the eye. Also, as shown in FIG. 80C , when the light receiving unit 203 receives light reflected from the user's eye at its right end (the side farther from the lens) (the center of the eyeball is located at the right end), this indicates that the actual inter-vertex distance is longer than the desired inter-vertex distance. In this case, the actual inter-vertex distance can be adjusted to the desired inter-vertex distance by moving the lens 4 closer to the eye.

[0119] While the above explanation uses Figures 80A to 80C to show a method for measuring the vertex distance, it is also possible to measure the interpupillary distance using the eyeball position measurement means 6. A method for measuring the interpupillary distance will be explained using Figure 80D. When measuring the interpupillary distance, light is irradiated onto both eyes of the user from the light source 201, and both eyes are photographed by the light receiving unit 203 to detect the positions of the pupils. Then, an image processing calculation circuit (not shown) detects the positions of the pupils, for example, the center positions of both ends of the pupil region of the eyes, and the interpupillary distance of the user is calculated from these pupil positions.

[0120] In Fig. 80D, an X axis (horizontal axis) and a Y axis (vertical axis) are defined that pass through the centers of the light receivers of the left and right light receiving units 203. When measuring the interpupillary distance, the distance between the Y axes of the left and right light receiving units 203 is known. For example, when the standard interpupillary distance PD ０ Alternatively, the previously set interpupillary distance may be stored.

[0121] The left side of Fig. 80D is the right eye image of the light receiving unit 203 for the right eye, and the right side of Fig. 80D is the left eye image of the light receiving unit 203. In the example of Fig. 80D, there is no deviation in the Y axis direction for either the right eye image or the left eye image, but the center of the pupil of the right eye is offset by -ΔX Ｒ The center of the pupil of the left eye is shifted by +ΔX Ｌ In this case, the user's interpupillary distance is set to the default value PD ０ For ΔX Ｒ +ΔX ＬThis allows the user's interpupillary distance to be measured.

[0122] Furthermore, by using the eyeball position measurement means 6, the positional relationship between the position of the user's eye and the optical center point of the lens inside the lens barrel can be detected. Figure 80E shows an image of the user's left eye captured by the light receiving unit 203 for the left eye. As explained in Figure 80D, an X axis (horizontal axis) and a Y axis (vertical axis) are defined that pass through the centers of the light receivers of the left and right light receiving units 203. For example, by determining in advance the positional relationship between the center of the light receiving unit 203 and the optical center of the lens, it is possible to detect the deviation of the position of the user's eye from the optical center of the lens.

[0123] In Fig. 80E, the center of the light receiving unit 203 for the left eye coincides with the optical center point of the lens for the left eye. Since the center of the pupil of the user's left eye is on the Y axis, there is no horizontal deviation from the optical center of the lens for the left eye, but there is a deviation of -ΔY in the Y axis direction. Ｌ Therefore, in the example of Fig. 80E, adjustment is performed using the vertical position adjustment means 12, which adjusts the vertical position of the user's face or head based on the measurement results so that the optical center point of the lens in the lens barrel is aligned with the line of sight of the user's eyes. Note that in the example of Fig. 80E, there is no horizontal deviation, so the lens barrel horizontal movement means 8 does not need to be operated.

[0124] When measuring the interpupillary distance and detecting the positional relationship between the user's eye position and the optical center point of the lens inside the lens barrel, it is desirable for the user to look straight ahead. For this reason, it is effective to display a target object in the center of the VR image or adjust the diopter toward infinity.

[0125] In the above description, the positional relationship between the left and right pupils of the user and the optical center is detected, but this is not limiting. For example, the positional relationship between the left and right pupils of the user and a predetermined fixed position may be detected.

[0126] In step S010, if the system has an automatic interpupillary distance adjustment function, in step S011 the interpupillary distance is calculated based on the value detected by the eyeball position measurement means, and the amount of movement of the lens barrel 3 is determined. In step S012, the lens barrel horizontal movement means 8 moves the lens barrel 3 by the calculated amount of movement, thereby adjusting the interpupillary distance to an optimal distance.

[0127] Figure 41 shows a schematic diagram of one embodiment of a means for changing the interpupillary distance by moving the lens barrel. The main body 1 of the head-mounted display shown in Figure 33A includes a lens barrel movement shaft 70 that passes through the tops of the left and right lens barrels 3, and a lens barrel movement motor 71 that rotates the shaft to move the left and right lens barrels left and right. Electronic control of this motor allows the lens barrel to be moved accurately.

[0128] This can be achieved, for example, by using a dedicated motor solution for PD adjustment from Zhaowei (https: / / www.zwgearbox.com / special / VR-micro-drive-system-solution), which allows for the setting of a specific interpupillary distance.

[0129] 41B shows an example (schematic diagram) of the lens barrel depth moving means 9 that moves the lens barrel. The lens barrel portion 3 can be moved in the depth direction by placing the lens barrel on a cylindrical cam 107 and rotating the cylindrical cam.

[0130] In step S020, if the interpupillary distance needs to be manually adjusted, in step S021, guide information 72 for the interpupillary distance setting process (start) as shown in FIG. 42 is displayed. In step S022, the interpupillary distance is detected by the eyeball position measurement means, and in step S023, it is determined whether the interpupillary distance is correct. If correction is necessary, the process proceeds to step S024; if not, the process jumps to step S026. In step S024, guide information is displayed based on the value detected by the eyeball position measurement means. Specifically, if the interpupillary distance is too wide, at least one of an interpupillary distance correction message (instruction to reduce) 73 and an interpupillary distance value display 76 as a guidance message as shown in FIG. 42 is displayed, and in step S025, the user is prompted to manually reduce the interpupillary distance using the interpupillary distance adjustment means. If the interpupillary distance is too narrow, at least one of an interpupillary distance correction message (enlargement instruction) 74 and an interpupillary distance value display 76 as shown in Fig. 42 is displayed as a guidance message, and in step S025, the user is prompted to manually widen the interpupillary distance using the interpupillary distance adjustment means. Thereafter, the process returns to step S022. In step S026, guide information 75 for the interpupillary distance setting process (end) as shown in Fig. 42 is displayed, and the process ends.

[0131] In step S030, which is the process of adjusting the upper and lower wearing positions, guide information 77 for the upper and lower position setting process (start) as shown in FIG. 43 is displayed in step S031. In step S032, the eyeball position measurement means detects a difference in the upper and lower positions, and in step S033, it is determined whether the upper and lower positions are correct. If correction is necessary, the process proceeds to step S034; if not, the process jumps to step S036. In step S034, guide information is displayed based on the value detected by the eyeball position measurement means. Specifically, if the wearing position is too low, at least one of a wearing position adjustment (upper and lower) message (instruction to raise) 78 and a wearing position adjustment (upper and lower) value display 81 is displayed as a guidance message as shown in FIG. 43, and the user is prompted to manually raise the wearing position in step S025. If the wearing position is too high, at least one of a wearing position adjustment (upper and lower) message (instruction to lower) 79 and a wearing position adjustment (upper and lower) value display 81 is displayed as a guidance message as shown in FIG. 43, and the user is prompted to manually lower the wearing position in step S035. Then, the process returns to step S032. In step S036, guide information 80 for the up / down position setting process (end) as shown in Fig. 43 is displayed, and the process ends.

[0132] In step S040 when the vertex distance automatic adjustment function is provided, in step S041, based on the value detected by the eyeball position measurement means, the lens barrel control means 7 compares the design value between the vertices obtained from the optimum vertex distance information storage means 20 with the measured current vertex distance, and determines the amount of movement of the lens barrel 3. In step S042, the lens barrel depth movement means 9 moves the lens barrel 3 by the calculated amount of movement, thereby adjusting the vertex distance to the optimum distance.

[0133] In step S050, when the inter-vertex distance needs to be manually adjusted, in step S051, guide information 82 for the inter-vertex setting process (start) as shown in FIG. 44 is displayed. In step S052, the inter-vertex distance is detected by the eyeball position measurement means, and in step S053, it is determined whether the inter-vertex distance is correct (the lens barrel control means 7 compares the design value between the vertices obtained from the optimal inter-vertex distance information storage means 20 with the measured current inter-vertex distance). If correction is necessary, the process proceeds to step S054; if not, the process jumps to step S056. In step S054, guide information is displayed based on the value detected by the eyeball position measurement means. Specifically, if the inter-vertex distance is too wide, at least one of a lens position adjustment message (instruction to move away) 83 and a lens position adjustment value display 86 is displayed as a guidance message as shown in FIG. 44, and in step S055, the user is prompted to manually narrow the distance using the depth distance adjustment means. If the inter-vertex distance is too narrow, at least one of a lens position adjustment message (instruction to move closer) 84 and a lens position adjustment value display 86 is displayed as a guidance message as shown in Fig. 44, and in step S055, the user is prompted to manually widen the distance using the depth distance adjustment means. Thereafter, the process returns to step S052. In step S056, guide information 85 for the inter-vertex setting process (end) as shown in Fig. 44 is displayed, and the process ends.

[0134] If the user wants to abandon or skip the adjustment while the flow of FIG. 40 is being executed, the adjustment process can be ended as an interrupt process at any time, and the head-mounted display can be used.

[0135] FIG. 3 shows an example of the configuration of the head-mounted display of the present disclosure (an example of a face pad design (changing the thickness, changing the distance between the face pad and the main body 1) of (Type 2)).

[0136] FIG. 3A is an example of a schematic diagram of a head-mounted display viewed from above, and FIG. 3B is an example of a system configuration diagram of FIG. 3A.

[0137] 2A and 2B is that the main body 1 has a main body-holding unit distance correction means 21 (an example of an adjustment means) between the holding unit 2 (which also serves as a shielding unit) instead of the lens barrel depth movement means 9. This main body-holding unit distance correction means 21 makes it possible to finely adjust the distance between the main body 1 and the holding unit 2, and as a result, even though there is no lens barrel depth movement means 9, it is possible to change the vertex distance to some extent after mounting.

[0138] FIG. 45 shows a flowchart of one embodiment of the configuration of the head-mounted display of the present disclosure ((Type 2) face pad design (changing the thickness, changing the distance between the face pad and the main body 1)).

[0139] The differences from the flowchart of FIG. 40 are that the inter-vertex distance adjustment (automatic) process shown in FIG. 40 is omitted, and step S054 in the inter-vertex distance adjustment (manual) process is changed from step S054 to step S054A, and step S055 to step S055A. Specifically, in step S054A, guide information is displayed based on the value detected by the eyeball position measurement means. Specifically, if the inter-vertex distance is too wide, at least one of a lens position adjustment message (instruction to move apart) 83 and a lens position adjustment value display 86 as shown in FIG. 46 is displayed, and in step S055A, the user is prompted to manually narrow the inter-vertex distance using the main body unit-holding unit distance correction means 21. If the inter-vertex distance is too narrow, at least one of a lens position adjustment message (instruction to move closer) 84 and a lens position adjustment value display 86 as shown in FIG. 46 is displayed, and in step S055A, the user is prompted to manually widen the inter-vertex distance using the main body unit-holding unit distance correction means 21. Then, the process returns to step S052. However, if the correction range of the main body-holding part distance correcting means 21 is limited and correction is difficult, the user can give up on the correction process.

[0140] If the user wants to abandon or skip the adjustment while the flow of FIG. 45 is being executed, the adjustment process can be ended as an interrupt process at any time, and the head-mounted display can be used.

[0141] FIG. 4 shows an example of the configuration of the head-mounted display of the present disclosure (an example of the innovation between the holding part 2 and the main body (the innovation of the hinge 63 or nose pad 64) of (Type 3)).

[0142] FIG. 4A is an example of a schematic diagram of a head-mounted display viewed from above, and FIG. 4B is an example of a system configuration diagram of FIG. 4A.

[0143] 2A and 2B is that the main body 1 has a main body-holding unit positional relationship correction unit 39 between the holding unit 2 (which also serves as a shielding unit) instead of the lens barrel depth movement unit 9. This 39 makes it possible to finely adjust the distance between the main body 1 and the holding unit 2, and thus, although there is no lens barrel depth movement unit 9, it is possible to change the vertex distance to some extent after mounting.

[0144] FIG. 47 shows a flowchart of one embodiment of the configuration of the head-mounted display of the present disclosure (an example of the innovation between the holding unit 2 and the main body (the innovation of the hinge 63 or nose pad 64) of (Type 3)).

[0145] The differences from the flowchart in Figure 40 are that the vertex distance adjustment (automatic) process shown in Figure 40 is not performed, and step S034 in the process of adjusting the upper and lower mounting positions has been changed to step S034B, and step S035 to step S035B. Specifically, if the mounting position is too low, at least one of a mounting position adjustment (up and down) message 78 (instruction to raise) and a mounting position adjustment (up and down) value display 81 is displayed as a guidance message as shown in Figure 48, and in step S035B, the user is urged to manually raise the mounting position using the main body unit-holding unit positional relationship correction means 39. If the mounting position is too high, at least one of a mounting position adjustment (up and down) message 79 (instruction to lower) and a mounting position adjustment (up and down) value display 81 is displayed as a guidance message as shown in Figure 48, and in step S035B, the user is urged to manually lower the mounting position using the main body unit-holding unit positional relationship correction means 39. Then, the process returns to step S032.

[0146] Step S054 in the inter-vertex distance adjustment (manual) process has been changed to step S054B, and step S055 to step S055B. Specifically, in step S054B, guide information is displayed based on the value detected by the eyeball position measurement means. Specifically, if the inter-vertex distance is too wide, at least one of a lens position adjustment message 83 (instruction to move apart) and a lens position adjustment value display 86 as shown in FIG. 49 is displayed as a guidance message, and in step S055B, the user is prompted to manually narrow the inter-vertex distance using the main body unit-holding unit positional relationship correction means 39. If the inter-vertex distance is too narrow, at least one of a lens position adjustment message 84 (instruction to move closer) and a lens position adjustment value display 86 as shown in FIG. 49 is displayed as a guidance message, and in step S055B, the user is prompted to manually widen the inter-vertex distance using the main body unit-holding unit positional relationship correction means 39. Thereafter, the process returns to step S052. However, if the correction range of the main body-holding positional relationship correcting means 39 is limited and correction is difficult, the user can abandon the correction process.

[0147] In this example, a correction method using a nose pad has been described, but the same processing can also be done using a deco pad.

[0148] If the user wants to abandon or skip the adjustment while the flow of FIG. 47 is being executed, the adjustment process can be ended as an interrupt process at any time, and the head-mounted display can be used.

[0149] FIG. 5 shows an example of the configuration of the head-mounted display (MR goggles) of the present disclosure (an example of a mechanism for moving the lens barrel 3 of (Type 1)).

[0150] FIG. 5A is an example of a schematic diagram of a head-mounted display viewed from above, and FIG. 5B is an example of a system configuration diagram of FIG. 5A.

[0151] The differences from Figures 2A and 2B are that a VST input means 34 has been added which has two left and right cameras 33 and a VST image processing means 35 which performs processing such as mapping the input stereo camera images into 3D space, and that the VR display control unit 11 has a VST image synthesis means which synthesizes the VST images with the images generated by the VR image generation means 15.

[0152] The added MR processing means have no effect on the means for correcting the positional relationship between the eye and the lens, and so the processing is the same as that in Fig. 2. Also, Fig. 5 shows a configuration in which an MR function is added to the configuration (Type 1) in Fig. 2, but it is also possible to add an MR function similar to that in Fig. 5 to the configurations (Type 2) in Fig. 3 and (Type 3) in Fig. 4, and in these cases, the means for correcting the positional relationship between the eye and the lens is the same.

[0153] Second Embodiment

[0154] This section describes the first of three solutions to issue 2, "Small goggles cannot accommodate eyeglasses, so mitigation measures are needed for eyeglass wearers." This is "a solution using a diopter adjustment means that does not change the positional relationship (vertex distance) after setting the positional relationship as intended by the design."

[0155] The diopter adjustment means can be realized mechanically or electrically (such as by an LCD lens). A mechanical method is to change the distance between the lens 4 and the display panel 5, as described in FIG. 50. This can be achieved by performing the process described in the flowchart of FIG. 40, setting the actual inter-vertex distance to the design inter-vertex distance 54, and then changing the distance between the lens 4 and the display panel 5 (moving the display panel) without changing the inter-vertex distance. This allows users who wear glasses to use the head-mounted display without glasses, even if the VR space cannot be viewed while wearing glasses, such as with a small head-mounted display.

[0156] FIG. 50 shows a diopter adjustment means (spherical lens adjustment means) in a head-mounted display.

[0157] When a head-mounted display uses the pancake lens method, multiple lenses are used. In this case, multiple lens groups are described as a single lens.

[0158] 50A shows the relationship between the eye 40, lens 4, and display panel 5 in the case of a person with emmetropia. When the eye of a person with emmetropia (or correction with a contact lens) is located at the design vertex distance 54, the image is focused on the retina and the image on the display panel 5 is clearly visible.

[0159] 50B shows the relationship between the eye 40, lens 4, and display panel 5 in the case of myopia. When the eye of a myopic person is located at the designed vertex distance 54, the focal point is located in front of the retina, and the image on the display panel becomes blurred.

[0160] Figure 50C shows an example of a method for correcting myopia (a method of moving the lens 4 closer to the display panel 5). With this method, moving the lens 4 toward the display panel 5 focuses the lens on the retina, allowing the image on the display panel to be clearly viewed. For hyperopia, moving the lens away from the display panel allows the display panel to be clearly viewed. However, while diopter adjustment is possible in this case, the vertex distance of 54, which is the design value, is reduced to 87 after movement. Therefore, as a side effect of the increased vertex distance, the FoV is narrower and objects appear smaller and farther away. Therefore, this method is not suitable for the present invention.

[0161] Figure 50D shows another example of a method for correcting myopia (a method of moving the display panel 5 closer to the lens 4). Unlike Figure 50C, this method does not change the distance between the lens 4 and the eyeball 40, but moves the display panel 5 closer to the lens 4, so that the image on the display panel 5 is focused on the retina and can be seen clearly. In the case of hyperopia, the display panel can be seen clearly by moving the display panel away from the lens. With this method, the actual vertex distance 41 matches the designed vertex distance 54 even after diopter adjustment, so there are no side effects. Therefore, this method is adopted in the present invention.

[0162] FIG. 51 shows a means for moving the display panel 5 inside the lens barrel 3.

[0163] Figure 51A shows an example of a diopter adjustment method that uses a display panel movement. This method uses a tilted ring to adjust the position of the display panel. While this method has a relatively simple mechanism, if the display panel needs to be moved a long distance, adjustment requires force, making strength an issue.

[0164] Figure 51B shows another example of a diopter adjustment means that moves the display panel. This shows a method in which a screw hole is provided on the outer periphery of the lens, and the lens position is adjusted by passing an adjustment screw through the screw hole on the outer periphery of the lens and turning the adjustment screw. The lens adjustment range, adjustment accuracy, adjustment force, etc. can be adjusted, making this suitable for cases where fine adjustment is required. There are several other ways to cut the threads besides the one shown on the right.

[0165] Figure 51C shows a third example of a diopter adjustment means that moves the display panel. This shows a method in which the outer periphery of the lens and the inner periphery of the adjustment ring are threaded. With this method, the lens adjustment range, adjustment precision, and adjustment force can be adjusted by the pitch of the threads, but compared to Figure 51B, this adjustment is more coarse. The actual mechanism will have a different structure depending on the structure of the lens mounting location, etc.

[0166] Figures 51D, 51E, and 51F show a fourth example of a diopter adjustment means that slides a lens or display panel within a lens barrel. Rotation in Figure 51D is restrained by a rod-shaped pin, while in Figure 51F, rotation is restrained by a concave-convex interlock, and the lens 4 within the lens barrel is slid by a cylindrical cam in Figure 51E. While this example moves the lens 4, a similar structure can also be used to move a display panel. In the case of a lens, the lens frame that fixes the glass or plastic lens body has a sliding portion and a fixed portion that is fixed to the sliding jig. In the case of a display panel, this can be achieved by having a sliding portion and a fixed portion that is fixed to the sliding jig on the frame that fixes the display panel body.

[0167] FIG. 6 shows an example of the configuration of the head-mounted display of the present disclosure (an example in which a diopter adjustment means is added to the configuration of (Type 1) in FIG. 2).

[0168] FIG. 6A is an example of a schematic diagram of a head-mounted display viewed from above, and FIG. 6B is an example of a system configuration diagram of FIG. 6A.

[0169] 2A and 2B is that the lens barrel 3 has a spherical lens adjustment means 22. After the positional relationship between the eyes and the lens is set to the optimal position using this spherical lens adjustment means 22, the diopter can be adjusted while maintaining this state. This means that even with a small head-mounted display that does not require glasses to view the VR space, users who wear glasses can use the head-mounted display without glasses.

[0170] FIG. 52 shows a flowchart of one embodiment of the configuration of the head-mounted display of the present disclosure (an example in which a diopter adjustment means is added to the configuration of (Type 1) in FIG. 2).

[0171] The difference from the flowchart in Figure 40 is that a diopter adjustment section (steps S101 and S102) has been added to the end of the processing in step S000. Specifically, in step S101, the user is asked whether or not to adjust the diopter. If the user determines that diopter adjustment is not necessary, the process ends. If the user determines that diopter adjustment is necessary, diopter adjustment processing S110 is called in step S102. In diopter adjustment processing S110, a guide video that makes it easy for the user to adjust the diopter is displayed in step S041, and the user adjusts the diopter using the spherical lens adjustment means 22 in step S042.

[0172] An example of a guide image for diopter adjustment is shown in Figure 53. The user adjusts the focus for the right eye, then the left eye, and the power is displayed, so if the user knows the power of their glasses, they can use that value as a reference when making adjustments.

[0173] As in the flowchart S120, the diopter adjustment process S110 may be performed before the process of FIG.

[0174] If the user wants to abandon or skip the adjustment while the flow of FIG. 52 is being executed, the adjustment process can be ended as an interrupt process at any time, and the head-mounted display can be used.

[0175] FIG. 7 shows an example of the configuration of the head-mounted display of the present disclosure (an example in which a diopter adjustment means is added to the configuration of (Type 2) in FIG. 3).

[0176] FIG. 7A is an example of a schematic diagram of a head-mounted display viewed from above, and FIG. 7B is an example of a system configuration diagram of FIG. 7A.

[0177] 3A and 3B is that the lens barrel 3 has a spherical lens adjustment means 22. After the positional relationship between the eyes and the lens is set to the optimal position using this spherical lens adjustment means 22, the diopter can be adjusted while maintaining this state. This means that even with a small head-mounted display that does not require glasses to view the VR space, users who wear glasses can use the head-mounted display without glasses.

[0178] The flowchart of the configuration in FIG. 7 is the same as the flowchart in FIG.

[0179] FIG. 8 shows an example of the configuration of the head-mounted display of the present disclosure (an example in which a diopter adjustment means is added to the configuration of (Type 3) in FIG. 4).

[0180] FIG. 8A is an example of a schematic diagram of a head-mounted display viewed from above, and FIG. 8B is an example of a system configuration diagram of FIG. 8A.

[0181] 4A and 4B is that the lens barrel 3 has a spherical lens adjustment means 22. After the positional relationship between the eyes and the lens is set to the optimal position using this spherical lens adjustment means 22, the diopter can be adjusted while maintaining this state. This means that even with a small head-mounted display that does not require glasses to view the VR space, glasses users can use the head-mounted display without glasses.

[0182] The flowchart of the configuration in FIG. 8 is the same as the flowchart in FIG.

[0183] FIG. 9 shows an example of the configuration of the head-mounted display of the present disclosure (an example of MR goggles in which a diopter adjustment means is added to the configuration of (Type 1) in FIG. 5).

[0184] FIG. 9A is an example of a schematic diagram of a head-mounted display viewed from above, and FIG. 9B is an example of a system configuration diagram of FIG. 9A.

[0185] 5A and 5B is that the lens barrel 3 has a spherical lens adjustment means 22. After the positional relationship between the eyes and the lens is set to the optimal position using this spherical lens adjustment means 22, the diopter can be adjusted while maintaining this state. This means that even with a small head-mounted display that does not require glasses to view the VR space, glasses users can use the head-mounted display without glasses.

[0186] The flowchart of the configuration in FIG. 9 is the same as the flowchart in FIG.

[0187] The diopter adjustment means is not limited to the movement between the lens 4 and the display panel 5 shown in Figure 50D. Fluid lens and liquid crystal lens technologies that dynamically change the lens power have been developed (e.g., FlexEnable's liquid crystal lens: https: / / www.flexenable.com / applications / tunable-lenses-for-ar-VR-and-smart-glasses / ). Using these technologies, it is possible to electrically change the lens power without physically moving the lens.

[0188] FIG. 10 shows an example of the configuration of the head-mounted display of the present disclosure (an example in which a diopter adjustment means using an additional lens is added to the configuration of (Type 1) in FIG. 2).

[0189] FIG. 10A is an example of a schematic diagram of a head-mounted display viewed from above, and FIG. 10B is an example of a system configuration diagram of FIG. 10A.

[0190] 2A and 2B is that the lens barrel 3 has an additional lens attachment means 23 in front of the lens 4. After the positional relationship between the eyes and the lens is set to the optimal position using this 23, by maintaining this state and then attaching an additional lens made based on the eyeglass prescription, it becomes possible to view the VR space under the same conditions as when wearing eyeglasses.

[0191] FIG. 54 shows a diopter adjustment means using an additional lens.

[0192] When a head-mounted display uses the pancake lens method, multiple lenses are used. In this case, multiple lens groups are described as a single lens.

[0193] FIG. 54A shows the relationship between the eye 40, the lens 4, and the display panel 5 in the case of a normal-sighted person's eye.

[0194] 54B shows the relationship between the eye 40, lens 4, and display panel 5 in the case of myopia. When the eye of a myopic person is located at the designed vertex distance 54, the focal point is located in front of the retina, and the image on the display panel becomes blurred.

[0195] 54C shows an example of a correction method using an additional lens for myopia. By inserting the additional lens 90 between the lens 4 and the eyeball 40, the focus is formed on the retina, allowing the image on the display panel to be seen clearly.

[0196] The flowchart for the configuration in Fig. 10 is almost identical to the flowchart in Fig. 40. The difference is that, because the additional lens 90 is inserted, the vertex-to-vertex distance 41 is reduced from the design value vertex-to-vertex distance 54 by the thickness of the additional lens 90. For this reason, when calculating the movement distance in steps S042 and S054 in the processing of the flowchart in Fig. 40, it is necessary to calculate the target vertex-to-vertex distance = design value vertex-to-vertex distance 54 - thickness of the additional lens 90.

[0197] 10 shows an example in which a diopter adjustment means using an additional lens is added to FIG. 2, but the same applies to the cases in which a diopter adjustment means using an additional lens is added to FIGS.

[0198] FIG. 11 shows an example of the configuration of the head-mounted display of the present disclosure (an example in which an additional lens (shift lens) is added to the configuration of (Type 1) in FIG. 6).

[0199] FIG. 11A is an example of a schematic diagram of a head-mounted display viewed from above, and FIG. 11B is an example of a system configuration diagram of FIG. 11A.

[0200] The difference from FIGS. 6A and 6B is that the lens barrel 3 has an additional lens mounting means 23 in front of the lens 4.

[0201] The diopter adjustment range of the spherical lens adjustment means 22 is limited to about 8D. Therefore, as shown in Figure 55, by combining a shift lens, the adjustment range can be shifted, allowing for a wider range of adjustment. By attaching a shift lens to the additional lens attachment means 23, the adjustment range of the spherical lens adjustment means can be widened.

[0202] The flowchart for the configuration of FIG. 11 is the same as the flowchart of FIG. 52 (the distance between vertices needs to be corrected by the thickness of the additional lens 90).

[0203] FIG. 11 shows an example in which an additional lens (shift lens) is added to the (Type 1) of FIG. 6, but the same applies to the cases in which a diopter adjustment means using an additional lens is added to the MR goggles of (Type 2) of FIG. 7, (Type 3) of FIG. 8, and FIG. 9.

[0204] FIG. 12 shows a system configuration diagram of one embodiment of the configuration of the head-mounted display of the present disclosure (an example in which a user information storage means 25 is added to the configuration of (Type 1) in FIG. 6).

[0205] The difference from Figure 6B is that the user information storage means 25 for recording and reproducing the setting information when each user uses the head-mounted display has a user information storage / setting means 92, a user identification information input means 93, and a user information storage database 94.

[0206] When multiple people share a head-mounted display equipped with a spherical lens adjustment means 22 as shown in Figure 6, they must perform interpupillary distance setting processing and spherical lens adjustment processing to suit each person's visual acuity each time they wear the display. Because performing this process every time is cumbersome, setting data (interpupillary distance value and spherical lens power value) is recorded for each user. The next time the display is worn, the user can manually or automatically select the appropriate user, retrieve their own setting data, and configure the head-mounted display. This allows users to quickly start working with the head-mounted display and reduces the burden of starting up.

[0207] Specifically, when using for the first time, personal identification information that identifies the user using the head-mounted display is extracted using the user identification information input means 93, and after the initial wearing settings according to the flowchart in Figure 52 are performed, the personal vision-related setting data (interpupillary distance, spherical lens power) is extracted via the lens barrel control means 7 in the VR display unit 10, and a pair of personal identification information and personal vision-related information is stored in the user information storage database 94.

[0208] When the same user uses the head-mounted display again, the individual is identified by the user identification information input means 93, and based on the user's personal identification information, the user's personal vision-related information is retrieved from the user information storage database 94. The personal vision-related information is sent to the VR display unit 10, and the eyepiece tube horizontal movement means 8 sets the interpupillary distance, and the spherical lens adjustment means 22 sets the spherical lens power value. The user information storage means 25 may be stored within the main unit 1 or in a device other than the head-mounted display main unit, such as a PC.

[0209] FIG. 56 shows a flowchart (S200) for resetting.

[0210] The difference from the flowchart in Figure 52 is that at the beginning of the processing in step S200, processing is added to retrieve personal corrective visual acuity information from the user information storage / setting means, and the retrieved interpupillary distance and spherical lens power values ​​are used to perform settings.

[0211] The conversion formula for the power based on the vertex distance can be calculated using formula (1). １ =D ０ / (1-(L １ -L ０ ) x D １ ) Equation (1) where, ΔD １ : Conversion frequency D ０ : Power when creating eyeglass prescription information L ０ : Distance between vertices when creating eyeglass prescription information [m] L １ : Distance between vertices when in use [m]

[0212] For example, suppose that when a user's eyeglass prescription was created, the vertex distance was the standard 12 mm and the power was -8.00. ０ = -8.00, L ０ = -0.0012 [m] If the distance between the vertices is 14 mm when the user wears the head mount, L １ = -0.0014 [m] to ΔD １ In other words, since the vertex distance has increased from 12 mm to 14 mm, if you want to obtain the same corrective effect as when the eyeglass prescription was created, the power needs to be set to -8.13.

[0213] The interpupillary distance adjustment flow S210 called in step S003 of the flowchart of S200 and the diopter adjustment process (automatic) S220 and (manual) S230 called in step S102 are different.

[0214] In the flow S210 for adjusting the interpupillary distance, in step S211, the interpupillary distance value in the personal corrective visual acuity information extracted from the user information storage and setting means 92 is set in the horizontal lens barrel movement means. In step S212, the horizontal lens barrel movement means uses the interpupillary distance value to move the lens barrel 3 so that the distance of the lens barrel 3 matches the interpupillary distance of the user.

[0215] In step S220 of the diopter adjustment process (automatic), in step S221, the value of the spherical lens power included in the personal corrective visual acuity information extracted from the user information storage / setting means 92 is set in the spherical lens adjustment means 22. In step S222, the spherical lens adjustment means is set using the value of the spherical lens power.

[0216] In the diopter adjustment process S230, a guide image that makes it easy for the user to adjust the diopter is displayed in step S231. In step S232, the user adjusts the diopter using the spherical lens adjustment means 22.

[0217] An example of a guide image for diopter adjustment is shown in Figure 57. The user adjusts the focus of the right eye and then the left eye, and the previous and current diopter values ​​are displayed, allowing the user to refer to these values ​​when making adjustments.

[0218] If the user wants to abandon or skip the adjustment while the flow of FIG. 52 is being executed, the adjustment process can be ended as an interrupt process at any time, and the head-mounted display can be used.

[0219] In addition, the user identification information input means 93 can also enable accurate automatic individual identification by performing individual identification using eye-specific information (each person's IPD information, eye color, pupil color and size, etc.) that can be generated by the eyeball position measurement means 6.

[0220] FIG. 13 shows an example of a system configuration diagram of the head-mounted display of the present disclosure (an example in which an additional lens mounting means 23 is added to the configuration of (Type 1) in FIG. 12).

[0221] The difference between FIG. 13 and FIG. 12 is that the lens barrel 3 has an additional lens mounting means 23 in front of the lens 4 .

[0222] <Third embodiment> This section describes the second of three solutions to issue 2, "Since small goggles cannot accommodate glasses, mitigation measures are needed for users who wear glasses." This solution is "a mechanism that switches VR space generation parameters such as distortion correction taking into account the thickness of the adapter lens and shift lens."

[0223] Fig. 14 shows an example of the configuration of a head-mounted display according to the present disclosure. Fig. 14A is an example of a schematic diagram of the head-mounted display as seen from above, and Fig. 14B is an example of a system configuration diagram of Fig. 14A. A main body 1 is held on the face of the user by a holding part 2 (all of the configurations (Types 1 to 3) are possible, but this holding mechanism is not shown in Fig. 14 because it is irrelevant).

[0224] 14A and 14B, in addition to the components of the basic structure of the head-mounted display shown in FIG. 1, there is a VR display unit 10 composed of an additional lens attachment means 23, a mirror-barrel horizontal movement means 8 for moving the mirror-barrel portion 3 left and right to match the interpupillary distance to that of the user, an optimal vertex distance information storage means 20, and a mirror-barrel portion control means 7 for controlling the movement of the mirror-barrel portion 3 by controlling the mirror-barrel horizontal movement means 8 and reporting the adjusted lens position to a lens position information storage means 18.

[0225] The VR display control unit 11 has a VR image generation means 15, and converts VR image data 16 or VR data generated by the VR application 16 into an image to be displayed on the VR display unit 10 based on the 6DoF information. The converted image is sent to the VR display unit 10 via a distortion correction means 14 that corrects distortion based on distortion correction data based on the optical characteristics of the lens 4 and other elements of the VR display unit 10, which are stored in a lens distortion information group storage means 24.

[0226] Using Figure 58, we will discuss the issues that arise when using an additional lens 90. As shown in Figure 58C, if the design inter-vertex distance 54 is sufficiently wide, such as 15 mm or more, even when the additional lens 90 is inserted, the inter-vertex distance 41 will be 12 mm or more, which is equal to or greater than the inter-vertex distance 41 of eyeglasses. This prevents discomfort caused by the additional lens 90 hitting the eyelashes. However, if the design inter-vertex distance 54 is about 12 mm (a closer distance is advantageous because it allows for a wider FoV, but 12 mm is the limit), wearing the additional lens 90 will result in a distance of about 10 mm, which will cause the problem of the additional lens being too close to the eyeball 40. Therefore, in such cases, instead of adjusting the distance between the lens 4 and the eyeball 40 to the design inter-vertex distance 54 as shown in Figure 58D, the problem of the additional lens being too close to the eye can be avoided by adjusting the distance between the additional lens 90 and the eyeball 40 to the design inter-vertex distance 54. In this case, the vertex distance 91, which is the distance between the lens 4 and the eyeball plus the thickness of the additional lens, becomes larger than the design value of the vertex distance 54. If a head-mounted display is used in this state, the expected VR space cannot be viewed because parameters such as distortion correction are set to the design value of the vertex distance 54.

[0227] To solve this problem, the lens distortion information group storage means 24 stores distortion correction parameters for vertex distance 91, which is the sum of the thickness of the additional lens when the additional lens 90 is added to the distortion correction parameters for vertex distance 54, which is the design value when no additional lens is present, and switches between the created (or dynamically created) lens distortion information depending on whether the additional lens 90 is attached to the additional lens attachment means 23, the thickness of the additional lens, etc.

[0228] In other words, when no additional lens is used, if the design value of vertex distance 54 is 12 mm, VR is displayed using lens distortion correction information for 12 mm. When an additional lens is attached, if the design value of vertex distance 54 is 12 mm, VR is displayed using lens distortion information generated using the value of 12 mm + the thickness of the adapter lens.

[0229] Here, we will explain the lens distortion information based on the optical characteristics of the lens 4 and other components of the VR display unit 10, which is stored in the lens distortion information group storage means 24. It is known that the distortion aberration of a head-mounted display can be expressed by the following formulas (A) and (B).

[0230] X ｄ = p ２ (3x ２ +y ２ ) + x{k ２ (x ２ +y ２ ) ２ +k １ (x ２ +y ２ ) + 1} + 2p １ xy Formula (A) Y ｄ = p １ (x ２ +3y ２ ) + y{k ２ (x ２ +y ２ ) ２ +k １ (x ２ +y ２ ) + 1} + 2p ２ xy Formula (B) where (x, y) are coordinates with the center of the lens as (0, 0), (X ｄ , Y ｄ ) is the coordinate after distortion correction, k １ , k ２ is the radial distortion coefficient of the lens, p １ , p ２ denotes the distortion coefficient of the lens in the circumferential direction.

[0231] Due to the optical characteristics of the head-mounted display, １ , k ２ , p １ , p ２Since the parameters are given, distortion can be corrected by performing inverse correction of equations (A) and (B) based on these parameters.

[0232] The lens distortion information storage means 19 and the lens distortion information group storage means 24 store k distortion information based on the vertex distance of the design value. １ , k ２ , p １ , p ２ Furthermore, the lens distortion information group storage means 24 stores the parameters k as distortion information based on the design value of the vertex distance and the thickness of the additional lens. １ , k ２ , p １ , p ２ The provision of lens distortion information group storage means 24 having such a configuration allows the VR display control unit 11 to correct any deviations in the inter-vertex distance that are not sufficiently adjusted by using distortion information based on the design value of the inter-vertex distance and the thickness of the additional lens.

[0233] Figure 15 shows another embodiment of the configuration of the head-mounted display of the present disclosure. Figure 15A is an example of a schematic diagram of the head-mounted display as seen from above, and Figure 15B is an example of a system configuration diagram of Figure 15A. The main body 1 is held on the user's face by a holding part 2 (all of the configurations (Types 1 to 3) are possible, but this holding mechanism is not shown in Figure 14 because it is irrelevant).

[0234] 15A and 15B , in addition to the configuration shown in Fig. 14 , a spherical lens adjustment means 22 is provided in addition to the components of the basic structure of the head-mounted display. This configuration is for realizing the diopter adjustment function using the shift lens and spherical lens adjustment means 22 described in Fig. 11. As in Fig. 14 , when the design value for vertex distance 54 is narrow, at around 12 mm, lens distortion information group storage means 24 has distortion correction parameters for both cases without an additional lens and for an additional lens, and by switching the parameters depending on whether or not an additional lens is present, optimal VR space viewing is realized regardless of whether or not an additional lens is present.

[0235] 16A and 16B are MR goggle versions of FIGS. 14A and 14B.

[0236] 17A and 17B are MR goggle versions of FIGS. 15A and 15B.

[0237] The function of switching the distortion correction parameters depending on whether or not the additional lens is present as shown in FIG. 14 functions in the same way for both VR goggles and MR goggles.

[0238] Fourth Embodiment

[0239] This section describes the third of three solutions to issue 2, "Since small goggles cannot accommodate eyeglasses, mitigation measures are needed for eyeglass wearers." This solution is "to realize a virtual eyeglass function within a head-mounted display based on eyeglass prescription information."

[0240] The virtual glasses function aims to achieve the same effect as wearing glasses by obtaining a glasses prescription or a set of corrective vision information measured from glasses, and setting the interpupillary distance, spherical lens strength, etc. in the head-mounted display based on the values ​​of that set of corrective vision information, and then adjusting the upper and lower wearing positions and the position between the vertices to the correct lens-to-eye position relationship equivalent to that of glasses.

[0241] In order to realize the virtual glasses function, the meaning of glasses prescription information and an auto lens meter that can read glasses prescription information from glasses will be explained.

[0242] Figure 59 shows an eyeglass prescription in Japan and eyeglass information obtained from an auto lens meter. An eyeglass prescription has two powers: one for distance vision (For Distance) and one for close vision (For Reading). In the case of a head-mounted display, the image itself is displayed on a display panel near the eyes, but in the VR space, the image is displayed at a distance through the lenses, so the virtual eyeglasses function uses the "distance" power.

[0243] Figure 59A shows the data of a glasses prescription. The corrective visual acuity information for a glasses prescription uses information on the left and right eyes for six items: spherical power, cylindrical power, astigmatism axis, prism, base, and interpupillary distance.

[0244] Spherical power (SPH) is the power of a spherical lens used to correct myopia and hyperopia, with a "-" value for myopia and a "+" value for hyperopia. Cylinder power (CYL) is the power of a cylindrical lens used to correct astigmatism. Astigmatism axis (AXIS) indicates the inclination direction of the astigmatism axis and is expressed as an angle of 0° to 180°. Prism (PRISM) is a numerical value used to correct strabismus and is measured in delta prism diopters. Base (BASE) indicates the direction of prism correction and is expressed as IN (inward), OUT (outward), UP (upward), DOWN (downward), or a value between 0 and 360 degrees. Pupil distance (PD) is the distance from the center of the face to the center of the pupils of the left and right eyes.

[0245] Figure 59B shows an example of measurements taken with an auto lens meter. An auto lens meter is a device that can read lens information from eyeglasses. (See, for example, https: / / www.nidek.co.jp / products / glasses / optical_list / optical_lensemeter / lm-1800pd.html.)

[0246] The distance correction visual acuity information group read from the glasses using the autolens meter can extract the same information as the information in the glasses prescription (spherical power, cylindrical power, astigmatism axis, prism, base and PD information for each eye).

[0247] FIG. 18 shows an outline of the configuration of an embodiment of VR goggles having a spherical lens adjustment means.

[0248] 18 shows a system configuration diagram of one embodiment of the configuration of the head-mounted display of the present disclosure (an example in which a corrective vision correction means 26 is added to the configuration of (Type 1) in FIG. 6). FIG. 18 also shows a configuration in which a corrective vision correction means 26 is added instead of the user information storage means 25 in FIG. 12.

[0249] The difference from Figure 6B is that it has a corrected vision correction means 26 which includes a corrected vision information input means 28 for the user wearing glasses to input their own corrected vision information 29 when starting to use the head-mounted display, a corrected vision information storage means 27 for storing that information, and a corrected vision information setting means 101 which transmits that information to various setting means of the head-mounted display and sets the value of that information.

[0250] The corrective vision information setting means 101 retrieves the corrective vision information stored in the corrective vision information storage means 27 and provides it to the spherical lens adjustment means 22 and the lens barrel horizontal movement means 8 via the lens barrel control means 7, thereby realizing a usage environment based on the user's corrective vision information.

[0251] FIG. 60 shows a flow chart (S300) of the configuration diagram of FIG.

[0252] The flowchart in Figure 60 is almost the same as the flowchart in Figure 56, and the differences from the flowchart in Figure 56 are that at the beginning of the processing in step S300, the processing of "retrieving individual corrected visual acuity information from the user information storage / setting means" in step S201 has been replaced with the addition of step S301 "obtaining corrected visual acuity information 29 in the corrected visual acuity information input means 28", step S302 "saving corrected visual acuity information 29 in the corrected visual acuity information storage means 27", and step S303 "setting corrected visual acuity information 29 in the corrected visual acuity information setting means 101", and that in the interpupillary distance adjustment flow S210 and the diopter adjustment flow, corrected visual acuity information 29 is instead set.

[0253] An example of a guide image for diopter adjustment is shown in Figure 61. The user adjusts the focus of the right eye and then the left eye, and since the power of the user's corrected visual acuity and the current power are displayed, the user can adjust the power of the corrected visual acuity to the target value.

[0254] FIG. 19 shows an example of a system configuration diagram of the head-mounted display of the present disclosure (an example in which an additional lens mounting means 23 is added to the configuration of (Type 1) in FIG. 18).

[0255] The only difference between FIG. 19 and FIG. 18 is that the lens barrel 3 has an additional lens mounting means 23 in front of the lens 4 .

[0256] 18 is that it is possible to attach a personal lens or a shift lens to the additional lens attachment means 23, which is not shown in Fig. 18. Therefore, even if the spherical lens power of the eyeglasses user exceeds the adjustment range of the spherical lens adjustment means of the head-mounted display, the virtual eyeglasses function can be realized by inserting a shift lens into the additional lens attachment means 23.

[0257] If the eyeglasses user's spherical lens power exceeds the adjustment range of the head-mounted display's spherical lens adjustment means, a warning is displayed to the user to encourage them to wear shift lenses, and the adjustment value of the spherical lens adjustment means must be reduced by the amount of the shift lenses.In addition, even if the user's face direction changes, for example, if they look down or tilt, the display screen follows the change in face direction, so the astigmatism distortion correction process does not change.

[0258] Furthermore, if means for detecting whether or not an additional lens is attached and for detecting the type of attached additional lens (such as the power of a shift lens) are added to the additional lens attachment means 23, user convenience will be further improved.

[0259] In Figures 18 and 19, adjustment of the depth direction (distance between vertices) of Figure 2 (Type 1) is shown using VR goggles with a movement mechanism for the lens barrel part 3, but a similar configuration is also possible in the case of MR goggles of Figure 3 (Type 2), Figure 4 (Type 3), and Figure 5 by adding corrective vision correction means 26.

[0260] 20 and 21 show a similar configuration to that of FIGS. 18 and 19, in which a corrective vision correction means 26 is added to the MR goggles.

[0261] 18, 19, 20, and 21 show a configuration in which only the spherical lens power and interpupillary distance are used as the corrective visual acuity information 29. In addition to the spherical lens power and interpupillary distance, the corrective visual acuity information 29 may also include the cylindrical power and astigmatism axis for astigmatism correction. A method for realizing the virtual glasses function in this case of astigmatism will be described.

[0262] First, a brief explanation of astigmatism. Astigmatism is a condition in which the focus of vision does not converge in one place, meaning that the light cannot be focused on the retina. There are two types of astigmatism: regular astigmatism and irregular astigmatism.

[0263] The eye is able to see a focused image by refracting incoming light with the cornea and crystalline lens, which act as lenses, and focusing it at a single point. If the cornea and crystalline lens are perfectly spherical, the focus will be at a single point at the back of the eye. Regular astigmatism occurs when the cornea or crystalline lens is shaped like a rugby ball, tilted in one direction (up and down, left and right, or diagonally), making it impossible to focus at a single point. This results in a symptom where, even when trying to focus on the retina, certain lines are clearly visible, but lines that intersect at right angles to those lines are difficult to see. This condition can be corrected with cylindrical lenses. What is usually referred to as "astigmatism" is regular astigmatism.

[0264] Irregular astigmatism cannot be corrected with glasses because it is caused by irregular corneas that cannot be corrected with cylindrical lenses. Therefore, this virtual glasses only targets regular astigmatism.

[0265] Regular astigmatism is divided into straight astigmatism, against-the-rule astigmatism, and oblique astigmatism depending on the direction of distortion. Figure 62 shows the symptoms of three types of astigmatism. Figure 62A shows an astigmatism test chart, Figure 62B shows examples of straight astigmatism, Figure 62C shows against-the-rule astigmatism, and Figure 62D shows examples of oblique astigmatism. Straight astigmatism is the most common type of astigmatism, with the top and bottom squashed like a sideways rugby ball. Vertical lines are clearly visible, but horizontal lines appear blurred. Against-the-rule astigmatism is a type of astigmatism where the left and right sides are squashed, with horizontal lines clearly visible, but vertical lines are difficult to see. Oblique astigmatism is a type in which the cornea or lens is tilted, making it easy to see diagonal lines and difficult to see lines that intersect at right angles to them.

[0266] Regular astigmatism can be corrected with cylindrical lenses. Since eyeglass prescriptions contain the cylinder power and the axis of astigmatism, these two values ​​can be used to visually reproduce the effect of cylindrical lenses. This can be achieved using the same methods as for correcting lens aberrations and distortions.

[0267] The cylindrical lens adjustment means deforms the image in the same manner as in aberration correction, based on information about the cylindrical lens, in order to correct regular astigmatism. The mathematical formula for deformation is: the cross-sectional power of the cylindrical lens is sin ２ Since the angle θ is θ, it can be obtained by the formula (2): R(θ) = R × sin ２ θ Formula (2) where R: refractive power in the direction of the principal meridian of greatest strength (D) θ: deviation angle of the principal meridian from the principal meridian of greatest strength of the cylindrical lens (the position where the meridian direction is perpendicular to the direction of the principal meridian of greatest strength is 0°) R(θ): refractive power on the principal meridian at a deviation angle θ from the principal meridian of greatest strength of the cylindrical lens

[0268] Using a cylindrical lens CYL +4D 180 degrees as an example, a method for calculating the refractive power distribution will be described using FIG. 81 . From the cylindrical lens information, it can be seen that the distortion of one of the user's eyes is vertical (180°) straight astigmatism, with an astigmatism power of +4D. A cylindrical lens has a "power direction," which is a direction in which the lens has optical power and generates refractive power along the direction of the lens curvature, and a "non-power direction" in which the lens has no optical power. In FIG. 81 , the power direction of the cylindrical lens is aligned with the Y-axis direction (vertical direction) in accordance with the state of vertical straight astigmatism and the direction of the strongest meridian of the user's eye. In other words, the power direction of the cylindrical lens is positioned along the Y-axis. Note that if the center of the display screen of the VR video in FIG. 81 is the origin O (0,0), the central axis of the cylindrical lens in FIG. 81 is positioned at a position passing through the origin O of the display screen of the VR video. In Figure 81, the astigmatism angle is 180 degrees, so the central axis of the cylindrical lens is the X-axis. Also, the length of the cylindrical lens in the power direction is equal to the width of the display image plane in the Y-axis direction. Here, the display screen of the VR video is assumed to be approximately the same as the VR video displayed on the display panel.

[0269] Therefore, for example, in the case of a cylindrical lens CYL+4D180 degrees, the power in each direction is: 30 degrees direction is 4D×sin ２ (30°) = D 60 degree direction is 4D × sin ２ (60°) = 3D, which can be calculated.

[0270] By performing similar calculations for multiple meridian angles, the refractive power distribution on the display screen of the VR image can be calculated. In addition, the refractive index distribution can be used to correct distortion due to the user's astigmatism in the displayed image.

[0271] 63 and 64 show a specific example of the process.

[0272] FIG. 63 is a diagram for explaining the basic concept of correcting regular astigmatism.

[0273] The top row of Figure 63 shows that when a user with astigmatism looks at the left-hand figure, it appears as if it were the right-hand figure. In other words, this is the case of regular astigmatism, where the top and bottom appear to be compressed relative to the left and right.

[0274] The bottom diagram shows a method for correcting astigmatism that appears like this using VR so that the image appears correct.

[0275] The figure at the far left of the bottom row appears the same as the figure at the left of the top row. If we add a vertically stretched deformation to correct for astigmatism, we get the figure at the second from the left of the bottom row. If we add the distortion correction in the VR basic software at the third from the left of the bottom row to correct the distortion that VR has at the fourth from the left of the bottom row, we get the figure at the third from the right of the bottom row. This is the same as the figure at the second from the left of the bottom row after astigmatism correction. This is the figure displayed on the display panel and seen through the lens. When a person with astigmatism looks at this, because the astigmatism's characteristics are those of the second from the right of the bottom row, which are compressed vertically, the image that the person with astigmatism sees will be the figure at the far right of the bottom row, which matches the figure at the far left of the bottom row that they want to display.

[0276] As described above, in the case of regular astigmatism, actual astigmatism correction is performed based on cylindrical lens information.

[0277] Figure 64 is a diagram for explaining the basic concept of correcting regular astigmatism, similar to Figure 63. The difference from Figure 63 is that it is a diagram for regular astigmatism that appears to be contracted in a diagonal direction tilted to the right, that is, when the astigmatic axis is oblique.

[0278] The upper left figure is the same as in Figure 63, and the right figure is the figure as seen by a person with astigmatism.

[0279] The lower part shows a method for correcting such astigmatism using VR, similar to that shown in FIG.

[0280] As in Figure 63, by adding the astigmatism correction second from the left in the figure below, the figure on the right side of the bottom row becomes the figure seen by the person with astigmatism, and astigmatism has been corrected. As in Figures 63 and 64, in the case of regular astigmatism, astigmatism can be corrected by adding a correction with the inverse characteristics using VR to the regular astigmatism indicated by the cylindrical lens power and astigmatism axis written on the prescription.

[0281] FIG. 22 shows an outline of the configuration of an embodiment of VR goggles with a virtual glasses function having a spherical lens adjustment means and a cylindrical lens adjustment means.

[0282] FIG. 22 shows a system configuration diagram of one embodiment of the configuration of the head-mounted display of the present disclosure (an example in which an adjustment means for dealing with astigmatism is added to the configuration of (Type 1) in FIG. 18).

[0283] The difference between Fig. 22 and Fig. 18 is that a cylindrical lens adjustment means 30, which is an adjustment means for dealing with astigmatism, has been added to the vision correction means 26, and an astigmatism correction means 31 has been added to the VR display control unit 11. The cylindrical lens adjustment means 30 extracts astigmatism-related information, such as cylindrical power and astigmatism axis information, from the vision correction information storage means 27, and passes it to the astigmatism correction means 31. The astigmatism correction means 31 uses the astigmatism-related information to perform the astigmatism correction processing described in Figs. 63 and 64, and outputs the corrected image to the distortion correction means.

[0284] FIG. 65 shows a flow chart (S400) of the configuration diagram of FIG.

[0285] The flowchart in Fig. 65 is the flowchart in Fig. 60 to which an astigmatism processing section has been added. The difference from the flowchart in Fig. 60 is that at the end of S300 in the flowchart in Fig. 60, there is added a section in which the current cylindrical power is retrieved from the cylindrical lens adjustment means in step S414, and a section in which it is determined in step S415 whether or not the retrieved cylindrical power matches the cylindrical power of the corrected visual acuity information (because if they match, the cylindrical power setting process is not necessary), and if they do not match, there is added a section in step S416 to call the cylindrical lens adjustment process.

[0286] In the cylindrical lens adjustment process of step S410, in step S411, the cylindrical lens adjustment means 30 extracts information related to astigmatism, such as cylindrical power and astigmatism axis information, from the corrective visual acuity information storage means 27. In step S412, the cylindrical lens adjustment means 30 passes the cylindrical lens information group to the astigmatism correction means 31, so that the astigmatism correction means 31 processes the astigmatism correction process contents in accordance with the information in the cylindrical lens information group.

[0287] 23 and 24 show an outline of the configuration of an embodiment of MR goggles with a virtual eyeglass function, which has a spherical lens adjustment means and a cylindrical lens adjustment means. The corrective vision information stored in the corrective vision information storage means 27 is the same as that shown in FIG. 22, and the functions of the cylindrical lens adjustment means 30 and the astigmatism correction means 31 are also the same as those shown in FIG.

[0288] The only difference between Figures 23 and 24 is that in Figure 23, the astigmatism correction means 31 is performed after the VST image from the VST image processing means 35 and the VR image from the VR image generation means 15 are combined in the VST image combination means 36, or before the combination.

[0289] 22, 23, and 24 show a configuration in which information for correcting astigmatism is used in addition to spherical lens power and interpupillary distance as corrective visual acuity information 29. In addition to spherical lens power, interpupillary distance, and cylinder power and astigmatism axis for correcting astigmatism, corrective visual acuity information 29 may also include information on prisms and bases for correcting strabismus. A method for realizing the virtual eyeglasses function for an eyeglasses prescription to which strabismus correction information has also been added will be described.

[0290] First, a simple explanation of strabismus will be given using Figure 66. Strabismus is a condition in which, when looking at an object, both eyes turn in the direction of the target, but while one eye is looking at the target, the other eye turns in a different direction from the target. As shown in Figure 66A, strabismus can be classified into esotropia, exotropia, and hypertropia (hypotropia) depending on the position of the eyes. Mild strabismus can be improved by using a prism, as shown in Figure 66B.

[0291] In the case of a head-mounted display, separate images can be displayed to each eye to enable stereoscopic vision. In the case of a person with strabismus, the image for each eye is misaligned because the person is looking in a direction different from the line of sight assumed by the head-mounted display, which not only prevents binocular stereoscopic vision but can also cause unpleasant symptoms such as VR sickness.

[0292] Therefore, alleviating strabismus is extremely important when users with strabismus use head-mounted displays.

[0293] With a head-mounted display, the image of the VR space displayed on the panel is viewed through lenses, making correction more difficult than with glasses. However, when generating the VR space, a virtual prism can be realized by changing the shooting axis of the virtual camera. Therefore, for mild strabismus, if the user's strabismus information (prism, base) is available, it can be accommodated by changing the display axis (virtual camera angle, etc.) based on that information.

[0294] Using Figure 67, we will discuss the issues faced by users with strabismus when using head-mounted displays.

[0295] Figure 67A shows the ideal display panel and lens arrangement for strabismus in which the left eye is facing outward, and Figure 67B shows the actual display panel and lens arrangement. The ideal display panel / lens arrangement would be directly facing the eyeball, so it should be as shown in Figure 67A, but in reality, the left and right display panels / lenses are generally fixed in the same way, so it ends up looking like Figure 67B. As a result, the left eye looks outward from the display panel, and with the usual display method of a head-mounted display, it will see a slightly distorted image.

[0296] Additionally, the different fields of view of the left and right eyes make stereoscopic vision difficult. For this reason, measuring the strabismus condition and, in the case of this diagram, correcting the image on the display panel for the left eye can provide a better VR viewing experience.

[0297] Specifically, this is achieved by changing the angle of the virtual camera for the left eye according to the degree of strabismus and modifying the distortion parameters as necessary. Also, since excessive differences from the actual field of view can cause severe fatigue, it is effective to adjust the degree of correction according to the user's preferences. Similar corrections can be made for other types of strabismus.

[0298] 68 and 69 are diagrams for explaining the basic concept of correcting strabismus using VR. Fig. 68 shows a situation where a person with strabismus is viewing an image displayed in VR.

[0299] Figure 68A shows the concept of VR video display. VR video displays images seen by each eye on display panels for the left and right eyes. This is achieved by displaying images of the VR space to be displayed on the left and right display panels, captured by virtual cameras (virtual cameras) that capture 3D space at the positions of the left and right eyes. Figure 68B illustrates the situation of a normal person without strabismus looking at the left and right display panels. Because both the left and right eyes are facing forward, they are facing the same direction as the virtual cameras in Figure 68A, allowing the VR video to be viewed without any problems and providing proper stereoscopic vision.

[0300] Figure 68C shows the situation when a person with strabismus views the same 3D space. In this figure, the left eye is facing outward, which does not match the direction of the virtual camera, making it difficult to achieve a proper stereoscopic view.

[0301] Figure 69A shows a method for correcting strabismus as shown in Figure 68A using VR. First, as shown in Figure 69A, the virtual camera for the left eye is turned in the opposite direction depending on the degree of strabismus. In this case, since the strabismus is directed to the left, the virtual camera is turned to the right. The situation when viewing this as VR is shown in Figure 68B, where the image for the left eye is shifted slightly to the left. When a person with strabismus views this, the left eye is turned outward to the left, so the image displayed with the left eye is shifted slightly to the right as shown in Figure 69B, and the left and right eyes see images that are almost the same as those seen by a normal person.

[0302] In reality, the brain also makes corrections to the images seen by the eyes, so the amount of correction needs to be adjusted according to the condition of the person with strabismus. One guideline is the prism and base values ​​of the prescription. From here, adjustments can be made while actually viewing in VR to achieve a comfortable viewing experience.

[0303] Figures 82A and 82B are diagrams illustrating the basic concept of correcting strabismus using VR. Figure 82A shows a situation in which a person with strabismus in the left eye is viewing an image displayed in VR without correction. The central diagram in Figure 82A is a plan view showing the shooting ranges of the virtual camera for the right eye and the virtual camera for the left eye in a virtual space. The diagram on the right side of Figure 82A shows the field of view when a display screen of a VR image captured by the virtual camera for the right eye is viewed with a normal right eye. The diagram on the left side of Figure 82A shows the field of view when a display screen of a VR image captured by the virtual camera for the left eye is viewed with a strabismus-affected left eye. In the diagram on the right side of Figure 82A, an object 211 is located near the center of the field of view of a normal right eye. However, in the diagram on the left side of Figure 82A, because the left eye with strabismus is facing inward, the field of view is tilted to the right, and it can be seen that the object 211, which is actually located near the center of the field of view, is shifted to the left of the center of the field of view.

[0304] Figure 82B shows a situation in which a person with strabismus in the left eye is viewing an image displayed in VR with correction. The central diagram of Figure 82B is a plan view showing the shooting ranges of the virtual cameras for the right eye and the left eye in the virtual space. Note that in the central diagram of Figure 82B, the virtual camera for the left eye is pointed outward and its shooting range is tilted to the left to accommodate the strabismus of the left eye. The diagram on the right side of Figure 82B shows the field of view when the display screen of the VR image captured by the virtual camera for the right eye is viewed with a normal right eye. The diagram on the left side of Figure 82B shows the field of view when the display screen of the VR image captured by the virtual camera for the left eye is viewed with a strabismus-affected left eye. In the diagram on the right side of Figure 82B, an object 211 is located near the center of the field of view of the normal right eye. On the other hand, in the left image of Figure 82B, the left eye, which has strabismus, is facing inward, so the field of view is tilted to the right. However, since the shooting range of the virtual camera for the left eye was tilted to the left in the first place, the tilts of the two cancel each other out, and it can be seen that object 211, which should be located near the center of the field of view, is positioned near the center of the field of view as it should be.

[0305] Furthermore, when the user's face changes direction, for example, when they look down or tilt their head, the virtual camera follows the change in face direction, so processing does not change depending on the face direction. Correct strabismus correction is possible by moving the virtual camera according to the face direction while adding strabismus correction to the virtual camera in a horizontal, frontal position.

[0306] Fig. 25 shows an outline of the configuration of an embodiment of VR goggles with a virtual glasses function having a spherical lens adjustment means, a cylindrical lens adjustment means, and a prism adjustment means. Fig. 25 shows a system configuration diagram of an embodiment of the configuration of the head-mounted display of the present disclosure (an example in which an adjustment means for adjusting for strabismus is added to the configuration of (Type 1) in Fig. 22).

[0307] The difference between Figure 25 and Figure 22 is that a prism adjustment means 32, which is an adjustment means for dealing with strabismus, has been added to the vision correction means 26. The prism adjustment means corrects strabismus by appropriately adjusting the VR image generation means based on the prism information group stored in the vision correction information storage means. In addition, by adjusting the distortion correction means as necessary, better VR images can be provided to the user.

[0308] FIG. 70 shows a flow chart (S500) of the configuration diagram of FIG.

[0309] The flowchart in Fig. 70 is the flowchart in Fig. 65 to which a strabismus processing section has been added. The difference from the flowchart in Fig. 65 is that at the end of S400 in the flowchart in Fig. 65, a section has been added in which it is determined whether or not the prism and base values ​​of the prism adjustment means in step S516 match the prism and base values ​​of the corrected visual acuity information (because if they match, prism adjustment processing is not required), and if they do not match, prism adjustment processing is called in step S517.

[0310] In the prism adjustment process of step S510, in step S511, the prism adjustment means 32 extracts information related to strabismus, such as prism power and base information, from the corrective vision information storage means 27. In step S512, the prism adjustment means 32 changes the processing of the VR image generation means 15 in accordance with the information in the prism information group. In step S513, it is determined whether distortion correction processing is necessary, and if necessary, in step S514, the distortion correction means 14 performs the processing required for prism processing.

[0311] Figure 26 shows an outline of an embodiment of MR goggles with a virtual eyeglass function that has a spherical lens adjustment means and a cylindrical lens adjustment means. The corrective vision information stored in the corrective vision information storage means 27 is the same as in Figure 23, and the functions of the cylindrical lens adjustment means 30 and astigmatism correction means 31 are the same as in Figure 22, but differ in that information from the prism adjustment means 32 is input to the VST image processing means 35, and the image from the VST camera is corrected to match the VR image according to the user's prism information.

[0312] Figures 27, 28, and 29 show cases where a head-mounted display with a virtual glasses function is shared by multiple people. It is extremely cumbersome to re-enter the corrected vision information for the virtual glasses function every time a new user changes. Therefore, it is desirable to be able to store corrected vision information for multiple people, as shown in Figure 12. Figure 27 has the same configuration as Figure 12, with the addition of a user information storage means 25 and a user identification information input means 93 to Figure 18. Similarly, Figure 28 and Figure 29 are configurations similar to Figure 20 and Figure 25, respectively, with the addition of a user information storage means 25 and a user identification information input means 93.

[0313] The user identification information input means 93 has a means for detecting personal identification information (irradiance, fingerprint, IC card, ID input) and a means for storing eyeglass prescription information for multiple people (eyeglass prescription information DB) on the VR goggles themselves or on a server, etc., and can have a means for retrieving the individual's eyeglass prescription information from the eyeglass prescription information DB based on the personal identification results, thereby eliminating the need to set it up every time and allowing each person to use the head-mounted display in their optimal viewing conditions (by using virtual glasses with eyeglass prescription information).

[0314] As shown in Fig. 71A, a head-mounted display (VR system) is composed of three components: a VR display unit, a VR display control unit (3D space generation means), and an input means. Also, as shown in Fig. 71E, a head-mounted display (MR system) is composed of five components: a VR display unit, a VR display control unit (3D space generation means), and an input means, as well as a VST input means and a VST video synthesis means.

[0315] As shown in Fig. 71, head-mounted displays (VR systems, MR systems) are divided into integrated types shown in Fig. 71A and 71E and separated types depending on the placement of the VR display control unit (3D space generation means) which requires heavy GPU processing. The separated types include three types: a PC-connected type shown in Fig. 71B and 71F, a smartphone-connected type shown in Fig. 71C and 71G, and a cloud-linked type shown in Fig. 71D and 71H, for a total of four configuration examples.

[0316] Figures 71A and 71E show examples of an integrated type. The integrated type has a configuration in which all three VR functions and five MR functions are included in the head-mounted display. Therefore, the VR / MR app is executed on the main body of the head-mounted display. Even with an integrated type, VR data and VR images may be obtained from a PC or cloud via a wireless network and displayed on the head-mounted display.

[0317] Figures 71B and 71F show examples of a separate type (PC-connected type). The head-mounted display is connected to a nearby PC (computer) via a wired or wireless connection, and the VR display control unit (3D space generation means) runs on the PC. In a VR head-mounted display, only the VR display unit and input means run. Specifically, the display unit plays VR video and audio sent from the PC, and the input unit inputs audio, head tracking, controller input, and other information and transmits it to the PC. The VR application runs on the PC. Similarly, in the case of an MR head-mounted display, functions other than the VR display control unit are performed on the head-mounted display side. In rare cases, video obtained by the VST input means is sent to the PC, and the PC also has a VST video synthesis means (however, in this configuration, since the video obtained by the VST input means is sent to the PC for synthesis processing, there is a concern of delays in the playback of the synthesized image).

[0318] Figures 71C and 71G show examples of a separate type (smartphone-connected type). The head-mounted display is connected to a nearby smartphone via wired or wireless connection, and the VR display control unit (3D space generation means) runs on the smartphone. This configuration has the advantage of being compact and easy to use, but since the GPU processing power of a smartphone is inferior to that of a PC, it is not suitable for running complex business VR apps.

[0319] Figures 71D and 71H show examples of a separate type (cloud-connected). The VR goggles are connected to a nearby PC or smartphone via wired or wireless connection, and then connect to the cloud via the PC or smartphone, or directly to the cloud via wireless connection. The VR display control unit (3D space generation means) runs on the cloud side. Performing processing requiring processing power, such as VR video processing, on a cloud server makes it possible to run complex commercial VR apps. However, since processing is performed in the cloud, delays occur, which may make it unsuitable for VR apps that require rapid response to movements. This is particularly advantageous when using a VR app that requires multiple people to experience VR simultaneously.

[0320] As a method for realizing a head-mounted display having a virtual glasses function, an example of a configuration in which only the head-mounted display has the virtual glasses function has been described so far.

[0321] As for the actual sales format of head-mounted displays and virtual glasses functions, head-mounted displays that are optimized for individuals using eyeglass prescription information may, like eyeglasses, be required to obtain medical device certification and be permitted to be sold only in specific sales formats. It is also conceivable that the head-mounted display itself could be sold as a general IT device, with the virtual glasses function sold separately as a software product certified as a medical device. To achieve this, a product structure could be divided into two products: a head-mounted display (a regular IT device) that has the basic control means necessary to realize the virtual glasses function but cannot realize the virtual glasses function, and virtual glasses function control software (medical device certified software) for realizing the virtual glasses function.

[0322] In this configuration where the hardware and software are separated, the function of handling the eyeglass prescription information described above does not work with the head-mounted display alone (for example, the configuration of FIG. 12). However, the function of the present disclosure can be made to work by installing virtual eyeglass function control software in the head-mounted display.

[0323] In the case of a two-body configuration, the head-mounted display (for example, Figures 27 and 29) has a lens barrel horizontal movement means 8 for correcting the interpupillary distance, a vertical position adjustment means 12 for correcting the vertical mounting position, a lens barrel depth movement means 9 for correcting the vertex distance, and a spherical lens adjustment means 22, but does not have a corrective vision information input means 28 or a corrective vision information setting means 101, etc.

[0324] The virtual glasses function control software has a corrective vision information input means 28, a corrective vision information storage means 27, a corrective vision information setting means 101, etc., and can store glasses prescription information. By using the glasses prescription information to control each function of the head-mounted display, VR viewing using the glasses prescription information can be realized.

[0325] FIG. 72 shows a first example of the software configuration of an integrated head-mounted display having a virtual glasses function.

[0326] The VR goggle control software 114 performs basic control of the head-mounted display and communicates with the VR application 16 via the VR basic software 113. The VR application 16 plays audio / video, and the video is displayed as VR on the VR display unit 10 controlled by the VR goggle control software 114 via the VR display control unit 11 controlled by the VR basic software 113. Audio is processed in the same way, but this processing is omitted in this diagram. Head tracking information, controller tracking information (so-called 6DoF information), and audio input from the controller or microphone are passed as VR input to the VR basic software 113 via the VR goggle control software 114 in part, where the 6DoF information and controller information are normalized to control the VR display control software, draw 3D CG, and perform audio communication.

[0327] The VR basic software 113 has the role of enabling various VR applications 16 to connect with the VR goggle control software 114, such as by transforming the video / audio according to the characteristics of the head-mounted display, normalizing head tracking information and controller tracking information into a prescribed format, and sending it to the VR application 16. Here, the cutting out of the VR video according to the tracking information is performed within the VR application 16, but since it is executed using the functions of the VR basic software 113, it is shown in the configuration diagram as being included in the VR display control unit 11.

[0328] The vision correction means control software 115 controls the light source for measuring eyeball position and the camera for measuring eyeball position to measure and adjust the vertex distance through the vision correction means 26 and to correct the interpupillary distance and wearing position. It calculates the eyeball position by measuring the eyeball position from the image acquired from the camera for measuring eyeball position, and then calculates the optimal lens / display panel position based on the calculated value and controls the lens / display panel position by lens / display panel position control to obtain the optimal image. If necessary, these conditions are sent to the VR basic software 113 via the VR goggle control software 114, and VR display control such as optimal distortion correction is performed. The vision correction means 26 can manually change the lens / display panel position in some cases.

[0329] The VR goggle control software 114 also performs communication settings when the power is turned on, other initial settings, and processing when the power is turned off.

[0330] Distortion correction processing is also generally performed by the VR basic software 113 controlling the VR control means, but when the power is turned on or the initial settings are changed, the distortion correction conditions are changed according to the required parameter values, allowing correction to be made according to the characteristics of the VR goggles.

[0331] Cylindrical lens adjustment and prism adjustment, including distortion correction, can be performed by controlling the VR display control unit 11 with the VR basic software 113, but the basic configuration is for the user to make adjustments while viewing a test pattern, etc.

[0332] FIG. 73 shows a first example of the software configuration of the separate type head mounted display of the present invention.

[0333] 72, the head-mounted display is equipped with VR goggle control software 114, corrective vision correction means control software 115, VR display unit 10, and corrective vision correction means 26, while the host such as a PC is equipped with VR basic software 113, VR application 16, and VR display control unit 11. VR input means 17 such as 6DoF information, a microphone, and a controller may be input to the head-mounted display and sent to the PC or may be input directly to the PC.

[0334] In addition, the PC or the like may be a computer connected via a network such as the cloud. In another embodiment, the vision correction means control software 115 and the vision correction means 26 may be provided in the PC or the like.

[0335] FIG. 74 shows a second example of the software configuration of the integrated head mounted display of the present invention.

[0336] The difference from Figure 72 is that it is equipped with corrected vision information processing software 116. The corrected vision information processing software 116 inputs the user's corrected vision information from an input means such as a USB memory or a keyboard, and saves and transmits the saved corrected vision information to the corrected vision correction means control software 115. The corrected vision correction means control software 115 controls the corrected vision correction means 26 based on the transmitted corrected vision information, and performs correction suitable for the user.

[0337] It is also possible to store multiple pieces of corrected vision information in the corrected vision correction means control software 115 and select the appropriate one depending on the usage situation, such as differences in the VR application 16.

[0338] Figure 75 shows a second software configuration example of the separate type VR goggles of the present invention. The difference from Figure 73 is that the VR goggles are equipped with corrective vision information processing software 116. The operation and function are the same as the corrective vision information processing software 116 in Figure 74.

[0339] As in Fig. 73, the PC or the like may be a computer connected via a network such as the cloud. In addition, when the input means is input to the PC or the like and information is sent to the corrected vision information processing software 116, the corrected vision information processing software 116, the corrected vision correction means control software 115, and the corrected vision correction means 26 may be provided in the PC or the like.

[0340] Figure 76 shows a third example of the software configuration of the integrated VR goggles of the present invention.

[0341] 74 is that the corrected vision information processing software 116 directly or indirectly connects to the network to obtain the corrected vision information of the user from the corrected vision information server 118. Other operations are the same.

[0342] When reading corrected vision information from the corrected vision information server 118, the user's ID is confirmed and the latest corrected vision information for that ID is obtained. At this time, it is possible to set permission for use so that corrected vision information cannot be obtained without permission. It is also possible to prevent corrected vision information from being obtained if the corrected vision information stored in the VR goggles is new or locked, and to control acquisition using not only the user's ID but also a password or a passcode in hardware or software.

[0343] Figure 77 shows a third example of the software configuration of the separated VR goggles of the present invention.

[0344] 75 is that the corrected vision information processing software 116 directly or indirectly connects to the network to obtain the corrected vision information of the user from the corrected vision information server 118. Other operations are the same.

[0345] As in Figures 73 and 75, the PC or the like may be a computer connected via a network such as the cloud. In addition, the corrected vision information processing software 116, the corrected vision correction means control software 115, and the corrected vision correction means 26 may be provided in the PC or the like. In this case, the corrected vision server is connected to the PC or the like via a network.

[0346] In a head-mounted display with a virtual glasses function, if a user inputs information other than the glasses prescription information measured at a medical institution, etc. as glasses prescription information, the virtual glasses function will be used in an inappropriate situation. To avoid this risk, some kind of usage restriction can be imposed on the means for storing glasses prescription information, thereby preventing the virtual glasses function from being used with incorrect glasses prescription information.

[0347] To enable this function only with eyeglass prescription information created by an ophthalmologist or a specialized institution, the means for storing eyeglass prescription information is provided with a lock and unlock mechanism. To unlock the function, a key is obtained from a key issuing institution that issues a key to enable this function after confirming that the prescription is appropriate and that the information is that of eyeglass lenses measured by a certified institution (such as a contracted eyeglass store), and the function is enabled after the key is obtained.

[0348] The corrected vision information issued by an ophthalmologist or a certified optician includes an identification ID. If the corrected vision information is on paper rather than computer data, it may be a code or character string based on printed information such as a two-dimensional code.

[0349] An ophthalmologist or a certified optician issues separate identification information, which is input and stored in the identification information input / storage means when the VR goggles or MR goggles app is installed. In the online case, each time corrected visual acuity information is read, the identification information and corrected visual acuity information may be obtained from a set server using a pre-assigned access key.

[0350] As shown in Fig. 78, the corrected vision information input means of the corrected vision correction means compares the identification information 120 input or stored in the identification information input storage means 121 with the identification ID of the input corrected vision information 29 to determine whether the corrected input information is correct, and if correct, validates the input corrected vision information 29. This determination can be made by determining that the identification ID and the identification information 120 are the same, that the result of a predetermined calculation is a predetermined one, etc.

[0351] In order to expand the range of use of head-mounted displays, it is important to provide appropriate virtual glasses functions to an unspecified number of people. For this reason, when assuming that a large number of people will use them at exhibition halls, museums, sales sites, theme parks, etc., it is difficult to have each person prepare their own eyeglass prescription information in advance. For this reason, by linking a machine such as an auto lens meter that reads eyeglass lens information installed in eyeglass stores with a server and multiple VR goggles, eyeglass prescription information can be obtained on the spot and sent to the head-mounted display at the same time, reducing the input work.

[0352] For customers who wear glasses, we lend them a pair of glasses for a short time, measure their vision with an auto-lens meter, etc., and send the data to the VR goggles they will be using, allowing them to see in nearly optimal conditions when they first start using the goggles. As shown in Figure 79, the corrected vision information input means of the corrected vision correction means is connected to a device that reads the corrected vision input information from the user's glasses, such as an auto-lens meter, and can read the read corrected vision information. If there is no online connection, the measured values ​​from the auto-lens meter are sequentially input into the corrected vision information input means. It is also possible to read and recognize printed corrected vision information using a camera, etc.

[0353] A better virtual eyeglass function is realized by providing a function to dynamically change the power of spherical lenses, cylindrical lenses, prisms, etc. according to the user's sensation after wearing the eyeglasses, and storing the setting results as information separate from eyeglass prescription information.

[0354] The device has a function that allows the user to obtain a situation that is different from the prescription information of the glasses but that the user considers to be optimal for VR viewing, and records that information as user-added correction information, and the next time the glasses are worn, the original correction information or the user-added correction information can be loaded and used.

[0355] The virtual glasses function of a head-mounted display sets various settings based on eyeglass prescription information. However, if correction is performed when the values ​​for the left and right eyes are extremely different, there is a risk of incorrect vision.

[0356] This allows the power of the spherical lenses, cylindrical lenses, prisms, etc. to be changed depending on the user's sensation after wearing them. In this case, if certain rules are not met (such as the difference in size between the left and right lenses not exceeding 5%), the system has a function to prohibit modification or to issue a warning and display a message such as "Please consult a doctor before using this value."

[0357] The present disclosure includes the following aspects.

[0358] (1) A method for providing a virtual reality (VR) space or a mixed reality (MR) space to a user having astigmatism in at least one eye using a head-mounted display, the method comprising the steps of: acquiring visual characteristic information of the user's eye; acquiring cylindrical lens information including a cylindrical lens power (D) and a cylindrical lens axis direction (AXIS) from the visual characteristic information; generating a display image for displaying the VR space or the MR space on the head-mounted display based on characteristic information related to the display of the head-mounted display; based on the cylindrical lens information, when the maximum refractive power in the direction of the strongest principal meridian of the user's astigmatism is R, the refractive index R(θ) on the principal meridian that is shifted at an angle θ from the strongest principal meridian of the cylindrical lens is given by equation (2), and generating an astigmatism distortion-corrected image of the user from the refractive power distribution on the principal meridian that is shifted at an angle θ from the strongest principal meridian of the cylindrical lens, with the center of the display image as the origin; and displaying the corrected display image on the head-mounted display. R(θ) = R × sin ２ θ Formula (2)

[0359] (2) A method for providing a VR space or an MR space to a user with strabismus in at least one eye using a head-mounted display, comprising: a step of acquiring visual characteristic information of the user's eye; a step of correcting the orientation of the virtual camera in a direction that cancels out the amount of deviation between the normal gaze direction and the gaze direction obtained from the visual characteristic information of the eye when photographing the VR space or MR space with the virtual camera in a reference coordinate system set in a three-dimensional spatial coordinate system with the lens of the virtual camera as the origin, according to the amount of deviation between the normal gaze direction and the gaze direction obtained from the visual characteristic information of the eye; and a step of displaying the corrected image on the head-mounted display.

[0360] This application is based on U.S. Provisional Application No. 63 / 554,784, filed February 16, 2024, and U.S. Provisional Application No. 63 / 556,207, filed February 21, 2024, the contents of which are incorporated herein by reference.

[0361] The head-mounted display according to the present disclosure can be used to correct 3D spatial images.

[0362] REFERENCE SIGNS LIST 1 Main body 2 Holding unit 3 Lens barrel 4 Lens 5 Display panel 6 Eyeball position measurement means 7 Lens barrel control means 8 Lens barrel horizontal movement means 9 Lens barrel depth movement means 10 VR display unit 11 VR display control unit 12 Up / down position adjustment means 13 Image display processing means 14 Distortion correction means 15 VR image generation means 16 VR image data, VR application 17 Input information (6DoF information, etc.) 18 Lens position information storage means 19 Lens distortion information storage means 20 Optimal vertex distance information storage means 21 Main body-holding unit distance correction means 22 Spherical lens adjustment means 23 Additional lens attachment means 24 Lens distortion information group storage means 25 User information storage means 26 Corrected vision correction means 27 Corrected vision information storage means 28 Corrected vision information input means 29 Corrected vision information 30 Cylindrical lens adjustment means 31 Astigmatism correction means 32 Prism adjustment means 33 Camera 34 VST input means 35 VST image processing means 36 VST image synthesis means 37 3D space generation unit 38 Shielding unit 39 Main unit-holding unit positional relationship correction unit 40 Eyeball 41 Vertex distance 42 Space for glasses 43 Pupil horizontal line 44 Interpupillary distance 45 Line of sight 46 Eyeball center of rotation 47 Deviation amount 48 Vertex distance 49 Distance between centers of rotation 50 Forward tilt angle θ 51 Optical center line 52 Optical center point 53 Design value FoV 54 Design value vertex distance 55 FoV wider than design value 56 Vertex distance narrower than design value 57 FoV narrower than design value 58 Vertex distance wider than design value 59 Side band 60 Headband 61 Temple 62 Deco pad 63 Hinge 64 Nose pad 65 Input means 66 VST input image 67 3D spatial image 68 MR composite image 69 Eyeglasses lens 70 Axis for moving the lens barrel 71 Motor for moving the lens barrel 72 Interpupillary distance correction message (start) 73 Interpupillary distance correction message (reduction instruction) 74 Interpupillary distance correction message (enlargement instruction) 75 Interpupillary distance correction message (end) 76 Interpupillary distance value display 77 Wearing position adjustment (up / down) message (start)78 Wearing position adjustment (up and down) message (instruction to raise) 79 Wearing position adjustment (up and down) message (instruction to lower) 80 Wearing position adjustment (up and down) message (end) 81 Wearing position adjustment (up and down) value display 82 Lens position adjustment message (start) 83 Lens position adjustment message (instruction to move away) 84 Lens position adjustment message (instruction to move closer) 85 Lens position adjustment message (end) 86 Lens position adjustment value display 87 Reduced distance between vertices after movement 88 Lens position before movement 89 Display panel position before movement 90 Additional lens 91 Distance between vertices with thickness of additional lens added 92 User information storage and setting means 93 User identification information input means 94 User information storage database 95 Focus adjustment message (start) 96 Focus adjustment message (right eye) 97 Focus adjustment message (left eye) 98 Focus adjustment message (end) 99 Focus adjustment value display 100 Focus adjustment value display (when resetting) 101 Corrected vision information setting means 102 Focus adjustment value display (when corrected vision is set) 103 Virtual camera 104 3D space image 105 Example of image on display panel 106 Retina image 107 Cylindrical cam 108 Slide axis 109 Slide convex portion 110 Slide concave portion 111 Lens frame 112 Lens barrel outer frame 113 VR basic software 114 VR goggle control software 115 Corrected vision correction means control software 116 Corrected vision information processing software 117 Input means (USB, keyboard, etc.) 118 Corrected vision information server 119 Ophthalmologist or certified optician 120 Identification information 121 Identification information input storage means 122 Identification information authentication means stage 123 Corrected vision information readout 124 User's glasses 125 Auto Lens Meter

Claims

1. A VR or MR goggle system comprising: a VR display control unit that generates VR images from input information including at least VR display data and 6DoF information; a VR display unit that displays the VR images independently for each eye; and a holder with means for fixing the VR display unit to the face or head, wherein the VR display unit has: two left and right lens-tube units that each include at least one lens and a display panel; an eyeball position measurement unit that measures the position of the eyes and the positional relationship and distance between the eyes and the lenses in the lens-tube; and an adjustment unit that uses the eyeball position measurement unit to measure the vertex distance, which is the distance between the user's eyes and the lens in the lens-tube units that is closest to the user's eyes, and adjusts the distance between the lens-tube units and the eyes so that the measurement result matches the design target value.

2. The VR or MR goggle system of claim 1, wherein the adjustment means is a barrel depth movement means for moving the barrel in the depth direction, and the VR display unit acquires a design target value for the inter-vertex distance from an optimal inter-vertex distance information storage means provided in the VR display control unit, controls the barrel depth movement means in accordance with fluctuations in the inter-vertex distance based on measurement information from the eyeball position measurement means, and further has a barrel control unit that transmits control information for the barrel depth movement means to the VR display control unit.

3. The VR or MR goggle system according to claim 1, wherein the adjustment means is a main body-holding unit distance correction means that contacts at least one of the top of the user's head, temples, back of the head, nose, forehead, and cheeks, and adjusts the distance between the VR display unit and the eyeballs.

4. The VR or MR goggle system described in claim 2, wherein the VR display unit further comprises: a lens barrel horizontal movement means for measuring the interpupillary distance of the user using the eyeball position measurement means, and horizontally moving the left and right lens barrel sections so that the measured interpupillary distance matches the distance between the centers of the left and right lens barrel sections; and a vertical position adjustment means for measuring the position of the user's eyes using the eyeball position measurement means, and adjusting the vertical positions of the lens barrel horizontal movement means, the lens barrel sections, and the user's face or head so that the optical center points of the lenses in the lens barrel sections and the line of sight of the eyes match, and the lens barrel section control unit further communicates the design target value of the vertex distance obtained from the optimal vertex distance information storage means to the lens barrel horizontal movement means based on the measurement information of the eyeball position measurement means.

5. The VR or MR goggle system of claim 2, wherein the VR display control unit comprises: a lens position information storage means for receiving and storing position information of the lens based on control information of the lens barrel depth movement means from the lens barrel control unit; a VR image generation means for cutting out the VR image for display on the VR display unit; and a distortion correction means for performing distortion correction on the VR image cut out by the VR image generation means based on distortion correction information from a lens distortion information storage means which stores distortion information caused by the display panel and the lens of the lens barrel of the VR display unit and based on a design value of the vertex-to-vertex distance, and on lens position information from the lens position information storage means.

6. A VR or MR goggle system as claimed in any one of claims 1 to 5, wherein the eyeball position measuring means comprises: a first light source that outputs a first light to be irradiated onto one eye of the user; and a first light receiving unit that receives the first light reflected by one eye of the user, wherein the first light receiving unit is set to receive reflected light of the first light at a predetermined position of the first light receiving unit when the distance between one eye of the user and a lens corresponding to said one eye is a predetermined vertex distance, and the eyeball position measuring means determines that the light receiving position of the first light receiving unit is shorter than the predetermined vertex distance when it is closer to the lens side than the predetermined position, and determines that the light receiving position of the first light receiving unit is longer than the predetermined vertex distance when it is farther from the lens side than the predetermined position.

7. The VR or MR goggle system according to claim 6, wherein the eyeball position measuring means detects first deviation information based on the positional relationship between the light receiving position where the first light receiving unit receives the reflected light of the first light and the predetermined position.

8. The VR or MR goggle system of claim 4, wherein the vertical position adjustment means, the lens barrel horizontal movement means, and the lens barrel depth movement means are mechanisms for manual adjustment using levers or rings, or mechanisms for electrical adjustment using a motor that rotates or vibrates, or a motor and gears, and the lens barrel horizontal movement means automatically or manually adjusts the horizontal distance between the left and right lens barrel sections to the interpupillary distance of the user, the vertical position adjustment means manually adjusts the height of the left and right lens barrel sections relative to the position of the user's eyeballs, and the lens barrel depth movement means manually or automatically adjusts the distance between the user's eyes and the lenses of the lens barrel sections to a predetermined vertex-to-vertex distance.

9. A VR or MR goggle system as described in claim 3 or 4, wherein the vertical position adjustment means or the main body-holding part distance correction means has an adjustment function for adjusting the tilt angles of the left and right lens barrel parts simultaneously or independently in response to the user's operation, and aligning the orientation of the lens barrel parts with the user's line of sight.

10. A VR or MR goggle system as described in claim 2 or 3, wherein, when the vertex-to-vertex distance adjusted by the lens barrel depth movement means or the main body-holding unit distance correction means does not match the design target value, the VR display control unit makes corrections to the VR space based on the difference between the position of the lens barrel and the design target value.

11. A VR or MR goggle system as claimed in claim 3 or 4, wherein the vertical position adjustment value of the up-down position adjustment means, the horizontal position adjustment value of the lens barrel horizontal movement means, and the depth adjustment value of the lens barrel depth movement means or the main body-holding unit gap correction means are each stored in a user information storage means together with identification information that enables the user to be identified, and are selected manually based on the identification information when the user uses the system, or automatically selected by inputting the identification information, and the up-down position adjustment means, the lens barrel horizontal movement means, the lens barrel depth movement means, or the main body-holding unit gap correction means adjusts based on the read-out vertical position adjustment value, horizontal position adjustment value, and depth adjustment value.

12. The VR or MR goggle system of claim 11, wherein the identification information is information obtainable by the eyeball position measuring means, including at least one of a number, character string, interpupillary distance information, eyeball color and size, iris, and blood vessel information around the eye, linked to each user, or information identifying an individual, including at least one of a fingerprint, voiceprint, and IC card.

13. A VR or MR goggle system as claimed in claim 3 or 4, wherein in adjustment by the vertical position adjustment means, the lens barrel horizontal movement means, the lens barrel depth movement means, or the main body-holding unit gap correction means, the deviation of the lens barrel vertical position, lens barrel horizontal position, and lens barrel depth information measured by the eyeball position measurement means from their respective target values ​​is determined, and the adjustment direction of each of the vertical position adjustment means, the lens barrel horizontal movement means, the lens barrel depth movement means, or the main body-holding unit gap correction means is indicated to the user by voice, text, or graphics, and the vertical position adjustment means, the lens barrel horizontal movement means, the lens barrel depth movement means, or the main body-holding unit gap correction means makes the adjustment.

14. A VR or MR goggle system as described in any one of claims 1 to 5, wherein each of the left and right lens barrel sections has a display panel that displays VR images and a lens designed to allow the user to view the image on the display panel, and further has a spherical lens adjustment means that adjusts the diopter by moving the display panel while fixing the inter-vertex distance.

15. The VR or MR goggle system according to any one of claims 1 to 5, wherein each of the left and right lens barrels has a display panel that displays VR images and a lens designed to allow the user to view the image on the display panel, and further has a spherical lens adjustment means with a sliding mechanism for adjusting the distance between the display panel and the lens, and the sliding mechanism has a rotation suppression mechanism that suppresses rotation of the display panel or the lens, and is a mechanism in which the display panel or the lens is provided with a rotating body having a spiral concave or convex portion and a convex or concave portion that fits therewith, and the display panel or the lens slides when the rotating body rotates, and the rotation suppression mechanism is a mechanism in which the display panel or the lens has a convex or concave portion that fits respectively with a concave groove or convex portion in the direction of movement between the inside of the lens barrel, or a mechanism in which the lens barrel has a plurality of rod-shaped guides between the end closest to the eye and the end farthest from the eye, and the display panel or the lens has holes through which the guides pass, allowing the display panel or the lens to slide within the lens barrel.

16. A VR or MR goggle system as described in claim 2, wherein, when additional lenses are added to the left and right lens barrel sections to adjust diopter, the lens barrel depth movement means detects that the additional lenses have been added or the addition of the additional lenses is set by the user, and adjusts the variation in the vertex distance due to the addition of the additional lenses to match the design target value.

17. The VR or MR goggle system according to claim 16, wherein the VR display control unit corrects distortion that occurs primarily when the distance between the lens and the user's eyes increases due to adjustment of the lens barrel depth movement means.

18. The VR or MR goggle system according to claim 17, wherein the lens distortion information group storage means stores distortion information caused by the lens and based on the design value of the vertex distance and the thickness of the additional lens, and the VR display control unit further corrects the deviation using distortion information caused by the lens and based on the design value of the vertex distance and the thickness of the additional lens when the adjustment of the variation in the vertex distance is insufficient.

19. A VR or MR goggle system as claimed in any one of claims 16 to 18, wherein the user's identification information, together with whether or not the additional lens is being used, the adjustment value of the lens barrel depth movement means, and the correction information by the VR display control unit are stored as personal corrective visual acuity information in a user information storage means, and when the user manually or automatically checks the presence or absence of the additional lens using the identification information and finds that the presence or absence of the additional lens differs from the stored state, a warning is issued to prompt the user to attach or remove the additional lens, and the lens barrel depth movement means and the VR display control unit respectively read and set the adjustment value of the lens barrel depth movement means and the correction information by the VR display control unit stored in the user information storage means.

20. The VR or MR goggle system of claim 14, wherein when the spherical lens adjustment means adjusts the diopter, the movement value obtained when the panel is moved with the inter-vertex distance fixed is stored together with identification information that can identify the user, and when the user uses the device, the movement value is selected manually based on the identification information or automatically selected by inputting the identification information, and the spherical lens adjustment means moves the panel or the lens according to the read-out movement value to adjust the diopter.

21. The VR or MR goggle system according to claim 20, wherein the identification information used in saving and reading out the diopter adjustment value is information obtainable by the eyeball position measuring means, including at least one of interpupillary distance information, eyeball color and size, iris, and blood vessel information around the eye, or information identifying an individual, including at least one of fingerprints, voiceprints, and IC cards.

22. The VR or MR goggle system of claim 4, wherein each of the left and right lens barrels has a display panel that displays VR images and a lens designed to allow the user to view the image on the display panel, and further has a spherical lens adjustment means that adjusts the diopter by moving the panel while fixing the inter-vertex distance, and the VR or MR goggle system further comprises: a corrective vision information input means that acquires the user's corrective vision information; and a corrective vision correction means that adjusts the lens barrel horizontal movement means, the lens barrel depth movement means, and the spherical lens adjustment means through the lens barrel control unit in accordance with the input corrective vision information.

23. The VR or MR goggle system according to claim 22, wherein the corrected visual acuity information is eyeglass prescription information or corrected visual acuity information of eyeglasses currently in use, and the corrected visual acuity correction means performs visual acuity correction based on formula (1) in the spherical lens adjustment means via the lens barrel control unit when the vertex distance at the time of lens design differs from the vertex distance assumed at the time of measurement of the corrected visual acuity information. ΔD １ =D ０ / (1-(L １ -L ０ ) x D １ ) Equation (1) where, ΔD １ : Conversion frequency D ０ : Power when creating eyeglass prescription information L ０ : Distance between vertices when creating eyeglass prescription information [m] L １ : Distance between vertices when in use [m] 24. The VR or MR goggle system according to claim 14, wherein the user has astigmatism in at least one eye, and the system further comprises corrective vision information input means for acquiring corrective vision information of the user, the corrective vision information including at least cylindrical lens information including cylindrical lens power (D) and cylindrical lens axis direction (AXIS), and the VR display control unit, based on the cylindrical lens information, further comprises astigmatism correction means for generating an astigmatism distortion-corrected image of the user from the refractive power distribution on the principal meridian at an angle θ to the principal meridian of the cylindrical lens, with the center of the display screen of the VR image as the origin, where R(θ) = R × sin ２ θ Formula (2) 25. The VR or MR goggle system of claim 14, further comprising: a corrective vision information input means for acquiring corrective vision information of the user; and the VR display control unit, in a reference coordinate system set in a three-dimensional spatial coordinate system with the lens of the virtual camera as the origin, when capturing a VR space or MR space with the virtual camera, corrects the orientation of the virtual camera in a direction that cancels out the amount of deviation between the normal gaze direction and the gaze direction obtained from the visual characteristic information of the eye, thereby generating a VR image, and the VR display unit displays the corrected VR image.

26. The VR or MR goggle system of claim 22, wherein the corrected vision correction means comprises: the corrected vision information input means; and a corrected vision information storage means for storing a plurality of input corrected vision information; the corrected vision information input means reads the corrected vision information from outside; reading of the corrected vision information is permitted by identification information linked to the user; the identification information is provided by an ophthalmologist or equivalent institution or individual responsible for prescription information, and can be read by an access key determined by the institution or individual and provided to the user.

27. The VR or MR goggle system described in claim 26, wherein the corrected vision correction means is configured to be controllable independently of at least the VR display unit and the VR display control unit, and is capable of inputting corrected vision information into the corrected vision information input means, storing and reading the corrected vision information in the corrected vision information storage means, and controlling the VR display control unit and the VR display unit using the read corrected vision information only when permitted.

28. The VR or MR goggle system of claim 26, wherein the corrective vision correction means adjusts the vertical position adjustment means, the lens barrel horizontal movement means, the lens barrel depth movement means, and the spherical lens adjustment means based on the corrective vision information input from the corrective vision information input means, and when the user makes fine adjustments after wearing the goggles, the values ​​after fine adjustments are recorded as user-added correction information and read out together with the corrective vision information the next time the goggles are used, and when the difference in the settings of the left and right lens barrel sections exceeds a predetermined value during adjustment of the vertical position adjustment means, the lens barrel horizontal movement means, the lens barrel depth movement means, and the spherical lens adjustment means by the corrective vision correction means or during fine adjustments by the user, the system prohibits modification or issues a warning.

29. The VR or MR goggle system of claim 24, further comprising: a VST image processing means for processing images from multiple cameras used for video see-through (VST) as VST images; and a VST image synthesis means for synthesizing the VST images processed by the VST image processing means with the VR images, wherein the user has astigmatism in at least one eye; the VR display control unit generates an image of the user with astigmatism distortion correction processed from the synthesized image synthesized by the VST image synthesis means using the astigmatism correction means; and the VR display unit displays the image of the user with astigmatism distortion correction processed.

30. The VR or MR goggle system of claim 25, further comprising: a VST image processing means for processing images from multiple cameras used for video see-through (VST) as VST images; and a VST image synthesis means for synthesizing the VST images processed by the VST image processing means with the VR images, wherein the user has strabismus in at least one eye; the VR display control unit, in a reference coordinate system set in a three-dimensional spatial coordinate system with the lens of the virtual camera as the origin, when capturing the synthesized image synthesized by the VST image synthesis means with the virtual camera, corrects the orientation of the virtual camera in a direction that cancels out the amount of deviation between the normal gaze direction and the gaze direction obtained from the visual characteristic information of the eye, to generate a VR image; and the VR display unit displays the corrected synthesized image.

31. The VR or MR goggle system of claim 25, further comprising: a VST image processing means for processing images from multiple cameras used for video see-through (VST) as VST images; and a VST image synthesis means for synthesizing the VST images processed by the VST image processing means with the VR images, wherein the user has strabismus in at least one eye; the VR display control unit, in a reference coordinate system set in a three-dimensional spatial coordinate system with the lens of the virtual camera as the origin, generates a VST-corrected image by correcting the orientation of the virtual camera in a direction that cancels out the amount of deviation between the normal gaze direction and the gaze direction obtained from the visual characteristic information of the eye when the VST images are captured with the virtual camera, the VST image synthesis means synthesizes the VST-corrected image with the corrected VR images, and the VR display unit displays the synthesized VR images.

32. VR or MR goggles comprising a VR display unit for independently displaying VR images to the left and right eyes, generated based on input information including at least VR display data and 6DoF information, and a holder with means for fixing the VR display unit to the face or head, wherein the VR display unit comprises: two left and right lens-tube units each including at least one lens and a display panel; an eyeball position measuring means for measuring the position of the eye and the positional relationship and distance between the eye and the lens in the lens-tube; and an adjustment means for measuring the vertex distance, which is the distance between the user's eye and the lens in the lens-tube unit closest to the user's eye, using the eyeball position measuring means, and adjusting the distance between the lens-tube units and the eyeballs so that the measurement result matches the design target value.

33. A method for providing a user with a VR or MR space using VR or MR goggles, comprising the steps of: measuring the position of the user's eyes and the positional relationship and distance between the user's eyes and lenses in a lens-tube portion of the VR or MR goggles; measuring the vertex distance, which is the distance between the user's eyes and the lens in the lens-tube portion that is closest to the user's eyes, using the measurement results from the measuring step; adjusting the distance between the lens-tube portion and the user's eyes so that the vertex distance matches a design target value; and displaying VR images generated based on input information including at least VR display data and 6DoF information on a display panel in the lens-tube portion after the distance to the user's eyes has been adjusted.

34. A program for providing a user with a VR or MR space using VR or MR goggles, comprising: a step of measuring the position of the user's eyes and the positional relationship and distance between the user's eyes and lenses in a lens-tube portion of the VR or MR goggles; a step of measuring the vertex distance, which is the distance between the user's eyes and the lens in the lens-tube portion that is closest to the user's eyes, using the measurement results from the measuring step; an adjustment step of adjusting the distance between the lens-tube portion and the user's eyes so that the vertex distance matches a design target value; and a step of displaying VR images generated based on input information including at least VR display data and 6DoF information on a display panel in the lens-tube portion after the distance to the user's eyes has been adjusted.

Images