Display device, head-mounted display, control method, and program

The HMD employs multiple adjustment mechanisms and an eyeball camera to simplify and enhance the alignment of display members with the user's eyeballs, addressing the complexity and precision issues in existing HMDs, thereby improving image quality.

JP2024163586APending Publication Date: 2024-11-22CANON KK
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023079335
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-12
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

Existing head-mounted displays (HMDs) face challenges in accurately adjusting the position of display members relative to the user's eyeballs, leading to deteriorated image quality due to misalignment, and current adjustment methods are complex and difficult to execute with high precision.

Method used

The HMD incorporates multiple adjustment mechanisms, including a head mounting mechanism and additional shift and tilt mechanisms, along with an eyeball camera, to allow for manual and automatic adjustments of display members, guided by user operations and automated corrections to align the display members with the eyeballs.

Benefits of technology

This approach enables precise and easy alignment of display members with the eyeballs, improving image quality by simplifying the adjustment process and ensuring accurate positioning through a combination of manual and automated adjustments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024163586000001_ABST
    Figure 2024163586000001_ABST
Patent Text Reader

Abstract

To make it possible to more appropriately and easily arrange a display or a lens relative to an eyeball.SOLUTION: A display device includes: display means configured to display an image; acquisition means configured to acquire a relative position of the eyeball of a user viewing the display means relative to a first member of the display means; and adjustment means for automatically adjusting a position of the first member in the display device based on the relative position of the eyeball relative to the first member when the relative position of the first member relative to the eyeball of the user is manually adjusted by a first operation of the user.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a display device, a head mounted display, a control method, and a program. [Background technology]

[0002] A head mounted display (hereinafter referred to as "HMD") uses a configuration including a display unit that displays an image for the user and a head mounting mechanism that fixes the HMD to the user's head. The display unit includes a display that displays the image and display components such as an eyepiece. In this configuration, the HMD is fixed to the user's head by the head mounting mechanism, and the display unit is positioned in front of the user's eyes. The user observes the display through the eyepiece and sees the image displayed on the display.

[0003] In such an HMD, the quality of the image viewed by the user generally deteriorates when there is a large misalignment between the display member and the user's eyeball. In order to prevent deterioration of image quality, it is necessary to appropriately adjust the positional relationship between the user's eyeball and the display member.

[0004] The display member position adjustment unit adjusts the position of the head mounting mechanism relative to the user's head, thereby making it possible to adjust the position of the display member for each HMD. The HMD may also have a mounting assist function that detects misalignment between the display member and the eyeball using an eyeball camera that observes the eyeball, and instructs the user to adjust the head mounting mechanism.

[0005] However, since the head mounting mechanism has degrees of freedom in multiple directions, it is difficult to adjust the position of the display member in all directions with high accuracy. Therefore, even if there is a mounting assistance for the head mounting mechanism using an eyeball camera, there is a limit to the accuracy of adjustment of each degree of freedom. On the other hand, Patent Document 1 describes a method of adjusting the position of the display member using multiple adjustment units including an adjustment unit other than the head mounting mechanism. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2010-102077 A Summary of the Invention [Problem to be solved by the invention]

[0007] However, in the method described in Patent Document 1, it is difficult for a user to understand the order and amount of adjustment of a plurality of adjustment units, which may result in complicated adjustment. Therefore, in the HMD, when appropriately positioning the display member with respect to the user's eyeball, adjustment is complicated.

[0008] Therefore, an object of the present invention is to enable a display, lens, etc. to be positioned more appropriately and simply relative to the eyeball. [Means for solving the problem]

[0009] One aspect of the present invention is a method for producing a composition comprising the steps of: A display device, comprising: A display means for displaying an image; an acquisition means for acquiring a position of an eyeball of a user viewing the display through the display means relative to a first member of the display means; When the relative position of the first member with respect to the eyeball of the user is manually adjusted by the first operation of the user, an adjustment means for automatically adjusting a position of the first member in the display device based on the position of the first member; The display device is characterized by having:

[0010] One aspect of the present invention is a method for producing a composition comprising the steps of: A display device capable of manually adjusting a relative position of a first member of the display means with respect to an eyeball of a user by a first operation of the user viewing the display means, said display means for displaying an image; an adjustment unit that adjusts a position of the first member on the display device by a second operation of the user different from the first operation in a direction that is a part of directions in which the position of the first member can be adjusted by the first operation; A display device characterized by having a request means for 1) requesting the user to adjust the position of the first member by the first operation, and 2) requesting the user to adjust the position of the first member by the second operation after the position of the first member has been adjusted by the first operation.

[0011] One aspect of the present invention is a method for producing a composition comprising the steps of: A method for controlling a display device having a display means, comprising the steps of: An acquisition step of acquiring a position of an eyeball of a user looking at the display means relative to a first member of the display means; an adjustment step of automatically adjusting a position of the first member on the display device based on a relative position of the eyeball with respect to the first member when a relative position of the first member with respect to the eyeball of the user is manually adjusted by a first operation of the user; The control method is characterized by having the following features.

[0012] One aspect of the present invention is a method for producing a composition comprising the steps of: A method for controlling a display device, the method comprising the steps of: (a) controlling a display device in which a position of a first member of a display device relative to an eyeball of the user is manually adjustable by a first operation of the user viewing the display device; A method for controlling a display device having an adjustment unit that is capable of adjusting a position of the first member on the display device by a second operation by the user that is different from the first operation in a direction that is a part of directions in which a position of the first member can be adjusted by the first operation, comprising: a first request step of requesting the user to adjust a position of the first member by the first operation; a second request step of requesting the user to adjust a position of the first member by the second operation after the position of the first member has been adjusted by the first operation; The control method is characterized by having the following features. Effect of the Invention

[0013] According to the present invention, a display, a lens, etc. can be positioned more appropriately and simply with respect to the eyeball. [Brief description of the drawings]

[0014] [Figure 1] FIG. 2 is a diagram illustrating the configuration of an HMD according to the first embodiment. [Diagram 2] FIG. 2 is a diagram illustrating the configuration of an HMD according to the first embodiment. [Diagram 3] 3A to 3C are diagrams illustrating a head mounting mechanism and a horizontal shift mechanism according to the first embodiment. [Figure 4] 3A to 3C are diagrams illustrating a head mounting mechanism and a horizontal shift mechanism according to the first embodiment. [Diagram 5] 3A to 3C are diagrams illustrating a tilt mechanism and a vertical shift mechanism according to the first embodiment. [Figure 6] 3A to 3C are diagrams illustrating a tilt mechanism and a vertical shift mechanism according to the first embodiment. [Figure 7] 4 is a flowchart showing adjustment of the position of the display member according to the first embodiment. [Figure 8] 5A to 5C are diagrams illustrating adjustment of the position of the display member according to the first embodiment. [Figure 9] FIG. 4 is a diagram showing an adjustment instruction image according to the first embodiment. [Figure 10] 13A to 13C are diagrams illustrating adjustment of the position of a display member according to a modified example. [Figure 11] FIG. 11 is a diagram illustrating the configuration of an HMD according to a second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings.

[0016] <Embodiment 1> An HMD 1 according to the first embodiment will be described with reference to Figures 1A, 1B, 2A, and 2B. Figure 1A is an external view of the HMD 1. Figure 1B is an external view of an HMD main body 11 included in the HMD 1. Figure 2A is a view showing the configuration of the HMD 1 (display 121a, display 121b, eyepiece 122a, eyepiece 122b, eyeball camera 123a, and eyeball camera 123b). Figure 2B shows an image of the left eyeball 91a and an image of the right eyeball 91b.

[0017] The HMD 1 is a display device worn on the head of a user. As shown in Fig. 1A, the HMD 1 has an HMD body 11, a head mounting mechanism 13, and multiple connecting mechanisms (a vertical shift mechanism 141 and a tilt mechanism 142). The multiple connecting mechanisms connect the HMD body 11 and the head mounting mechanism 13.

[0018] The HMD main body 11 is held by a head mounting mechanism 13 and a plurality of connecting mechanisms. The HMD main body 11 is placed in front of the user's eyes. The head mounting mechanism 13 is a headband-like member that is fixed to the user's head.

[0019] 1B, the HMD main body 11 has two display units 12 corresponding to the left and right eyes. The two display units 12 are a left display unit 12a (a unit that displays an image for the user's left eye) and a right display unit 12b (a unit that displays an image for the user's right eye).

[0020] 2A is a diagram showing display members included in two display units 12. The left display unit 12a has a display 121a and an eyepiece 122a as display members (optical members). The right display unit 12b has a display 121b and an eyepiece 122b as display members (optical members). In the following, the display 121a and the eyepiece 122a are collectively referred to as the "display member 120a," and the display 121b and the eyepiece 122b are collectively referred to as the "display member 120b."

[0021] Display 121a and display 121b each display an image. A user views the images displayed on display 121a and display 121b through eyepiece 122a and eyepiece 122b. Left display unit 12a and right display unit 12b each have a plurality of IRED elements 124 that project infrared light onto the user's eyeball. Left display unit 12a has eyeball camera 123a (imaging section) that observes the eyeball. Right display unit 12b has eyeball camera 123b (imaging section) that observes the eyeball. Because left display unit 12a has eyeball camera 123a and display member 120a as an integral unit, the position of eyeball camera 123a changes with the change in the position of display member 120a. Since right-side display unit 12b has eye camera 123b and display member 120b integrated together, the position of eye camera 123b changes with the change in the position of display member 120b.

[0022] FIG. 2B shows an image of the user's left eyeball 91a captured by eyeball camera 123a and an image of the user's right eyeball 91b captured by eyeball camera 123b. Eyeball camera 123a observes the outline of left pupil 911a and the reflected infrared light, and obtains the two-dimensional or three-dimensional relative position of eyeball 91a with respect to left display unit 12a. Eyeball camera 123b observes the outline of right pupil 911b and the reflected infrared light, and obtains the two-dimensional or three-dimensional relative position of eyeball 91b with respect to right display unit 12b.

[0023] Here, the adjustment section (adjustment member) of the HMD 1 will be described. The adjustment section can adjust the relative position of the display member 120a with respect to the eyeball 91a, and the relative position of the display member 120b with respect to the eyeball 91b. The HMD 1 has a head mounting mechanism 13, a vertical shift mechanism 141, a tilt mechanism 142, and a horizontal shift mechanism 143 as adjustment sections. Hereinafter, as shown in Figs. 1A and 1B, the left-right direction of the user is called the "X direction", the front direction is called the "Z direction", and the direction approximately perpendicular to the X direction and the Z direction is called the "Y direction".

[0024] When the head mounting mechanism 13 is attached to the user's head, it has degrees of freedom in multiple directions. For example, the head mounting mechanism 13 can move in the Y direction (Sy direction in FIG. 1A) relative to the HMD main body 11 and rotate in rotational directions around the X direction to the Z direction (Rx direction, Rz direction, Ry direction in FIG. 1A). By mounting the HMD 1 on the user's head while adjusting the head mounting mechanism 13 having degrees of freedom in multiple directions, it is possible to adjust the position of the HMD main body 11 in the Y direction and the rotational position around the X direction to the Z direction. However, it is difficult to adjust the head mounting mechanism 13 with high accuracy simultaneously for each of the multiple directions. For this reason, in order to adjust the HMD main body 11 with high accuracy, a separate adjustment unit (adjustment unit other than the head mounting mechanism 13) is required to individually adjust the position in each direction.

[0025] The vertical shift mechanism 141 is an adjustment unit that shifts (shifts) the HMD main body 11 in the Y direction (Sy' direction in FIG. 1A) relative to the head mounting mechanism 13, and adjusts the position of the HMD main body 11 in the Y direction.

[0026] The tilt mechanism 142 is an adjustment unit that rotates (rotationally moves) the HMD body 11 around the X direction (Rx' direction in FIG. 1A) relative to the vertical shift mechanism 141. The tilt mechanism 142 adjusts the rotational position of the HMD body 11 around the X direction. The tilt mechanism 142 is connected to the vertical shift mechanism 141.

[0027] The horizontal shift mechanism 143 is an adjustment unit that moves each of the left and right display units 12a and 12b individually (independently) in the X direction (Sx direction in FIG. 1B) in the HMD body 11 (HMD1). In the HMD1, the horizontal shift mechanism 143 is a mechanism that collectively refers to the rotary motor 143a and a guide mechanism (not shown). The horizontal shift mechanism 143 allows the X direction position of the left and right display units 12a and 12b to be individually adjusted in the HMD body 11 (HMD1).

[0028] The rotary motor 143a is a drive unit having a lead shaft 143b. The left display unit 12a is engaged with one lead shaft 143b, and the right display unit 12b is engaged with the other lead shaft 143b. The HMD 1 rotates the lead shaft 143b by controlling the rotary motor 143a. By rotating the lead shaft 143b, the positions of the left display unit 12a and the right display unit 12b in the X direction can be adjusted in the HMD main body 11 (HMD 1).

[0029] (Regarding the relationship between multiple coordinating parts) Here, the relationship between the multiple adjustment units will be described with reference to eyeball images of the left and right eyes of the user captured by eyeball camera 123a and eyeball camera 123b.

[0030] 3A to 3C and 4A to 4C show the head mounting mechanism 13 and the horizontal shift mechanism 14. 3. FIGS. 3A to 3C are diagrams for explaining the adjustment of the position of the HMD main body 11 (the display members 120a and 120b) by adjusting the head mounting mechanism 13 and the horizontal shift mechanism 143. FIGS. 4A to 4C show eyeball images (the eyeball image of the left eyeball 91a and the eyeball image of the right eyeball 91b) acquired by the eyeball camera 123a and the eyeball camera 123b. The position of the eyeball 91a in the eyeball image of the left eyeball 91a indicates the relative position of the eyeball 91a with respect to the display member 120a. The position of the eyeball 91b in the eyeball image of the right eyeball 91b indicates the relative position of the eyeball 91b with respect to the display member 120b.

[0031] Consider a case where the positions of the two display units 12 around the Y direction (Ry1 direction in FIG. 3A) are adjusted by the head mounting mechanism 13, as shown in FIG. 3A. In this case, the two display units 12 (display member 120a and display member 120b) move with approximately the same vector. Therefore, as shown in FIG. 4A, in the two eyeball images, both eyeball 91a and eyeball 91b can be moved with approximately the same vector (Sx5, Sx6 in FIG. 4A).

[0032] Consider a case where the positions of the two display units 12 are adjusted in the same X direction (Sx1 direction and Sx2 direction in FIG. 3B) by the horizontal shift mechanism 143, as shown in FIG. 3B. In this case, the two display units 12 (display member 120a and display member 120b) move with approximately the same vector. Therefore, as shown in FIG. 4B, eyeballs 91a and 91b can be moved with approximately the same vector (Sx7, Sx8 in FIG. 4B) in the two eyeball images.

[0033] Consider a case where the positions of the two display units 12 are adjusted in mutually opposite directions in the X direction (Sx3 direction and Sx4 direction in FIG. 3C) by the horizontal shift mechanism 143 as shown in FIG. 3C. In this case, the two display units 12 (display member 120a and display member 120b) move with vectors that are approximately opposite to each other. Therefore, as shown in FIG. 4C, an operation can be performed to move eyeballs 91a and 91b in two eyeball images with vectors that are approximately opposite to each other (Sx9, Sx10 in FIG. 4C).

[0034] In the above description, the vector along which the eyeball moves within the plane of the two eyeball images has been described. However, the optical axis of eyeball camera 123a and the optical axis of eyeball camera 123b are not necessarily parallel to each other. Therefore, when these two optical axes are not parallel, it is appropriate to generate an eyeball image in which the influence of the tilt of the optical axis is corrected, and then calculate the vector along which the eyeball moves three-dimensionally. Therefore, the vector along which the eyeball moves has not only a component in the plane direction of the eyeball image, but also a component in the depth direction.

[0035] In addition, in the adjustment using the horizontal shift mechanism 143, it is possible to perform a combination of an operation of shifting the eyeballs 91a and 91b in substantially the same direction as shown in FIG. 4B and an operation of shifting the eyeballs 91a and 91b in substantially the opposite direction as shown in FIG. 4C. This allows the position of each of the user's eyeballs 91a and 91b to be adjusted individually in the X direction. For example, the distance between the eyeballs 91a and 91b is different for each user. Therefore, it is possible to adjust the positions of the display members 120a and 120b so that the distance between the display members 120a and 120b matches the distance between the eyeballs 91a and 91b of each user. This allows the display members 120a and 120b to be positioned in a more appropriate position.

[0036] Next, the relationship between the tilt mechanism 142 and the up / down shift mechanism 141 will be described.

[0037] 5A, 5B, 6A, and 6B show the tilt mechanism 142 and the up-down shift mechanism 141. 5A and 5B show an example of adjusting the position of HMD main body 11 by adjusting tilt mechanism 142 and up / down shift mechanism 141. Fig. 6A and 6B show eyeball images (an eyeball image of left eyeball 91a and an eyeball image of right eyeball 91b) acquired by eyeball camera 123a and eyeball camera 123b.

[0038] As shown in Fig. 5A, when the position of the HMD main body 11 is adjusted around the X direction (Rx1 direction in Fig. 5A) by the tilt mechanism 142, it is possible to move both eyeballs 91a and 91b with substantially the same vector (Syz1, Syz2 in Fig. 6A) as shown in Fig. 6A. By adjusting the tilt mechanism 142, it is possible to "shift eyeballs 91a and 91b in the Y direction and in the Z direction" at the same time.

[0039] Also, as shown in Fig. 5B, by adjusting the position of the HMD main body 11 in the Y direction (Sy1 direction in Fig. 5B) by the vertical shift mechanism 141, it is possible to move both eyeballs 91a and 91b with substantially the same vector (Sy1, Sy2 in Fig. 6B) as shown in Fig. 6B. By adjusting the vertical shift mechanism 141, it is possible to shift the eyeballs 91a and 91b in the Y direction.

[0040] (Regarding the position adjustment of display components) Next, the overall process of adjusting the positions of the display members 120a and 120b will be described with reference to the flowchart of Fig. 7A. The process of adjusting the positions of the display members 120a and 120b by adjusting each adjustment unit will be described below. In the following, a control unit (such as a processor) included in the HMD 1 executes a program to execute the process of each step.

[0041] In step S1002, the control unit controls the user to adjust the head mounting mechanism 13. In step S1003, the control unit controls the user to adjust the tilt mechanism 142. In step S1004, the control unit controls the user to adjust the up / down shift mechanism 141. In step S1005, the control unit adjusts the horizontal shift mechanism 143.

[0042] In the flowchart of FIG. 7A, in steps S1002 to S1004, the adjustment units are adjusted in response to manual operation of the respective adjustment units by the user.

[0043] On the other hand, in step S1005, the HMD 1 drives the rotary motor 143a included in the horizontal shift mechanism 143 to automatically adjust the horizontal shift mechanism 143. In this way, the head mounting mechanism 13, the tilt mechanism 142, and the up-down shift mechanism 141 are adjustment units that are manually adjusted by a user's operation (hereinafter referred to as "manual adjustment units"). The horizontal shift mechanism 143 is an adjustment unit that can be automatically adjusted without responding to a user's operation (hereinafter referred to as "automatic adjustment unit").

[0044] (Head mounted mechanism adjustment process) The adjustment of the head mounting mechanism 13 in step S1002 will be described with reference to the flowchart in FIG. 7B.

[0045] In step S1008, the control unit determines whether or not adjustment of the head mounting mechanism 13 is necessary. In step S1008, if the positions of the eyeballs 91a and 91b are each included in the target range in the two eyeball images, it is determined that adjustment of the head mounting mechanism 13 is unnecessary. If it is determined that adjustment of the head mounting mechanism 13 is unnecessary, the process of this flowchart ends. If it is determined that adjustment of the head mounting mechanism 13 is necessary, the process proceeds to step S1009.

[0046] In step S1009, the control unit requests the user to adjust the head mounting mechanism 13 (perform an operation to adjust the head mounting mechanism 13). At this time, the control unit displays an adjustment instruction image on the display 121a and the display 121b, requesting the user to make the adjustment. FIG. 9 shows an example of the adjustment instruction image. The adjustment instruction image includes an instruction D1 (adjustment unit instruction D1) indicating the adjustment unit to be adjusted, and an instruction D2 (adjustment direction instruction D2) indicating the adjustment direction of the adjustment unit. For example, an image in which the head mounting mechanism 13 is emphasized (highlighted) is displayed as the adjustment unit instruction D1. Also, an arrow or a character string indicating the adjustment direction of the head mounting mechanism 13 is displayed as the adjustment direction instruction D2.

[0047] Here, if such adjustment instructions are not displayed, the user cannot grasp the adjustment units to be adjusted and the adjustment direction. Therefore, by displaying the instructions in step S1009, it is possible to reduce the possibility that the adjustments will be performed in the wrong order and to reduce the possibility that the adjustments will become complicated. Note that only one of the adjustment unit instructions and the adjustment direction instructions may be displayed.

[0048] In step S1010, the control unit determines whether or not the eyeballs 91a and 91b are positioned within the target range in the two eyeball images after the head mounting mechanism 13 is adjusted by the user. If the control unit determines that the eyeballs 91a and 91b are positioned within the target range, the control unit determines that the display members 120a and 120b are appropriately positioned, and determines that the adjustment of the head mounting mechanism 13 is complete. If the control unit determines that the adjustment of the head mounting mechanism 13 is complete, the process proceeds to step S1011. If the control unit determines that the adjustment of the head mounting mechanism 13 is not complete (if the control unit determines that at least one of the eyeballs 91a and 91b is not positioned within the target range), the process returns to step S1009. In this case, the processes of steps S1009 and S1010 are repeated until the adjustment of the head mounting mechanism 13 is complete.

[0049] In step S1011, the control unit displays an image (adjustment completion image) indicating that the adjustment of the head mounting mechanism 13 is completed on the display 121a and the display 121b.

[0050] Regarding the details of the adjustment of the "tilt mechanism 142" in step S1003 and the adjustment of the "up-down shift mechanism 141" in step S1004, the "adjustment unit" to be processed is different from that in the flowchart shown in Fig. 7B, but otherwise is the same. Therefore, detailed description of the processing of steps S1003 and S1004 will be omitted.

[0051] (Horizontal shift mechanism adjustment process) Next, the adjustment of the horizontal shift mechanism 143 in step S1005 will be described with reference to the flowchart in Fig. 7C. For example, the process of the flowchart in Fig. 7C may be started when the control unit determines that "the user has manually adjusted the adjustment unit in at least one of steps S1002 to S1004." In other words, the process of the flowchart in Fig. 7C may be started when the position of the display member 120a relative to the eyeball 91a or the position of the display member 120b relative to the eyeball 91b is manually adjusted by the user's operation.

[0052] In step S1014, the control unit determines whether or not adjustment of the horizontal shift mechanism 143 is necessary. In step S1014, if the eyeballs 91a and 91b are located within the target range in the two eyeball images, the control unit determines that adjustment of the horizontal shift mechanism 143 is unnecessary. If at least one of the eyeballs 91a and 91b is not located within the target range in the two eyeball images, the control unit determines that adjustment of the horizontal shift mechanism 143 is necessary. If it is determined that adjustment of the horizontal shift mechanism 143 is unnecessary, If it is determined that the horizontal shift mechanism 143 needs to be adjusted, the process proceeds to step S1015.

[0053] In step S1015, the control unit adjusts the positions of the display members 120a and 120b so that the eyeballs 91a and 91b are positioned within the target range in the two eyeball images. At this time, the control unit drives the rotation motor 143a to adjust the positions of the display members 120a and 120b in the HMD main body 11 (HMD1).

[0054] In step S1016, the control unit determines whether the automatic adjustment of the horizontal shift mechanism 143 is completed by determining whether the eyeballs 91a and 91b are located within the target range in the two eyeball images. The control unit determines that the automatic adjustment of the horizontal shift mechanism 143 is completed when the eyeballs 91a and 91b are located within the target range in the two eyeball images. If it is determined that the adjustment of the horizontal shift mechanism 143 is completed, the process proceeds to step S1017. If it is determined that the adjustment of the horizontal shift mechanism 143 is not completed, the process returns to step S1015.

[0055] In step S1017, the control unit displays an image (selection image) for the user to select whether or not to manually adjust the horizontal shift mechanism 143 on the display 121a and the display 121b.

[0056] In step S1018, the control unit determines whether or not the user has selected to perform manual adjustment of the horizontal shift mechanism 143. If it is determined that the user has selected not to perform manual adjustment, the process of this flowchart ends. If it is determined that the user has selected to perform manual adjustment, the process proceeds to step S1019.

[0057] In step S1019, similarly to step S1009, the control unit displays an image instructing adjustment of the horizontal shift mechanism 143 (see FIG. 9).

[0058] In step S1020, the control unit determines whether or not the adjustment of the horizontal shift mechanism 143 is complete. In step S1020, the control unit determines that the manual adjustment of the horizontal shift mechanism 143 is complete if, for example, the user presses the adjustment completion button. If it is determined that the adjustment is not complete, the process returns to step S1019. If it is determined that the adjustment is complete, the process of this flowchart ends.

[0059] In the flowchart of Fig. 7C, the control unit executes adjustment of the horizontal shift mechanism 143, which is an automatic adjustment unit (step S1015), and determines whether the eyeballs 91a and 91b are positioned within the target range in the two eyeball images (step S1016). After determining that the eyeballs 91a and 91b are positioned within the target range, the control unit displays a selection image for selecting whether or not to perform manual adjustment (step S1017). After this, if the user selects to perform manual adjustment in step S1018, the control unit causes the user to perform additional manual adjustment (step S1019).

[0060] As a result, after automatic adjustment of the display members 120a and 120b has been performed, the user can position the display members 120a and 120b in a position that can improve the display image quality while actually viewing the display image.

[0061] In addition, the HMD 1 displays a selection image for selecting whether or not to perform manual adjustment in step S1017. However, if it is determined in step S1016 that the eyeballs 91a and 91b are located within the target range in the two eyeball images, the processes in steps S1017 and S1018 may not be performed. In this case, the HMD 1 In step S1019, a manual adjustment instruction screen may be displayed to instruct the user to perform manual adjustment.

[0062] After the automatic adjustments in steps S1015 and S1016, the HMD 1 performs the processes of steps S1017 to S1020 to allow the user to perform manual adjustments. However, the processes of steps S1017 to S1020 do not necessarily have to be performed.

[0063] Here, in the HMD 1 according to the first embodiment, the following operations (1) and (2) are realized.

[0064] (1) The first adjustment is performed by the first adjustment unit, and then the second adjustment is performed by the second adjustment unit. For example, as shown in Fig. 7A, the first adjustment is performed by the first adjustment unit in step S1002, so that the positions of the display members 120a and 120b of the HMD 1 are adjusted. Then, the second adjustment is performed by the second adjustment unit in step S1005, so that the positions of the display members 120a and 120b are further adjusted.

[0065] (2) In the first adjustment, for example, the first adjustment unit can perform a first operation of moving the positions of the eyeballs 91a and 91b in the two eyeball images in substantially the same vector. In the second adjustment, for example, the second adjustment unit can perform a second operation of moving the positions of the eyeballs 91a and 91b in the two eyeball images in the same manner as the first operation. Note that, although the first operation is an operation of moving the eyeballs 91a and 91b in substantially the same vector here, the first operation may be an operation of moving the positions of the eyeballs 91a and 91b in substantially the opposite vector. Note that, although the second operation is an operation similar to the first operation, it is sufficient that the second operation is an operation similar to at least a part of the first operation. Also, the second operation may be an operation that combines "an operation similar to at least a part of the first operation" and "another operation."

[0066] (Regarding the first case) The effects of the above operations and configurations (1) and (2) will be described with reference to Figures 8A and 8B. First, a case where the first adjustment unit is head mounting mechanism 13 and the second adjustment unit is horizontal shift mechanism 143 (first case) will be described. In this case, the first adjustment unit is a manual adjustment unit and the second adjustment unit includes an automatic adjustment unit.

[0067] Fig. 8A shows two eye images when a first adjustment of the head-mounted mechanism 13 is performed. Fig. 8B shows two eye images when a second adjustment of the horizontal shift mechanism 143 is performed.

[0068] The target range 81a is a range in which the user should place the pupil 911a (eyeball 91a) so that the user can view the screen of the display 121a with sufficient image quality. The target range 81b is a range in which the user should place the pupil 911b (eyeball 91b) so that the user can view the screen of the display 121b with sufficient image quality. The position and size of the target range 81a in the left eyeball image are the same as the position and size of the target range 81b in the right eyeball image.

[0069] The head mounted mechanism 13 is a manual adjustment unit. Also, the size of the target range 81a and the size of the target range 81b are relatively small. Therefore, if the user attempts to place the pupil 911a in the target range 81a and the pupil 911b in the target range 81b only by adjusting the head mounted mechanism 13 (moving the vectors Sx5 and Sx6 in FIG. 8A), delicate operations are required. For this reason, a long adjustment time is required.

[0070] In the HMD 1, the adjustment of the head mounting mechanism 13 or the horizontal shift mechanism 143 determines whether the Therefore, even if an error (a difference between the position of the target range 81a and the position of the pupil 911a, or a difference between the position of the target range 81b and the position of the pupil 911b) after adjustment of the head mounting mechanism 13 is large, the error can be corrected by the subsequent adjustment of the horizontal shift mechanism 143.

[0071] Therefore, in adjusting the head mounted mechanism 13, the range in which the pupil 911a should be located may be set to a target range 82a that includes the target range 81a and is wider than the target range 81a. The range in which the pupil 911b should be located may be set to a target range 82b that includes the target range 81b and is wider than the target range 81b. In this case, in step S1009, the control unit requests the user to adjust the head mounted mechanism 13 (to operate the head mounted mechanism 13) so as to locate the pupil 911a in the target range 82a and locate the pupil 911b in the target range 82b.

[0072] Then, when adjusting horizontal shift mechanism 143, adjustment may be performed so that pupil 911a is located in target range 81a and pupil 911b is located in target range 81b. In this case, in step S1015, the control unit executes adjustment of horizontal shift mechanism 143 so that pupil 911a is located in target range 81a and pupil 911b is located in target range 81b.

[0073] This allows easy manual adjustment since it is sufficient to position the pupils 911a and 911b in a large range (target ranges 82a and 82b) when manually adjusting the head mounting mechanism 13. Furthermore, since automatic adjustment is performed in the subsequent adjustment of the horizontal shift mechanism 143, the automatic adjustment can be easily realized even when the pupils 911a and 911b are positioned in a small range (target ranges 81a and 81b).

[0074] (Regarding the second case) Next, a case where the first adjustment unit is head mounted mechanism 13 (second case) will be considered.

[0075] The head mounting mechanism 13 has degrees of freedom in multiple directions relative to the head, and it is more difficult to control the positions of the display members 120a and 120b with high precision than other adjustment units. For this reason, when the pupil 911a is positioned in the target range 81a and the pupil 911a is positioned in the target range 81b, a particularly long adjustment time is required by adjusting only the head mounting mechanism 13.

[0076] Therefore, in the HMD 1, in the adjustment of the head mounting mechanism 13, which takes a particularly long time, the pupil 911a is arranged in the wide target range 82a, and the pupil 911b is arranged in the wide target range 82b. After that, the pupil 911a is arranged in the target range 81a, and the pupil 911b is arranged in the target range 81b by adjusting an adjustment unit other than the head mounting mechanism 13 (an adjustment unit that can move the positions of the display members 120a and 120b in fewer directions than the head mounting mechanism 13). For this reason, the control unit requests the user to adjust the adjustment unit (operate the adjustment unit) so as to arrange the pupil 911a in the target range 81a, and arrange the pupil 911b in the target range 81b.

[0077] In this way, the head mounting mechanism 13, which is not easy to control the positions of the display members 120a and 120b with high accuracy, is adjusted first, and then the other adjustment units are adjusted. This allows the head mounting mechanism 13, which has a high degree of freedom, to quickly control the positions of the display members 120a and 120b, although with low accuracy, and then the other adjustment units can adjust the positions of the display members with high accuracy. This allows the user to easily and quickly adjust the positions of the display members 120a and 120b.

[0078] (About the third case) Also, a case (third case) in which the first adjustment unit is the tilt mechanism 142 and the second adjustment unit is the up / down shift mechanism 141 when adjusting the Y-direction positions of the display members 120a and 120b will be described.

[0079] In this case, the tilt mechanism 142, which is the first adjustment unit, is an adjustment mechanism (hereinafter referred to as a "rotation adjustment mechanism") that can adjust the positions of the display members 120a and 120b by rotating the HMD main body 11. The up-down shift mechanism 141, which is the second adjustment unit, is a mechanism that can adjust the positions of the display members 120a and 120b by shifting the HMD main body 11.

[0080] When the positions of the display members 120a and 120b are adjusted by a rotation adjustment mechanism such as the tilt mechanism 142, the pupils 911a and 911b shift (move) in the Y and Z directions, as shown in Fig. 6A. Since the rotation adjustment mechanism cannot adjust both directions (Y and Z directions) individually, it is difficult to simultaneously control the positions in the Y and Z directions with high accuracy. For this reason, a long adjustment time is required to control the positions of the pupils 911a and 911b with high accuracy in the Y and Z directions.

[0081] Therefore, in the HMD 1, it is sufficient to control the positions of the pupils 911a and 911b with high accuracy only in the Z direction in adjusting the tilt mechanism 142, which is a rotation adjustment mechanism. After that, the positions of the pupils 911a and 911b in the Y direction can be controlled with high accuracy by adjusting the up / down shift mechanism 141. In this way, even adjustment of the positions of the display members 120a and 120b using the rotation adjustment mechanism can be easily achieved.

[0082] According to the HMD 1 of the first embodiment, the positions of the display members 120a and 120b can be easily controlled with high accuracy.

[0083] Although the first to third cases have been described above, the combination of the first and second adjustment units is not limited to the above-mentioned combinations of adjustment units.

[0084] The HMD1 has a display member 120a (display 121a and eyepiece 122a) and a display member 120b (display 121b and eyepiece 122b). The eyeball camera 123a provides an eyeball image showing the relative position of the left eyeball 91a with respect to the display member 120a, as shown in FIG. 2B. The eyeball camera 123b provides an eyeball image showing the relative position of the right eyeball 91b with respect to the display member 120b, as shown in FIG. 2B. This allows the "relative position of the display member 120a with respect to the eyeball 91a" and the "relative position of the display member 120b with respect to the eyeball 91b" to be measured with high accuracy. This allows the positions of the display member 120a and the display member 120b to be controlled with high accuracy.

[0085] In the HMD 1, eyeball camera 123a is integrated with display 121a and eyepiece 122a. Eyeball camera 123b is integrated with display 121b and eyepiece 122b. This allows, for example, the "relative position between eyeball camera 123a and eyeball 91a" to be regarded as the "relative position between display member 120a and eyeball 91a." This allows the positions of eyeball 91a and eyeball 91b to be detected with high accuracy by simple calculation. Then, when the detection accuracy of the positions of eyeball 91a and eyeball 91b is improved, the positions of display member 120a and display member 120b can be controlled with higher accuracy.

[0086] In the first embodiment, the positions of both the display member 120a and the display member 120b are adjusted at the same time. However, only one of them may be adjusted. The position of only one of the display member 120a and the display member 120b may be adjusted, and then the position of the other may be adjusted. Also, although it has been described that the position of the display member 120a is adjusted when the positions of both the display 121a and the eyepiece 122a are adjusted, the position of either the display 121a or the eyepiece 122a may be adjusted. Similarly, when the position of the display member 120b is adjusted, the position of either the display 121b or the eyepiece 122b may be adjusted.

[0087] (Modification) In the first case where the first adjustment unit is the head mounted mechanism 13 and the second adjustment unit is the horizontal shift mechanism 143, the HMD 1 according to the first embodiment uses the target range 82a and the target range 82b when performing the adjustment of the first adjustment unit. The target range 81a and the target range 81b are used when performing the adjustment of the second adjustment unit. In either adjustment unit, the stroke (adjustable amount) by which the positions of the display member 120a and the display member 120b can be adjusted is finite, so that the stroke may be insufficient in the adjustment of the second adjustment unit. In this case, the eyeball 91a cannot be placed in the target range 81a, and the eyeball 91b cannot be placed in the target range 81b. For this reason, there is a possibility that the display member 120a and the display member 120b cannot be placed in appropriate positions.

[0088] To avoid this, the HMD 1 corrects the target range 82a and the target range 82b based on "the positions of the eyeballs 91a and 91b in the two eyeball images" and "the stroke range within which the second adjustment unit can move the display member 120a and the display member 120b." At this time, the target range 82a is corrected (determined) by the second adjustment unit so that the display member 120a can be placed in the target range 81a. The target range 82b is corrected (determined) by the second adjustment unit so that the display member 120a can be placed in the target range 81b.

[0089] 10A and 10B are diagrams illustrating an example in which the target range 82a and the target range 82b are determined by the stroke range in which the second adjustment unit can move the display member 120a and the display member 120b. Fig. 10A is a diagram showing the target range 82a and the target range 82b before correction. Fig. 10B is a diagram showing the target range 82a and the target range 82b after correction.

[0090] The strokes Sl and Sr in Fig. 10A are obtained by converting the strokes by which the second adjustment unit can move the display members 120a and 120b into strokes by which the eyeballs 91a and 91b can be moved in the eyeball image. Fig. 10A shows an example in which the stroke Sl by which the eyeballs 91a and 91b can be moved to the left is small, and the stroke Sr by which the eyeballs 91a and 91b can be moved to the right is large.

[0091] If the stroke is large enough, no correction is performed, and the adjustment by the first adjustment unit places pupil 911a in target range 82a and pupil 911b in target range 82b. In the subsequent adjustment by the second adjustment unit, pupil 911a can also be placed in target range 81a and pupil 911b in target range 81b.

[0092] However, when the stroke is small, even if the pupil 911a is placed in the target range 82a in the adjustment by the first adjustment unit, the pupil 911a may not be placed in the target range 81a in the subsequent adjustment by the second adjustment unit. The same applies to the placement of the pupil 911b. In order to avoid such a case, it is necessary to correct the target range 82a and the target range 82b as shown in FIG. 10B. In the example shown in FIG. 10B, the right range of the target range 82a and the target range 82b of the adjustment by the first adjustment unit is narrowed according to the size of the stroke Sl. This makes it possible to place the pupil 911a in the target range 81a even if the stroke Sl of the subsequent adjustment by the second adjustment unit is small.

[0093] In addition, even if the pupil 911a is arranged in the target range 82a and the pupil 911b is arranged in the target range 82b by the adjustment of the first adjustment unit, the positions of the pupil 911a and the pupil 911b may move during the period until the adjustment of the second adjustment unit. For this reason, it is possible that the stroke of the second adjustment unit cannot arrange the pupil 911a in the target range 81a and the pupil 911b in the target range 81b. In order to avoid such a case, before or during the adjustment of the second adjustment unit, it may be determined whether or not "the adjustment of the second adjustment unit can arrange the pupil 911a in the target range 81a and the pupil 911b in the target range 81b." Then, if the pupil 911a cannot be arranged in the target range 81a or the pupil 911a cannot be arranged in the target range 81b due to insufficient stroke, the adjustment of the second adjustment unit is interrupted, and the process returns to the adjustment of the first adjustment unit. This makes it possible to avoid a case where it becomes impossible to position pupil 911a in target range 81a and pupil 911b in target range 81b.

[0094] In this way, the control unit determines whether or not the second adjustment unit can position the eyeball within the target range before or during the adjustment by the second adjustment unit. If the eyeball cannot be positioned within the target range, the control unit interrupts the adjustment by the second adjustment unit and performs the adjustment by the first adjustment unit again.

[0095] <Embodiment 2> Next, a description will be given of an HMD 2 according to embodiment 2. In the following, the same components in embodiment 2 as those in embodiment 1 are denoted by the same reference numerals as those in embodiment 1, and the description thereof will be omitted.

[0096] Fig. 11A is an external view of HMD2. Fig. 11B is an external view of an HMD main body included in HMD2. HMD2 has more adjustment units compared to HMD1. As shown in Fig. 11A, HMD2 has an HMD main body 11 and a head mounting mechanism 13. HMD2 has multiple connecting mechanisms (up-down shift mechanism 141, tilt mechanism 142, roll mechanism 244, front-rear shift mechanism 245, yaw mechanism 246) that connect the HMD main body 11 and the head mounting mechanism 13.

[0097] Here, we will describe the adjustment unit (adjustment mechanism) of the HMD 2. As shown in Fig. 11, the HMD 1 has a head mounting mechanism 13, a vertical shift mechanism 141, a tilt mechanism 142, a horizontal shift mechanism 143, a roll mechanism 244, a front-rear shift mechanism 245, and a yaw mechanism 246 as adjustment units.

[0098] The roll mechanism 244 is connected to the tilt mechanism 142. The roll mechanism 244 rotates around the Z direction (Rz' direction in FIG. 11A) relative to the tilt mechanism 142, and can adjust the rotational position of the HMD main body 11 (the display member 120a and the display member 120a) around the Z direction.

[0099] The front-rear shift mechanism 245 is connected to the roll mechanism 244. The front-rear shift mechanism 245 holds the yaw mechanism 246 so as to be shiftable in the Z direction (the Sz' direction in FIG. 11A) and can adjust the position of the HMD main body 11 (the display member 120a and the display member 120a) in the Z direction.

[0100] The yaw mechanism 246 is held by the front-rear shift mechanism 245. The yaw mechanism 246 holds the HMD main body 11 rotatably in the Y direction (the Ry' direction in FIG. 11A) and can adjust the position of the HMD main body 11 (the display member 120a and the display member 120a) around the Y direction.

[0101] These adjustment units precisely control the position of the display member 120a and the display member 120a. It is effective in controlling

[0102] Here, any two of the head mounting mechanism 13, horizontal shift mechanism 143, up / down shift mechanism 141, front / rear shift mechanism 245, tilt mechanism 142, roll mechanism 244, and yaw mechanism 246 can be used as the first adjustment unit and the second adjustment unit.

[0103] For example, the combination of the "first adjustment unit and the second adjustment unit" is "head mounting mechanism 13 and horizontal shift mechanism 143", "head mounting mechanism 13 and up / down shift mechanism 141", or "head mounting mechanism 13 and roll mechanism 244". The combination of the "first adjustment unit and the second adjustment unit" is "tilt mechanism 142 and up / down shift mechanism 141", or "tilt mechanism 142 and front / rear shift mechanism 245". With such a combination, the first adjustment unit and the second adjustment unit can provide the same effect as any one of the first to third cases described in the first embodiment.

[0104] In each embodiment, the display member 120a and the display member 120b are a lens (optical element) and a display (retinal projection type), but are not limited to this. The display member 120a and the display member 120b may be a laser light source and a mirror (MEMS mirror) (retinal scanning type). In this case, the light emitted by the laser light source is reflected by the mirror and then reaches the retina of the user's eye. As a result, the display member 120a and the display member 120b draw (display) an image on the retina of the user's eye. Instead of a mirror, any optical element having optical power (for example, capable of changing the trajectory of light) may be used, for example, a prism or a diffractive optical element may be used.

[0105] In each embodiment, the head mounting mechanism 13, the tilt mechanism 142, and the up-down shift mechanism 141 are described as adjustment units (manual adjustment units) that are manually adjusted by a user's operation. However, the head mounting mechanism 13, the tilt mechanism 142, and the up-down shift mechanism 141 may be automatic adjustment units that can be adjusted automatically. Also, in each embodiment, the horizontal shift mechanism 143 is described as an adjustment unit (automatic adjustment unit) that can be automatically adjusted without responding to a user's operation, but the horizontal shift mechanism 143 may be a manual adjustment unit that is manually adjusted.

[0106] Although the present invention has been described in detail based on the preferred embodiments, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Parts of the above-described embodiments may be combined as appropriate.

[0107] Also, in the above, "If A is equal to or greater than B, proceed to step S1, and if A is smaller (lower) than B, proceed to step S2" may be read as "If A is greater (higher) than B, proceed to step S1, and if A is equal to or less than B, proceed to step S2." Conversely, "If A is greater (higher) than B, proceed to step S1, and if A is equal to or less than B, proceed to step S2" may be read as "If A is greater (higher) than B, proceed to step S1, and if A is smaller (lower) than B, proceed to step S2." Therefore, unless a contradiction occurs, "equal to or greater than A" may be read as "equal to or greater than A (high; long; many)," and "equal to or less than A" may be read as "equal to or less than A (low; short; few)." And, "equal to or greater than A" may be read as "equal to or greater than A," and "equal to or less than A" may be read as "equal to or less than A."

[0108] Each functional unit in each of the above embodiments (variations) may or may not be an individual piece of hardware. The functions of two or more functional units may be realized by a common piece of hardware. Each of a plurality of functions of one functional unit may be realized by a separate piece of hardware. Two or more functions of one functional unit may be realized by a common piece of hardware. Also, each functional unit may be realized by hardware such as an ASIC, an FPGA, or a DSP. For example, the device may have a processor and a memory (storage medium) in which a control program is stored. The functions of at least some of the functional units of the device may be realized by the processor reading and executing the control program from the memory.

[0109] (Other embodiments) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) for implementing one or more of the functions.

[0110] The disclosure of the above embodiments includes the following configurations, methods, and programs. (Configuration 1) A display device, comprising: A display means for displaying an image; An acquisition means for acquiring a relative position of an eyeball of a user looking at the display means with respect to a first member of the display means; an adjustment means for automatically adjusting a position of the first member on the display device based on a relative position of the eyeball with respect to the first member when a relative position of the first member with respect to the eyeball of the user is manually adjusted by a first operation of the user; A display device comprising: (Configuration 2) The imaging device further includes an imaging means that is integral with the first member and that captures an image of the eyeball, the acquiring means acquires a position of the eyeball in the eyeball image as a relative position of the eyeball with respect to the first member; 2. The display device according to configuration 1. (Configuration 3) a requesting means for requesting the user to perform an operation of placing the eyeball in a first range in the eyeball image as the first operation, the adjustment means adjusts a position of the first member so as to position the eyeball, which is located in the first range in the eyeball image, in a second range included in the first range. 3. The display device according to configuration 2. (Configuration 4) A display device capable of manually adjusting a relative position of a first member of the display means with respect to an eyeball of a user by a first operation of the user viewing the display means, said display means for displaying an image; an adjustment unit that adjusts a position of the first member on the display device by a second operation of the user different from the first operation in a direction that is a part of directions in which the position of the first member can be adjusted by the first operation; 1) requesting the user to adjust a position of the first member by the first operation, and 2) requesting the user to adjust the position of the first member by the second operation after the position of the first member has been adjusted by the first operation. (Configuration 5) The imaging means is integrally formed with the first member, and further includes imaging means for acquiring an eyeball image obtained by imaging the eyeball of the user. 5. The display device according to configuration 4. (Configuration 6) The request means is When requesting the user to adjust a position of the first member by the first operation, requesting the user to perform an operation to place the eyeball in a first range in the eyeball image as the first operation; When requesting the user to adjust the position of the first member by the second operation, the user is requested to perform, as the second operation, an operation to position the eyeball located in the first range in the eyeball image into a second range included in the first range. 6. The display device according to configuration 5. (Configuration 7) the first range is a range based on the second range and an amount by which the position of the first member can be adjusted by adjusting the adjustment means; 7. The display device according to configuration 3 or 6. (Configuration 8) when the eyeball in the eye image cannot be positioned within the second range by the adjustment means, the request means requests the user to adjust the position of the first member by the first operation again. 8. The display device according to configuration 3, 6 or 7. (Configuration 9) when the request means requests the user to adjust the position of the first member, the request means displays an instruction indicating at least one of an object to be adjusted by the user and a direction of adjustment. 8. The display device according to any one of configurations 3 to 7. (Configuration 10) The first member has a second member corresponding to the left eye of the user and a third member corresponding to the right eye of the user. 10. The display device according to any one of configurations 1 to 9. (Configuration 11) the adjustment means is capable of adjusting a position of the second member and a position of the third member such that the second member and the third member move along substantially the same vector. 11. The display device according to configuration 10. (Configuration 12) the adjustment means is capable of adjusting a position of the second member and a position of the third member such that the second member and the third member move in vectors that are substantially opposite to each other. 12. The display device according to configuration 10 or 11. (Configuration 13) The adjustment means is capable of shifting the first member. 13. The display device according to any one of configurations 1 to 12. (Configuration 14) In the first operation, the first member can be rotated. 14. The display device according to any one of configurations 1 to 13. (Configuration 15) A display device, comprising: A display means for displaying an image; An acquisition means for acquiring a relative position of an eyeball of a user looking at the display means with respect to a first member of the display means; an adjustment means for adjusting a position of the first member on the display device based on a relative position of the eyeball with respect to the first member when a relative position of the first member with respect to the eyeball of the user is adjusted by a first operation of the user; having the first operation is an adjustment of a mechanism that rotates and moves the first member, The adjustment means performs adjustment using a mechanism that shifts and moves the first member. A display device comprising: (Configuration 16) The display device is a head-mounted display that is worn on the user's head. 15. The display device according to any one of configurations 1 to 14. (Configuration 17) A head-mounted display to be worn on a user's head, A display means for displaying an image; An acquisition means for acquiring a position of the eyeball of the user looking at the display means relative to a first member of the display means; an adjustment means for adjusting a position of the first member in the head mounted display based on a relative position of the eyeball with respect to the first member when a relative position of the first member with respect to the eyeball of the user is adjusted by a first operation of the user, the first operation is an operation on a mechanism to be worn on the user's head, The adjustment means adjusts a mechanism other than a mechanism for mounting the headset on the user's head. A head mounted display characterized by: (Method 1) A method for controlling a display device having a display means, comprising the steps of: An acquisition step of acquiring a position of an eyeball of a user looking at the display means relative to a first member of the display means; an adjustment step of automatically adjusting a position of the first member on the display device based on a relative position of the eyeball with respect to the first member when a relative position of the first member with respect to the eyeball of the user is manually adjusted by a first operation of the user; A control method comprising the steps of: (Method 2) A method for controlling a display device, the method comprising: a first operation of a display means for manually adjusting a position of a first member of the display means relative to an eyeball of the user; A method for controlling a display device having an adjustment unit that is capable of adjusting a position of the first member on the display device by a second operation by the user that is different from the first operation in a direction that is a part of directions in which a position of the first member can be adjusted by the first operation, comprising: a first request step of requesting the user to adjust a position of the first member by the first operation; a second request step of requesting the user to adjust a position of the first member by the second operation after the position of the first member has been adjusted by the first operation; A control method comprising the steps of: (program) A program for causing a computer to function as each of the means of the display device according to any one of configurations 1 to 15. [Explanation of symbols]

[0111] 1: HMD (head mounted display), 120a, 120b: display members, 121a, 121b: Display 122a, 122b: Eyepieces 13: Head mounting mechanism, 143: Horizontal shift mechanism

Claims

1. A display device, comprising: A display means for displaying an image; An acquisition means for acquiring a relative position of an eyeball of a user looking at the display means with respect to a first member of the display means; an adjustment means for automatically adjusting a position of the first member on the display device based on a relative position of the eyeball with respect to the first member when a relative position of the first member with respect to the eyeball of the user is manually adjusted by a first operation of the user; A display device comprising:

2. The eyeball image capturing apparatus further includes an imaging means that is integral with the first member and captures an image of the eyeball, the acquiring means acquires a position of the eyeball in the eyeball image as a relative position of the eyeball with respect to the first member; 2. The display device according to claim 1 .

3. a requesting unit for requesting the user to perform an operation of placing the eyeball in a first range in the eyeball image as the first operation, the adjustment means adjusts a position of the first member so as to position the eyeball, which is located in the first range in the eyeball image, in a second range included in the first range.

3. The display device according to claim 2.

4. A display device capable of manually adjusting a relative position of a first member of the display means with respect to an eyeball of a user by a first operation of the user viewing the display means, said display means for displaying an image; an adjustment unit that adjusts a position of the first member on the display device by a second operation of the user different from the first operation in a direction that is a part of directions in which a position of the first member can be adjusted by the first operation; A display device comprising: 1) a request means for requesting the user to adjust the position of the first member by the first operation; and 2) a request means for requesting the user to adjust the position of the first member by the second operation after the position of the first member has been adjusted by the first operation.

5. The camera further includes an imaging means that is integral with the first member and that captures an eyeball image of the user.

5. The display device according to claim 4.

6. The request means is When requesting the user to adjust a position of the first member by the first operation, the user is requested to perform an operation to place the eyeball in a first range in the eyeball image as the first operation; When requesting the user to adjust the position of the first member by the second operation, the user is requested to perform, as the second operation, an operation to position the eyeball located in the first range in the eyeball image into a second range included in the first range.

6. The display device according to claim 5.

7. the first range is a range based on the second range and an amount by which the position of the first member can be adjusted by adjusting the adjustment means; 7. The display device according to claim 3 or 6.

8. the request means, when the adjustment means is unable to position the eyeball in the eye image within the second range, requests the user to adjust the position of the first member again by the first operation.

7. The display device according to claim 3 or 6.

9. and when requesting the user to adjust the position of the first member, the request means displays an instruction indicating at least one of an object to be adjusted by the user and a direction of adjustment.

7. The display device according to claim 3, wherein the first and second electrodes are arranged in a first direction.

10. The first member has a second member corresponding to the left eye of the user and a third member corresponding to the right eye of the user.

7. The display device according to claim 1, wherein the first and second electrodes are arranged in a first direction.

11. the adjustment means is capable of adjusting a position of the second member and a position of the third member such that the second member and the third member move along substantially the same vector. The display device according to claim 10 .

12. the adjustment means is capable of adjusting a position of the second member and a position of the third member such that the second member and the third member move in vectors that are substantially opposite to each other. The display device according to claim 10 .

13. The adjustment means is capable of shifting the first member.

7. The display device according to claim 1, wherein the first and second electrodes are arranged in a first direction.

14. In the first operation, the first member can be rotated.

7. The display device according to claim 1, wherein the first and second electrodes are arranged in a first direction.

15. A display device, comprising: A display means for displaying an image; An acquisition means for acquiring a relative position of an eyeball of a user looking at the display means with respect to a first member of the display means; an adjustment means for adjusting a position of the first member on the display device based on a relative position of the eyeball with respect to the first member when a relative position of the first member with respect to the eyeball of the user is adjusted by a first operation of the user; having the first operation is an adjustment of a mechanism that rotationally moves the first member, The adjustment means performs adjustment using a mechanism that shifts and moves the first member. A display device comprising:

16. The display device is a head-mounted display that is worn on the user's head.

7. The display device according to claim 1, wherein the first and second electrodes are arranged in a first direction.

17. A head-mounted display to be worn on a user's head, A display means for displaying an image; An acquisition means for acquiring a relative position of an eyeball of the user looking at the display means with respect to a first member of the display means; A first operation of the user causes the first member to move relative to the eyeball of the user. and an adjustment unit that adjusts a position of the first member in the head mounted display based on a relative position of the eyeball with respect to the first member when the position is adjusted, the first operation is an operation on a mechanism to be worn on the user's head, The adjustment means adjusts a mechanism other than a mechanism for mounting the headset on the user's head. A head mounted display.

18. A method for controlling a display device having a display means, comprising the steps of: acquiring a position of an eyeball of a user looking at the display means relative to a first member of the display means; an adjustment step of automatically adjusting a position of the first member on the display device based on a relative position of the eyeball with respect to the first member when a relative position of the first member with respect to the eyeball of the user is manually adjusted by a first operation of the user; A control method comprising the steps of:

19. A method for controlling a display device, the method comprising the steps of: (a) controlling a display device in such a manner that a position of a first member of the display device relative to an eyeball of the user can be manually adjusted by a first operation of the user viewing the display device; A method for controlling a display device having an adjustment unit that is capable of adjusting a position of the first member on the display device by a second operation by the user that is different from the first operation in a direction that is a part of directions in which a position of the first member can be adjusted by the first operation, comprising: a first request step of requesting the user to adjust a position of the first member by the first operation; a second request step of requesting the user to adjust the position of the first member by the second operation after the position of the first member has been adjusted by the first operation; A control method comprising the steps of:

20. A program for causing a computer to function as each of the means of the display device according to any one of claims 1 to 6.

Citation Information

Patent Citations

  • Head-mounted display

    JP2010102077A