Display device, control method for display device, program

Abstract

To provide a display device that enables high-precision IPD adjustment. [Solution] A display device that can be worn on a user's head and has a display unit for displaying images comprises an image acquisition means for continuously acquiring eyeball images of the user's eyes, and a control means for performing specific control to move the display unit based on the eyeball images. The control means does not perform the specific control unless the position of the characteristic points of the eye in the eyeball image remains within a certain size range for a predetermined time.

Description

Technical Field

[0001] The present invention relates to a display device wearable on a user's head, a control method for the display device, and a program.

Background Art

[0002] A head-mounted display (HMD) has a device for acquiring the interpupillary distance of a user in order to adjust the optical axes of left and right display displays and an eyepiece optical system for observing the display displays according to the user's eye width. In addition, some HMDs have a so-called IPD (Interpupillary Distance) adjustment mechanism that can adjust the position of the display display.

[0003] Patent Document 1 describes a technique for acquiring (storing) the distance between a user's pupils when the stationary state of an HMD is detected by a gyro sensor. Patent Document 2 describes a technique that enables a user to adjust the position of a display display while viewing an image of their own eyeball by capturing an image of the eyeball and displaying the image on the display display.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in Patent Document 1, even if the HMD is detected as stationary by the gyro sensor, the possibility that the user's eyeballs are moving (rotating) cannot be ruled out, and an incorrect interpupillary distance may be obtained. In Patent Document 2, the user manually adjusts the IPD while the image of the eyeballs is displayed on the display unit, but there is a problem in that the position where the user fixates on is not stable. Therefore, the accuracy of IPD adjustment could not be ensured.

[0006] Therefore, the present invention aims to provide a display device that can achieve high-precision IPD adjustment. [Means for solving the problem]

[0007] One aspect of the present invention is, A display device that can be worn on the user's head and has a display unit for displaying images, Image acquisition means for continuously acquiring eyeball images of the user's eye, Control means for performing specific control to move the display unit based on the eyeball image, It has, The control means does not perform the specific control unless the position of the characteristic point of the eye in the eyeball image remains within a certain size range for a predetermined time. This is a display device characterized by the following features. One aspect of the present invention is, A display device that can be worn on the user's head and has a display unit for displaying images, Image acquisition means for continuously acquiring eyeball images of the user's eye, Control means for performing specific control to notify the user to move the display unit. and, Having The control means does not perform the specific control unless the position of the characteristic point of the eye in the eyeball image remains within a certain size range for a predetermined time. This is a display device characterized by the following features.

[0008] One aspect of the present invention is, A control method for a display device that can be worn on a user's head and has a display unit for displaying images, An image acquisition step of continuously acquiring an eyeball image of the user's eye, A control step of performing specific control to move the display unit based on the eyeball image, It has, The control step is a control method for a display device, characterized in that the specific control is not performed unless the position of the characteristic point of the eye in the eyeball image remains within a certain size range for a predetermined time. One aspect of the present invention is, A control method for a display device that can be worn on a user's head and has a display unit for displaying images, An image acquisition step of continuously acquiring an eyeball image of the user's eye, A control step that performs specific control to notify the user to move the display unit, Having In the control step, the specific control is not performed unless the position of the characteristic point of the eye in the eyeball image remains within a certain size range for a predetermined time. This is a control method for a display device characterized by the following features. [Effects of the Invention]

[0009] According to the present invention, a display device capable of achieving high-precision IPD adjustment can be provided. [Brief explanation of the drawing]

[0010] [Figure 1] This is a diagram illustrating the configuration of the HMD according to Embodiment 1. [Figure 2] This is an external view of the HMD body according to Embodiment 1. [Figure 3] This is a diagram illustrating the eyepiece according to Embodiment 1. [Figure 4] It is a flowchart of the processing of the HMD according to Embodiment 1. [Figure 5] It is a diagram showing the structure of the eyeball according to Embodiment 1. [Figure 6] It is a flowchart of the processing of the HMD according to Embodiment 2.

Modes for Carrying Out the Invention

[0011] Hereinafter, embodiments of the present invention will be described in detail based on the accompanying drawings.

[0012] <Embodiment 1> Hereinafter, the HMD1 according to Embodiment 1 will be described. FIG. 1A is an external view of the HMD1 which is a display device that can be worn on the user's head. The HMD1 has an HMD main body 101 (main body part), a connecting part 102, and a wearing part 103. The HMD main body 101 is connected to a wearing part 103 that is worn around the user's head in a turban shape via the connecting part 102.

[0013] FIGS. 2A and 2B are external views of the HMD main body 101 seen from the user side wearing the HMD1. The HMD main body 101 has a right display unit 104 which is a display unit for the right eye and , a left display unit 105 which is a display unit for the left eye. The right display unit 104 displays an image for the right eye, and the left display unit 105 displays an image for the left eye. The right display unit 104 includes a display panel 108 and an eyepiece lens (not shown) which is a display optical system. The horizontal position of the right display unit 104 is changeable. On the other hand, when the center line of the HMD main body 101 is defined by the broken line in FIGS. 2A and 2B, the left display unit 105 is configured symmetrically with the right display unit 104 based on this center line. The horizontal position of the left display unit 105 is changeable in the same manner as the right display unit 104.

[0014] Figure 2A shows the HMD body 101 with the right display unit 104 and the left display unit 105 moved to their outermost positions (driven). Figure 2B shows the HMD body 101 with the right display unit 104 and the left display unit 105 moved to their innermost positions (driven).

[0015] Figure 2C shows the configuration of the right-side display unit 104. The right-side display unit 104 includes an eyepiece optical system and a display panel 108. The right-side display unit 104 can be moved (driven) left and right (horizontally) by a stepping motor 109. By controlling the stepping motor 109, the position of the right-side display unit 104 can be controlled independently. In addition to being driven by the stepping motor 109, the position of the right-side display unit 104 can also be adjusted manually by the user. The left-side display unit 105 has the same configuration as the right-side display unit 104.

[0016] Here, we denote the distance from the center line of the HMD body 101 to the optical axis center of the right display unit 104 as Xr, and the distance to the optical axis center of the left display unit 105 as Xl. Then, the ranges of distances Xr and Xl can be defined as the range between the minimum value X_min and the maximum value X_max, respectively, as follows. X_min≦Xr≦X_max X_min ≤ Xl ≤ X_max

[0017] The smaller the minimum value X_min and the larger the maximum value X_max, the wider the IPD adjustment range becomes, allowing it to accommodate a wider range of users. However, this increases the space required for the drive mechanism, making the HMD1 larger. On the other hand, the distribution of interpupillary distance in adults is somewhat fixed. For this reason, for example, in Embodiment 1, assuming a user with an interpupillary distance in the range of 51 to 77 mm, the minimum value X_min is set to 25.5 mm and the maximum value X_max to 38.5 mm.

[0018] Figure 3 is a detailed view of the eyepiece sections of the right-hand display unit 104 and the left-hand display unit 105. As shown in Figure 3, in the right-hand display unit 104, the camera 107 (imaging device) for observing the eyeball is positioned at the lower left of the eyepiece (the 8 o'clock position). In the left-hand display unit 105, the camera 107 is positioned at the lower right of the eyepiece (the 4 o'clock position). The camera 107 is an image acquisition unit that continuously acquires eyeball images by capturing images of the eyeball. In automatic IPD adjustment, the drive target position of each display unit is determined based on the eyeball images captured by the camera 107.

[0019] The process of Embodiment 1 will be described with reference to the flowchart in Figure 4. In the following, as shown in Figure 1B, the control unit 120 (such as a processor) included in the HMD main unit 101 executes the processing of each step according to the program stored in the memory unit 121 (storage unit). When the power of the HMD1 is turned ON, the processing in this flowchart begins.

[0020] In step S401, the control unit 120, before acquiring the eyeball image (before automatic IPD adjustment), controls the right display unit 104 and the left display unit 105, HMD1 (HMD body 101 The right display unit 104 and the left display unit 105 are moved to a symmetrical position (initial position) with respect to the center line of the HMD1. For example, the control unit 120 moves the right display unit 104 and the left display unit 105 to a position where Xr=Xl=31mm. As this is appropriate for the average adult IPD, the right display unit 104 and the left display unit 105 can be positioned appropriately for the average user, since the average IPD is approximately 62mm. In addition, the right display unit 104 and the left display unit 105 are positioned symmetrically (line-symmetrical position) with respect to the center line of the HMD1. Therefore, the user can be encouraged to wear the HMD1 with their midline aligned with the center line of the HMD1.

[0021] Once step S401 is completed, it is assumed that the user will begin the process of putting on the HMD1. Therefore, in steps S402 to S405, it is determined whether or not the process of putting on the HMD1 has been completed.

[0022] In step S402, the control unit 120 controls the camera 107 to acquire an eyeball image by imaging the user's eyeball and the area around it. Hereafter, the eyeball image acquired by the camera 107 of the right display unit 104 will be referred to as the "right image," and the eyeball image acquired by the camera 107 of the left display unit 105 will be referred to as the "left image." When there is no need to distinguish between the right image and the left image, they will simply be referred to as eyeball images.

[0023] In step S403, the control unit 120 performs image processing on both the right and left images to detect the positions of feature points on the outer periphery of the eyeball in each image. Figure 5 shows the structure of the human eyeball. When the user wears the HMD1, it is expected that feature points on the outer periphery of the eyeball, such as the "lower end of the eyeball, lacrimal caruncle, outer corner of the eye, or the left and right lateral edges of the eyeball," as shown in Figure 5, will be captured in the eyeball image. Therefore, the control unit 120 identifies the positions of these feature points (hereinafter referred to as "periphery positions") in the eyeball image through image processing. In the following, the control unit 120 focuses on the position of the lacrimal caruncle as the outer periphery position of the eyeball and identifies the position of the lacrimal caruncle. However, as shown in Figure 5, other parts also exist on the outer periphery of the eyeball, so the positions of other parts may also be identified.

[0024] In step S404, the control unit 120 determines whether the outer position of the eye in the eyeball image remains within a certain size range (for example, a circle with a radius of 10 pixels) for a predetermined time T. In other words, in step S404, the control unit 120 determines whether the HMD1 has not moved by a certain amount over the predetermined time T in relation to the position of the user's face. If it is determined that the outer position remains within a certain size range for a predetermined time T (the HMD1 has not moved by a certain amount), it is determined that the user has completed the process of putting on the HMD1, and the process proceeds to step S405. If it is not determined that the outer position remains within a certain size range for a predetermined time T, it is determined that the user has not completed the process of putting on the HMD1, and the process returns to step S402.

[0025] While the user is putting on the HMD1, the relative position between the camera 107 and the user's eyeball changes. Therefore, the position of the outer edge of the eye in the eyeball image detected in step S403 also changes over time. For example, the difference D1 between the position of the lacrimal caruncle (X0, Y0) in the eyeball image of one frame (=frame N) and the position of the lacrimal caruncle (X1, Y1) in the eyeball image of the next frame N+1 can be calculated using Equation 1.

number

[0026] Assuming that a predetermined fixed distance is A pixels, we consider the case where D1 ≤ A. In this case, it can be said that the HMD1 has hardly moved relative to the user's face between the two frames, frame N and frame N+1. In this case, the difference D2 between the position of the lacrimal caruncle (X0, Y0) in frame N and the position of the lacrimal caruncle (X2, Y2) in the subsequent frame N+2 is calculated using Equation 2.

number

[0027] Therefore, in step S404, if D2≦A is satisfied, the control unit 120 performs the same calculation for subsequent frames D3, D4, etc., and determines whether Dx≦A (x=1, 2, 3, etc.) is continuously satisfied over a predetermined time T. For example, if camera 107 is driven for 60 frames and the predetermined time T=2 seconds, it is determined whether Dx≦A is satisfied for all Dx from D1 to D120. If a frame in which Dx≦A is not satisfied occurs along the way, the control unit 120 resets the reference position (X0,Y0). When two consecutive frames satisfying Dx≦A appear again, the control unit 120 sets the position of the lacrimal caruncle in the first frame as the new reference position (X0,Y0).

[0028] In step S405, the control unit 120 determines whether the outer periphery positions of the left and right eyes detected in step S403 are symmetrical with respect to the center line of the HMD1. Even after the user completes the HMD1 fitting process, if the center line of the HMD1 is clearly far from the user's midline, the optimal position for each display unit may be beyond the range of distance Xr or distance Xl. As a result, IPD adjustment may not be performed correctly.

[0029] If the center line of the HMD1 and the user's midline are approximately coincident, the outer positions of the left and right eyes detected in step S403 are approximately symmetrical (linear symmetry) with respect to the center line of the HMD1. For example, consider the case where the number of effective pixels in the horizontal direction of the right image is H pixels, and the position of the lacrimal caruncle in the right image is (Xs, Ys). In this case, the position of the lacrimal caruncle in the left image is expected to be (H-Xs, Ys).

[0030] However, it is desirable to consider the possibility that the human body is not perfectly symmetrical, or that the user may not wear the HMD1 in a position where the center line of the HMD1 and the user's midline perfectly coincide. It is also desirable to consider the possibility that the right display unit 104 and the left display unit 105 are not perfectly horizontal, but are positioned slightly diagonally when the HMD1 is worn. For this reason, for example, it is desirable to set B pixels as a margin. In this case, if the position of the lacrimal caruncle in the right image is (Xs, Ys), and the position of the lacrimal caruncle in the left image is within the range of (H-Xs±B, Ys±B), it is determined that the HMD1 is worn with the center line of the HMD1 and the user's midline approximately coincide. If it is determined that the position of the lacrimal caruncle in the left image is within the range of (H-Xs±B, Ys±B), the process proceeds to step S406. If it is determined that the position of the lacrimal caruncle in the left image is not within the range of (H-Xs±B, Ys±B), the process proceeds to step S407.

[0031] In step S406, the control unit 120 drives (moves) the right display unit 104 and the left display unit 105 to perform automatic IPD adjustment. In automatic IPD adjustment, the user's pupil position is detected in the eyeball image based on the image (eyeball image) acquired by the camera 107. Then, the target drive position for each display unit (right display unit 104 and left display unit 105) is determined based on the pupil position. Then, according to the target drive position, Each display unit is driven. Specifically, the drive amount is calculated based on information such as "the current pupil position in the eyeball image," "the expected pupil position in the eyeball image if the IPD were correctly adjusted," and "the correlation (sensitivity) between the drive amount of each display unit and the pupil position in the eyeball image." Then, according to the drive amount, the stepping motor 109 drives each display unit to achieve automatic IPD adjustment.

[0032] In step S407, the control unit 120 warns the user that the HMD1 is not properly fitted. The control unit 120 may, for example, display a warning message on each display unit, play a warning message from a speaker (not shown), or sound a warning.

[0033] In step S408, the control unit 120 records the position of the outer periphery of the eye in the left and right images in the storage unit 121 immediately after the automatic IPD adjustment is completed (immediately after the processing in step S406 is finished). For this reason, the control unit 120 also operates as a recording control unit that controls the storage unit 121. Even after automatic IPD adjustment is completed, there may be cases where the display units move due to, for example, the user tilting their head, or where force is applied to the display units by the user's accidental hand movements. In such cases, it is possible that the display units may move from their positions after automatic IPD adjustment. Therefore, the processing in step S408 is executed to record the position of the outer periphery of the eye in the left and right images acquired immediately after the automatic IPD adjustment is completed (immediately after the processing in step S406 is finished). For example, the control unit 120 records the position of the lacrimal caruncle (Xsl, Ysl) in the left image and the position of the lacrimal caruncle (Xsr, Ysr) in the right image in the storage unit 121.

[0034] In steps S409 to S411, the HMD1 has started normal operation, and the user has begun their experience using the HMD1.

[0035] In step S409, the control unit 120 detects the current peripheral position of the eye in both the left and right images. Therefore, while the processing from steps S409 to S411 is repeated, the camera 107 continues to capture images, and the control unit 120 continues to detect the current peripheral position of the eye in both the left and right images.

[0036] In step S410, the control unit 120 calculates the difference between the outer perimeter position detected in step S409 and the outer perimeter position recorded in the storage unit 121 in step S408 for both the right and left eyes. The control unit 120 then determines whether the difference between the two outer perimeter positions is within a predetermined distance of C pixels (a predetermined amount).

[0037] For example, if the position of the lacrimal cone in the left image detected in step S409 is (Xsl_new, Ysl_new), and the position of the lacrimal cone in the left image does not move by a predetermined distance C after automatic IPD adjustment, then equation 3 below is satisfied. If the position of the lacrimal cone in the right image is (Xsr_new, Ysr_new), and the position of the lacrimal cone in the right image does not move by a predetermined distance C after automatic IPD adjustment, then equation 4 below is satisfied. On the other hand, if equation 3 is not satisfied, the position of the left display unit 105 is inappropriate because the left display unit 105 has moved significantly from its position after automatic IPD adjustment. If equation 4 is not satisfied, the position of the left display unit 105 is inappropriate because the right display unit 104 has moved significantly from its position after automatic IPD adjustment.

number

[0038] Therefore, if at least one of equations 3 and 4 is not satisfied, it is determined that at least one of the display units has moved from the optimal position for the user, and the process proceeds to step S412. If both equations 3 and 4 are satisfied, the process proceeds to step S411.

[0039] In step S411, the control unit 120 determines whether or not the user has performed a power-off operation. If it is determined that the power-off operation has not been performed, the process returns to step S409. If it is determined that the power-off operation has been performed, the power to the HMD1 is turned off.

[0040] In step S412, the control unit 120 issues a warning to the user, similar to step S407. Then, the process returns to step S406, and the automatic IPD adjustment is repeated.

[0041] Although the user returns to step S406, if the mounting part 103 has rotated away from the user's head, there will be no optimal position for the user within the movable range of each display unit. Therefore, even if the IPD adjustment is performed again in step S406, it is possible that the misalignment of each display unit will not be resolved. Thus, the warning content could include prompting the user to correct the mounting position, and further modifications could include returning to step S401 or step S402 to prompt the user to align the center line of the HMD1 with the midline of the user, or prompting the user to reattach the device.

[0042] In Embodiment 1, the HMD1 performs automatic IPD adjustment if the outer peripheral position remains within a specific range for a predetermined time or longer when the HMD1 is started up. This allows for more precise identification of the placement positions for each display unit, thus enabling highly accurate automatic IPD adjustment. The HMD1 also records the outer peripheral position in the eyeball image acquired immediately after automatic IPD adjustment. During normal operation, the HMD1 constantly detects the outer peripheral position in the eyeball image, and if the difference between the recorded outer peripheral position and the current outer peripheral position is large, it warns the user and performs automatic IPD adjustment again. This ensures that each display unit remains in the appropriate position even when the HMD1 is in normal operation.

[0043] <Embodiment 2> In Embodiment 1, the HMD1 performs automatic IPD adjustment by driving the right display unit 104 and the left display unit 105 with a stepping motor 109. In Embodiment 2, assuming that the stepping motor 109 is not present, the user manually adjusts the positions of the right display unit 104 and the left display unit 105.

[0044] The appearance and configuration of the HMD1 according to Embodiment 2 are the same as those of the HMD1 according to Embodiment 1, except that the stepping motor 109 is absent. The flowchart in Figure 6 shows the processing of the HMD1 according to Embodiment 2. Since the flowchart in Figure 6 is the same as the flowchart in Figure 4 in most of its processing, steps S601 and S606, which show the differences from Figure 4, will be explained. Note that steps other than steps S601 and S606 are shown in Figure 4. The same process as the steps in the flowchart is performed.

[0045] In step S601, the control unit 120 displays a notification on the right display unit 104 and the left display unit 105 requesting the user to manually move them to their initial positions (symmetrical positions). Here, if the display units are at the edges of their adjustment ranges, they can be easily set to positions symmetrical with respect to the center line of the HMD body 101, even manually. For this reason, a notification may be displayed to position each display unit at a position where Xr=Xl=X_min or Xr=Xl=X_max is satisfied. However, if each display unit is moved to the edge of its adjustment range, depending on the width of the imaging range of the camera 107, the user's eyes may not be within the imaging range, which could prevent the processing in the subsequent steps S402 and S403. Therefore, a marking line may be pre-marked at a specific position symmetrical to the center line of the HMD body 101 (for example, a position where Xr=Xl=31mm), and a notification may be displayed requesting that each display unit be manually aligned to this marking position.

[0046] Furthermore, a configuration may be adopted that allows the right-side display unit 104 and the left-side display unit 105 to be moved to symmetrical positions without the user removing the HMD1. For example, the user may be able to feel a click when each display unit reaches a position where Xr=Xl=31mm. The user may then manually move each display unit to a position where Xr=Xl=31mm is satisfied, using the click as a clue. This makes it possible to determine in steps S404 and S405 that the user has properly attached the HMD1.

[0047] In step S606, the control unit 120 notifies the user of a request for manual IPD adjustment. Unlike step S406, which performs automatic IPD adjustment, in step S606, which performs manual IPD adjustment, it is necessary to determine when the adjustment operation is complete. The control unit 120 may determine when the adjustment operation is complete when the position of the outer edge of the eye is stable, as in step S404. The control unit 120 may also determine when the IPD adjustment is complete when the user operates a button or the like (not shown). Once the IPD adjustment is complete, the process proceeds to step S408.

[0048] In Embodiment 2, when the HMD1 is started up, if the outer peripheral position remains within a specific range for a predetermined time or longer, the HMD1 requests the user to perform IPD adjustment. This allows for more precise positioning of each display unit, thus enabling highly accurate IPD adjustment. The HMD1 also records the outer peripheral position in the eyeball image immediately after IPD adjustment. During normal operation, the HMD1 constantly detects the outer peripheral position in the eyeball image, and if the difference between the recorded outer peripheral position and the current outer peripheral position is large, it warns the user and requests further IPD adjustment. This ensures that each display unit remains in the appropriate position even when the HMD1 is in normal operation.

[0049] Furthermore, in the above, "If A is greater than or equal to B, proceed to step S1; if A is less than (lower than) B, proceed to step S2" may be rephrased as "If A is greater than (higher than) B, proceed to step S1; if A is less than or equal to B, proceed to step S2." Conversely, "If A is greater than (higher than) B, proceed to step S1; if A is less than or equal to B, proceed to step S2" may be rephrased as "If A is greater than or equal to B, proceed to step S1; if A is less than (lower than) B, proceed to step S2." Therefore, as long as no contradiction arises, "greater than or equal to A" may be rephrased as "greater than (higher; longer; more) than A," and "less than or equal to A" may be rephrased as "less than (lower; shorter; fewer) than A." And "greater than (higher; longer; more) than A" may be rephrased as "greater than or equal to A," and "less than (lower; shorter; fewer) than A" may be rephrased as "less than or equal to A."

[0050] Note that the various controls described above are performed by a single piece of hardware (e.g., a processor or circuit). It may be done, or it may not be. Multiple pieces of hardware (for example, multiple processors, multiple circuits, or a combination of one or more processors and one or more circuits) may share the processing to control the entire device.

[0051] Furthermore, the above-mentioned processors are processors in a broad sense, including general-purpose processors and specialized processors. General-purpose processors include, for example, CPUs (Central Processing Units), MPUs (Micro Processing Units), and DSPs (Digital Signal Processors). Specialized processors include, for example, GPUs (Graphics Processing Units), ASICs (Application Specific Integrated Circuits), and PLDs (Programmable Logic Devices). Programmable logic devices include, for example, FPGAs (Field Programmable Gate Arrays) and CPLDs (Complex Programmable Logic Devices).

[0052] Furthermore, although embodiments of the present invention have been described in detail, the present invention is not limited to these specific embodiments, and various forms that do not depart from the spirit of the invention are also included in the present invention. Moreover, each of the embodiments described above is merely one embodiment of the present invention, and it is possible to combine each embodiment as appropriate.

[0053] <Other Embodiments> The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit that implements one or more functions.

[0054] The above-disclosed embodiments include the following configurations, methods, and programs. (Composition 1) A display device that can be worn on the user's head and has a display unit for displaying images, Image acquisition means for continuously acquiring eyeball images of the user's eye, Control means for performing specific control to move the display unit based on the eyeball image, It has, The control means does not perform the specific control unless the position of the characteristic point of the eye in the eyeball image remains within a certain size range for a predetermined time. A display device characterized by the following features. (Configuration 2) A display device that can be worn on the user's head and has a display unit for displaying images, Image acquisition means for continuously acquiring eyeball images of the user's eye, Control means for performing specific control to notify the user to move the display unit, Having The control means does not perform the specific control unless the position of the characteristic point of the eye in the eyeball image remains within a certain size range for a predetermined time. A display device characterized by the following features. (Composition 3) The display unit includes a right-eye unit and a left-eye unit, each having an imaging device. The imaging device of the right eye unit acquires a first image by imaging the right eye. , The imaging device of the left eye unit acquires a second image by imaging the left eye, The control means 1) determines whether the position of the feature point in the first image and the position of the feature point in the second image are symmetrical, and 2) if it determines that the position of the feature point in the first image and the position of the feature point in the second image are not symmetrical, it does not perform the specific control. A display device according to configuration 1 or 2, characterized by the above. (Composition 4) The control means shall warn the user if the specific control is not performed. A display device according to any one of configurations 1 to 3, characterized by the above. (Composition 5) The aforementioned characteristic point is a part on the outer periphery of the eye. A display device according to any one of configurations 1 to 4, characterized by the above. (Composition 6) The aforementioned characteristic point is one of the following: the lower end of the eyeball, the lateral end of the eyeball, the lacrimal caruncle, or the outer corner of the eye. The display device according to configuration 5, characterized by the features described herein. (Composition 7) The display unit includes a unit for the right eye and a unit for the left eye. The image acquisition means acquires the eyeball image when the right eye unit and the left eye unit are positioned symmetrically with respect to the center line of the display device. A display device according to any one of configurations 1 to 6, characterized by the above. (Composition 8) Before acquiring the eyeball image, the control means moves the right eye unit and the left eye unit to positions that are symmetrical with respect to the center line of the display device if the positions of the right eye unit and the left eye unit are not symmetrical with respect to the center line of the display device. The display device according to configuration 7, characterized by the features described above. (Composition 9) Before acquiring the eyeball image, if the positions of the right eye unit and the left eye unit are not symmetrical with respect to the center line of the display device, the control means requests the user to move the right eye unit and the left eye unit to positions where they are symmetrical. The display device according to configuration 7, characterized by the features described above. (Composition 10) The display device further includes a recording control means that, when the position of the display unit is adjusted in accordance with the specific control, records the position of the feature point in the eyeball image acquired after the adjustment of the position of the display unit in a storage means. The control means performs the specific control when the position of the feature point in the current eyeball image differs from the position recorded in the storage means by a predetermined amount. A display device according to any one of configurations 1 to 9, characterized by the above. (Method 1) A control method for a display device that can be worn on a user's head and has a display unit for displaying images, An image acquisition step of continuously acquiring an eyeball image of the user's eye, A control step of performing specific control to move the display unit based on the eyeball image, It has, In the control step, the specific control is not performed unless the position of the characteristic point of the eye in the eyeball image remains within a certain size range for a predetermined time. A method for controlling a display device, characterized by the features described above. (Method 2) A control method for a display device that can be worn on a user's head and has a display unit for displaying images, An image acquisition step of continuously acquiring an eyeball image of the user's eye, A control step that performs specific control to notify the user to move the display unit, Having In the control step, the specific control is not performed unless the position of the characteristic point of the eye in the eyeball image remains within a certain size range for a predetermined time. A method for controlling a display device, characterized by the features described above. (program) A program for causing a computer to function as one of the display devices described in any of configurations 1 to 10. [Explanation of Symbols]

[0055] 1:HMD (display device), 104: Right-side display unit, 105: Left-side display unit, 107: Camera, 109: Stepping motor, 120: Control Unit

Claims

1. A display device that can be worn on the user's head and has a display unit for displaying images, Image acquisition means for continuously acquiring eyeball images of the user's eye, Control means for performing specific control to move the display unit based on the eyeball image, It has, The control means does not perform the specific control unless the position of the characteristic point of the eye in the eyeball image remains within a certain size range for a predetermined time. A display device characterized by the following features.

2. A display device that can be worn on the user's head and has a display unit for displaying images, Image acquisition means for continuously acquiring eyeball images of the user's eye, Control means for performing specific control to notify the user to move the display unit, Having The control means does not perform the specific control unless the position of the characteristic point of the eye in the eyeball image remains within a certain size range for a predetermined time. A display device characterized by the following features.

3. The display unit includes a right-eye unit and a left-eye unit, each having an imaging device. The imaging device of the right eye unit acquires a first image by imaging the right eye, The imaging device of the left eye unit acquires a second image by imaging the left eye, The control means 1) determines whether the position of the feature point in the first image and the position of the feature point in the second image are symmetrical, and 2) if it determines that the position of the feature point in the first image and the position of the feature point in the second image are not symmetrical, it does not perform the specific control. The display device according to feature 1 or 2.

4. The control means shall warn the user if the specific control is not performed. The display device according to feature 1 or 2.

5. The aforementioned characteristic point is a part on the outer periphery of the eye. The display device according to feature 1 or 2.

6. The aforementioned characteristic point is one of the following: the lower end of the eyeball, the lateral end of the eyeball, the lacrimal caruncle, or the outer corner of the eye. The display device according to feature 5.

7. The display unit includes a unit for the right eye and a unit for the left eye. The image acquisition means acquires the eyeball image when the right eye unit and the left eye unit are positioned symmetrically with respect to the center line of the display device. The display device according to feature 1 or 2.

8. Before acquiring the eyeball image, the control means moves the right eye unit and the left eye unit to positions that are symmetrical with respect to the center line of the display device, if the positions of the right eye unit and the left eye unit are not symmetrical with respect to the center line of the display device. The display device according to feature 7.

9. Before acquiring the eyeball image, if the positions of the right eye unit and the left eye unit are not symmetrical with respect to the center line of the display device, the control means requests the user to move the right eye unit and the left eye unit to positions where they are symmetrical. The display device according to feature 7.

10. The display device further includes a recording control means that, when the position of the display unit is adjusted in accordance with the specific control, records the position of the feature point in the eyeball image acquired after the adjustment of the position of the display unit in a storage means. The control means performs the specific control when the position of the feature point in the current eyeball image differs from the position recorded in the storage means by a predetermined amount. The display device according to feature 1 or 2.

11. A control method for a display device that can be worn on a user's head and has a display unit for displaying images, An image acquisition step of continuously acquiring an eyeball image of the user's eye, A control step of performing specific control to move the display unit based on the eyeball image, It has, In the control step, the specific control is not performed unless the position of the characteristic point of the eye in the eyeball image remains within a certain size range for a predetermined time. A method for controlling a display device, characterized by the features described above.

12. A control method for a display device that can be worn on a user's head and has a display unit for displaying images, An image acquisition step of continuously acquiring an eyeball image of the user's eye, A control step that performs specific control to notify the user to move the display unit, Having In the control step, the specific control is not performed unless the position of the characteristic point of the eye in the eyeball image remains within a certain size range for a predetermined time. A method for controlling a display device, characterized by the features described above.

13. A program for causing a computer to function as one of the means of the display device described in claim 1 or 2.

Images